WO2021070219A1 - Air conditioning system - Google Patents

Air conditioning system Download PDF

Info

Publication number
WO2021070219A1
WO2021070219A1 PCT/JP2019/039470 JP2019039470W WO2021070219A1 WO 2021070219 A1 WO2021070219 A1 WO 2021070219A1 JP 2019039470 W JP2019039470 W JP 2019039470W WO 2021070219 A1 WO2021070219 A1 WO 2021070219A1
Authority
WO
WIPO (PCT)
Prior art keywords
indoor
information
image
unit
air conditioning
Prior art date
Application number
PCT/JP2019/039470
Other languages
French (fr)
Japanese (ja)
Inventor
平野　誠
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to JP2021550952A priority Critical patent/JP7191244B2/en
Priority to PCT/JP2019/039470 priority patent/WO2021070219A1/en
Publication of WO2021070219A1 publication Critical patent/WO2021070219A1/en

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00—Control or safety arrangements
    • F24F11/50—Control or safety arrangements characterised by user interfaces or communication
    • F24F11/52—Indication arrangements, e.g. displays
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00—Control or safety arrangements
    • F24F11/50—Control or safety arrangements characterised by user interfaces or communication
    • F24F11/56—Remote control

Definitions

  • the present invention relates to an air conditioning system that harmonizes indoor air.
  • Patent Document 1 discloses an air conditioner that displays a person's position and the temperature of the person's position detected based on two-dimensional thermal image data created by a thermal image sensor on a display unit of a remote controller. ..
  • a person's position includes at least one of a person's face position, a person's hand position, and a person's foot position. The position of the person and the temperature of the position of the person are calculated from the information of the thermal image data.
  • Patent Document 2 discloses an air conditioner that includes an imaging unit such as a camera and acquires information on the indoor environment such as an individual's face from an image captured by the imaging unit.
  • the present invention has been made in view of the above, and an object of the present invention is to obtain an air conditioning system capable of intuitively grasping the state of a room without increasing the size.
  • the air conditioning system includes an air conditioner arranged in a room to blow conditioned air into the room and a controller for controlling the operation of the air conditioner.
  • the air conditioner is an indoor information acquisition unit that acquires indoor information that is information about the state of the room, an air conditioner communication unit that communicates with external equipment, and an air conditioner control unit that controls the air conditioner of the air conditioner.
  • the controller includes an operation unit that accepts the setting operation of the operation of the air conditioner, an imaging unit that captures an indoor image that is an image showing the state of the room, a display unit that displays information on the operation of the air conditioner, and an external unit. It is equipped with a controller communication unit that communicates with the device. The display unit superimposes at least a part of the indoor information on the indoor image and displays it.
  • the air conditioning system according to the present invention has the effect that it is possible to intuitively grasp the state of the room without increasing the size.
  • Front view showing an example of the controller according to the first embodiment of the present invention It is a front view which shows the other example of the controller which concerns on Embodiment 1 of this invention, and is the front view which shows the controller which includes the touch panel type display part.
  • the figure which shows the internal storage part of the room information processing part which concerns on Embodiment 1 of this invention A flowchart showing the operation of the controller in the air conditioning system according to the first embodiment of the present invention.
  • FIG. 6 is an enlarged view showing a state in which a user's face image is superimposed on a face portion of the human body in the thermal image in the first embodiment of the present invention.
  • the figure which shows the method of setting the room temperature in the air-conditioning setting by the operation of the controller in Embodiment 1 of this invention The schematic diagram which shows the method of changing the set air flow information in the air conditioning setting by using the touch panel type display part in Embodiment 1 of this invention.
  • FIG. 1 is a configuration diagram schematically showing the configuration of the air conditioning system 100 according to the first embodiment of the present invention.
  • FIG. 2 is a functional block diagram showing a functional configuration of the air conditioner 10 according to the first embodiment of the present invention.
  • FIG. 2 shows the indoor unit 11 of the air conditioner 10 and the controller 14 in the configuration of the air conditioner system 100.
  • the air conditioner system 100 is between an indoor unit 11 installed indoors, an outdoor unit 12 installed outdoors, and an indoor unit 11 and an outdoor unit 12. It includes an air conditioner 10 including a refrigerant pipe 13 for circulating a refrigerant, and a controller 14 that transmits a control instruction command to the air conditioner 10 to the indoor unit 11.
  • the outdoor unit 12 can communicate with the indoor unit 11 via a communication line (not shown).
  • the air conditioner 10 forms one complete refrigeration cycle with the indoor unit 11 and the outdoor unit 12.
  • the air conditioner 10 uses a refrigerant that circulates between the indoor unit 11 and the outdoor unit 12 through the refrigerant pipe 13 to transfer heat between the indoor air and the outdoor air, which are the air conditioning target spaces.
  • the indoor unit 11 and the outdoor unit 12 are connected by a refrigerant pipe 13, and the pressure of the refrigerant flowing in the refrigerant pipe 13 is changed by the compressor provided in the outdoor unit 12 to achieve air conditioning by absorbing and radiating the heat of the refrigerant.
  • the indoor unit 11 includes an indoor information acquisition unit 21, an indoor information processing unit 22, an indoor unit communication unit 23, an air conditioning control unit 24, and an air conditioning changing unit 25.
  • the controller 14 includes an operation unit 31, an image pickup unit 32, a controller communication unit 33, an image processing unit 34, and a display unit 35.
  • FIG. 3 is a front view showing the appearance of the indoor unit 11 in the air conditioner 10 according to the first embodiment of the present invention.
  • FIG. 4 is a front view schematically showing a state when the air conditioning setting of the indoor unit 11 in the air conditioner 10 according to the first embodiment of the present invention is changed.
  • the indoor unit 11 includes an indoor information acquisition unit 21, an indoor unit communication unit 23, and an air conditioning changing unit 25 on the front surface.
  • the indoor information acquisition unit 21 acquires indoor information which is information on the state of the room.
  • An infrared sensor is exemplified as an example of the indoor information acquisition unit 21.
  • FIG. 5 is a perspective view showing an infrared sensor provided in the indoor unit 11 of the air conditioner 10 according to the first embodiment of the present invention.
  • FIG. 6 is a schematic view showing an example of the temperature detection range in the infrared sensor according to the first embodiment of the present invention.
  • the left-right direction corresponding to the width direction of the room is the X direction
  • the vertical direction corresponding to the height direction of the room is the Y direction.
  • the infrared sensor can detect the surface temperature at a distant point, and can comprehensively detect the surface temperature of the entire room. That is, the infrared sensor can acquire the surface temperature in the room as indoor information.
  • thermopile sensor is exemplified as an example of an infrared sensor.
  • the thermopile sensor converts the temperature measured by the thermopile element into a format that can be transmitted to the indoor information processing unit 22, and generates temperature distribution information 61 indicating the temperature distribution of the surface temperature in the room.
  • the thermopile element included in the thermopile sensor may be one or a plurality.
  • seven thermopile elements, a thermopile element 41, a thermopile element 42, a thermopile element 43, a thermopile element 44, a thermopile element 45, a thermopile element 46, and a thermopile element 47 are arranged in this order in the vertical direction. It has been installed.
  • the infrared sensor shown in FIG. 5 detects the surface temperature from the ceiling surface of the room to the floor surface directly below the indoor unit 11.
  • FIG. 6 shows a state in which temperature information of the surface temperature in a room is acquired by an infrared sensor including thermopile elements 47 from thermopile elements 41 arranged in a row in the Y direction.
  • the indoor monitoring areas that the infrared sensor monitors and acquires the temperature information of the surface temperature are the monitoring range A1, the monitoring range A2, the monitoring range A3, the monitoring range A4, the monitoring range A5, the monitoring range A6, and so on in the Y direction. It is divided into the monitoring range A7.
  • thermopile element 41 monitors the monitoring range A1 and acquires indoor information. That is, the thermopile element 41 acquires the surface temperature in the room in the monitoring range A1. Similarly, the thermopile element 42 monitors the monitoring range A2 and acquires indoor information. The thermopile element 43 monitors the monitoring range A3 and acquires indoor information. The thermopile element 44 monitors the monitoring range A4 and acquires indoor information. The thermopile element 45 monitors the monitoring range A5 and acquires indoor information. The thermopile element 46 monitors the monitoring range A6 and acquires indoor information. The thermopile element 47 monitors the monitoring range A7 and acquires indoor information.
  • the indoor unit 11 includes a direction changing unit (not shown) that changes the direction of the infrared sensor in the X direction.
  • the direction of the infrared sensor is the direction toward the detection target portion of the surface temperature.
  • the direction changing unit includes a mechanism for driving the direction of the infrared sensor in the X direction, changes the direction of the infrared sensor to the left and right, and moves the infrared sensor in the horizontal direction at regular intervals.
  • the infrared sensor detects the surface temperature of the entire room while changing the detection target part of the surface temperature in the X direction by driving the direction changing part, and creates a temperature distribution which is the temperature information of the room in the XY plane.
  • the indoor information processing unit 22 extracts the indoor feature information 63 used for grasping the indoor state such as the indoor feature and the indoor condition from the indoor information acquired by the indoor information acquisition unit 21.
  • the indoor feature information 63 is information indicating the features in the room. Further, the indoor information processing unit 22 can extract the human body from the indoor information acquired by the indoor information acquisition unit 21 and generate the human body information as a part of the indoor feature information 63.
  • the human body information is information about the human body such as a human face, hands and feet in the indoor information.
  • the indoor information processing unit 22 stores, for example, human body determination information corresponding to the shape and size of the human body in the human body information in advance, compares the human body determination information with the indoor feature information 63, and obtains the human body in the indoor feature information 63. Can be extracted.
  • the indoor unit communication unit 23 is an air conditioner communication unit for the indoor unit 11 to communicate with an external device of the indoor unit 11.
  • the indoor unit communication unit 23 receives the information transmitted from the controller communication unit 33 of the controller 14 and transmits it to the air conditioning control unit 24, and the information and air conditioning control processed and transmitted by the indoor information processing unit 22.
  • the information transmitted from the unit 24 is transmitted to the controller communication unit 33.
  • the indoor unit communication unit 23 may be any communication method as long as it can communicate with the controller communication unit 33 mounted on the controller 14. Infrared communication and wireless communication are exemplified as an example of the communication method between the indoor unit communication unit 23 and the controller communication unit 33.
  • infrared communication in the near infrared band having a wavelength of about 750 nm to 1000 nm is used. Since near-infrared light cannot pass through the walls of the room, it is used in the same room so that the infrared light emitted from the light emitting part on the transmitting side reaches the light receiving part on the receiving side, which is short-range communication. Often. Further, infrared communication has a feature that the communication speed is slow, but the light emitting member and the light receiving member are simple and inexpensive.
  • Wireless communication there are various standards such as wireless LAN (Local Area Network) communication and specific low power communication.
  • wireless LAN Local Area Network
  • specific low power communication there is no limitation on the type of wireless system used for the communication method between the indoor unit communication unit 23 and the controller communication unit 33.
  • Wireless LAN is a 2.4 GHz band communication that can be used universally, is a standard widely used including personal computers, and is versatile and can communicate at high speed.
  • the air conditioning control unit 24 provides various information related to the operation of the air conditioner 10, such as information received from the indoor information processing unit 22, instruction information received from the controller 14, and information stored in the air conditioning control unit 24 in advance. Based on this, the operation of the air conditioner 10 is controlled. That is, the air conditioning control unit 24 performs air conditioning operation such as the temperature of the airflow blown into the room from the indoor unit 11 and the strength and direction of the airflow blown into the room from the indoor unit 11 based on various information regarding the operation of the air conditioner 10. Controls the setting of and controls the operation of the air conditioner 10.
  • the air conditioning changing unit 25 changes the air conditioning operation by changing the state of the airflow blown from the indoor unit 11 into the room, that is, the airflow direction and the air volume, etc., based on the command transmitted from the air conditioning control unit 24. ..
  • the air harmonization changing unit 25 includes a first wind direction changing unit 25a and a second wind direction changing unit 25b having louvers for changing the wind direction of the airflow blown into the room from the indoor unit 11 in the vertical direction, and an indoor unit.
  • a third wind direction changing section 25c having a louver that changes the direction of the airflow blown into the room from 11 in the horizontal direction, a fan motor (not shown) that changes the strength of the airflow, and a heat exchanger (not shown) that changes the temperature of the airflow. And have.
  • the third wind direction changing section 25c is provided on the inner side of the air conditioning changing section 25 with respect to the first wind direction changing section 25a and the second wind direction changing section 25b.
  • the air conditioning changing unit 25 operates the first wind direction changing unit 25a, the second wind direction changing unit 25b, the third wind direction changing unit 25c, the fan motor, and the heat exchanger based on the command from the air conditioning control unit 24. Let's change the air conditioning operation.
  • the air conditioning control unit 24 changes the directions of the first wind direction changing unit 25a and the second wind direction changing unit 25b of the air conditioning changing unit 25. Control may be performed to change the wind direction from downward to upward. Further, for example, when two people are present in the room and the air conditioning settings desired by each of the two people are different, the air conditioning control unit 24 sets the first wind direction changing unit 25a as shown in FIG. And the second wind direction changing unit 25b may be controlled to move independently.
  • the first wind direction changing unit 25a shows a state in which the wind direction of the airflow blown into the room from the indoor unit 11 is directed downward, and the second wind direction changing part 25b is blown out from the indoor unit 11 into the room. It shows that the wind direction of the airflow is upward.
  • the third wind direction changing portion 25c can change the wind direction to the left and right, and is composed of, for example, a plurality of fins.
  • the strength of the airflow blown from the indoor unit 11 into the room is changed by adjusting the rotation speed of the fan motor provided in the air conditioning changing unit 25. Further, the temperature of the airflow blown from the indoor unit 11 into the room is changed by changing the temperature of the refrigerant of the heat exchanger provided in the air conditioning changing unit 25.
  • the air conditioning control unit 24 is realized as, for example, a processing circuit having a hardware configuration shown in FIG. 7.
  • FIG. 7 is a diagram showing an example of the hardware configuration of the processing circuit according to the first embodiment of the present invention.
  • the air conditioning control unit 24 is realized, for example, by the processor 101 executing the program stored in the memory 102 shown in FIG. ..
  • a plurality of processors and a plurality of memories may cooperate to realize the above function.
  • a part of the functions of the air conditioning control unit 24 may be implemented as an electronic circuit, and the other part may be realized by using the processor 101 and the memory 102.
  • At least one of the indoor information processing unit 22 and the indoor unit communication unit 23 may be configured to be realized by the processor 101 executing a program similarly stored in the memory 102. Further, the processor and memory for realizing at least one of the indoor information processing unit 22 and the indoor unit communication unit 23 may be the same as the processor and memory for realizing the air conditioning control unit 24, or may be different. Processor and memory.
  • the controller 14 includes an operation unit 31, an image pickup unit 32, a controller communication unit 33, an image processing unit 34, and a display unit 35.
  • FIG. 8 is a front view showing an example of the controller 14 according to the first embodiment of the present invention.
  • the controller 14 shown in the first embodiment is a remote controller separate from the indoor unit 11.
  • the operation unit 31 accepts the setting operation of the air conditioning setting requested by the user. That is, the operation unit 31 is an interface for remotely controlling the operation of the air conditioner 10, and receives instructions from the user regarding the operation of the air conditioner 10 and operation setting information for setting the operation of the air conditioner 10. ..
  • the operation unit 31 starts the operation of the air conditioner 10, stops the operation of the air conditioner 10, selects the operation mode of the air conditioner 10, changes the set temperature, changes the set humidity, sets the air volume, sets the wind direction, and operates. It is configured so that the user can arbitrarily select various functions related to the air conditioning operation in the air conditioner 10, such as changing the setting of prohibited items.
  • the operation unit 31 can also set information such as a date and a time.
  • the operation unit 31 transmits various received information to the controller communication unit 33 and the image processing unit 34.
  • the operation unit 31 of the controller 14 can be a button-type operation unit as shown in FIG.
  • the imaging unit 32 is a device such as a camera that captures a visible image, and captures a room that is an air-conditioning target space to generate an indoor image that is an image showing the state of the room.
  • the mounting position of the image pickup unit 32 on the controller 14 is not limited as long as the room can be photographed.
  • the imaging range of the imaging unit 32 is preferably a wide angle so that a wide area in the room can be photographed.
  • the controller communication unit 33 receives instruction information for remote control of the operation of the air conditioner 10 from the operation unit 31.
  • the controller communication unit 33 transmits the instruction information received from the operation unit 31 to the indoor unit communication unit 23 of the indoor unit 11. Further, the controller communication unit 33 receives various information from the indoor unit communication unit 23 of the indoor unit 11.
  • the controller communication unit 33 transmits the received information to the image processing unit 34.
  • the controller communication unit 33 may be any communication method as long as it can communicate with the indoor unit communication unit 23 mounted on the indoor unit 11. For the controller communication unit 33, wireless LAN communication in a band of 2.4 GHz that can support image communication with a large amount of data is often selected.
  • the image processing unit 34 uses various information related to the operation of the air conditioner 10, such as information transmitted from the indoor unit 11, setting information transmitted from the operation unit 31, and information on the indoor image taken by the imaging unit 32. Perform the process for visualization to show in.
  • the image processing unit 34 causes the display unit 35 to display the indoor image taken by the imaging unit 32 as a background image. Further, the image processing unit 34 superimposes at least a part of the indoor information transmitted from the indoor information processing unit 22 on the background image and displays it on the display unit 35.
  • the image processing unit 34 can detect the human body from the indoor image taken by the imaging unit 32.
  • the image processing unit 34 can detect the human body from the difference in the brightness of the two indoor images taken continuously by the imaging unit 32. When the difference between two images taken consecutively is extracted, the difference is always 0 in the absence of a moving object such as a human body. On the other hand, when a moving body exists, the difference is other than 0. Therefore, the image processing unit 34 can detect the presence of a moving object at a position where the difference is other than 0 in the two images taken consecutively. Further, the image processing unit 34 identifies the individual of the human body extracted by the indoor information processing unit 22 from the features in the human body information generated by the indoor information processing unit 22, that is, identifies who the human body is. Can be recognized.
  • the display unit 35 displays various information related to the operation of the air conditioner 10, including the operation content received by the operation unit 31 and the image processed by the image processing unit 34.
  • the display unit 35 may be a color display unit or a monochrome display unit.
  • the display unit 35 is a display unit that displays in color, the visibility is good and there is a sense of quality, but the display member is expensive and the power consumption is large. Therefore, when the display unit 35 for color display is used for the controller 14 used as a wireless controller, the battery capacity decreases rapidly, so that a charging system such as a mobile phone terminal is required.
  • the display unit 35 is a display unit for monochrome display, power consumption can be suppressed as compared with the case where the display unit for color display is used for the display unit 35, so that it is possible to use a non-rechargeable dry battery. However, the visibility is low.
  • the content displayed on the display unit 35 does not have to be displayed in real time, and may be a stream image such as a television or a video movie, or a still image updated at regular intervals.
  • the display unit 35 outputs to the display unit 35 a change in the processed image processed by the image processing unit 34 after the operation unit 31 is operated to change the setting of the air conditioner 10 or the image pickup unit 32 takes a picture. You only have to change the display when you do.
  • a memory liquid crystal used for an electronic shelf label or the like may be used for the display unit 35. The memory liquid crystal consumes power when rewriting the display contents, but has a feature that it can be driven with low power consumption when there is no change in the display contents. Therefore, when the controller 14 is used as a dedicated controller for the air conditioner 10, the battery life of the controller 14 can be extended by using a memory liquid crystal for the display unit 35.
  • the controller 14 has a function that can be used as an operation unit 31, an image pickup unit 32, a controller communication unit 33, an image processing unit 34, and a display unit 35 even if it is not dedicated to the air conditioner 10. Anything that can communicate with the indoor unit communication unit 23 of 11 may be used.
  • the controller 14 can be realized by using, for example, a mobile phone terminal such as a smartphone used by the user, or a device such as a tablet terminal.
  • the mobile phone terminal If it is a general mobile phone terminal, a button type or touch panel type display unit, an image processing unit for display, and a communication unit are always installed.
  • the communication unit many mobile phone terminals are equipped with infrared communication, Bluetooth (registered trademark) communication, or wireless LAN communication functions. Therefore, the mobile phone terminal can be used as the controller 14 by making the indoor unit communication unit 23 of the indoor unit 11 correspond to these communications.
  • FIG. 9 is a front view showing another example of the controller 14 according to the first embodiment of the present invention, and is a front view showing the controller 14 including the touch panel type display unit 35a.
  • the operation unit 31 of the controller 14 is not limited to the button-type operation unit 31 as shown in FIG. 8, and is a touch panel type that has both the function of the operation unit 31 and the function of the display unit 35 as shown in FIG. It may be configured as a display unit 35a.
  • FIG. 9 shows a virtual indoor image that can be seen from the user side operating the controller 14, including the user operating the controller 14. Since the touch panel type display unit 35a is known, detailed description of the touch panel type display unit 35a will be omitted.
  • the touch panel type display unit 35a displays virtual buttons on the screen, the number of operation button selections can be limited by displaying only the operation buttons required in a certain operation scene. Further, the touch panel type display unit 35a improves operability by changing the size of the button according to the age or preference of the user.
  • the button-type operation unit has an advantage that a click feeling can be obtained when the user operates the operation unit.
  • a vibrating panel may be mounted on the touch panel type display unit 35a, and the user may be given a click sensation by stimulating the vibration of the vibrating panel to the fingertips operating the touch panel.
  • a determination button 31a which is a physical button as shown in FIG. 9, may be provided as a part of the operation unit 31. Even if the operation unit 31 is configured so that the touch panel operation can be enabled or the touch panel operation disabled can be switched by pressing the enter button 31a, and the start and end of the operation on the touch panel can be specified. Good.
  • FIG. 10 is a flowchart showing the operation of the indoor unit 11 in the air conditioning system 100 according to the first embodiment of the present invention.
  • step S110 the indoor information acquisition unit 21 acquires indoor information.
  • step S120 the indoor information processing unit 22 extracts the indoor feature information 63 from the indoor information acquired by the indoor information acquisition unit 21.
  • the indoor information acquisition unit 21 when the indoor information acquisition unit 21 is an infrared sensor shown in FIG. 5, the indoor information acquisition unit 21 measures the surface temperature over a wide area in the room, which is the monitoring range.
  • the infrared sensor periodically detects the infrared intensity of the monitoring range at a predetermined cycle at a preset predetermined time.
  • the infrared sensor converts the infrared intensity of the detected monitoring range into temperature by performing a predetermined conversion process on the detected infrared intensity detection result, and obtains temperature distribution information 61 indicating the temperature distribution of the indoor surface temperature. It is generated and transmitted to the indoor information processing unit 22 as indoor temperature information which is indoor information.
  • the temperature distribution information 61 is indoor information.
  • the indoor information processing unit 22 receives the temperature distribution information 61, which is the temperature information in the room, from the indoor information acquisition unit 21, stores it, and holds it.
  • the indoor information processing unit 22 generates thermal image information 62, which is thermal image information expressing the temperature distribution of the indoor surface temperature in terms of color temperature, from the temperature distribution information 61 received from the indoor information acquisition unit 21.
  • the thermal image information 62 is information indicating indoor information as an image.
  • the indoor information processing unit 22 extracts the indoor feature information 63, which is information indicating the features in the room, from the thermal image information 62.
  • FIG. 11 is a diagram showing an example of a thermal image according to the first embodiment of the present invention.
  • a thermal image is displayed so that the shade of color differs depending on the temperature.
  • the thermal image is displayed as a color image, for example, the high temperature is displayed in red and the low temperature is displayed in blue.
  • FIG. 11 shows a thermal image generated from the temperature distribution information 61 acquired in the summer. Since it is summer, the air conditioner 10 is in a cooling operation, and since the room is cool and the outside is hot, there is a temperature difference between the window 71 and the wall 72.
  • the thermal image shown in FIG. 11 if the rules of temperature display in the thermal image shown in FIG. 11 and the arrangement of objects in the indoor space are understood, it can be inferred that the square area on the right side is the window 71. However, the visibility of thermal images is lower than that of photographs. For this reason, it is generally difficult to infer from the thermal image whether or not the windows are arranged.
  • the indoor information processing unit 22 extracts the indoor feature information 63, which is information indicating the indoor features such as the indoor features and the indoor conditions, from the thermal image information 62.
  • the indoor information processing unit 22 acquires indoor feature information 63, which is information on a line segment to which the temperature change points are connected, by connecting the temperature change points in the thermal image shown in FIG. 11 with a line, for example.
  • FIG. 12 is a diagram showing another example of the thermal image according to the first embodiment of the present invention.
  • FIG. 12 shows a thermal image in which a person is present.
  • the indoor information processing unit 22 extracts the indoor feature information 63 by connecting the temperature change points in the thermal image shown in FIG. 12 with a line as in the case of FIG. 11, and the shape of the indoor feature information 63. From the size and size, the human body 66 in the thermal image shown in FIG. 12 can be extracted.
  • the indoor information processing unit 22 stores in advance human body determination information corresponding to the shape and size of the indoor feature information 63 of the human body in the thermal image, and compares the human body determination information with the indoor feature information 63 in the thermal image.
  • the human body 66 is extracted.
  • the indoor information acquisition unit 21 periodically acquires the indoor surface temperature and transmits the temperature distribution information 61 to the indoor information processing unit 22.
  • the indoor information processing unit 22 periodically generates thermal image information 62, and extracts information on changes in the indoor surface temperature with the passage of time and the magnitude of changes in the indoor surface temperature from the thermal image information 62. Then, even if the indoor information processing unit 22 extracts from the extracted information a portion where the change in the indoor surface temperature is faster than a predetermined determination criterion and the indoor surface temperature is higher than the surroundings as the human body 66. Good. Further, the indoor information processing unit 22 may extract a thermal image in which the absolute value of the temperature is around 36 ° C. as the human body 66.
  • the indoor information processing unit 22 can detect the human body from the difference in the temperature distribution of the surface temperature of the two rooms continuously acquired by the indoor information acquisition unit 21.
  • the difference is always 0 in the absence of a moving body such as a human body.
  • the indoor information processing unit 22 can detect the presence of a moving object at a position where the difference is other than 0 in the two images taken consecutively.
  • the indoor information processing unit 22 can determine that the detected moving object is a pet or a falling object. Further, when the detected moving object is larger than a predetermined determination criterion, the indoor information processing unit 22 determines that the detected moving object is a disturbance in human body detection such as movement or lighting of furniture such as a curtain. Therefore, the accuracy of human body detection can be improved.
  • the indoor information processing unit 22 uses human body information such as a human face, hands and feet, and indoor objects such as floors, walls, and furniture from the absolute values of position, size, shape, and temperature in the thermal image. It is possible to detect and recognize object information which is information.
  • the human body information and the object information also include position information in the thermal image, that is, position information in the room. That is, the indoor information processing unit 22 extracts the human body from the indoor information, extracts the human body information which is the information about the human body in the indoor information, and transmits it to the air conditioning control unit 24 and the image processing unit 34. Further, the indoor information processing unit 22 extracts an object from the indoor information, extracts the object information which is information about the object in the indoor information, and transmits the object information to the air conditioning control unit 24 and the image processing unit 34.
  • FIG. 13 is a diagram showing an internal storage unit 221 of the indoor information processing unit 22 according to the first embodiment of the present invention.
  • the indoor information processing unit 22 stores the temperature distribution information 61, the thermal image information 62, and the indoor feature information 63 in the internal storage unit 221 of the indoor information processing unit 22.
  • the human body information and the indoor information are included in the indoor feature information 63 and stored. The human body information and the indoor information can be handled independently of the indoor feature information 63.
  • step S130 the indoor information processing unit 22 transmits the thermal image information 62 and the indoor feature information 63 to the controller 14. Specifically, the indoor information processing unit 22 transmits the thermal image information 62 and the indoor feature information 63 to the image processing unit 34 via the indoor unit communication unit 23 and the controller communication unit 33. The image processing unit 34 receives and stores the thermal image information 62 and the indoor feature information 63.
  • FIG. 14 is a flowchart showing the operation of the controller 14 in the air conditioning system 100 according to the first embodiment of the present invention.
  • FIG. 15 is a diagram showing an example of an indoor image according to the first embodiment of the present invention.
  • the imaging unit 32 takes an indoor image, which is an image showing the state of the room.
  • the imaging unit 32 captures a range in which the indoor information acquisition unit 21 acquires indoor information in the room.
  • the imaging unit 32 transmits the indoor image information 64, which is the information of the captured indoor image, to the image processing unit 34.
  • the image processing unit 34 receives and stores the indoor image information 64 transmitted from the imaging unit 32.
  • step S220 the image processing unit 34 performs a process of extracting the features of the indoor image from the indoor image, and extracts the indoor image feature information 65, which is a feature of the indoor image, on the image information of the indoor image.
  • the image processing unit 34 stores the extracted indoor image feature information 65 in association with the indoor image information 64.
  • the indoor image feature information 65 includes the shape and position of a large object in the room such as a wall, floor, window, and table, the boundary line between the wall and the floor in the indoor image, and the boundary between the floor and the window in the indoor image. An example is a line.
  • the indoor image feature information 65 can be rephrased as a feature of the room where the image is taken.
  • the imaging unit 32 of the controller 14 is arranged near the indoor information acquisition unit 21 of the indoor unit 11, and when the indoor information acquisition unit 21 acquires indoor information, the image is taken in the same direction as the indoor information acquisition unit 21 faces.
  • the imaging unit 32 takes a picture of the room with the unit 32 facing.
  • the infrared sensor which is the indoor information acquisition unit 21
  • the direction is the same as the direction in which the infrared sensor faces the center of the temperature detection range.
  • the imaging unit 32 is directed toward.
  • the image processing unit 34 can acquire the indoor image feature information 65 at the same position as the indoor feature information 63 extracted by the indoor information processing unit 22.
  • the imaging unit 32 takes a picture of the room in a state where the controller 14 is held by a holding unit provided on the front surface of the indoor unit 11 and holding the controller 14, for example. It is also possible for the imaging unit 32 to take a picture of the room while the user holds the controller 14.
  • step S230 the image processing unit 34 uses the thermal image information 62, the indoor feature information 63, the indoor image information 64, and the indoor image feature information 65 in a state where the thermal image and the indoor image are superimposed.
  • a process of enlarging or reducing the indoor image is performed so that the indoor feature information 63 indicating the same portion in the room and the indoor image feature information 65 match. That is, the image processing unit 34 adjusts the scale of the indoor image so that the indoor feature information 63 indicating the same part in the room and the indoor image feature information 65 match.
  • the image processing unit 34 stores the indoor image information 64 after the scale has been adjusted. Further, the image processing unit 34 performs image processing such as moving the position of the indoor image and trimming the indoor image if necessary, and performs indoor feature information 63 and indoor image feature information indicating the same part in the room. The indoor image is corrected so that it matches 65.
  • the image processing unit 34 displays the indoor image after the scale has been adjusted as a background image on the touch panel type display unit 35a of the controller 14 as shown in FIG.
  • the user can use the touch panel type display unit to display windows, furniture, and the like that are difficult to discriminate only from the thermal image acquired by the indoor information acquisition unit 21.
  • the background image displayed on the 35a can be visually and intuitively recognized, and the visibility of the indoor state is improved.
  • step S240 the image processing unit 34 superimposes at least a part of the thermal image represented by the thermal image information 62 on the background image displayed on the touch panel type display unit 35a. That is, the image processing unit 34 superimposes at least a part of the room information on the background image displayed on the touch panel type display unit 35a.
  • FIG. 16 is a diagram showing an example of a thermal image including a human body according to the first embodiment of the present invention.
  • FIG. 17 is a diagram showing an example of a background image in which a human body area of a thermal image is superimposed in the first embodiment of the present invention.
  • the image processing unit 34 is the human body transmitted from the indoor information processing unit 22. Based on the information, the human body 66 and the human body area including the periphery of the human body 66 are extracted on the thermal image. Then, as shown in FIG. 17, the image processing unit 34 may superimpose the extracted thermal image 73 of the human body area on the background image displayed on the touch panel type display unit 35a. As described above, since the scale of the indoor image is adjusted so that the indoor feature information 63 indicating the same part in the room and the indoor image feature information 65 match, the thermal image of the human body area superimposed on the background image. 73 is superimposed on the background image in a state of matching the human body 66.
  • the user can determine the indoor state, which is difficult to determine only by the thermal image acquired by the indoor information acquisition unit 21, in the background image displayed on the touch panel type display unit 35a and the human body area superimposed on the background image.
  • the thermal image 73 can be visually and intuitively recognized, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. Therefore, in the air conditioning system 100, the visibility of the indoor state can be improved as compared with the case where the indoor state is displayed on the touch panel type display unit 35a only by the thermal image of the room.
  • the image processing unit 34 may superimpose the thermal image represented by the thermal image information 62 stored in the image processing unit 34 on the background image displayed on the touch panel type display unit 35a in a semi-transparent state. ..
  • the user superimposes the indoor state, which was difficult to determine only by the thermal image acquired by the indoor information acquisition unit 21, on the background image displayed on the touch panel type display unit 35a and the touch panel type display unit 35a.
  • the thermal image can be visually and intuitively recognized, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved.
  • step S220 the image pickup unit 32 of the controller 14 is in a state where the image pickup unit 32 faces in exactly the same direction as the room information acquisition unit 21 faces when the room information acquisition unit 21 acquires the room information.
  • the indoor image by superimposing at least a part of the thermal image on the background image, the indoor state can be visually and intuitively recognized by the background image and the thermal image, and the touch panel type display unit.
  • the indoor information acquisition unit 21 acquires indoor information
  • the image is taken in a state in which the indoor information acquisition unit 21 faces approximately the same direction as the indoor information acquisition unit 21 faces to the extent that the visibility of the indoor state displayed on 35a is improved. Any image will do. Therefore, the image pickup unit 32 of the controller 14 cannot take a picture of the room in a state where the image pickup unit 32 faces in exactly the same direction as the room information acquisition unit 21 faces when the room information acquisition unit 21 acquires the room information. It doesn't matter.
  • the indoor feature information 63 and the indoor image feature information 65 which indicate the same part in the room in a state where the thermal image and the indoor image are superimposed, do not have to completely match. That is, the indoor feature information 63 and the indoor image feature information 65, which indicate the same part in the room in a state where the thermal image and the indoor image are superimposed, are obtained by superimposing at least a part of the thermal image on the background image.
  • the indoor state can be visually and intuitively recognized by the image and the thermal image, and they match to the extent that the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. Just do it.
  • the indoor feature information 63 and the indoor image feature information 65 indicating the same part in the room in a state where the thermal image and the indoor image are superimposed are the indoor part represented by the indoor feature information 63.
  • the indoor portion represented by the indoor image feature information 65 may be enlarged or reduced to the extent that it falls within a predetermined range.
  • the indoor part represented by the indoor feature information 63 and the indoor part represented by the indoor image feature information 65 are within a predetermined distance range in the indoor image by enlarging or reducing the indoor image. It suffices if it is in a state of being inside.
  • the indoor part represented by the indoor feature information 63 and the indoor part represented by the indoor image feature information 65 can be obtained.
  • the indoor part represented by the indoor feature information 63 and the indoor part represented by the indoor image feature information 65 are at a predetermined distance in the indoor image. It suffices if it is within the range.
  • FIG. 18 is an enlarged view showing a state in which the user's face image 74 is superimposed on the face portion of the human body 66 in the thermal image in the first embodiment of the present invention.
  • the thermal image shown in FIG. 18 shows a thermal image generated from the temperature distribution information 61 acquired in the summer.
  • the user's face image 74 may be superimposed on the face portion of the human body 66 in the thermal image.
  • the user's face image 74 is captured by the imaging unit 32.
  • the image processing unit 34 enlarges or reduces the user's face image 74 so as to match the size of the face portion of the human body 66 in the thermal image shown in FIG. 12, and trims the user's face image 74 if necessary.
  • Face image 74 is processed.
  • the image processing unit 34 performs a process of superimposing the processed user's face image 74 on the face portion of the human body 66 in the thermal image as shown in FIG.
  • the processed user's face image 74 can be superimposed on the face portion of the human body 66 in the thermal image as shown in FIG. 16 described above.
  • the thermal image 73 of the human body area is superimposed on the background image displayed on the touch panel type display unit 35a as shown in FIG. 17, the human body area is extracted from the thermal image on which the user's face image 74 is superimposed.
  • the thermal image 73 of the human body area on which the user's face image 74 is superimposed can be superimposed on the background image.
  • the user can determine the indoor state, which is difficult to determine only from the thermal image acquired by the indoor information acquisition unit 21, in the background image displayed on the touch panel type display unit 35a and the human body area superimposed on the background image. It can be visually and intuitively recognized by the thermal image and the user's face image 74 superimposed on the thermal image of the human body area, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. Will be done.
  • a caricature image or icon created by the user is superimposed on the face portion of the thermal image shown in FIG. 16 and superimposed on the face portion of the thermal image of the human body area shown in FIG. May be done.
  • the image processing unit 34 can directly acquire the caricature image or icon created by the user from an external device via the controller communication unit 33. Further, the image processing unit 34 can acquire images or icons of other pictures from the controller communication unit 33 and an external device via the Internet.
  • the image processing unit 34 can superimpose the image taken by the imaging unit 32 or the image or icon acquired from the external device of the controller 14 on the position of the human body specified by the human body information in the indoor image. ..
  • the image captured by the image pickup unit 32, the image acquired from the external device of the controller 14, and the icon acquired from the external device of the controller 14 are specified and selected based on the indoor information which is the information about the indoor state. It can be said that it is one of the indoor information.
  • the image stored in advance in the image processing unit 34 may be superimposed on the thermal image of the human body area.
  • the image processing unit 34 corresponds to the characteristics of the human body information from a plurality of images stored in advance in the image processing unit 34 based on the characteristics of the human body information included in the indoor feature information 63 acquired from the indoor information processing unit 22. Select an image and superimpose the selected image on the thermal image of the human body area.
  • the characteristics of the human body information are exemplified by the size of the human body, the time zone when the human body is detected, the position of the human body in the room, the absolute value of the temperature of the human body, and the like.
  • the image processing unit 34 is a person whose image or icon stored in advance in the image processing unit 34 corresponding to the characteristics of the human body information is specified by the characteristics of the human body information in the indoor image displayed on the touch panel type display unit 35a. It is superimposed on the detection position of. For example, when the air conditioning system 100 is installed in a house, the image processing unit 34 sits on the sofa, where the detected large human body is the father, and the detected human body is the mother during the daytime. It may be determined that the human body in which the present state is detected is a child, and the human body in which the detected temperature is higher than a predetermined temperature is a baby. That is, the image processing unit 34 can identify and recognize an individual in the human body based on the characteristics of the human body information.
  • the determination criteria for determining the individual of the human body that is, the type of the human body based on the characteristics of the human body information is stored in advance in the image processing unit 34.
  • the image processing unit 34 can identify who the human body detected in the thermal image is in the family. Then, the image processing unit 34 stores an image, an icon, or the like in association with each identified individual. As a result, even when a plurality of people are present in the room, the image processing unit 34 displays an image or an icon or the like corresponding to the individual corresponding to the characteristics of the detected human body information on the touch panel type display unit 35a of the controller 14. By superimposing it on the displayed background image, it is possible to visually and intuitively determine who is in what position.
  • the favorite air conditioning setting information 67 which is the information of the air conditioning setting preferred by each individual user, is stored in the image processing unit 34. May be good.
  • the pre-registered favorite air conditioning setting information 67 May be displayed on the touch panel type display unit 35a. That is, the image processing unit 34 is displayed on the background image when the information for selecting an individual displayed on the touch panel type display unit 35a, which is specified by the characteristics of the human body information, is input to the operation unit 31.
  • the information for selecting an individual may be received, and the favorite air harmony setting information 67 corresponding to the information of the selected person may be displayed on the touch panel type display unit 35a. Since the preferred air-conditioning setting information 67 is associated with the determination criteria for determining an individual in the human body based on the above-mentioned characteristics of the human body information, the individual displayed in the background image is selected to be preferred. Air conditioning setting information 67 is selected.
  • the image processing unit 34 sends the tapped favorite air conditioning setting information 67 to the controller communication unit 33 and the indoor unit. It is transmitted to the air conditioning control unit 24 via the communication unit 23. That is, when the information for selecting the selected person's favorite air conditioning setting information 67 is input by the operation unit 31, the image processing unit 34 sets the selected favorite air conditioning setting information 67 as a new air conditioning setting. It is transmitted to the air conditioning control unit 24 as information.
  • the air conditioning control unit 24 receives the favorite air conditioning setting information 67 and controls the operation of the air conditioner 10 based on the favorite air conditioning setting information 67.
  • the operability of the air conditioning setting of the air conditioner 10 can be improved by the user.
  • the image processing unit 34 controls the setting to be reflected by two taps, or displays the consent confirmation by the first tap. Control may be performed.
  • the image processing unit 34 may be able to edit by long-pressing the information to be changed on the screen displayed on the touch panel type display unit 35a.
  • the indoor information processing unit 22 can detect and recognize human body information such as a person's face, hands and feet, and object information which is information on indoor objects such as floors, walls and furniture. it can.
  • the human body information and the object information also include position information in the thermal image, that is, position information in the room.
  • the indoor information processing unit 22 transmits human body information and object information to the air conditioning control unit 24.
  • the image processing unit 34 associates the human body information of the person selected by the operation unit 31 with the favorite air conditioning setting information 67 corresponding to the person selected by the operation unit 31 and transmits the information to the air conditioning control unit 24. You may.
  • the human body information of the selected person also includes position information in the background image, that is, position information in the room.
  • the air conditioning control unit 24 has the human body information transmitted from the indoor information processing unit 22, the human body information of the person selected by the operation unit 31, and the preferred air conditioning of the selected person transmitted from the image processing unit 34. Based on the setting information 67, the position of the person selected by the operation unit 31 in the room is specified. Then, the air conditioning control unit 24 hits the hot human body, for example, when the hot human body is in the right direction, based on the favorite air conditioning setting information 67 corresponding to the person selected by the operation unit 31. As described above, the air conditioning changing unit 25 is controlled so that the first wind direction changing unit 25a and the second wind direction changing unit 25b face to the right.
  • the air conditioning control unit 24 can determine the constitution of the person selected by the operation unit 31 such as being hot or cold from the contents of the person's favorite air conditioning setting information 67 selected by the operation unit 31. ..
  • the criteria for setting the air conditioning for determining the constitution that is hot or the constitution that is cold is stored in advance in the air conditioning control unit 24.
  • the air conditioning control unit 24 can specify the position of the person selected by the operation unit 31 in the room only by the human body information of the person selected by the operation unit 31 transmitted from the image processing unit 34. Is.
  • FIG. 19 is a diagram showing a storage unit 341 of the image processing unit 34 according to the first embodiment of the present invention.
  • the image processing unit 34 stores the indoor image information 64, the indoor image feature information 65, and the favorite air harmony setting information 67 in the internal storage unit 341 of the image processing unit 34.
  • FIG. 20 is a diagram showing a state in which the air conditioning setting is set by operating the controller 14 in the first embodiment of the present invention.
  • FIG. 20 shows a state in which a background image on which an icon of a human body is superimposed is displayed on a touch panel type display unit 35a.
  • the user can operate the air conditioning setting by operating the controller 14. If the user can recognize what the current room temperature is near the user in the room, it becomes easier to determine how many times the temperature should be raised or lowered from the current room temperature.
  • the image processing unit 34 causes the touch panel type display unit 35a to display the temperature display 81 indicating the temperature of the touched position on the touch panel type display unit 35a.
  • the temperature displayed by the temperature display 81 is not the set temperature in the air conditioner 10, but the indoor temperature detected by the indoor information acquisition unit 21 or the airflow temperature calculated from the airflow temperature blown out from the indoor unit 11. is there.
  • FIG. 21 is a diagram showing a method of setting the room temperature in the air conditioning setting by operating the controller 14 in the first embodiment of the present invention.
  • the screen switches to the air conditioning setting screen as shown in FIG. 21.
  • a plurality of temperature candidates 82 having a vertical width centered on the current temperature indicated by the temperature display 81 are displayed next to the temperature display 81, and a desired indoor temperature 83 can be selected.
  • the air conditioning setting of the room temperature can be changed by tapping and selecting the temperature candidate 82 displayed on the touch panel type display unit 35a.
  • FIG. 21 shows a state in which 21 ° C. is selected as the desired room temperature 83.
  • a message confirming consent to reflect the selection of the desired room temperature 83 is displayed on the touch panel so that the wrong selection is not reflected when the desired room temperature 83 is selected. It may be displayed on the display unit 35a of the expression. Then, the user may tap the message so that the selection of the desired room temperature 83 is reflected in the air conditioning setting.
  • the current room temperature indicated by the temperature display 81 can be changed in 0.5 ° C increments at 2 ° C above and below.
  • the air conditioner is constantly used, the user's feeling of coldness is often eliminated even by raising the room temperature by 0.5 ° C. Therefore, if the change range of the room temperature setting is 2 ° C., it is possible to eliminate the user's feeling of cold. If the user's feeling of coldness is not sufficiently resolved even after changing the room temperature setting by 2 ° C, touch the temperature display 81 again and the temperature candidate 82 will be 2 ° C above and below the changed temperature. Is displayed, and the desired room temperature 83 can be changed. Therefore, it is not always possible to change the desired indoor temperature 83 only within the range of 2 ° C. from the initial indoor temperature.
  • the selection width of the desired room temperature 83 is 2 ° C. has been described, but in a state where 21 ° C. is selected as the desired room temperature 83 in FIG. 21, a touch panel type display unit is further described.
  • the temperature may be displayed until the desired temperature can be selected by sliding the temperature higher than 22 ° C, 22.5 ° C, 23 ° C, and so on. ..
  • the currently set airflow information is displayed as the vector information including the direction and size information as the airflow display by the arrow icon 84.
  • the arrow shown in FIG. 20 is an airflow display icon representing the set airflow information set by the user in the air conditioner 10.
  • the set airflow information is information on the airflow, which is one of the air conditioning settings set in the air conditioner 10 by the user, and includes the strength of the airflow.
  • the direction of the arrow icon 84 represents the direction of the airflow in the room, and the length of the arrow icon 84 represents the strength of the airflow in the room.
  • the image processing unit 34 receives the set airflow information set in the air conditioner 10 by the user from the operation unit 31, and combines and displays the set airflow information with the background image displayed on the touch panel type display unit 35a. be able to.
  • FIG. 22 is a schematic diagram showing a method of changing the set airflow information in the air conditioning setting using the touch panel type display unit 35a in the first embodiment of the present invention.
  • the axis of the air flow is displayed as a black circle 85 next to the base point of the arrow icon 84.
  • the shape or size of the arrow icon 84, or both the shape and the size are changed.
  • the broken line arrow icon 86 in FIG. 22 is an icon after the arrow icon 84 has changed.
  • the user drags and drops the vicinity of the tip of the arrow icon 84 while the black circle 85 is displayed to extend the tip of the arrow icon 84.
  • the user drags and drops the vicinity of the tip of the arrow icon 84 while the black circle 85 is displayed to rotate the tip of the arrow icon 84 around the black circle 85. And slide it.
  • Information on the shape or size of the changed arrow icon 84, or both the shape and size, is transmitted to the image processing unit 34.
  • the image processing unit 34 converts the information of the arrow icon 84 into the set value of the air flow of the air conditioning setting and transmits it to the air conditioning control unit 24.
  • the air conditioning control unit 24 controls the air conditioning operation settings such as the direction of the air flow and the strength of the air flow based on the set values of the air flow received from the image processing unit 34. That is, a broken line is formed by changing the shape or size of the arrow icon 84 displayed on the touch panel type display unit 35a and indicating the airflow information set in the air conditioner 10, or both the shape and size.
  • the set value of the air flow corresponding to the shape and size of the arrow icon 86 is transmitted to the air conditioning control unit 24.
  • the airflow display may display an image of the wind.
  • the image processing unit 34 displays the airflow during heating with a red or orange arrow icon 84 to indicate the warmth of the wind. Further, the image processing unit 34 displays the air flow during cooling with a light blue or blue arrow icon 84 to indicate the coldness of the wind.
  • the arrow icon 84 is a wind display, and the touch panel type display unit 35a makes it easy to visually determine what kind of operation mode the driver is operating in.
  • the user can visually view the indoor state while observing the indoor image, which is an image showing the room displayed on the touch panel type display unit 35a, the indoor information superimposed on the indoor image, and the position of the human body.
  • the set airflow information can be changed so as to avoid obstacles such as sofas and furniture.
  • the user can change the set airflow information so that the airflow is directed in the direction of temperature unevenness, and it is possible to efficiently and comfortably achieve comfortable air conditioning and improve the operability of the air conditioning setting.
  • the recognition result may be displayed on the background image on the touch panel type display unit 35a.
  • the image processing unit 34 recognizes an object such as a television, a sofa, and a window, and individuals such as a father and a mother, and displays them on the background image of the touch panel type display unit 35a.
  • the image processing unit 34 may border and display the individual and the object on the background image according to the shape of the recognition result of the individual and the object.
  • the image processing unit 34 may display a comment of the recognition result near an individual and an object on the background image. Thereby, the user can also confirm whether the air conditioner 10 can correctly identify the indoor state and operate normally by looking at the display of the touch panel type display unit 35a.
  • the recognition result comment can be corrected.
  • the comment of the recognition result displayed on the touch panel type display unit 35a is touched, the comment of the recognition result becomes the input mode and the character can be directly input.
  • you want to correct the recognition result comment that is displayed as "Dad” on the touch panel type display unit 35a you can touch the "Dad” display to display correction candidates such as "Mother", “Child", and "Customer” on the touch panel. It may be displayed on the display unit 35a of the expression, and the correction candidate of the correct content may be selected on the display unit 35a of the touch panel type.
  • the air conditioning system 100 when a wide area of the indoor space is photographed and recognized, and the air conditioning operation is controlled according to the recognition result of the human body in the indoor space, how the air conditioner 10 uses the air.
  • the user can confirm whether or not the harmony space is recognized by the display of the touch panel type display unit 35a.
  • the recognition result in the air conditioner 10 is easily corrected and useless. It is possible to perform proper air-conditioning operation without any problems.
  • the image processing unit 34 invalidates the operation of the operation unit 31 even if the child operates the operation unit 31, and the touch panel type display unit 35a is, for example, "child lock". By displaying "Medium”, it is possible to prevent an erroneous operation of the controller 14 by a child. Further, even when a user other than a specific registrant registered in the controller 14 operates the controller 14 as a user who can operate the controller 14, the operation of the operation unit 31 is invalidated to suppress unnecessary air conditioning operation. It is also possible to realize energy-saving operation of the air conditioner 10.
  • the image processing unit 34 When an individual human body is recognized, the image processing unit 34 simply displays the pre-registered personal preference air conditioning setting information 67 on the touch panel type display unit 35a in response to the individual recognition result.
  • the air conditioning setting or the operation menu of the air conditioning setting which is presumed to be changed based on the current indoor environment, is guessed and displayed on the touch panel type display unit 35a, or the air is presumed to be a necessary setting function.
  • the harmony setting function may be displayed to improve operability.
  • the necessary setting function is, for example, "a setting function for only the air volume".
  • the image processing unit 34 is presumed to be required for the air-conditioning setting presumed to be the preference of the identified individual or the identified individual in consideration of the current indoor environment.
  • the operation menu of the air conditioning setting to be performed is inferred and displayed as a candidate on the touch panel type display unit 35a.
  • the image processing unit 34 uses a question format based on the recognition result of the human body in the image processing unit 34 and the personal favorite air conditioning setting information 67 registered in advance so that the user does not have to worry about the operation setting of the air conditioning setting.
  • the operation may be selectable. That is, the image processing unit 34 estimates the preference of the individual's air conditioning setting from the identification result of the individual identified by the characteristics of the human body information, and displays the estimated air conditioning setting on the touch panel type display unit 35a in the form of a question. You may.
  • the image processing unit 34 changes the display for confirming whether or not the air conditioning setting is changed on the touch panel type display unit 35a and how to change the air conditioning setting based on the personal preference air conditioning setting information 67 registered in advance.
  • a touch panel type display unit 35a displays a display of choices to be performed, and prompts the user to input a setting instruction by the operation unit 31. The user inputs the desired air conditioning setting conditions from the operation unit 31 according to the display of the touch panel type display unit 35a.
  • the indoor image captured by the imaging unit 32 is not a scene seen by the user, but an image of a scene seen from the indoor unit 11 of the air conditioner 10. Therefore, the image processing unit 34 calculates information on what kind of object exists in the room and how it looks to the user based on the recognition result of the object and the human body, and the user.
  • a virtual image that can be seen from the screen may be generated and displayed on the touch panel type display unit 35a.
  • FIG. 9 described above a virtual indoor image that can be seen from the user side operating the controller 14, including the user operating the controller 14, is shown.
  • the indoor unit 11 of the air conditioner 10 is also displayed in the virtual indoor image shown in FIG. By displaying the indoor unit 11 that is not actually captured in the indoor image in the virtual indoor image in this way, it is possible to clearly display where the wind is blowing from where.
  • the air conditioning system 100 includes an indoor information acquisition unit 21 in which the indoor unit 11 of the air conditioner 10 acquires indoor information which is information on the indoor state. Further, the controller 14 includes an imaging unit 32 that captures an indoor image that is an image showing the state of the room, and a display unit 35 that displays information regarding the operation of the air conditioner. Then, the imaging unit 32 superimposes at least a part of the thermal image, which is the indoor information, on the indoor image and displays it on the display unit 35.
  • the user visually and intuitively recognizes the indoor state, which is difficult to distinguish from the indoor thermal image alone, by the background image displayed on the display unit 35 and the thermal image 73 superimposed on the background image. And the visibility of the indoor condition is improved.
  • the indoor temperature state can be recognized at the same time, and when the indoor state is recognized only by the indoor thermal image and when the indoor state is recognized only by the indoor image. Compared to, the indoor condition can be easily grasped.
  • the air conditioner system 100 does not mount an image pickup unit such as an expensive camera on the air conditioner 10, but uses an indoor image taken by the image pickup unit 32 of the controller 14 as a background image on the display unit 35. Display it. Then, at least a part of the indoor information is superimposed on the indoor image and displayed on the display unit 35. As a result, the size of the air conditioner 10 does not increase due to the provision of the image pickup device in the air conditioner 10, and the air conditioner 10 can be realized at low cost and in a small space.
  • an image pickup unit such as an expensive camera
  • the air conditioning system 100 can display the identification result of the person and the object in the air conditioner 10 by synthesizing it with the background image.
  • the user can easily and intuitively recognize whether or not the air conditioner 10 correctly authenticates the state of the indoor space by the display of the display unit 35, and the operation of the air conditioner 10 is erroneously performed.
  • the display on the display unit 35 makes it possible to easily and intuitively recognize whether or not the operation is wasted.
  • the energy-saving operation of the air conditioner 10 can be realized by correcting the identification result.
  • the air conditioning system 100 can replace the user's face specified from the thermal image information 62 with the user's face image 74 and display it compositely on the background image of the display unit 35. Further, the user's face specified from the thermal image information 62 is replaced with the user's caricature or icon and compositely displayed on the background image of the display unit 35 to easily display the person in the room while ensuring personal privacy. It can be recognized by the part 35.
  • the air conditioning system 100 displays the personal favorite air conditioning setting specified from the thermal image information 62 on the display unit 35, so that the user can easily set the expected setting from the limited air conditioning setting. It can be selected to improve the operability of the setting operation of the air conditioning setting.
  • the touch panel type display unit 35a as the display unit 35 and displaying the airflow setting of the air harmony setting on the touch panel type display unit 35a by the arrow icon, the airflow such as the direction and the air volume of the airflow can be felt like a touch panel. You can intuitively monitor the air conditioning setting of, and you can also set it. As a result, it is possible to realize an air conditioning system with improved user convenience.
  • the air conditioning system 100 adjusts the air conditioning so that the air conditioning is not hindered by obstacles by displaying the air conditioning setting on the touch panel type display unit 35a by the icon of the arrow, and the adjusted air conditioning is achieved. If it is inappropriate, appropriate energy-saving operation can be realized by correcting the air conditioning setting with a touch panel or the like. Since the user can visually and intuitively adjust the airflow by looking at the display of the touch panel type display unit 35a, the user can set the airflow without being particularly conscious of it.
  • the indoor state can be intuitively grasped without increasing the size of the air conditioner 10 by providing the air conditioner 10 with an image pickup device. Is possible.
  • the configuration shown in the above-described embodiment shows an example of the content of the present invention, can be combined with another known technique, and is one of the configurations without departing from the gist of the present invention. It is also possible to omit or change the part.

Abstract

An air conditioner (10) comprises: an indoor information acquisition unit (21) that acquires indoor information, which is information relating to the state of a room; an air conditioner communication unit that communicates with external devices; and an air-conditioning control unit (24) that performs the air-conditioning control of the air conditioner (10). A controller (14) is provided with: a manipulation unit (31) that accepts setting manipulations for the operation of the air conditioner (10); an image-capturing unit (32) that captures an indoor image, which is an image showing the state of the room; a display unit (35) that displays information relating to the operation of the air conditioner (10); and a controller communication unit (33) that communicates with external devices. The display unit (35) overlays at least part of the indoor information on the indoor image and displays the same.

Description

空気調和システムAir conditioning system
　本発明は、室内の空気を調和する空気調和システムに関する。 The present invention relates to an air conditioning system that harmonizes indoor air.
　特許文献１には、熱画像センサが作成した二次元の熱画像データに基づいて検出された人の位置および人の位置の温度をリモートコントローラの表示部に表示する空気調和機が開示されている。人の位置には、人の顔の位置、人の手の位置、および人の足の位置のうち少なくとも１つが含まれる。人の位置および人の位置の温度は、熱画像データの情報から算出される。 Patent Document 1 discloses an air conditioner that displays a person's position and the temperature of the person's position detected based on two-dimensional thermal image data created by a thermal image sensor on a display unit of a remote controller. .. A person's position includes at least one of a person's face position, a person's hand position, and a person's foot position. The position of the person and the temperature of the position of the person are calculated from the information of the thermal image data.
　特許文献２には、カメラなどの撮像部を備えて、撮像部が撮像した画像より個人の顔などの室内環境の情報を取得する空気調和機が開示されている。 Patent Document 2 discloses an air conditioner that includes an imaging unit such as a camera and acquires information on the indoor environment such as an individual's face from an image captured by the imaging unit.
特開２０１６－２１７８８６号公報Japanese Unexamined Patent Publication No. 2016-217886 特開２０１１－２２０６１２号公報Japanese Unexamined Patent Publication No. 2011-220612
　しかしながら、上記特許文献１の空気調和機では、リモートコントローラの表示部に熱画像を表示しても、熱画像データの情報からは検出された人が室内の誰であるかを識別できず、視認性が乏しく、室内の状態を直感的に把握して空気調和機の設定操作をすることができない、という問題があった。すなわち、リモートコントローラで風向を右向きに設定したときに、リモートコントローラの表示部に表示された熱画像では、風向が空気調和機から見て右方向なのか、または風向が空気調和機に向かって右方向なのかがわかりにくかった。 However, in the air conditioner of Patent Document 1, even if the thermal image is displayed on the display unit of the remote controller, it is not possible to identify who in the room the detected person is from the information of the thermal image data, and the person can be visually recognized. There was a problem that the air conditioner could not be set and operated by intuitively grasping the indoor condition due to poor characteristics. That is, when the wind direction is set to the right on the remote controller, in the thermal image displayed on the display of the remote controller, is the wind direction to the right when viewed from the air conditioner, or the wind direction is to the right when facing the air conditioner? It was hard to tell if it was the direction.
　また、上記特許文献２の空気調和機は、撮像部を搭載するため、部品搭載スペースを確保するために空気調和機のサイズが大きくなってしまう、という問題があった。 Further, since the air conditioner of Patent Document 2 is equipped with an imaging unit, there is a problem that the size of the air conditioner becomes large in order to secure a space for mounting parts.
　本発明は、上記に鑑みてなされたものであって、大型化を伴うことなく、室内の状態を直感的に把握することが可能な空気調和システムを得ることを目的とする。 The present invention has been made in view of the above, and an object of the present invention is to obtain an air conditioning system capable of intuitively grasping the state of a room without increasing the size.
　上述した課題を解決し、目的を達成するために、本発明にかかる空気調和システムは、室内に配置されて調和空気を室内へ送風する空気調和機と、空気調和機の運転を制御するコントローラとを備える。空気調和機は、室内の状態に関する情報である室内情報を取得する室内情報取得部と、外部の機器と通信を行う空気調和機通信部と、空気調和機の空気調和制御を行う空気調和制御部と、を備える。コントローラは、空気調和機の運転の設定操作を受け付ける操作部と、室内の状態を示す画像である室内画像を撮影する撮像部と、空気調和機の運転に関する情報を表示する表示部と、外部の機器と通信を行うコントローラ通信部と、を備える。表示部は、室内情報の少なくとも一部を室内画像に重畳して表示する。 In order to solve the above-mentioned problems and achieve the object, the air conditioning system according to the present invention includes an air conditioner arranged in a room to blow conditioned air into the room and a controller for controlling the operation of the air conditioner. To be equipped. The air conditioner is an indoor information acquisition unit that acquires indoor information that is information about the state of the room, an air conditioner communication unit that communicates with external equipment, and an air conditioner control unit that controls the air conditioner of the air conditioner. And. The controller includes an operation unit that accepts the setting operation of the operation of the air conditioner, an imaging unit that captures an indoor image that is an image showing the state of the room, a display unit that displays information on the operation of the air conditioner, and an external unit. It is equipped with a controller communication unit that communicates with the device. The display unit superimposes at least a part of the indoor information on the indoor image and displays it.
　本発明にかかる空気調和システムは、大型化を伴うことなく、室内の状態を直感的に把握することが可能である、という効果を奏する。 The air conditioning system according to the present invention has the effect that it is possible to intuitively grasp the state of the room without increasing the size.
本発明の実施の形態１にかかる空気調和システムの構成を模式的に示す構成図A block diagram schematically showing the configuration of the air conditioning system according to the first embodiment of the present invention. 本発明の実施の形態１にかかる空気調和機の機能構成を示す機能ブロック図Functional block diagram showing the functional configuration of the air conditioner according to the first embodiment of the present invention. 本発明の実施の形態１にかかる空気調和機における室内機の外観を示す正面図Front view showing the appearance of the indoor unit in the air conditioner according to the first embodiment of the present invention. 本発明の実施の形態１にかかる空気調和機における室内機の空気調和設定の変更時の様子を模式的に示した正面図Front view schematically showing a state at the time of changing the air conditioning setting of the indoor unit in the air conditioner according to the first embodiment of the present invention. 本発明の実施の形態１にかかる空気調和機の室内機に設けられる赤外線センサーを示す斜視図Perspective view showing an infrared sensor provided in an indoor unit of the air conditioner according to the first embodiment of the present invention. 本発明の実施の形態１にかかる赤外線センサーにおける温度検出範囲の一例を示す模式図Schematic diagram showing an example of the temperature detection range in the infrared sensor according to the first embodiment of the present invention. 本発明の実施の形態１にかかる処理回路のハードウェア構成の一例を示す図The figure which shows an example of the hardware composition of the processing circuit which concerns on Embodiment 1 of this invention. 本発明の実施の形態１にかかるコントローラの一例を示す正面図Front view showing an example of the controller according to the first embodiment of the present invention. 本発明の実施の形態１にかかるコントローラの他の例を示す正面図であり、タッチパネル式の表示部を備えるコントローラを示す正面図It is a front view which shows the other example of the controller which concerns on Embodiment 1 of this invention, and is the front view which shows the controller which includes the touch panel type display part. 本発明の実施の形態１にかかる空気調和システムにおける室内機の動作を示すフローチャートA flowchart showing the operation of the indoor unit in the air conditioning system according to the first embodiment of the present invention. 本発明の実施の形態１にかかる熱画像の一例を示す図The figure which shows an example of the thermal image which concerns on Embodiment 1 of this invention. 本発明の実施の形態１にかかる熱画像の他の例を示す図The figure which shows another example of the thermal image which concerns on Embodiment 1 of this invention. 本発明の実施の形態１にかかる室内情報処理部の内部の記憶部を示す図The figure which shows the internal storage part of the room information processing part which concerns on Embodiment 1 of this invention. 本発明の実施の形態１にかかる空気調和システムにおけるコントローラの動作を示すフローチャートA flowchart showing the operation of the controller in the air conditioning system according to the first embodiment of the present invention. 本発明の実施の形態１にかかる室内画像の一例を示す図The figure which shows an example of the room image which concerns on Embodiment 1 of this invention. 本発明の実施の形態１における人体を含む熱画像の一例を示す図The figure which shows an example of the thermal image including the human body in Embodiment 1 of this invention. 本発明の実施の形態１において熱画像の人体エリアが重畳された背景画像の一例を示す図The figure which shows an example of the background image which superposed the human body area of the thermal image in Embodiment 1 of this invention. 本発明の実施の形態１において熱画像における人体の顔部分にユーザーの顔画像が重畳された状態を拡大して示す図FIG. 6 is an enlarged view showing a state in which a user's face image is superimposed on a face portion of the human body in the thermal image in the first embodiment of the present invention. 本発明の実施の形態１にかかる画像処理部の記憶部を示す図The figure which shows the storage part of the image processing part which concerns on Embodiment 1 of this invention. 本発明の実施の形態１におけるコントローラの操作により空気調和設定を設定する状態を示す図The figure which shows the state which sets the air-conditioning setting by the operation of the controller in Embodiment 1 of this invention. 本発明の実施の形態１におけるコントローラの操作により空気調和設定における室内温度を設定する方法を示す図The figure which shows the method of setting the room temperature in the air-conditioning setting by the operation of the controller in Embodiment 1 of this invention. 本発明の実施の形態１においてタッチパネル式の表示部を用いて空気調和設定における設定気流情報を変更する方法を示す模式図The schematic diagram which shows the method of changing the set air flow information in the air conditioning setting by using the touch panel type display part in Embodiment 1 of this invention.
　以下に、本発明の実施の形態にかかる空気調和システムを図面に基づいて詳細に説明する。なお、この実施の形態によりこの発明が限定されるものではない。 The air conditioning system according to the embodiment of the present invention will be described in detail below with reference to the drawings. The present invention is not limited to this embodiment.
実施の形態１．
　図１は、本発明の実施の形態１にかかる空気調和システム１００の構成を模式的に示す構成図である。図２は、本発明の実施の形態１にかかる空気調和機１０の機能構成を示す機能ブロック図である。図２においては、空気調和システム１００の構成のうち、空気調和機１０の室内機１１と、コントローラ１４とについて示している。 Embodiment 1.
FIG. 1 is a configuration diagram schematically showing the configuration of the air conditioning system 100 according to the first embodiment of the present invention. FIG. 2 is a functional block diagram showing a functional configuration of the air conditioner 10 according to the first embodiment of the present invention. FIG. 2 shows the indoor unit 11 of the air conditioner 10 and the controller 14 in the configuration of the air conditioner system 100.
　図１に示すように、本実施の形態１にかかる空気調和機システム１００は、室内に設置された室内機１１、室外に設置された室外機１２、室内機１１と室外機１２との間で冷媒を循環させるための冷媒管１３を備えて構成される空気調和機１０、および空気調和機１０に対する制御指示命令を室内機１１に送信するコントローラ１４を備える。室外機１２は、図示しない通信線を介して室内機１１と通信可能とされている。 As shown in FIG. 1, the air conditioner system 100 according to the first embodiment is between an indoor unit 11 installed indoors, an outdoor unit 12 installed outdoors, and an indoor unit 11 and an outdoor unit 12. It includes an air conditioner 10 including a refrigerant pipe 13 for circulating a refrigerant, and a controller 14 that transmits a control instruction command to the air conditioner 10 to the indoor unit 11. The outdoor unit 12 can communicate with the indoor unit 11 via a communication line (not shown).
　空気調和機１０は、一つの完結した冷凍サイクルを室内機１１と室外機１２とで形成している。空気調和機１０は、冷媒管１３を通って室内機１１と室外機１２との間を循環する冷媒を使用して、空気調和対象空間である室内の空気と室外の空気との間で熱移動を行い、室内に対する空気調和を実現している。すなわち、室内機１１と室外機１２とは冷媒管１３により接続されており、冷媒管１３中を流れる冷媒の圧力を室外機１２の備える圧縮機により変化させて冷媒の吸熱、放熱により空気調和を行う。 The air conditioner 10 forms one complete refrigeration cycle with the indoor unit 11 and the outdoor unit 12. The air conditioner 10 uses a refrigerant that circulates between the indoor unit 11 and the outdoor unit 12 through the refrigerant pipe 13 to transfer heat between the indoor air and the outdoor air, which are the air conditioning target spaces. To achieve air conditioning for the room. That is, the indoor unit 11 and the outdoor unit 12 are connected by a refrigerant pipe 13, and the pressure of the refrigerant flowing in the refrigerant pipe 13 is changed by the compressor provided in the outdoor unit 12 to achieve air conditioning by absorbing and radiating the heat of the refrigerant. Do.
　室内機１１は、室内情報取得部２１と、室内情報処理部２２と、室内機通信部２３と、空気調和制御部２４と、空気調和変更部２５と、を備えている。また、コントローラ１４は、操作部３１と、撮像部３２と、コントローラ通信部３３と、画像処理部３４と、表示部３５と、を備えている。 The indoor unit 11 includes an indoor information acquisition unit 21, an indoor information processing unit 22, an indoor unit communication unit 23, an air conditioning control unit 24, and an air conditioning changing unit 25. Further, the controller 14 includes an operation unit 31, an image pickup unit 32, a controller communication unit 33, an image processing unit 34, and a display unit 35.
　以下、空気調和機１０の各構成部について説明する。まず、室内機１１の構成部について説明する。図３は、本発明の実施の形態１にかかる空気調和機１０における室内機１１の外観を示す正面図である。図４は、本発明の実施の形態１にかかる空気調和機１０における室内機１１の空気調和設定の変更時の様子を模式的に示した正面図である。室内機１１は、前面に、室内情報取得部２１、室内機通信部２３および空気調和変更部２５を備えている。 Hereinafter, each component of the air conditioner 10 will be described. First, the constituent parts of the indoor unit 11 will be described. FIG. 3 is a front view showing the appearance of the indoor unit 11 in the air conditioner 10 according to the first embodiment of the present invention. FIG. 4 is a front view schematically showing a state when the air conditioning setting of the indoor unit 11 in the air conditioner 10 according to the first embodiment of the present invention is changed. The indoor unit 11 includes an indoor information acquisition unit 21, an indoor unit communication unit 23, and an air conditioning changing unit 25 on the front surface.
　室内情報取得部２１は、室内の状態に関する情報である室内情報を取得する。室内情報取得部２１の一例として、赤外線センサーが例示される。図５は、本発明の実施の形態１にかかる空気調和機１０の室内機１１に設けられる赤外線センサーを示す斜視図である。図６は、本発明の実施の形態１にかかる赤外線センサーにおける温度検出範囲の一例を示す模式図である。図６において、部屋の幅方向に対応する左右方向をＸ方向とし、部屋の高さ方向に対応する縦方向をＹ方向とする。赤外線センサーは、離れた地点の表面温度を検出することができ、室内全体の表面温度を網羅して検出することが可能である。すなわち、赤外線センサーは、室内情報として室内の表面温度を取得することができる。 The indoor information acquisition unit 21 acquires indoor information which is information on the state of the room. An infrared sensor is exemplified as an example of the indoor information acquisition unit 21. FIG. 5 is a perspective view showing an infrared sensor provided in the indoor unit 11 of the air conditioner 10 according to the first embodiment of the present invention. FIG. 6 is a schematic view showing an example of the temperature detection range in the infrared sensor according to the first embodiment of the present invention. In FIG. 6, the left-right direction corresponding to the width direction of the room is the X direction, and the vertical direction corresponding to the height direction of the room is the Y direction. The infrared sensor can detect the surface temperature at a distant point, and can comprehensively detect the surface temperature of the entire room. That is, the infrared sensor can acquire the surface temperature in the room as indoor information.
　赤外線センサーの一例として、サーモパイルセンサが例示される。サーモパイルセンサは、サーモパイル素子で計測した温度を室内情報処理部２２に送信可能な形式に変換して室内の表面温度の温度分布を示す温度分布情報６１を生成する。サーモパイルセンサが備えるサーモパイル素子は、１つであってもよく、複数であってもよい。図５に示す赤外線センサーは、７個のサーモパイル素子であるサーモパイル素子４１、サーモパイル素子４２、サーモパイル素子４３、サーモパイル素子４４、サーモパイル素子４５、サーモパイル素子４６およびサーモパイル素子４７がこの順で縦方向に並べられて設置されている。図５に示す赤外線センサーは、部屋の天井面から室内機１１の真下の床面までの表面温度を検出する。 A thermopile sensor is exemplified as an example of an infrared sensor. The thermopile sensor converts the temperature measured by the thermopile element into a format that can be transmitted to the indoor information processing unit 22, and generates temperature distribution information 61 indicating the temperature distribution of the surface temperature in the room. The thermopile element included in the thermopile sensor may be one or a plurality. In the infrared sensor shown in FIG. 5, seven thermopile elements, a thermopile element 41, a thermopile element 42, a thermopile element 43, a thermopile element 44, a thermopile element 45, a thermopile element 46, and a thermopile element 47 are arranged in this order in the vertical direction. It has been installed. The infrared sensor shown in FIG. 5 detects the surface temperature from the ceiling surface of the room to the floor surface directly below the indoor unit 11.
　図６においては、Ｙ方向に１列に並べられたサーモパイル素子４１からサーモパイル素子４７を備える赤外線センサーにより、室内の表面温度の温度情報を取得する状態を示している。赤外線センサーが監視して表面温度の温度情報を取得する室内の監視領域は、Ｙ方向において、上方から監視範囲Ａ１、監視範囲Ａ２、監視範囲Ａ３、監視範囲Ａ４、監視範囲Ａ５、監視範囲Ａ６および監視範囲Ａ７に分割される。 FIG. 6 shows a state in which temperature information of the surface temperature in a room is acquired by an infrared sensor including thermopile elements 47 from thermopile elements 41 arranged in a row in the Y direction. The indoor monitoring areas that the infrared sensor monitors and acquires the temperature information of the surface temperature are the monitoring range A1, the monitoring range A2, the monitoring range A3, the monitoring range A4, the monitoring range A5, the monitoring range A6, and so on in the Y direction. It is divided into the monitoring range A7.
　サーモパイル素子４１は、監視範囲Ａ１を監視して、室内情報を取得する。すなわち、サーモパイル素子４１は、監視範囲Ａ１の室内の表面温度を取得する。同様に、サーモパイル素子４２は、監視範囲Ａ２を監視して、室内情報を取得する。サーモパイル素子４３は、監視範囲Ａ３を監視して、室内情報を取得する。サーモパイル素子４４は、監視範囲Ａ４を監視して、室内情報を取得する。サーモパイル素子４５は、監視範囲Ａ５を監視して、室内情報を取得する。サーモパイル素子４６は、監視範囲Ａ６を監視して、室内情報を取得する。サーモパイル素子４７は、監視範囲Ａ７を監視して、室内情報を取得する。 The thermopile element 41 monitors the monitoring range A1 and acquires indoor information. That is, the thermopile element 41 acquires the surface temperature in the room in the monitoring range A1. Similarly, the thermopile element 42 monitors the monitoring range A2 and acquires indoor information. The thermopile element 43 monitors the monitoring range A3 and acquires indoor information. The thermopile element 44 monitors the monitoring range A4 and acquires indoor information. The thermopile element 45 monitors the monitoring range A5 and acquires indoor information. The thermopile element 46 monitors the monitoring range A6 and acquires indoor information. The thermopile element 47 monitors the monitoring range A7 and acquires indoor information.
　室内機１１は、赤外線センサーの向きをＸ方向において変更する不図示の方向変更部を備える。赤外線センサーの向きは、表面温度の検出対象部を向く向きである。方向変更部は、赤外線センサーの向きをＸ方向において駆動する機構を備え、赤外線センサーの向きを左右方向に変更し、赤外線センサーを一定間隔で水平方向に動かす。赤外線センサーは、方向変更部の駆動により表面温度の検出対象部をＸ方向において変化させながら、室内全体の表面温度を検出し、ＸＹ平面における室内の温度情報である温度分布を作成する。 The indoor unit 11 includes a direction changing unit (not shown) that changes the direction of the infrared sensor in the X direction. The direction of the infrared sensor is the direction toward the detection target portion of the surface temperature. The direction changing unit includes a mechanism for driving the direction of the infrared sensor in the X direction, changes the direction of the infrared sensor to the left and right, and moves the infrared sensor in the horizontal direction at regular intervals. The infrared sensor detects the surface temperature of the entire room while changing the detection target part of the surface temperature in the X direction by driving the direction changing part, and creates a temperature distribution which is the temperature information of the room in the XY plane.
　室内情報処理部２２は、室内情報取得部２１が取得した室内情報から、室内の特徴および室内の状況といった、室内の状態を把握するために用いられる室内特徴情報６３を抽出する。室内特徴情報６３は、室内における特徴を示す情報である。また、室内情報処理部２２は、室内情報取得部２１が取得した室内情報から、人体を抽出して、室内特徴情報６３の一部として人体情報を生成することができる。人体情報は、室内情報における、人の顔、手および足などの人体に関する情報である。室内情報処理部２２は、たとえば人体情報における人体の形状および大きさに対応する人体判定情報を予め記憶しており、人体判定情報と室内特徴情報６３とを比較して室内特徴情報６３における人体を抽出することができる。 The indoor information processing unit 22 extracts the indoor feature information 63 used for grasping the indoor state such as the indoor feature and the indoor condition from the indoor information acquired by the indoor information acquisition unit 21. The indoor feature information 63 is information indicating the features in the room. Further, the indoor information processing unit 22 can extract the human body from the indoor information acquired by the indoor information acquisition unit 21 and generate the human body information as a part of the indoor feature information 63. The human body information is information about the human body such as a human face, hands and feet in the indoor information. The indoor information processing unit 22 stores, for example, human body determination information corresponding to the shape and size of the human body in the human body information in advance, compares the human body determination information with the indoor feature information 63, and obtains the human body in the indoor feature information 63. Can be extracted.
　室内機通信部２３は、室内機１１が室内機１１の外部の機器と通信を行うための空気調和機通信部である。室内機通信部２３は、コントローラ１４のコントローラ通信部３３から送信された情報を受信して空気調和制御部２４に送信し、また室内情報処理部２２において処理されて送信された情報および空気調和制御部２４から送信された情報をコントローラ通信部３３へ送信する。なお、室内機通信部２３は、コントローラ１４に搭載されたコントローラ通信部３３と互いに通信できるものであればよく、通信方法は問わない。室内機通信部２３とコントローラ通信部３３との通信方法の例としては、赤外線通信および無線通信が例示される。 The indoor unit communication unit 23 is an air conditioner communication unit for the indoor unit 11 to communicate with an external device of the indoor unit 11. The indoor unit communication unit 23 receives the information transmitted from the controller communication unit 33 of the controller 14 and transmits it to the air conditioning control unit 24, and the information and air conditioning control processed and transmitted by the indoor information processing unit 22. The information transmitted from the unit 24 is transmitted to the controller communication unit 33. The indoor unit communication unit 23 may be any communication method as long as it can communicate with the controller communication unit 33 mounted on the controller 14. Infrared communication and wireless communication are exemplified as an example of the communication method between the indoor unit communication unit 23 and the controller communication unit 33.
　例えば、室内機通信部２３とコントローラ通信部３３との通信方法が赤外線通信である場合には、波長が７５０ｎｍから１０００ｎｍ程度の近赤外帯域の赤外線通信が利用される。近赤外光は、室内の壁を透過できないため、送信側である発光部から発光された赤外光が受信側である受光部に届くように同一の部屋で使用され、近距離通信であることが多い。また、赤外線通信は、通信速度が遅い反面、発光の部材と受光の部材とが簡素で安価に構成される特徴がある。 For example, when the communication method between the indoor unit communication unit 23 and the controller communication unit 33 is infrared communication, infrared communication in the near infrared band having a wavelength of about 750 nm to 1000 nm is used. Since near-infrared light cannot pass through the walls of the room, it is used in the same room so that the infrared light emitted from the light emitting part on the transmitting side reaches the light receiving part on the receiving side, which is short-range communication. Often. Further, infrared communication has a feature that the communication speed is slow, but the light emitting member and the light receiving member are simple and inexpensive.
　一方、無線通信については、無線ＬＡＮ（Ｌｏｃａｌ　Ａｒｅａ　Ｎｅｔｗｏｒｋ）通信、特定小電力通信など様々な規格がある。本実施の形態１において室内機通信部２３とコントローラ通信部３３との通信方法に用いる無線方式の種類に限定はない。無線ＬＡＮは、世界共通で使用できる２．４ＧＨｚの帯域の通信であり、パーソナルコンピュータをはじめ広く使用されている規格であり、汎用性があり高速で通信できる。 On the other hand, regarding wireless communication, there are various standards such as wireless LAN (Local Area Network) communication and specific low power communication. In the first embodiment, there is no limitation on the type of wireless system used for the communication method between the indoor unit communication unit 23 and the controller communication unit 33. Wireless LAN is a 2.4 GHz band communication that can be used universally, is a standard widely used including personal computers, and is versatile and can communicate at high speed.
　空気調和制御部２４は、室内情報処理部２２から受信した情報、コントローラ１４から受信した指示情報、およびあらかじめ空気調和制御部２４に記憶している情報といった、空気調和機１０の運転に関する各種情報に基づいて空気調和機１０の動作を制御する。すなわち、空気調和制御部２４は、空気調和機１０の運転に関する各種情報に基づいて、室内機１１から室内に吹き出す気流の温度、室内機１１から室内に吹き出す気流の強さおよび方向といった空気調和運転の設定を制御し、空気調和機１０の動作を制御する。 The air conditioning control unit 24 provides various information related to the operation of the air conditioner 10, such as information received from the indoor information processing unit 22, instruction information received from the controller 14, and information stored in the air conditioning control unit 24 in advance. Based on this, the operation of the air conditioner 10 is controlled. That is, the air conditioning control unit 24 performs air conditioning operation such as the temperature of the airflow blown into the room from the indoor unit 11 and the strength and direction of the airflow blown into the room from the indoor unit 11 based on various information regarding the operation of the air conditioner 10. Controls the setting of and controls the operation of the air conditioner 10.
　空気調和変更部２５は、空気調和制御部２４から送信される指令に基づいて、室内機１１から室内に吹き出す気流の状態、すなわち気流の風向および風量などを変更して空気調和運転の変更を行う。空気調和変更部２５は、図４に示すように、室内機１１から室内に吹き出す気流の鉛直方向における風向きを変更するルーバーを有する第１風向変更部２５ａおよび第２風向変更部２５ｂと、室内機１１から室内に吹き出す気流の水平方向における風向きを変更するルーバーを有する第３風向変更部２５ｃと、気流の強さを変更する図示しないファンのモーターと、気流の温度を変更する図示しない熱交換器とを備えている。第３風向変更部２５ｃは、空気調和変更部２５において第１風向変更部２５ａおよび第２風向変更部２５ｂよりも内部側に設けられている。空気調和変更部２５は、空気調和制御部２４からの指令に基づいて、第１風向変更部２５ａ、第２風向変更部２５ｂ、第３風向変更部２５ｃ、ファンのモーター、および熱交換器を動作させて、空気調和運転の変更を行う。 The air conditioning changing unit 25 changes the air conditioning operation by changing the state of the airflow blown from the indoor unit 11 into the room, that is, the airflow direction and the air volume, etc., based on the command transmitted from the air conditioning control unit 24. .. As shown in FIG. 4, the air harmonization changing unit 25 includes a first wind direction changing unit 25a and a second wind direction changing unit 25b having louvers for changing the wind direction of the airflow blown into the room from the indoor unit 11 in the vertical direction, and an indoor unit. A third wind direction changing section 25c having a louver that changes the direction of the airflow blown into the room from 11 in the horizontal direction, a fan motor (not shown) that changes the strength of the airflow, and a heat exchanger (not shown) that changes the temperature of the airflow. And have. The third wind direction changing section 25c is provided on the inner side of the air conditioning changing section 25 with respect to the first wind direction changing section 25a and the second wind direction changing section 25b. The air conditioning changing unit 25 operates the first wind direction changing unit 25a, the second wind direction changing unit 25b, the third wind direction changing unit 25c, the fan motor, and the heat exchanger based on the command from the air conditioning control unit 24. Let's change the air conditioning operation.
　例えば、室内機１１から室内に吹き出す気流を上向きに変更する場合、空気調和制御部２４は、空気調和変更部２５の第１風向変更部２５ａおよび第２風向変更部２５ｂの向きを変更させて、風向を下向きから上向きに変更させる制御を行えばよい。また、例えば室内に２人の人が在室しており、２人の各々が希望する空気調和設定が異なる場合は、空気調和制御部２４は、図４に示すように第１風向変更部２５ａと第２風向変更部２５ｂとを独立して可動させる制御を行えばよい。ここで、図４において、第１風向変更部２５ａについては室内機１１から室内に吹き出す気流の風向を下向きにした様子を示しており、第２風向変更部２５ｂについては室内機１１から室内に吹き出す気流の風向を上向きにした様子を示している。また、第３風向変更部２５ｃは左右に風向を変更できるものであり、例えば複数のフィンで構成されている。 For example, when the airflow blown from the indoor unit 11 into the room is changed upward, the air conditioning control unit 24 changes the directions of the first wind direction changing unit 25a and the second wind direction changing unit 25b of the air conditioning changing unit 25. Control may be performed to change the wind direction from downward to upward. Further, for example, when two people are present in the room and the air conditioning settings desired by each of the two people are different, the air conditioning control unit 24 sets the first wind direction changing unit 25a as shown in FIG. And the second wind direction changing unit 25b may be controlled to move independently. Here, in FIG. 4, the first wind direction changing unit 25a shows a state in which the wind direction of the airflow blown into the room from the indoor unit 11 is directed downward, and the second wind direction changing part 25b is blown out from the indoor unit 11 into the room. It shows that the wind direction of the airflow is upward. Further, the third wind direction changing portion 25c can change the wind direction to the left and right, and is composed of, for example, a plurality of fins.
　また、室内機１１から室内に吹き出す気流の強さは、空気調和変更部２５に設けられたファンのモーターの回転数を調整することで変更する。また、室内機１１から室内に吹き出す気流の温度は、空気調和変更部２５に設けられた熱交換器の冷媒の温度を変更することで変更する。 Further, the strength of the airflow blown from the indoor unit 11 into the room is changed by adjusting the rotation speed of the fan motor provided in the air conditioning changing unit 25. Further, the temperature of the airflow blown from the indoor unit 11 into the room is changed by changing the temperature of the refrigerant of the heat exchanger provided in the air conditioning changing unit 25.
　また、空気調和制御部２４は、例えば、図７に示したハードウェア構成の処理回路として実現される。図７は、本発明の実施の形態１にかかる処理回路のハードウェア構成の一例を示す図である。空気調和制御部２４が図７に示す処理回路により実現される場合、空気調和制御部２４は、例えば、図７に示すメモリ１０２に記憶されたプログラムをプロセッサ１０１が実行することにより、実現される。また、複数のプロセッサおよび複数のメモリが連携して上記機能を実現してもよい。また、空気調和制御部２４の機能のうちの一部を電子回路として実装し、他の部分をプロセッサ１０１およびメモリ１０２を用いて実現するようにしてもよい。 Further, the air conditioning control unit 24 is realized as, for example, a processing circuit having a hardware configuration shown in FIG. 7. FIG. 7 is a diagram showing an example of the hardware configuration of the processing circuit according to the first embodiment of the present invention. When the air conditioning control unit 24 is realized by the processing circuit shown in FIG. 7, the air conditioning control unit 24 is realized, for example, by the processor 101 executing the program stored in the memory 102 shown in FIG. .. Further, a plurality of processors and a plurality of memories may cooperate to realize the above function. Further, a part of the functions of the air conditioning control unit 24 may be implemented as an electronic circuit, and the other part may be realized by using the processor 101 and the memory 102.
　また、室内情報処理部２２および室内機通信部２３のうちの少なくとも１つを、同様にメモリ１０２に記憶されたプログラムをプロセッサ１０１が実行することにより、実現されるように構成してもよい。また、室内情報処理部２２および室内機通信部２３のうちの少なくとも１つを実現するためのプロセッサおよびメモリは、空気調和制御部２４を実現するプロセッサおよびメモリと同一であってもよいし、別のプロセッサおよびメモリであってもよい。 Further, at least one of the indoor information processing unit 22 and the indoor unit communication unit 23 may be configured to be realized by the processor 101 executing a program similarly stored in the memory 102. Further, the processor and memory for realizing at least one of the indoor information processing unit 22 and the indoor unit communication unit 23 may be the same as the processor and memory for realizing the air conditioning control unit 24, or may be different. Processor and memory.
　つぎに、コントローラ１４の構成部について説明する。図２に示すように、コントローラ１４は、操作部３１、撮像部３２、コントローラ通信部３３、画像処理部３４および表示部３５を備えている。図８は、本発明の実施の形態１にかかるコントローラ１４の一例を示す正面図である。なお、本実施の形態１において示すコントローラ１４は、室内機１１とは別体のリモートコントローラである。 Next, the components of the controller 14 will be described. As shown in FIG. 2, the controller 14 includes an operation unit 31, an image pickup unit 32, a controller communication unit 33, an image processing unit 34, and a display unit 35. FIG. 8 is a front view showing an example of the controller 14 according to the first embodiment of the present invention. The controller 14 shown in the first embodiment is a remote controller separate from the indoor unit 11.
　操作部３１は、ユーザーの要求する空気調和設定の設定操作を受け付ける。すなわち、操作部３１は、空気調和機１０の運転を遠隔制御するためのインタフェースであり、ユーザーから空気調和機１０の運転についての指示であり空気調和機１０の運転を設定する運転設定情報を受け付ける。操作部３１は、空気調和機１０の運転開始、空気調和機１０の運転停止、空気調和機１０の運転モードの選択、設定温度の変更、設定湿度の変更、風量の設定、風向の設定、操作禁止事項の設定変更といった、空気調和機１０における空気調和運転に係わる様々な機能をユーザーが任意に選択できるように構成されている。また、操作部３１は、日付および時刻といった情報も設定することができる。操作部３１は、受け付けた各種情報をコントローラ通信部３３および画像処理部３４に送信する。コントローラ１４の操作部３１は、図８に示すようにボタン式の操作部とすることができる。 The operation unit 31 accepts the setting operation of the air conditioning setting requested by the user. That is, the operation unit 31 is an interface for remotely controlling the operation of the air conditioner 10, and receives instructions from the user regarding the operation of the air conditioner 10 and operation setting information for setting the operation of the air conditioner 10. .. The operation unit 31 starts the operation of the air conditioner 10, stops the operation of the air conditioner 10, selects the operation mode of the air conditioner 10, changes the set temperature, changes the set humidity, sets the air volume, sets the wind direction, and operates. It is configured so that the user can arbitrarily select various functions related to the air conditioning operation in the air conditioner 10, such as changing the setting of prohibited items. The operation unit 31 can also set information such as a date and a time. The operation unit 31 transmits various received information to the controller communication unit 33 and the image processing unit 34. The operation unit 31 of the controller 14 can be a button-type operation unit as shown in FIG.
　撮像部３２は、カメラなど可視画像を撮影する機器であり、空気調和対象空間である室内を撮影して室内の状態を示す画像である室内画像を生成する。撮像部３２は、室内を撮影できれば、コントローラ１４における搭載位置は限定されない。なお、撮像部３２の撮像範囲は室内広域を撮影できるように広角であることが好ましい。 The imaging unit 32 is a device such as a camera that captures a visible image, and captures a room that is an air-conditioning target space to generate an indoor image that is an image showing the state of the room. The mounting position of the image pickup unit 32 on the controller 14 is not limited as long as the room can be photographed. The imaging range of the imaging unit 32 is preferably a wide angle so that a wide area in the room can be photographed.
　コントローラ通信部３３は、空気調和機１０の運転を遠隔制御するための指示情報を操作部３１から受信する。コントローラ通信部３３は、操作部３１から受信した指示情報を室内機１１の室内機通信部２３に送信する。また、コントローラ通信部３３は、室内機１１の室内機通信部２３から各種情報を受信する。コントローラ通信部３３は、受信した情報を画像処理部３４に送信する。なお、コントローラ通信部３３は、室内機１１に搭載された室内機通信部２３と互いに通信できるものであればよく、通信方法は問わない。コントローラ通信部３３は、データ量の大きい画像通信に対応できる２．４ＧＨｚの帯域の無線ＬＡＮ通信が選定されることが多い。 The controller communication unit 33 receives instruction information for remote control of the operation of the air conditioner 10 from the operation unit 31. The controller communication unit 33 transmits the instruction information received from the operation unit 31 to the indoor unit communication unit 23 of the indoor unit 11. Further, the controller communication unit 33 receives various information from the indoor unit communication unit 23 of the indoor unit 11. The controller communication unit 33 transmits the received information to the image processing unit 34. The controller communication unit 33 may be any communication method as long as it can communicate with the indoor unit communication unit 23 mounted on the indoor unit 11. For the controller communication unit 33, wireless LAN communication in a band of 2.4 GHz that can support image communication with a large amount of data is often selected.
　画像処理部３４は、室内機１１から送信された情報および操作部３１から送信された設定情報、および撮像部３２が撮影した室内画像の情報といった、空気調和機１０の運転に関する各種の情報をユーザーに示すために可視化するための処理を行う。画像処理部３４は、撮像部３２が撮影した室内画像を背景画像として表示部３５に表示させる。また、画像処理部３４は、室内情報処理部２２から送信される室内情報の少なくとも一部を背景画像に重畳して表示部３５に表示させる。 The image processing unit 34 uses various information related to the operation of the air conditioner 10, such as information transmitted from the indoor unit 11, setting information transmitted from the operation unit 31, and information on the indoor image taken by the imaging unit 32. Perform the process for visualization to show in. The image processing unit 34 causes the display unit 35 to display the indoor image taken by the imaging unit 32 as a background image. Further, the image processing unit 34 superimposes at least a part of the indoor information transmitted from the indoor information processing unit 22 on the background image and displays it on the display unit 35.
　画像処理部３４は、撮像部３２において撮影された室内画像から人体を検出することができる。画像処理部３４は、撮像部３２において連続して撮影された２枚の室内画像の輝度の差分から人体を検出することが可能である。連続して撮影された２枚の画像の差分を抽出した場合、人体などの動体がない状態では、差分は常に０となる。一方、動体が存在する場合には、差分が０以外となる。このため、画像処理部３４は、連続して撮影された２枚の画像において差分が０以外となる位置に動体が存在することを検出できる。また、画像処理部３４は、室内情報処理部２２において生成された人体情報における特徴から、室内情報処理部２２で抽出された人体の個人を特定して、すなわち人体がだれであるかを特定して、認識することができる。 The image processing unit 34 can detect the human body from the indoor image taken by the imaging unit 32. The image processing unit 34 can detect the human body from the difference in the brightness of the two indoor images taken continuously by the imaging unit 32. When the difference between two images taken consecutively is extracted, the difference is always 0 in the absence of a moving object such as a human body. On the other hand, when a moving body exists, the difference is other than 0. Therefore, the image processing unit 34 can detect the presence of a moving object at a position where the difference is other than 0 in the two images taken consecutively. Further, the image processing unit 34 identifies the individual of the human body extracted by the indoor information processing unit 22 from the features in the human body information generated by the indoor information processing unit 22, that is, identifies who the human body is. Can be recognized.
　表示部３５は、操作部３１で受け付けた操作内容および画像処理部３４で処理された画像を含む、空気調和機１０の運転に関する各種情報を表示する。 The display unit 35 displays various information related to the operation of the air conditioner 10, including the operation content received by the operation unit 31 and the image processed by the image processing unit 34.
　また、表示部３５は、カラー表示する表示部であってもよく、モノクローム表示するものであってもよい。表示部３５がカラー表示する表示部である場合は、視認性が良く高級感もあるが、表示部材が高価であり消費電力が大きい。このため、ワイヤーレスとして使用するコントローラ１４に、カラー表示する表示部３５を使用した場合は、電池容量の低下が早いため、例えば携帯電話端末のように充電システムが必要になる。一方、表示部３５がモノクローム表示する表示部である場合は、カラー表示する表示部を表示部３５に用いる場合と比べて消費電力を抑えられるため、充電式ではない乾電池で対応することが可能であるが、視認性は低くなる。 Further, the display unit 35 may be a color display unit or a monochrome display unit. When the display unit 35 is a display unit that displays in color, the visibility is good and there is a sense of quality, but the display member is expensive and the power consumption is large. Therefore, when the display unit 35 for color display is used for the controller 14 used as a wireless controller, the battery capacity decreases rapidly, so that a charging system such as a mobile phone terminal is required. On the other hand, when the display unit 35 is a display unit for monochrome display, power consumption can be suppressed as compared with the case where the display unit for color display is used for the display unit 35, so that it is possible to use a non-rechargeable dry battery. However, the visibility is low.
　なお、表示部３５に表示する内容は、リアルタイムに表示される必要はなく、テレビおよびビデオ動画のようなストリーム画像であってもよく、また一定間隔で更新される静止画像であってもよい。表示部３５は、操作部３１が操作されて空気調和機１０の設定が変更されたり、撮像部３２において撮影が行われて画像処理部３４で処理された処理画像の変化を表示部３５に出力するときだけ、表示を変更すればよい。表示部３５には、電子棚札などに使用されているメモリー液晶を使用してもよい。メモリー液晶は、表示内容の書換時には電力を消費するが、表示内容に変化が無いときには低消費電力で駆動できる特徴を有する。このため、コントローラ１４を空気調和機１０の専用コントローラとして使用する場合は、表示部３５にメモリー液晶を用いることで、コントローラ１４の電池寿命を長くできる。 The content displayed on the display unit 35 does not have to be displayed in real time, and may be a stream image such as a television or a video movie, or a still image updated at regular intervals. The display unit 35 outputs to the display unit 35 a change in the processed image processed by the image processing unit 34 after the operation unit 31 is operated to change the setting of the air conditioner 10 or the image pickup unit 32 takes a picture. You only have to change the display when you do. A memory liquid crystal used for an electronic shelf label or the like may be used for the display unit 35. The memory liquid crystal consumes power when rewriting the display contents, but has a feature that it can be driven with low power consumption when there is no change in the display contents. Therefore, when the controller 14 is used as a dedicated controller for the air conditioner 10, the battery life of the controller 14 can be extended by using a memory liquid crystal for the display unit 35.
　また、コントローラ１４は、空気調和機１０専用のものでなくても、操作部３１、撮像部３２、コントローラ通信部３３、画像処理部３４および表示部３５として使用できる機能を備えており、室内機１１の室内機通信部２３と通信できるものであればよい。コントローラ１４は、例えば、ユーザーが使用しているスマートフォンなどの携帯電話端末、またはタブレット端末などの機器を使用することで実現できる。 Further, the controller 14 has a function that can be used as an operation unit 31, an image pickup unit 32, a controller communication unit 33, an image processing unit 34, and a display unit 35 even if it is not dedicated to the air conditioner 10. Anything that can communicate with the indoor unit communication unit 23 of 11 may be used. The controller 14 can be realized by using, for example, a mobile phone terminal such as a smartphone used by the user, or a device such as a tablet terminal.
　一般的な携帯電話端末であれば、ボタン式またはタッチパネル式の表示部、表示のための画像処理部および通信部は必ず搭載されている。通信部については、多くの携帯電話端末に赤外線通信、Ｂｌｕｅｔｏｏｔｈ（登録商標）通信または無線ＬＡＮ通信の機能が搭載されている。したがって、室内機１１の室内機通信部２３をこれらの通信に対応させることで携帯電話端末をコントローラ１４として使用することができる。 If it is a general mobile phone terminal, a button type or touch panel type display unit, an image processing unit for display, and a communication unit are always installed. As for the communication unit, many mobile phone terminals are equipped with infrared communication, Bluetooth (registered trademark) communication, or wireless LAN communication functions. Therefore, the mobile phone terminal can be used as the controller 14 by making the indoor unit communication unit 23 of the indoor unit 11 correspond to these communications.
　図９は、本発明の実施の形態１にかかるコントローラ１４の他の例を示す正面図であり、タッチパネル式の表示部３５ａを備えるコントローラ１４を示す正面図である。コントローラ１４の操作部３１は、図８に示すようなボタン式の操作部３１に限定されず、図９に示すように、操作部３１の機能と表示部３５の機能とを兼ね備えたタッチパネル式の表示部３５ａとして構成されてもよい。図９では、コントローラ１４を操作しているユーザーを含めて、コントローラ１４を操作しているユーザー側から見える仮想的な室内画像を示している。なお、タッチパネル式の表示部３５ａは公知であるため、タッチパネル式の表示部３５ａについての詳細な説明は省略する。 FIG. 9 is a front view showing another example of the controller 14 according to the first embodiment of the present invention, and is a front view showing the controller 14 including the touch panel type display unit 35a. The operation unit 31 of the controller 14 is not limited to the button-type operation unit 31 as shown in FIG. 8, and is a touch panel type that has both the function of the operation unit 31 and the function of the display unit 35 as shown in FIG. It may be configured as a display unit 35a. FIG. 9 shows a virtual indoor image that can be seen from the user side operating the controller 14, including the user operating the controller 14. Since the touch panel type display unit 35a is known, detailed description of the touch panel type display unit 35a will be omitted.
　タッチパネル式の表示部３５ａは、画面上に仮想ボタンが表示されるため、ある操作場面で必要な操作ボタンだけを表示することで操作ボタンの選択数を限定できる。また、タッチパネル式の表示部３５ａは、ユーザーの年齢または好みに対応させてボタンの大きさを変えることで操作性が向上する。ボタン式の操作部は、ユーザーが操作したときにクリック感覚が得られるという利点がある。タッチパネル式の表示部３５ａにおいても、タッチパネル式の表示部３５ａに例えば振動パネルを搭載し、タッチパネルを操作した指先に振動パネルの振動の刺激を与えることでユーザーにクリック感覚を与えてもよい。 Since the touch panel type display unit 35a displays virtual buttons on the screen, the number of operation button selections can be limited by displaying only the operation buttons required in a certain operation scene. Further, the touch panel type display unit 35a improves operability by changing the size of the button according to the age or preference of the user. The button-type operation unit has an advantage that a click feeling can be obtained when the user operates the operation unit. In the touch panel type display unit 35a, for example, a vibrating panel may be mounted on the touch panel type display unit 35a, and the user may be given a click sensation by stimulating the vibration of the vibrating panel to the fingertips operating the touch panel.
　一方で、タッチパネル式の表示部３５ａは、コントローラ１４を操作しようと意図しない場合でも、タッチパネル式の表示部３５ａに触れるだけで操作したものと誤認識されるおそれがある。このため、例えば操作部３１の一部として図９に示すような物理ボタンである決定ボタン３１ａが設けられてもよい。操作部３１は、決定ボタン３１ａが押されることでタッチパネルの動作の有効またはタッチパネルの動作の無効が切り替えられるように構成されて、タッチパネルにおける操作の開始と終了とを特定できるように構成されてもよい。 On the other hand, even if the touch panel type display unit 35a is not intended to operate the controller 14, it may be erroneously recognized that the touch panel type display unit 35a is operated simply by touching the touch panel type display unit 35a. Therefore, for example, a determination button 31a, which is a physical button as shown in FIG. 9, may be provided as a part of the operation unit 31. Even if the operation unit 31 is configured so that the touch panel operation can be enabled or the touch panel operation disabled can be switched by pressing the enter button 31a, and the start and end of the operation on the touch panel can be specified. Good.
　つぎに、空気調和システム１００の動作について説明する。図１０は、本発明の実施の形態１にかかる空気調和システム１００における室内機１１の動作を示すフローチャートである。 Next, the operation of the air conditioning system 100 will be described. FIG. 10 is a flowchart showing the operation of the indoor unit 11 in the air conditioning system 100 according to the first embodiment of the present invention.
　まず、ステップＳ１１０において、室内情報取得部２１が室内情報を取得する。ステップＳ１２０において、室内情報処理部２２は、室内情報取得部２１が取得した室内情報から室内特徴情報６３を抽出する。 First, in step S110, the indoor information acquisition unit 21 acquires indoor information. In step S120, the indoor information processing unit 22 extracts the indoor feature information 63 from the indoor information acquired by the indoor information acquisition unit 21.
　例えば、室内情報取得部２１が図５に示す赤外線センサーである場合、室内情報取得部２１は、監視範囲である室内における広域の表面温度を測定する。赤外線センサーは、予め設定された既定の時間をおいて既定の周期で定期的に監視範囲の赤外線強度を検出する。 For example, when the indoor information acquisition unit 21 is an infrared sensor shown in FIG. 5, the indoor information acquisition unit 21 measures the surface temperature over a wide area in the room, which is the monitoring range. The infrared sensor periodically detects the infrared intensity of the monitoring range at a predetermined cycle at a preset predetermined time.
　赤外線センサーは、検出した赤外線強度の検出結果に対して既定の変換処理を行うことにより、検出した監視範囲の赤外線強度を温度に変換して室内の表面温度の温度分布を示す温度分布情報６１を生成し、室内情報である室内の温度情報として室内情報処理部２２に送信する。温度分布情報６１は、室内情報である。室内情報処理部２２は、室内情報取得部２１から室内の温度情報である温度分布情報６１を受け取り、記憶して保持する。 The infrared sensor converts the infrared intensity of the detected monitoring range into temperature by performing a predetermined conversion process on the detected infrared intensity detection result, and obtains temperature distribution information 61 indicating the temperature distribution of the indoor surface temperature. It is generated and transmitted to the indoor information processing unit 22 as indoor temperature information which is indoor information. The temperature distribution information 61 is indoor information. The indoor information processing unit 22 receives the temperature distribution information 61, which is the temperature information in the room, from the indoor information acquisition unit 21, stores it, and holds it.
　室内情報処理部２２は、室内情報取得部２１から受け取った温度分布情報６１から、室内の表面温度の温度分布を色温度で表現する熱画像の情報である熱画像情報６２を生成する。熱画像情報６２は、室内情報を画像として示す情報である。そして、室内情報処理部２２は、室内における特徴を示す情報である室内特徴情報６３を、熱画像情報６２から抽出する。 The indoor information processing unit 22 generates thermal image information 62, which is thermal image information expressing the temperature distribution of the indoor surface temperature in terms of color temperature, from the temperature distribution information 61 received from the indoor information acquisition unit 21. The thermal image information 62 is information indicating indoor information as an image. Then, the indoor information processing unit 22 extracts the indoor feature information 63, which is information indicating the features in the room, from the thermal image information 62.
　図１１は、本発明の実施の形態１にかかる熱画像の一例を示す図である。熱画像をモノクローム画像で表示する場合には、例えば図１１に示すように温度によって色の濃淡が異なるように表示する。また、熱画像をカラー画像で表示する場合には、例えば高温を赤で表示し、低温を青で表示する。 FIG. 11 is a diagram showing an example of a thermal image according to the first embodiment of the present invention. When displaying a thermal image as a monochrome image, for example, as shown in FIG. 11, the thermal image is displayed so that the shade of color differs depending on the temperature. When the thermal image is displayed as a color image, for example, the high temperature is displayed in red and the low temperature is displayed in blue.
　図１１は、夏場に取得される温度分布情報６１から生成される熱画像を示している。夏場であるので、空気調和機１０は冷房運転を行っており、室内は涼しく、室外は高温であるため、窓７１と壁７２とでは温度差が発生している。図１１に示す熱画像では、図１１に示す熱画像における温度表示の規則および室内空間における物の配置を理解していれば、右側の四角い範囲が窓７１であることが推測できる。しかしながら、熱画像の視認性は写真に比べて低い。このため、一般には、窓が配置されているかどうかを熱画像から推測することは難しい。 FIG. 11 shows a thermal image generated from the temperature distribution information 61 acquired in the summer. Since it is summer, the air conditioner 10 is in a cooling operation, and since the room is cool and the outside is hot, there is a temperature difference between the window 71 and the wall 72. In the thermal image shown in FIG. 11, if the rules of temperature display in the thermal image shown in FIG. 11 and the arrangement of objects in the indoor space are understood, it can be inferred that the square area on the right side is the window 71. However, the visibility of thermal images is lower than that of photographs. For this reason, it is generally difficult to infer from the thermal image whether or not the windows are arranged.
　そこで、室内情報処理部２２は、室内の特徴および室内の状況といった室内における特徴を示す情報である室内特徴情報６３を、熱画像情報６２から抽出する。室内情報処理部２２は、たとえば図１１に示す熱画像における温度の変化点を線で結ぶことで、温度の変化点が接続された線分の情報である室内特徴情報６３を取得する。 Therefore, the indoor information processing unit 22 extracts the indoor feature information 63, which is information indicating the indoor features such as the indoor features and the indoor conditions, from the thermal image information 62. The indoor information processing unit 22 acquires indoor feature information 63, which is information on a line segment to which the temperature change points are connected, by connecting the temperature change points in the thermal image shown in FIG. 11 with a line, for example.
　図１２は、本発明の実施の形態１にかかる熱画像の他の例を示す図である。図１２では、人物が存在する状態の熱画像を示している。室内に人物が存在する場合は、壁および床の温度に比べて人体の温度が高い状態であることが多い。この場合には、室内情報処理部２２は、図１１の場合と同様に図１２に示す熱画像における温度の変化点を線で結ぶことで室内特徴情報６３を抽出し、室内特徴情報６３の形状および大きさから、図１２に示す熱画像における人体６６を抽出することができる。室内情報処理部２２は、熱画像における人体の室内特徴情報６３の形状および大きさに対応する人体判定情報を予め記憶しており、人体判定情報と室内特徴情報６３とを比較して熱画像における人体６６を抽出する。 FIG. 12 is a diagram showing another example of the thermal image according to the first embodiment of the present invention. FIG. 12 shows a thermal image in which a person is present. When a person is present in the room, the temperature of the human body is often higher than the temperature of the walls and floor. In this case, the indoor information processing unit 22 extracts the indoor feature information 63 by connecting the temperature change points in the thermal image shown in FIG. 12 with a line as in the case of FIG. 11, and the shape of the indoor feature information 63. From the size and size, the human body 66 in the thermal image shown in FIG. 12 can be extracted. The indoor information processing unit 22 stores in advance human body determination information corresponding to the shape and size of the indoor feature information 63 of the human body in the thermal image, and compares the human body determination information with the indoor feature information 63 in the thermal image. The human body 66 is extracted.
　なお、人は移動するため、室内情報取得部２１が定期的に室内の表面温度を取得して、温度分布情報６１を室内情報処理部２２に送信する。室内情報処理部２２は、定期的に熱画像情報６２を生成し、熱画像情報６２から時間経過に伴う室内の表面温度の変化の情報と室内の表面温度の変化の大きさを抽出する。そして、室内情報処理部２２は、抽出した情報から、室内の表面温度の変化が予め決められた判定基準よりも速く、周囲に比べて室内の表面温度が高い部分を人体６６として抽出してもよい。また、室内情報処理部２２は、熱画像において温度の絶対値が３６℃付近であるものを人体６６として抽出してもよい。 Since people move, the indoor information acquisition unit 21 periodically acquires the indoor surface temperature and transmits the temperature distribution information 61 to the indoor information processing unit 22. The indoor information processing unit 22 periodically generates thermal image information 62, and extracts information on changes in the indoor surface temperature with the passage of time and the magnitude of changes in the indoor surface temperature from the thermal image information 62. Then, even if the indoor information processing unit 22 extracts from the extracted information a portion where the change in the indoor surface temperature is faster than a predetermined determination criterion and the indoor surface temperature is higher than the surroundings as the human body 66. Good. Further, the indoor information processing unit 22 may extract a thermal image in which the absolute value of the temperature is around 36 ° C. as the human body 66.
　また、室内情報処理部２２は、室内情報取得部２１において連続して取得された２つの室内の表面温度の温度分布における差分から、人体を検出することが可能である。連続して取得された２つの室内の表面温度の温度分布の差分を抽出した場合、人体などの動体がない状態では、差分は常に０となる。一方、動体が存在する場合には、差分が０以外となる。このため、室内情報処理部２２は、連続して撮影された２枚の画像において差分が０以外となる位置に動体が存在することを検出できる。 Further, the indoor information processing unit 22 can detect the human body from the difference in the temperature distribution of the surface temperature of the two rooms continuously acquired by the indoor information acquisition unit 21. When the difference between the temperature distributions of the surface temperatures in two rooms acquired in succession is extracted, the difference is always 0 in the absence of a moving body such as a human body. On the other hand, when a moving body exists, the difference is other than 0. Therefore, the indoor information processing unit 22 can detect the presence of a moving object at a position where the difference is other than 0 in the two images taken consecutively.
　そして、室内情報処理部２２は、検出された動体が予め決められた判定基準よりも小さい場合は、検出された動体がペットまたは落下物であると判定することができる。また、室内情報処理部２２は、検出された動体が予め決められた判定基準よりも大きい場合は、検出された動体がカーテン等の調度品が動作または照明といった人体検出における外乱であると判定することで、人体検出の精度を向上することができる。 Then, when the detected moving object is smaller than the predetermined determination standard, the indoor information processing unit 22 can determine that the detected moving object is a pet or a falling object. Further, when the detected moving object is larger than a predetermined determination criterion, the indoor information processing unit 22 determines that the detected moving object is a disturbance in human body detection such as movement or lighting of furniture such as a curtain. Therefore, the accuracy of human body detection can be improved.
　すなわち、室内情報処理部２２は、熱画像における位置、大きさ、形状および温度の絶対値などから、人の顔、手および足などの人体情報と、床、壁、家具等の室内の物体の情報である物体情報を検出し、認識することができる。人体情報と物体情報には、熱画像における位置の情報、すなわち室内における位置の情報も含まれる。すなわち、室内情報処理部２２は、室内情報から人体を抽出し、室内情報における人体に関する情報である人体情報を抽出して空気調和制御部２４および画像処理部３４に送信する。また、室内情報処理部２２は、室内情報から物体を抽出し、室内情報における物体に関する情報である物体情報を抽出して空気調和制御部２４および画像処理部３４に送信する。 That is, the indoor information processing unit 22 uses human body information such as a human face, hands and feet, and indoor objects such as floors, walls, and furniture from the absolute values of position, size, shape, and temperature in the thermal image. It is possible to detect and recognize object information which is information. The human body information and the object information also include position information in the thermal image, that is, position information in the room. That is, the indoor information processing unit 22 extracts the human body from the indoor information, extracts the human body information which is the information about the human body in the indoor information, and transmits it to the air conditioning control unit 24 and the image processing unit 34. Further, the indoor information processing unit 22 extracts an object from the indoor information, extracts the object information which is information about the object in the indoor information, and transmits the object information to the air conditioning control unit 24 and the image processing unit 34.
　図１３は、本発明の実施の形態１にかかる室内情報処理部２２の内部の記憶部２２１を示す図である。室内情報処理部２２は、温度分布情報６１と、熱画像情報６２と、室内特徴情報６３と、を室内情報処理部２２の内部の記憶部２２１に記憶する。人体情報および室内情報は、室内特徴情報６３に含めて記憶される。なお、人体情報および室内情報は、室内特徴情報６３から独立して取り扱うことも可能である。 FIG. 13 is a diagram showing an internal storage unit 221 of the indoor information processing unit 22 according to the first embodiment of the present invention. The indoor information processing unit 22 stores the temperature distribution information 61, the thermal image information 62, and the indoor feature information 63 in the internal storage unit 221 of the indoor information processing unit 22. The human body information and the indoor information are included in the indoor feature information 63 and stored. The human body information and the indoor information can be handled independently of the indoor feature information 63.
　ステップＳ１３０において、室内情報処理部２２は、熱画像情報６２と室内特徴情報６３とを、コントローラ１４に送信する。具体的に、室内情報処理部２２は、熱画像情報６２と室内特徴情報６３とを、室内機通信部２３とコントローラ通信部３３とを介して画像処理部３４に送信する。画像処理部３４は、熱画像情報６２と室内特徴情報６３とを受信し、記憶する。 In step S130, the indoor information processing unit 22 transmits the thermal image information 62 and the indoor feature information 63 to the controller 14. Specifically, the indoor information processing unit 22 transmits the thermal image information 62 and the indoor feature information 63 to the image processing unit 34 via the indoor unit communication unit 23 and the controller communication unit 33. The image processing unit 34 receives and stores the thermal image information 62 and the indoor feature information 63.
　つぎに、コントローラ１４の動作について説明する。図１４は、本発明の実施の形態１にかかる空気調和システム１００におけるコントローラ１４の動作を示すフローチャートである。図１５は、本発明の実施の形態１にかかる室内画像の一例を示す図である。 Next, the operation of the controller 14 will be described. FIG. 14 is a flowchart showing the operation of the controller 14 in the air conditioning system 100 according to the first embodiment of the present invention. FIG. 15 is a diagram showing an example of an indoor image according to the first embodiment of the present invention.
　まず、ステップＳ２１０において、撮像部３２が、室内の状態を示す画像である室内画像を撮影する。撮像部３２は、室内において室内情報取得部２１が室内情報を取得する範囲を撮影する。撮像部３２は、撮影した室内画像の情報である室内画像情報６４を画像処理部３４に送信する。画像処理部３４は、撮像部３２から送信された室内画像情報６４を受信して記憶する。 First, in step S210, the imaging unit 32 takes an indoor image, which is an image showing the state of the room. The imaging unit 32 captures a range in which the indoor information acquisition unit 21 acquires indoor information in the room. The imaging unit 32 transmits the indoor image information 64, which is the information of the captured indoor image, to the image processing unit 34. The image processing unit 34 receives and stores the indoor image information 64 transmitted from the imaging unit 32.
　ステップＳ２２０において、画像処理部３４は、室内画像から室内画像の特徴を抽出する処理を行って、室内画像の特徴である室内画像特徴情報６５を室内画像の画像情報上で抽出する。画像処理部３４は、抽出した室内画像特徴情報６５を、室内画像情報６４と関連付けして記憶する。室内画像特徴情報６５は、例えば壁、床、窓、テーブルなど、室内において大きい物体の形状および位置、室内画像における壁と床との間の境界線、室内画像における床と窓との間の境界線などが例示される。室内画像特徴情報６５は、撮影場所である室内の特徴とも換言できる。 In step S220, the image processing unit 34 performs a process of extracting the features of the indoor image from the indoor image, and extracts the indoor image feature information 65, which is a feature of the indoor image, on the image information of the indoor image. The image processing unit 34 stores the extracted indoor image feature information 65 in association with the indoor image information 64. The indoor image feature information 65 includes the shape and position of a large object in the room such as a wall, floor, window, and table, the boundary line between the wall and the floor in the indoor image, and the boundary between the floor and the window in the indoor image. An example is a line. The indoor image feature information 65 can be rephrased as a feature of the room where the image is taken.
　例えばコントローラ１４の撮像部３２が、室内機１１の室内情報取得部２１の近くに配置され、室内情報取得部２１が室内情報を取得する場合に室内情報取得部２１が向く方向と同じ方向に撮像部３２が向いた状態で、撮像部３２が室内を撮影する。上述したように室内情報取得部２１である赤外線センサーが室内の表面温度の検出方向を変化させながら室内の表面温度を取得する場合には、赤外線センサーが温度検出範囲の中心を向く方向と同じ方向に撮像部３２を向ける。このようにして撮像部３２が室内画像を撮影することにより、室内情報処理部２２が抽出した室内特徴情報６３と同じ位置となる室内画像特徴情報６５を画像処理部３４が取得することができる。 For example, the imaging unit 32 of the controller 14 is arranged near the indoor information acquisition unit 21 of the indoor unit 11, and when the indoor information acquisition unit 21 acquires indoor information, the image is taken in the same direction as the indoor information acquisition unit 21 faces. The imaging unit 32 takes a picture of the room with the unit 32 facing. As described above, when the infrared sensor, which is the indoor information acquisition unit 21, acquires the indoor surface temperature while changing the indoor surface temperature detection direction, the direction is the same as the direction in which the infrared sensor faces the center of the temperature detection range. The imaging unit 32 is directed toward. When the imaging unit 32 captures the indoor image in this way, the image processing unit 34 can acquire the indoor image feature information 65 at the same position as the indoor feature information 63 extracted by the indoor information processing unit 22.
　撮像部３２は、たとえば室内機１１の前面に設けられてコントローラ１４を保持する保持部にコントローラ１４が保持された状態で室内を撮影する。なお、ユーザーがコントローラ１４を保持した状態で撮像部３２が室内を撮影することも可能である。 The imaging unit 32 takes a picture of the room in a state where the controller 14 is held by a holding unit provided on the front surface of the indoor unit 11 and holding the controller 14, for example. It is also possible for the imaging unit 32 to take a picture of the room while the user holds the controller 14.
　ステップＳ２３０において、画像処理部３４は、熱画像情報６２と、室内特徴情報６３と、室内画像情報６４と、室内画像特徴情報６５とを用いて、熱画像と室内画像とを重ね合わせた状態で室内における同一の部分を示す室内特徴情報６３と室内画像特徴情報６５とが一致するように、室内画像を拡大または縮小する処理を行う。すなわち、画像処理部３４は、室内における同一の部分を示す室内特徴情報６３と室内画像特徴情報６５とが一致するように室内画像の縮尺を調整する。画像処理部３４は、縮尺が調整された後の室内画像情報６４を記憶する。また、画像処理部３４は、必要な場合は室内画像の位置を移動させる処理およびトリミングといった画像処理を室内画像に対して行って、室内における同一の部分を示す室内特徴情報６３と室内画像特徴情報６５とが一致するように室内画像を補正する。 In step S230, the image processing unit 34 uses the thermal image information 62, the indoor feature information 63, the indoor image information 64, and the indoor image feature information 65 in a state where the thermal image and the indoor image are superimposed. A process of enlarging or reducing the indoor image is performed so that the indoor feature information 63 indicating the same portion in the room and the indoor image feature information 65 match. That is, the image processing unit 34 adjusts the scale of the indoor image so that the indoor feature information 63 indicating the same part in the room and the indoor image feature information 65 match. The image processing unit 34 stores the indoor image information 64 after the scale has been adjusted. Further, the image processing unit 34 performs image processing such as moving the position of the indoor image and trimming the indoor image if necessary, and performs indoor feature information 63 and indoor image feature information indicating the same part in the room. The indoor image is corrected so that it matches 65.
　そして、画像処理部３４は、縮尺が調整された後の室内画像を背景画像として、図１５のようにコントローラ１４のタッチパネル式の表示部３５ａに表示させる。 Then, the image processing unit 34 displays the indoor image after the scale has been adjusted as a background image on the touch panel type display unit 35a of the controller 14 as shown in FIG.
　このようにして背景画像がタッチパネル式の表示部３５ａに表示されることで、ユーザーは、室内情報取得部２１が取得した熱画像だけでは判別しにくかった窓および家具等を、タッチパネル式の表示部３５ａに表示された背景画像によって視覚的におよび直感的に認識することができ、室内の状態の視認性が改善される。 By displaying the background image on the touch panel type display unit 35a in this way, the user can use the touch panel type display unit to display windows, furniture, and the like that are difficult to discriminate only from the thermal image acquired by the indoor information acquisition unit 21. The background image displayed on the 35a can be visually and intuitively recognized, and the visibility of the indoor state is improved.
　ステップＳ２４０において、画像処理部３４は、タッチパネル式の表示部３５ａに表示する背景画像に、熱画像情報６２で表される熱画像の少なくとも一部を重畳する。すなわち、画像処理部３４は、タッチパネル式の表示部３５ａに表示する背景画像に、室内情報の少なくとも一部を重畳する。図１６は、本発明の実施の形態１における人体を含む熱画像の一例を示す図である。図１７は、本発明の実施の形態１において熱画像の人体エリアが重畳された背景画像の一例を示す図である。 In step S240, the image processing unit 34 superimposes at least a part of the thermal image represented by the thermal image information 62 on the background image displayed on the touch panel type display unit 35a. That is, the image processing unit 34 superimposes at least a part of the room information on the background image displayed on the touch panel type display unit 35a. FIG. 16 is a diagram showing an example of a thermal image including a human body according to the first embodiment of the present invention. FIG. 17 is a diagram showing an example of a background image in which a human body area of a thermal image is superimposed in the first embodiment of the present invention.
　図１６に示すように、画像処理部３４に記憶された熱画像情報６２で表される熱画像に人体６６が含まれる場合に、画像処理部３４は、室内情報処理部２２から送信された人体情報に基づいて、人体６６および人体６６の周囲を含む人体エリアを熱画像上で抽出する。そして、画像処理部３４は、図１７に示すように、タッチパネル式の表示部３５ａに表示する背景画像に、抽出した人体エリアの熱画像７３を重畳して表示してもよい。上述したように、室内における同一の部分を示す室内特徴情報６３と室内画像特徴情報６５とが一致するように室内画像の縮尺が調整されているため、背景画像に重畳される人体エリアの熱画像７３は背景画像において人体６６に一致した状態で重畳される。 As shown in FIG. 16, when the human body 66 is included in the thermal image represented by the thermal image information 62 stored in the image processing unit 34, the image processing unit 34 is the human body transmitted from the indoor information processing unit 22. Based on the information, the human body 66 and the human body area including the periphery of the human body 66 are extracted on the thermal image. Then, as shown in FIG. 17, the image processing unit 34 may superimpose the extracted thermal image 73 of the human body area on the background image displayed on the touch panel type display unit 35a. As described above, since the scale of the indoor image is adjusted so that the indoor feature information 63 indicating the same part in the room and the indoor image feature information 65 match, the thermal image of the human body area superimposed on the background image. 73 is superimposed on the background image in a state of matching the human body 66.
　これにより、ユーザーは、室内情報取得部２１が取得した熱画像だけでは判別しにくかった室内の状態を、タッチパネル式の表示部３５ａに表示された背景画像、および背景画像に重畳された人体エリアの熱画像７３によって視覚的におよび直感的に認識することができ、タッチパネル式の表示部３５ａに表示される室内の状態の視認性が改善される。したがって、空気調和システム１００では、室内の熱画像だけで室内の状態をタッチパネル式の表示部３５ａに表示する場合に比べて、室内の状態の視認性を改善できる。 As a result, the user can determine the indoor state, which is difficult to determine only by the thermal image acquired by the indoor information acquisition unit 21, in the background image displayed on the touch panel type display unit 35a and the human body area superimposed on the background image. The thermal image 73 can be visually and intuitively recognized, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. Therefore, in the air conditioning system 100, the visibility of the indoor state can be improved as compared with the case where the indoor state is displayed on the touch panel type display unit 35a only by the thermal image of the room.
　さらに、画像処理部３４は、タッチパネル式の表示部３５ａに表示する背景画像に、画像処理部３４に記憶された熱画像情報６２で表される熱画像を半透過の状態で重畳してもよい。この場合も、ユーザーは、室内情報取得部２１が取得した熱画像だけでは判別しにくかった室内の状態を、タッチパネル式の表示部３５ａに表示された背景画像、およびタッチパネル式の表示部３５ａに重畳された熱画像によって視覚的におよび直感的に認識することができ、タッチパネル式の表示部３５ａに表示される室内の状態の視認性が改善される。 Further, the image processing unit 34 may superimpose the thermal image represented by the thermal image information 62 stored in the image processing unit 34 on the background image displayed on the touch panel type display unit 35a in a semi-transparent state. .. In this case as well, the user superimposes the indoor state, which was difficult to determine only by the thermal image acquired by the indoor information acquisition unit 21, on the background image displayed on the touch panel type display unit 35a and the touch panel type display unit 35a. The thermal image can be visually and intuitively recognized, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved.
　なお、ステップＳ２２０において、コントローラ１４の撮像部３２は、室内情報取得部２１が室内情報を取得する場合に室内情報取得部２１が向く方向と完全に同じ方向に撮像部３２が向いた状態で室内を撮影する必要はない。すなわち、室内画像は、背景画像に熱画像の少なくとも一部を重畳することにより、背景画像と熱画像とによって室内の状態を視覚的におよび直感的に認識することができ、タッチパネル式の表示部３５ａに表示される室内の状態の視認性が改善される程度に、室内情報取得部２１が室内情報を取得する場合に室内情報取得部２１が向く方向とおよそ同じ方向を向いた状態で撮影された画像であればよい。したがって、コントローラ１４の撮像部３２は、室内情報取得部２１が室内情報を取得する場合に室内情報取得部２１が向く方向と完全に同じ方向に撮像部３２が向いた状態で室内を撮影できなくてもかまわない。 In step S220, the image pickup unit 32 of the controller 14 is in a state where the image pickup unit 32 faces in exactly the same direction as the room information acquisition unit 21 faces when the room information acquisition unit 21 acquires the room information. There is no need to shoot. That is, in the indoor image, by superimposing at least a part of the thermal image on the background image, the indoor state can be visually and intuitively recognized by the background image and the thermal image, and the touch panel type display unit. When the indoor information acquisition unit 21 acquires indoor information, the image is taken in a state in which the indoor information acquisition unit 21 faces approximately the same direction as the indoor information acquisition unit 21 faces to the extent that the visibility of the indoor state displayed on 35a is improved. Any image will do. Therefore, the image pickup unit 32 of the controller 14 cannot take a picture of the room in a state where the image pickup unit 32 faces in exactly the same direction as the room information acquisition unit 21 faces when the room information acquisition unit 21 acquires the room information. It doesn't matter.
　そして、ステップＳ２３０において、熱画像と室内画像とを重ね合わせた状態で室内における同一の部分を示す室内特徴情報６３と室内画像特徴情報６５とは、完全に一致しなくてもよい。すなわち、熱画像と室内画像とを重ね合わせた状態で室内における同一の部分を示す室内特徴情報６３と室内画像特徴情報６５とは、背景画像に熱画像の少なくとも一部を重畳することにより、背景画像と熱画像とによって室内の状態を視覚的におよび直感的に認識することができ、タッチパネル式の表示部３５ａに表示される室内の状態の視認性が改善される程度に、一致していればよい。 Then, in step S230, the indoor feature information 63 and the indoor image feature information 65, which indicate the same part in the room in a state where the thermal image and the indoor image are superimposed, do not have to completely match. That is, the indoor feature information 63 and the indoor image feature information 65, which indicate the same part in the room in a state where the thermal image and the indoor image are superimposed, are obtained by superimposing at least a part of the thermal image on the background image. The indoor state can be visually and intuitively recognized by the image and the thermal image, and they match to the extent that the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. Just do it.
　したがって、室内画像は、熱画像と室内画像とを重ね合わせた状態で室内における同一の部分を示す室内特徴情報６３と室内画像特徴情報６５とは、室内特徴情報６３で表される室内の部分と、室内画像特徴情報６５で表される室内の部分とが、予め決められた範囲内に入る程度に、拡大または縮小されればよい。一例として、室内特徴情報６３で表される室内の部分と室内画像特徴情報６５で表される室内の部分とが、室内画像を拡大または縮小することにより、室内画像において予め決められた距離の範囲内に入る状態とされていればよい。また、他の例として、室内画像を拡大または縮小することにより、室内の１つの部分について、室内特徴情報６３で表される室内の部分と室内画像特徴情報６５で表される室内の部分とが一致しており、室内の他の１つの部分について、室内特徴情報６３で表される室内の部分と室内画像特徴情報６５で表される室内の部分とが、室内画像において予め決められた距離の範囲内に入る状態とされていればよい。 Therefore, in the indoor image, the indoor feature information 63 and the indoor image feature information 65 indicating the same part in the room in a state where the thermal image and the indoor image are superimposed are the indoor part represented by the indoor feature information 63. The indoor portion represented by the indoor image feature information 65 may be enlarged or reduced to the extent that it falls within a predetermined range. As an example, the indoor part represented by the indoor feature information 63 and the indoor part represented by the indoor image feature information 65 are within a predetermined distance range in the indoor image by enlarging or reducing the indoor image. It suffices if it is in a state of being inside. Further, as another example, by enlarging or reducing the indoor image, for one part of the room, the indoor part represented by the indoor feature information 63 and the indoor part represented by the indoor image feature information 65 can be obtained. As for the other part of the room, the indoor part represented by the indoor feature information 63 and the indoor part represented by the indoor image feature information 65 are at a predetermined distance in the indoor image. It suffices if it is within the range.
　上記においては、撮像部３２によって撮影される撮影対象が、室内情報取得部２１が室内情報を取得する範囲とされた場合について説明した。撮像部３２は、さらにユーザーの顔の撮影画像を撮影してもよい。図１８は、本発明の実施の形態１において熱画像の人体６６の顔部分にユーザーの顔画像７４が重畳された状態を拡大して示す図である。図１８に示される熱画像は、夏場に取得される温度分布情報６１から生成される熱画像を示している。 In the above, the case where the photographing target photographed by the imaging unit 32 is within the range in which the indoor information acquisition unit 21 acquires the indoor information has been described. The imaging unit 32 may further capture a captured image of the user's face. FIG. 18 is an enlarged view showing a state in which the user's face image 74 is superimposed on the face portion of the human body 66 in the thermal image in the first embodiment of the present invention. The thermal image shown in FIG. 18 shows a thermal image generated from the temperature distribution information 61 acquired in the summer.
　例えば、上述した図１２に示すように、人体６６を含む熱画像がある場合に、熱画像における人体６６の顔部分に、ユーザーの顔画像７４を重畳してもよい。この場合、ユーザーの顔画像７４が、撮像部３２により撮影される。そして、画像処理部３４が、図１２に示す熱画像における人体６６の顔部分の大きさに合うように、ユーザーの顔画像７４を拡大または縮小し、必要な場合にはトリミングをして、ユーザーの顔画像７４を加工する。画像処理部３４は、加工後のユーザーの顔画像７４を、図１８に示すように熱画像における人体６６の顔部分に重畳する処理を行う。 For example, as shown in FIG. 12 described above, when there is a thermal image including the human body 66, the user's face image 74 may be superimposed on the face portion of the human body 66 in the thermal image. In this case, the user's face image 74 is captured by the imaging unit 32. Then, the image processing unit 34 enlarges or reduces the user's face image 74 so as to match the size of the face portion of the human body 66 in the thermal image shown in FIG. 12, and trims the user's face image 74 if necessary. Face image 74 is processed. The image processing unit 34 performs a process of superimposing the processed user's face image 74 on the face portion of the human body 66 in the thermal image as shown in FIG.
　そして、同様の処理を行うことにより、加工後のユーザーの顔画像７４を、上述した図１６に示すような熱画像における人体６６の顔部分に重畳することができる。そして、図１７に示したようにタッチパネル式の表示部３５ａに表示された背景画像に人体エリアの熱画像７３を重畳する際に、ユーザーの顔画像７４が重畳された熱画像から人体エリアを抽出して、ユーザーの顔画像７４が重畳された人体エリアの熱画像７３を背景画像に重畳することができる。 Then, by performing the same processing, the processed user's face image 74 can be superimposed on the face portion of the human body 66 in the thermal image as shown in FIG. 16 described above. Then, when the thermal image 73 of the human body area is superimposed on the background image displayed on the touch panel type display unit 35a as shown in FIG. 17, the human body area is extracted from the thermal image on which the user's face image 74 is superimposed. Then, the thermal image 73 of the human body area on which the user's face image 74 is superimposed can be superimposed on the background image.
　この場合も、ユーザーは、室内情報取得部２１が取得した熱画像だけでは判別しにくかった室内の状態を、タッチパネル式の表示部３５ａに表示された背景画像、背景画像に重畳された人体エリアの熱画像、および人体エリアの熱画像に重畳されたユーザーの顔画像７４によって視覚的におよび直感的に認識することができ、タッチパネル式の表示部３５ａに表示される室内の状態の視認性が改善される。 In this case as well, the user can determine the indoor state, which is difficult to determine only from the thermal image acquired by the indoor information acquisition unit 21, in the background image displayed on the touch panel type display unit 35a and the human body area superimposed on the background image. It can be visually and intuitively recognized by the thermal image and the user's face image 74 superimposed on the thermal image of the human body area, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. Will be done.
　また、ユーザーの顔画像７４の代わりに、ユーザーによって作成された似顔絵の画像またはアイコンが図１６に示す熱画像の顔部分に重畳されて、図１７に示す人体エリアの熱画像の顔部分に重畳されてもよい。画像処理部３４は、ユーザーによって作成された似顔絵の画像またはアイコンを、コントローラ通信部３３経由で外部の機器から直接取得することができる。また、画像処理部３４は、その他の絵の画像またはアイコンを、コントローラ通信部３３およびインターネット経由で外部の機器から取得することができる。 Further, instead of the user's face image 74, a caricature image or icon created by the user is superimposed on the face portion of the thermal image shown in FIG. 16 and superimposed on the face portion of the thermal image of the human body area shown in FIG. May be done. The image processing unit 34 can directly acquire the caricature image or icon created by the user from an external device via the controller communication unit 33. Further, the image processing unit 34 can acquire images or icons of other pictures from the controller communication unit 33 and an external device via the Internet.
　すなわち、画像処理部３４は、撮像部３２において撮影された画像、またはコントローラ１４の外部の機器から取得した画像もしくはアイコンを、室内画像において人体情報により特定される人体の位置に重畳することができる。撮像部３２において撮影された画像、コントローラ１４の外部の機器から取得した画像およびコントローラ１４の外部の機器から取得したアイコンは、室内の状態に関する情報である室内情報に基づいて特定されて選択されるものであり、室内情報の１つといえる。 That is, the image processing unit 34 can superimpose the image taken by the imaging unit 32 or the image or icon acquired from the external device of the controller 14 on the position of the human body specified by the human body information in the indoor image. .. The image captured by the image pickup unit 32, the image acquired from the external device of the controller 14, and the icon acquired from the external device of the controller 14 are specified and selected based on the indoor information which is the information about the indoor state. It can be said that it is one of the indoor information.
　また、人体エリアの熱画像に重畳される顔画像等が１パターンのみである場合には、空気調和空間である室内に複数人が存在した場合に、どの位置に誰が存在するのかという観点で視認性が低下する。このため、画像処理部３４に予め記憶されている画像が、人体エリアの熱画像に重畳されてもよい。画像処理部３４は、室内情報処理部２２から取得した室内特徴情報６３に含まれる人体情報の特徴に基づいて、画像処理部３４に予め記憶されている複数の画像から人体情報の特徴に対応する画像を選択して、選択した画像を人体エリアの熱画像に重畳する。人体情報の特徴は、人体の大きさ、人体が検出された時間帯、室内における人体の位置、人体の温度の絶対値などが例示される。 Further, when there is only one pattern such as a face image superimposed on the thermal image of the human body area, when there are a plurality of people in the room which is an air-conditioned space, it is visually recognized from the viewpoint of who is present at which position. The sex is reduced. Therefore, the image stored in advance in the image processing unit 34 may be superimposed on the thermal image of the human body area. The image processing unit 34 corresponds to the characteristics of the human body information from a plurality of images stored in advance in the image processing unit 34 based on the characteristics of the human body information included in the indoor feature information 63 acquired from the indoor information processing unit 22. Select an image and superimpose the selected image on the thermal image of the human body area. The characteristics of the human body information are exemplified by the size of the human body, the time zone when the human body is detected, the position of the human body in the room, the absolute value of the temperature of the human body, and the like.
　画像処理部３４は、人体情報の特徴に対応する、予め画像処理部３４に記憶された画像またはアイコンを、タッチパネル式の表示部３５ａに表示された室内画像において人体情報の特徴により特定される人の検出位置に重畳する。例えば空気調和システム１００が住宅に設置されている場合、画像処理部３４は、検出された大きさが大きい人体はお父さん、日中に動いている状態が検出された人体はお母さん、ソファーに座っている状態が検出された人体は子供、検出された温度が予め決められた温度よりも高い人体は赤ちゃん、と判定してもよい。すなわち、画像処理部３４は、人体情報の特徴に基づいて人体の個人を特定して認識できる。 The image processing unit 34 is a person whose image or icon stored in advance in the image processing unit 34 corresponding to the characteristics of the human body information is specified by the characteristics of the human body information in the indoor image displayed on the touch panel type display unit 35a. It is superimposed on the detection position of. For example, when the air conditioning system 100 is installed in a house, the image processing unit 34 sits on the sofa, where the detected large human body is the father, and the detected human body is the mother during the daytime. It may be determined that the human body in which the present state is detected is a child, and the human body in which the detected temperature is higher than a predetermined temperature is a baby. That is, the image processing unit 34 can identify and recognize an individual in the human body based on the characteristics of the human body information.
　このように人体情報の特徴によって人体の個人、すなわち人体の種別を判定するための判定基準は、画像処理部３４に予め記憶される。ユーザーは簡易な選択により家族の人体情報の特徴をコントローラ１４に入力することができるようにすることで、熱画像において検出される人体が家族のだれであるかを画像処理部３４が識別できる。そして、画像処理部３４は、識別される個人ごとに画像またはアイコン等を関連付けて記憶しておく。これにより、画像処理部３４は、複数人が室内に存在している場合でも、検出された人体情報の特徴に対応する個人に対応した画像またはアイコン等をコントローラ１４のタッチパネル式の表示部３５ａに表示された背景画像に重畳表示し、誰がどの位置に存在しているかを視覚的におよび直感的に判断できる。 In this way, the determination criteria for determining the individual of the human body, that is, the type of the human body based on the characteristics of the human body information is stored in advance in the image processing unit 34. By allowing the user to input the characteristics of the human body information of the family to the controller 14 by a simple selection, the image processing unit 34 can identify who the human body detected in the thermal image is in the family. Then, the image processing unit 34 stores an image, an icon, or the like in association with each identified individual. As a result, even when a plurality of people are present in the room, the image processing unit 34 displays an image or an icon or the like corresponding to the individual corresponding to the characteristics of the detected human body information on the touch panel type display unit 35a of the controller 14. By superimposing it on the displayed background image, it is possible to visually and intuitively determine who is in what position.
　また、人体の表面的な特徴だけでなく、個人ごとの顔情報に加えて、ユーザーの各個人が好む空気調和設定の情報である好みの空気調和設定情報６７が画像処理部３４に記憶されてもよい。タッチパネル式の表示部３５ａに表示された人の画像、背景画像に重畳された顔画像、絵の画像またはアイコンに対応する領域がタップされることにより、予め登録された好みの空気調和設定情報６７がタッチパネル式の表示部３５ａに表示されてもよい。すなわち、画像処理部３４は、人体情報の特徴により特定される、タッチパネル式の表示部３５ａに表示されている個人を選択する情報が操作部３１に入力された場合に、背景画像に表示されている個人を選択する情報を受信して、選択された人の情報に対応する好みの空気調和設定情報６７をタッチパネル式の表示部３５ａに表示させてもよい。好みの空気調和設定情報６７は、上述した人体情報の特徴によって人体の個人を判定するための判定基準に関連付けられているため、背景画像に表示されている個人が選択されることにより、好みの空気調和設定情報６７が選択される。 Further, in addition to the superficial features of the human body, in addition to the face information for each individual, the favorite air conditioning setting information 67, which is the information of the air conditioning setting preferred by each individual user, is stored in the image processing unit 34. May be good. By tapping the area corresponding to the image of the person displayed on the touch panel type display unit 35a, the face image superimposed on the background image, the picture image or the icon, the pre-registered favorite air conditioning setting information 67 May be displayed on the touch panel type display unit 35a. That is, the image processing unit 34 is displayed on the background image when the information for selecting an individual displayed on the touch panel type display unit 35a, which is specified by the characteristics of the human body information, is input to the operation unit 31. The information for selecting an individual may be received, and the favorite air harmony setting information 67 corresponding to the information of the selected person may be displayed on the touch panel type display unit 35a. Since the preferred air-conditioning setting information 67 is associated with the determination criteria for determining an individual in the human body based on the above-mentioned characteristics of the human body information, the individual displayed in the background image is selected to be preferred. Air conditioning setting information 67 is selected.
　そして、画像処理部３４は、タッチパネル式の表示部３５ａに表示された好みの空気調和設定情報６７がタップされた場合に、タップされた好みの空気調和設定情報６７をコントローラ通信部３３および室内機通信部２３を介して空気調和制御部２４に送信する。すなわち、画像処理部３４は、選択した人の好みの空気調和設定情報６７を選択する情報が操作部３１により入力された場合に、選択された好みの空気調和設定情報６７を新たな空気調和設定情報として空気調和制御部２４に送信する。空気調和制御部２４は、好みの空気調和設定情報６７を受信し、好みの空気調和設定情報６７に基づいて空気調和機１０の運転を制御する。 Then, when the favorite air conditioning setting information 67 displayed on the touch panel type display unit 35a is tapped, the image processing unit 34 sends the tapped favorite air conditioning setting information 67 to the controller communication unit 33 and the indoor unit. It is transmitted to the air conditioning control unit 24 via the communication unit 23. That is, when the information for selecting the selected person's favorite air conditioning setting information 67 is input by the operation unit 31, the image processing unit 34 sets the selected favorite air conditioning setting information 67 as a new air conditioning setting. It is transmitted to the air conditioning control unit 24 as information. The air conditioning control unit 24 receives the favorite air conditioning setting information 67 and controls the operation of the air conditioner 10 based on the favorite air conditioning setting information 67.
　このようにユーザーの好みの空気調和設定情報６７が自動で空気調和機１０の運転に反映されることにより、ユーザーにおける空気調和機１０の空気調和設定の操作性を改善できる。このとき、１回のタップで設定が反映されると誤操作になるおそれがあるため、画像処理部３４は、２回のタップで設定が反映される制御、または１回目のタップで同意確認が表示される制御を行ってもよい。また、空気調和設定の一部の情報を変更したい場合は、タッチパネル式の表示部３５ａに表示された画面において変更したい情報を長押しすると画像処理部３４において編集ができるようにされてもよい。 By automatically reflecting the user's favorite air conditioning setting information 67 in the operation of the air conditioner 10, the operability of the air conditioning setting of the air conditioner 10 can be improved by the user. At this time, if the setting is reflected by one tap, an erroneous operation may occur. Therefore, the image processing unit 34 controls the setting to be reflected by two taps, or displays the consent confirmation by the first tap. Control may be performed. Further, when it is desired to change a part of the information of the air conditioning setting, the image processing unit 34 may be able to edit by long-pressing the information to be changed on the screen displayed on the touch panel type display unit 35a.
　なお、室内情報処理部２２は、上述したように人の顔、手および足などの人体情報と、床、壁、家具等の室内の物体の情報である物体情報を検出し、認識することができる。人体情報と物体情報には、熱画像における位置の情報、すなわち室内における位置の情報も含まれる。室内情報処理部２２は、人体情報と物体情報とを、空気調和制御部２４に送信する。 As described above, the indoor information processing unit 22 can detect and recognize human body information such as a person's face, hands and feet, and object information which is information on indoor objects such as floors, walls and furniture. it can. The human body information and the object information also include position information in the thermal image, that is, position information in the room. The indoor information processing unit 22 transmits human body information and object information to the air conditioning control unit 24.
　そして、画像処理部３４は、操作部３１によって選択された人の人体情報と、操作部３１によって選択された人に対応する好みの空気調和設定情報６７とを関連付けて空気調和制御部２４に送信してもよい。選択された人の人体情報には、背景画像における位置の情報、すなわち室内における位置の情報も含まれる。 Then, the image processing unit 34 associates the human body information of the person selected by the operation unit 31 with the favorite air conditioning setting information 67 corresponding to the person selected by the operation unit 31 and transmits the information to the air conditioning control unit 24. You may. The human body information of the selected person also includes position information in the background image, that is, position information in the room.
　空気調和制御部２４は、室内情報処理部２２から送信された人体情報と、操作部３１によって選択された人の人体情報と、画像処理部３４から送信された選択された人の好みの空気調和設定情報６７とに基づいて、操作部３１によって選択された人の室内における位置を特定する。そして、空気調和制御部２４は、操作部３１によって選択された人に対応する好みの空気調和設定情報６７に基づいて、例えば暑がりの人体が右方向にいる場合には、気流が暑がりの人体に当たるように、第１風向変更部２５ａおよび第２風向変更部２５ｂが右方向に向くように空気調和変更部２５を制御する。空気調和制御部２４は、操作部３１によって選択された人の好みの空気調和設定情報６７の内容から操作部３１によって選択された人が暑がりである、または寒がりであるなどの体質を判定できる。暑がりである体質または寒がりである体質を判定するための空気調和設定の基準は、予め空気調和制御部２４に記憶されている。 The air conditioning control unit 24 has the human body information transmitted from the indoor information processing unit 22, the human body information of the person selected by the operation unit 31, and the preferred air conditioning of the selected person transmitted from the image processing unit 34. Based on the setting information 67, the position of the person selected by the operation unit 31 in the room is specified. Then, the air conditioning control unit 24 hits the hot human body, for example, when the hot human body is in the right direction, based on the favorite air conditioning setting information 67 corresponding to the person selected by the operation unit 31. As described above, the air conditioning changing unit 25 is controlled so that the first wind direction changing unit 25a and the second wind direction changing unit 25b face to the right. The air conditioning control unit 24 can determine the constitution of the person selected by the operation unit 31 such as being hot or cold from the contents of the person's favorite air conditioning setting information 67 selected by the operation unit 31. .. The criteria for setting the air conditioning for determining the constitution that is hot or the constitution that is cold is stored in advance in the air conditioning control unit 24.
　また、空気調和制御部２４は、画像処理部３４から送信された、操作部３１によって選択された人の人体情報のみによって、操作部３１によって選択された人の室内における位置を特定することも可能である。 Further, the air conditioning control unit 24 can specify the position of the person selected by the operation unit 31 in the room only by the human body information of the person selected by the operation unit 31 transmitted from the image processing unit 34. Is.
　図１９は、本発明の実施の形態１にかかる画像処理部３４の記憶部３４１を示す図である。画像処理部３４は、室内画像情報６４と、室内画像特徴情報６５と、好みの空気調和設定情報６７とを画像処理部３４の内部の記憶部３４１に記憶する。 FIG. 19 is a diagram showing a storage unit 341 of the image processing unit 34 according to the first embodiment of the present invention. The image processing unit 34 stores the indoor image information 64, the indoor image feature information 65, and the favorite air harmony setting information 67 in the internal storage unit 341 of the image processing unit 34.
　図２０は、本発明の実施の形態１におけるコントローラ１４の操作により空気調和設定を設定する状態を示す図である。図２０では、人体のアイコンが重畳された背景画像がタッチパネル式の表示部３５ａに表示された状態を示している。ユーザーは、コントローラ１４の操作によって空気調和設定を操作することができる。ユーザーは、室内に居るユーザーの近くの現在の室内温度が何度であるかを認識することができると、現在の室内温度より何度上げ下げすればよいのかを判断しやすくなる。 FIG. 20 is a diagram showing a state in which the air conditioning setting is set by operating the controller 14 in the first embodiment of the present invention. FIG. 20 shows a state in which a background image on which an icon of a human body is superimposed is displayed on a touch panel type display unit 35a. The user can operate the air conditioning setting by operating the controller 14. If the user can recognize what the current room temperature is near the user in the room, it becomes easier to determine how many times the temperature should be raised or lowered from the current room temperature.
　このため、図２０に示すように、画像処理部３４は、タッチパネル式の表示部３５ａにおいてタッチされた位置の温度を示す温度表示８１をタッチパネル式の表示部３５ａに表示させる。温度表示８１により表示される温度は、空気調和機１０における設定温度ではなく、室内情報取得部２１により検出される室内温度または室内機１１から吹き出される気流の吹き出し温度から算出される気流温度である。 Therefore, as shown in FIG. 20, the image processing unit 34 causes the touch panel type display unit 35a to display the temperature display 81 indicating the temperature of the touched position on the touch panel type display unit 35a. The temperature displayed by the temperature display 81 is not the set temperature in the air conditioner 10, but the indoor temperature detected by the indoor information acquisition unit 21 or the airflow temperature calculated from the airflow temperature blown out from the indoor unit 11. is there.
　図２１は、本発明の実施の形態１におけるコントローラ１４の操作により空気調和設定における室内温度を設定する方法を示す図である。図２０に示すようにタッチパネル式の表示部３５ａに表示された温度表示８１をタップする、または１秒以上長押しすると、図２１に示すように空気調和設定画面に切り替わる。空気調和設定画面では、温度表示８１の横に、温度表示８１で示される現在の温度を中心に上下幅を有する複数の温度候補８２が表示され、希望する室内温度８３を選択可能とされる。タッチパネル式の表示部３５ａに表示された温度候補８２をタップして選択することで室内温度の空気調和設定を変更することができる。図２１においては、希望する室内温度８３として２１℃が選択された状態を示している。 FIG. 21 is a diagram showing a method of setting the room temperature in the air conditioning setting by operating the controller 14 in the first embodiment of the present invention. When the temperature display 81 displayed on the touch panel type display unit 35a as shown in FIG. 20 is tapped or held down for 1 second or longer, the screen switches to the air conditioning setting screen as shown in FIG. 21. On the air conditioning setting screen, a plurality of temperature candidates 82 having a vertical width centered on the current temperature indicated by the temperature display 81 are displayed next to the temperature display 81, and a desired indoor temperature 83 can be selected. The air conditioning setting of the room temperature can be changed by tapping and selecting the temperature candidate 82 displayed on the touch panel type display unit 35a. FIG. 21 shows a state in which 21 ° C. is selected as the desired room temperature 83.
　希望する室内温度８３の選択時に誤った選択が反映されないように、タッチパネル式の表示部３５ａにおける希望する室内温度８３の選択後に、希望する室内温度８３の選択の反映の同意を確認するメッセージがタッチパネル式の表示部３５ａに表示されるようにしてもよい。そして、ユーザーがメッセージをタップすることで、希望する室内温度８３の選択が空気調和設定に反映されるようにしてもよい。 After selecting the desired room temperature 83 on the touch panel type display unit 35a, a message confirming consent to reflect the selection of the desired room temperature 83 is displayed on the touch panel so that the wrong selection is not reflected when the desired room temperature 83 is selected. It may be displayed on the display unit 35a of the expression. Then, the user may tap the message so that the selection of the desired room temperature 83 is reflected in the air conditioning setting.
　図２１に示す例では、温度表示８１で示される現在の室内温度から０．５℃刻みに上下２℃において変更できる。一般に定常的に空気調和機を使用している状態であれば、室内温度を０．５℃上げるだけでもユーザーの寒さの体感は解消されることが多い。したがって、室内温度の設定の変更幅が２℃あれば、ユーザーの寒さの体感の解消に対応できる。仮に室内温度の設定を２℃変更した後でもユーザーの寒さの体感の解消が不十分である場合は、温度表示８１を再度タッチすると変更後の温度を中心に温度候補８２が上下２℃の幅で表示され、さらに希望する室内温度８３を変更できる。したがって、必ずしも当初の室内温度から２℃の範囲でしか希望する室内温度８３が変更できないということはない。 In the example shown in FIG. 21, the current room temperature indicated by the temperature display 81 can be changed in 0.5 ° C increments at 2 ° C above and below. Generally, if the air conditioner is constantly used, the user's feeling of coldness is often eliminated even by raising the room temperature by 0.5 ° C. Therefore, if the change range of the room temperature setting is 2 ° C., it is possible to eliminate the user's feeling of cold. If the user's feeling of coldness is not sufficiently resolved even after changing the room temperature setting by 2 ° C, touch the temperature display 81 again and the temperature candidate 82 will be 2 ° C above and below the changed temperature. Is displayed, and the desired room temperature 83 can be changed. Therefore, it is not always possible to change the desired indoor temperature 83 only within the range of 2 ° C. from the initial indoor temperature.
　図２１に示す例では、希望する室内温度８３の選択幅が２℃である例を説明したが、図２１の希望する室内温度８３として２１℃が選択された状態において、さらにタッチパネル式の表示部３５ａをタッチしたまま２２℃より下までスライドするときに２２℃より高い温度、２２．５℃、２３℃・・・と温度がスライドして希望の温度を選択できるまで表示できるようにしてもよい。 In the example shown in FIG. 21, an example in which the selection width of the desired room temperature 83 is 2 ° C. has been described, but in a state where 21 ° C. is selected as the desired room temperature 83 in FIG. 21, a touch panel type display unit is further described. When sliding below 22 ° C while touching 35a, the temperature may be displayed until the desired temperature can be selected by sliding the temperature higher than 22 ° C, 22.5 ° C, 23 ° C, and so on. ..
　ユーザーがタッチパネル式の表示部３５ａをタッチすると、現在の設定気流情報が、気流表示として方向と大きさの情報を含むベクトル情報として矢印のアイコン８４で表示される。図２０に示す矢印は、ユーザーが空気調和機１０に設定している設定気流情報を表す気流表示のアイコンである。設定気流情報は、ユーザーによって空気調和機１０に設定された空気調和設定の１つである気流の情報であり気流の強さを含む。矢印のアイコン８４の向きは室内における気流の向きを表し、矢印のアイコン８４の長さは室内における気流の強さを表している。 When the user touches the touch panel type display unit 35a, the currently set airflow information is displayed as the vector information including the direction and size information as the airflow display by the arrow icon 84. The arrow shown in FIG. 20 is an airflow display icon representing the set airflow information set by the user in the air conditioner 10. The set airflow information is information on the airflow, which is one of the air conditioning settings set in the air conditioner 10 by the user, and includes the strength of the airflow. The direction of the arrow icon 84 represents the direction of the airflow in the room, and the length of the arrow icon 84 represents the strength of the airflow in the room.
　図２０に示したタッチパネル式の表示部３５ａの画像を見ることにより、ユーザーは、ユーザーが空気調和機１０に設定した気流の状態を理解できる。画像処理部３４は、操作部３１からユーザーによって空気調和機１０に設定された設定気流情報を受信して、タッチパネル式の表示部３５ａに表示された背景画像に設定気流情報を合成して表示することができる。 By looking at the image of the touch panel type display unit 35a shown in FIG. 20, the user can understand the state of the air flow set by the user in the air conditioner 10. The image processing unit 34 receives the set airflow information set in the air conditioner 10 by the user from the operation unit 31, and combines and displays the set airflow information with the background image displayed on the touch panel type display unit 35a. be able to.
　図２２は、本発明の実施の形態１においてタッチパネル式の表示部３５ａを用いて空気調和設定における設定気流情報を変更する方法を示す模式図である。空気調和機１０に設定されている設定気流情報を変更する場合は、図２２に示すように現在の設定気流情報の状態が矢印のアイコン８４の状態のとき、矢印のアイコン８４をタップまたは１秒以上長押しすると、矢印のアイコン８４の基点の隣に気流の軸が黒丸８５で表示される。黒丸８５が表示された状態でユーザーが矢印のアイコン８４の先端付近をドラッグアンドドロップ操作することで、矢印のアイコン８４の形状もしくは大きさ、または形状および大きさの両方が変化する。図２２における破線矢印アイコン８６は、矢印のアイコン８４が変化した後のアイコンである。 FIG. 22 is a schematic diagram showing a method of changing the set airflow information in the air conditioning setting using the touch panel type display unit 35a in the first embodiment of the present invention. To change the set airflow information set in the air conditioner 10, tap the arrow icon 84 or 1 second when the current set airflow information state is the arrow icon 84 as shown in FIG. When pressed for a long time, the axis of the air flow is displayed as a black circle 85 next to the base point of the arrow icon 84. When the user drags and drops the vicinity of the tip of the arrow icon 84 while the black circle 85 is displayed, the shape or size of the arrow icon 84, or both the shape and the size are changed. The broken line arrow icon 86 in FIG. 22 is an icon after the arrow icon 84 has changed.
　気流を強くする場合は、黒丸８５が表示された状態でユーザーが矢印のアイコン８４の先端付近をドラッグアンドドロップ操作して矢印のアイコン８４の先端を伸ばす。また、気流の方向を変更する場合は、黒丸８５が表示された状態でユーザーが矢印のアイコン８４の先端付近をドラッグアンドドロップ操作して、黒丸８５を中心に矢印のアイコン８４の先端を回転させてスライドさせる。 To strengthen the air flow, the user drags and drops the vicinity of the tip of the arrow icon 84 while the black circle 85 is displayed to extend the tip of the arrow icon 84. To change the direction of the airflow, the user drags and drops the vicinity of the tip of the arrow icon 84 while the black circle 85 is displayed to rotate the tip of the arrow icon 84 around the black circle 85. And slide it.
　変化した矢印のアイコン８４の形状もしくは大きさ、または形状および大きさの両方の情報は、画像処理部３４に送信される。画像処理部３４は、矢印のアイコン８４の情報を空気調和設定の気流の設定値に変換して空気調和制御部２４に送信する。空気調和制御部２４は、画像処理部３４から受信した気流の設定値に基づいて、気流の向きおよび気流の強さといった空気調和運転の設定を制御する。すなわち、タッチパネル式の表示部３５ａに表示されて空気調和機１０に設定された気流の情報を示す矢印のアイコン８４の形状もしくは大きさ、または形状および大きさの両方が変更されることによって、破線矢印アイコン８６の形状および大きさに対応した気流の設定値が空気調和制御部２４に送信される。 Information on the shape or size of the changed arrow icon 84, or both the shape and size, is transmitted to the image processing unit 34. The image processing unit 34 converts the information of the arrow icon 84 into the set value of the air flow of the air conditioning setting and transmits it to the air conditioning control unit 24. The air conditioning control unit 24 controls the air conditioning operation settings such as the direction of the air flow and the strength of the air flow based on the set values of the air flow received from the image processing unit 34. That is, a broken line is formed by changing the shape or size of the arrow icon 84 displayed on the touch panel type display unit 35a and indicating the airflow information set in the air conditioner 10, or both the shape and size. The set value of the air flow corresponding to the shape and size of the arrow icon 86 is transmitted to the air conditioning control unit 24.
　また、気流表示は、風のイメージが表示されてもよい。タッチパネル式の表示部３５ａがカラー表示に対応している場合、画像処理部３４は、暖房時の気流は、風の暖かみを示すように赤色またはオレンジ色の矢印のアイコン８４で表示する。また、画像処理部３４は、冷房時の気流は、風の冷たさを示すように水色または青色の矢印のアイコン８４で表示する。これにより、矢印のアイコン８４が風の表示であることがわかるとともに、どのような運転モードで運転しているのかをタッチパネル式の表示部３５ａの表示により、見た目で判別しやすくなる。 In addition, the airflow display may display an image of the wind. When the touch panel type display unit 35a supports color display, the image processing unit 34 displays the airflow during heating with a red or orange arrow icon 84 to indicate the warmth of the wind. Further, the image processing unit 34 displays the air flow during cooling with a light blue or blue arrow icon 84 to indicate the coldness of the wind. As a result, it can be seen that the arrow icon 84 is a wind display, and the touch panel type display unit 35a makes it easy to visually determine what kind of operation mode the driver is operating in.
　上記の操作を行うことで、ユーザーは、タッチパネル式の表示部３５ａに表示された室内を示す画像である室内画像、室内画像に重畳された室内情報および人体位置を見ながら視覚的に室内の状態を把握した上で、矢印のアイコン８４を操作することによりソファーおよび家具などの障害物を避けるように設定気流情報を変更することができる。また、ユーザーは、温度ムラがある方向に気流を向けるように設定気流情報を変更することもでき、効率良く快適な空気調和と空気調和設定の操作性の改善とを実現できる。 By performing the above operation, the user can visually view the indoor state while observing the indoor image, which is an image showing the room displayed on the touch panel type display unit 35a, the indoor information superimposed on the indoor image, and the position of the human body. By operating the arrow icon 84 after grasping the above, the set airflow information can be changed so as to avoid obstacles such as sofas and furniture. In addition, the user can change the set airflow information so that the airflow is directed in the direction of temperature unevenness, and it is possible to efficiently and comfortably achieve comfortable air conditioning and improve the operability of the air conditioning setting.
　また、画像処理部３４は、前述のように個人および物体を認識することができるので、認識結果をタッチパネル式の表示部３５ａにおける背景画像に表示してもよい。例えば、画像処理部３４は、テレビ、ソファーおよび窓といった物体と、お父さんおよびお母さんという個人と、を認識してタッチパネル式の表示部３５ａの背景画像上に重畳して表示する。また、画像処理部３４は、個人および物体の認識結果の形状に合わせて背景画像上の個人および物体を縁取り表示してもよい。また、画像処理部３４は、背景画像上の個人および物体の近くに認識結果のコメントを表示してもよい。これにより、ユーザーは、タッチパネル式の表示部３５ａの表示を見ることにより、空気調和機１０が室内の状態を正しく識別して正常に運転できているのかを確認することもできる。 Further, since the image processing unit 34 can recognize an individual and an object as described above, the recognition result may be displayed on the background image on the touch panel type display unit 35a. For example, the image processing unit 34 recognizes an object such as a television, a sofa, and a window, and individuals such as a father and a mother, and displays them on the background image of the touch panel type display unit 35a. In addition, the image processing unit 34 may border and display the individual and the object on the background image according to the shape of the recognition result of the individual and the object. Further, the image processing unit 34 may display a comment of the recognition result near an individual and an object on the background image. Thereby, the user can also confirm whether the air conditioner 10 can correctly identify the indoor state and operate normally by looking at the display of the touch panel type display unit 35a.
　また、認識結果のコメントが仮に誤っている場合は、認識結果のコメントを修正することができる。認識結果のコメントを修正する場合には、タッチパネル式の表示部３５ａに表示されて誤っている認識結果のコメントをタッチすると、認識結果のコメントが入力モードとなり直接文字入力できるようになる。例えばタッチパネル式の表示部３５ａに「お父さん」と表示されている認識結果のコメントを修正したい場合に「お父さん」の表示をタッチすると、「お母さん」、「子供」、「お客様」といった修正候補がタッチパネル式の表示部３５ａに表示され、正しい内容の修正候補をタッチパネル式の表示部３５ａで選択できるようにしてもよい。 Also, if the recognition result comment is incorrect, the recognition result comment can be corrected. When correcting the comment of the recognition result, if the comment of the recognition result displayed on the touch panel type display unit 35a is touched, the comment of the recognition result becomes the input mode and the character can be directly input. For example, if you want to correct the recognition result comment that is displayed as "Dad" on the touch panel type display unit 35a, you can touch the "Dad" display to display correction candidates such as "Mother", "Child", and "Customer" on the touch panel. It may be displayed on the display unit 35a of the expression, and the correction candidate of the correct content may be selected on the display unit 35a of the touch panel type.
　上記のように空気調和システム１００では、室内空間の広域を撮影して認識し、室内空間における人体の認識結果に対応して空気調和運転を制御する場合に、空気調和機１０がどのように空気調和空間を認識しているかを、タッチパネル式の表示部３５ａの表示によってユーザーが確認できる。また、空気調和システム１００では、空気調和空間の認識結果が誤っていることに起因して無駄な空気調和運転が行われている場合は、空気調和機１０における認識結果を簡単に修正して無駄の無い適切な空気調和運転をすることができる。 As described above, in the air conditioning system 100, when a wide area of the indoor space is photographed and recognized, and the air conditioning operation is controlled according to the recognition result of the human body in the indoor space, how the air conditioner 10 uses the air. The user can confirm whether or not the harmony space is recognized by the display of the touch panel type display unit 35a. Further, in the air conditioning system 100, when a useless air conditioning operation is performed due to an erroneous recognition result of the air conditioning space, the recognition result in the air conditioner 10 is easily corrected and useless. It is possible to perform proper air-conditioning operation without any problems.
　また、画像処理部３４は、人体の認識結果が子供である場合、子供が操作部３１を操作しても操作部３１の操作を無効にして、タッチパネル式の表示部３５ａには例えば「チャイルドロック中」と表示しておくことで、子供によるコントローラ１４の誤操作を防止することができる。また、コントローラ１４の操作を操作可能なユーザーとしてコントローラ１４に登録された特定の登録者以外が操作した場合も、操作部３１の操作を無効にすることで、無駄な空気調和運転を抑制して空気調和機１０の省エネルギー運転を実現することもできる。 Further, when the recognition result of the human body is a child, the image processing unit 34 invalidates the operation of the operation unit 31 even if the child operates the operation unit 31, and the touch panel type display unit 35a is, for example, "child lock". By displaying "Medium", it is possible to prevent an erroneous operation of the controller 14 by a child. Further, even when a user other than a specific registrant registered in the controller 14 operates the controller 14 as a user who can operate the controller 14, the operation of the operation unit 31 is invalidated to suppress unnecessary air conditioning operation. It is also possible to realize energy-saving operation of the air conditioner 10.
　画像処理部３４は、人体の個人が認識された場合に、個人の認識結果に対応して、予め登録された個人の好みの空気調和設定情報６７をタッチパネル式の表示部３５ａに表示するだけでなく、現在の室内環境に基づいて変更されると推測される空気調和設定または空気調和設定の操作メニューを推測してタッチパネル式の表示部３５ａに表示したり、必要な設定機能と推測される空気調和設定機能を表示して操作性を改善してもよい。現在の室内環境は、例えば熱画像情報６２から認識される現在の室内温度が例示される。必要な設定機能は、例えば「風量のみの設定機能」とされる。すなわち、画像処理部３４は、人体の個人が特定された場合に、現在の室内環境を加味して、特定した個人の好みと推測される空気調和設定または特定した個人に必要とされると推測される空気調和設定の操作メニューを推測して、タッチパネル式の表示部３５ａに候補として表示する。 When an individual human body is recognized, the image processing unit 34 simply displays the pre-registered personal preference air conditioning setting information 67 on the touch panel type display unit 35a in response to the individual recognition result. The air conditioning setting or the operation menu of the air conditioning setting, which is presumed to be changed based on the current indoor environment, is guessed and displayed on the touch panel type display unit 35a, or the air is presumed to be a necessary setting function. The harmony setting function may be displayed to improve operability. As the current indoor environment, for example, the current indoor temperature recognized from the thermal image information 62 is exemplified. The necessary setting function is, for example, "a setting function for only the air volume". That is, when an individual of the human body is identified, the image processing unit 34 is presumed to be required for the air-conditioning setting presumed to be the preference of the identified individual or the identified individual in consideration of the current indoor environment. The operation menu of the air conditioning setting to be performed is inferred and displayed as a candidate on the touch panel type display unit 35a.
　また、画像処理部３４は、ユーザーが空気調和設定の操作設定に悩まないように、画像処理部３４における人体の認識結果と予め登録された個人の好みの空気調和設定情報６７により、質問形式で操作を選択できるようにしてもよい。すなわち、画像処理部３４は、人体情報の特徴により特定した個人の識別結果から、個人の空気調和設定の好みを推測し、推測した空気調和設定を質問形式でタッチパネル式の表示部３５ａに表示してもよい。 Further, the image processing unit 34 uses a question format based on the recognition result of the human body in the image processing unit 34 and the personal favorite air conditioning setting information 67 registered in advance so that the user does not have to worry about the operation setting of the air conditioning setting. The operation may be selectable. That is, the image processing unit 34 estimates the preference of the individual's air conditioning setting from the identification result of the individual identified by the characteristics of the human body information, and displays the estimated air conditioning setting on the touch panel type display unit 35a in the form of a question. You may.
　画像処理部３４は、予め登録された個人の好みの空気調和設定情報６７に基づいて、タッチパネル式の表示部３５ａに空気調和設定の変更の有無を確認する表示、空気調和設定をどのように変更するかの選択肢の表示などをタッチパネル式の表示部３５ａに表示し、操作部３１による設定指示の入力をユーザーに促す。ユーザーは、タッチパネル式の表示部３５ａの表示に従って所望の空気調和設定の条件を操作部３１から入力する。 The image processing unit 34 changes the display for confirming whether or not the air conditioning setting is changed on the touch panel type display unit 35a and how to change the air conditioning setting based on the personal preference air conditioning setting information 67 registered in advance. A touch panel type display unit 35a displays a display of choices to be performed, and prompts the user to input a setting instruction by the operation unit 31. The user inputs the desired air conditioning setting conditions from the operation unit 31 according to the display of the touch panel type display unit 35a.
　また、撮像部３２が撮像した室内画像は、ユーザーが見ている光景ではなく、空気調和機１０の室内機１１から見た光景の画像である。このため、画像処理部３４は、物体および人体の認識結果に基づいて、ユーザーを基準としてどのような物体が室内に存在しており、ユーザーからどのように見えるかの情報を算出して、ユーザーから見える仮想的な画像を生成してタッチパネル式の表示部３５ａに表示してもよい。上述した図９では、コントローラ１４を操作しているユーザーを含めて、コントローラ１４を操作しているユーザー側から見える仮想的な室内画像を示している。図９に示す仮想的な室内画像には、空気調和機１０の室内機１１も表示している。このように実際には室内画像に撮影されない室内機１１を仮想的な室内画像に表示することで、風がどこからどこに向かって吹いているのかわかりやすく表示することもできる。 Further, the indoor image captured by the imaging unit 32 is not a scene seen by the user, but an image of a scene seen from the indoor unit 11 of the air conditioner 10. Therefore, the image processing unit 34 calculates information on what kind of object exists in the room and how it looks to the user based on the recognition result of the object and the human body, and the user. A virtual image that can be seen from the screen may be generated and displayed on the touch panel type display unit 35a. In FIG. 9 described above, a virtual indoor image that can be seen from the user side operating the controller 14, including the user operating the controller 14, is shown. The indoor unit 11 of the air conditioner 10 is also displayed in the virtual indoor image shown in FIG. By displaying the indoor unit 11 that is not actually captured in the indoor image in the virtual indoor image in this way, it is possible to clearly display where the wind is blowing from where.
　上述したように、本実施の形態１にかかる空気調和システム１００は、空気調和機１０の室内機１１が、室内の状態に関する情報である室内情報を取得する室内情報取得部２１を備える。また、コントローラ１４が、室内の状態を示す画像である室内画像を撮影する撮像部３２と、空気調和機の運転に関する情報を表示する表示部３５とを備える。そして、撮像部３２は、室内情報である熱画像の少なくとも一部を室内画像に重畳して表示部３５に表示させる。 As described above, the air conditioning system 100 according to the first embodiment includes an indoor information acquisition unit 21 in which the indoor unit 11 of the air conditioner 10 acquires indoor information which is information on the indoor state. Further, the controller 14 includes an imaging unit 32 that captures an indoor image that is an image showing the state of the room, and a display unit 35 that displays information regarding the operation of the air conditioner. Then, the imaging unit 32 superimposes at least a part of the thermal image, which is the indoor information, on the indoor image and displays it on the display unit 35.
　これにより、ユーザーは、室内の熱画像だけでは判別しにくかった室内の状態を、表示部３５に表示された背景画像、および背景画像に重畳された熱画像７３によって視覚的におよび直感的に認識することができ、室内の状態の視認性が改善される。また、熱画像を背景画像に重畳して表示することで、室内の温度状態を同時に認識でき、室内の熱画像だけで室内の状態を認識する場合および室内画像だけで室内の状態を認識する場合に比べて室内の状態を容易に把握できる。 As a result, the user visually and intuitively recognizes the indoor state, which is difficult to distinguish from the indoor thermal image alone, by the background image displayed on the display unit 35 and the thermal image 73 superimposed on the background image. And the visibility of the indoor condition is improved. In addition, by superimposing the thermal image on the background image and displaying it, the indoor temperature state can be recognized at the same time, and when the indoor state is recognized only by the indoor thermal image and when the indoor state is recognized only by the indoor image. Compared to, the indoor condition can be easily grasped.
　空気調和システム１００は、空気調和機１０に高価なカメラ等の撮像部を搭載せずに、コントローラ１４の撮像部３２で撮影された画像である室内画像を背景画像として使用して表示部３５に表示させる。そして、室内情報の少なくとも一部を室内画像に重畳して表示部３５に表示させる。これにより、空気調和機１０に撮像機器を備えることによる空気調和機１０の大型化が生じず、安価で省スペースな空気調和機１０を実現できる。 The air conditioner system 100 does not mount an image pickup unit such as an expensive camera on the air conditioner 10, but uses an indoor image taken by the image pickup unit 32 of the controller 14 as a background image on the display unit 35. Display it. Then, at least a part of the indoor information is superimposed on the indoor image and displayed on the display unit 35. As a result, the size of the air conditioner 10 does not increase due to the provision of the image pickup device in the air conditioner 10, and the air conditioner 10 can be realized at low cost and in a small space.
　また、空気調和システム１００は、空気調和機１０における人および物体の識別結果を背景画像に合成して表示することができる。これにより、ユーザーは、空気調和機１０が室内空間の状態を正しく認証しているか否かを表示部３５の表示によって容易に直感的に認識することができ、空気調和機１０の運転が誤って無駄な運転になっていないかを表示部３５の表示によって容易に直感的に認識することができる。そして、空気調和機１０が室内空間の状態を誤って識別している場合には、識別結果を修正することで、無駄の無い空気調和機１０の省エネルギー運転を実現できる。 Further, the air conditioning system 100 can display the identification result of the person and the object in the air conditioner 10 by synthesizing it with the background image. As a result, the user can easily and intuitively recognize whether or not the air conditioner 10 correctly authenticates the state of the indoor space by the display of the display unit 35, and the operation of the air conditioner 10 is erroneously performed. The display on the display unit 35 makes it possible to easily and intuitively recognize whether or not the operation is wasted. When the air conditioner 10 erroneously identifies the state of the indoor space, the energy-saving operation of the air conditioner 10 can be realized by correcting the identification result.
　また、空気調和システム１００は、熱画像情報６２より特定されたユーザーの顔を、ユーザーの顔画像７４に置き換えて表示部３５の背景画像に合成表示することができる。さらに、熱画像情報６２より特定されたユーザーの顔は、ユーザーの似顔絵またはアイコンに置き換えて表示部３５の背景画像に合成表示することで、個人のプライバシーを確保しながら容易に在室人物を表示部３５で認識できる。 Further, the air conditioning system 100 can replace the user's face specified from the thermal image information 62 with the user's face image 74 and display it compositely on the background image of the display unit 35. Further, the user's face specified from the thermal image information 62 is replaced with the user's caricature or icon and compositely displayed on the background image of the display unit 35 to easily display the person in the room while ensuring personal privacy. It can be recognized by the part 35.
　また、空気調和システム１００は、熱画像情報６２より特定された個人の好みの空気調和設定を表示部３５に表示することで、ユーザーは限定された空気調和設定の中から、期待する設定を容易に選択することができ、空気調和設定の設定操作の操作性を改善することができる。 Further, the air conditioning system 100 displays the personal favorite air conditioning setting specified from the thermal image information 62 on the display unit 35, so that the user can easily set the expected setting from the limited air conditioning setting. It can be selected to improve the operability of the setting operation of the air conditioning setting.
　また、表示部３５としてタッチパネル式の表示部３５ａを使用し、空気調和設定の気流の設定を矢印のアイコンによってタッチパネル式の表示部３５ａに表示させることで、タッチパネル感覚で気流の向きおよび風量といった気流の空気調和設定を直感的にモニターでき、さらに設定もできる。これにより、ユーザーの利便性が向上した空気調和システムを実現できる。 Further, by using the touch panel type display unit 35a as the display unit 35 and displaying the airflow setting of the air harmony setting on the touch panel type display unit 35a by the arrow icon, the airflow such as the direction and the air volume of the airflow can be felt like a touch panel. You can intuitively monitor the air conditioning setting of, and you can also set it. As a result, it is possible to realize an air conditioning system with improved user convenience.
　また、空気調和システム１００は、気流の設定を矢印のアイコンによってタッチパネル式の表示部３５ａに表示させることで、障害物により空気調和が阻害されないように気流を調整し、その調整された空気調和が不適切であれば空気調和設定をタッチパネルなどで修正することで適切な省エネルギー運転を実現できる。ユーザーは、タッチパネル式の表示部３５ａの表示を見ることで、視覚的におよび直感的に気流を調整できるため、特に意識することなく気流の設定を行うことができる。 Further, the air conditioning system 100 adjusts the air conditioning so that the air conditioning is not hindered by obstacles by displaying the air conditioning setting on the touch panel type display unit 35a by the icon of the arrow, and the adjusted air conditioning is achieved. If it is inappropriate, appropriate energy-saving operation can be realized by correcting the air conditioning setting with a touch panel or the like. Since the user can visually and intuitively adjust the airflow by looking at the display of the touch panel type display unit 35a, the user can set the airflow without being particularly conscious of it.
　したがって、本実施の形態１にかかる空気調和システム１００によれば、空気調和機１０に撮像機器を備えることによる空気調和機１０の大型化を伴うことなく、室内の状態を直感的に把握することが可能である。 Therefore, according to the air conditioner system 100 according to the first embodiment, the indoor state can be intuitively grasped without increasing the size of the air conditioner 10 by providing the air conditioner 10 with an image pickup device. Is possible.
　以上の実施の形態に示した構成は、本発明の内容の一例を示すものであり、別の公知の技術と組み合わせることも可能であるし、本発明の要旨を逸脱しない範囲で、構成の一部を省略、変更することも可能である。 The configuration shown in the above-described embodiment shows an example of the content of the present invention, can be combined with another known technique, and is one of the configurations without departing from the gist of the present invention. It is also possible to omit or change the part.
　１０　空気調和機、１１　室内機、１２　室外機、１３　冷媒管、１４　コントローラ、２１　室内情報取得部、２２　室内情報処理部、２３　室内機通信部、２４　空気調和制御部、２５　空気調和変更部、２５ａ　第１風向変更部、２５ｂ　第２風向変更部、２５ｃ　第３風向変更部、３１　操作部、３１ａ　決定ボタン、３２　撮像部、３３　コントローラ通信部、３４　画像処理部、３５　表示部、３５ａ　タッチパネル式の表示部、４１，４２，４３，４４，４５，４６，４７　サーモパイル素子、６１　温度分布情報、６２　熱画像情報、６３　室内特徴情報、６４　室内画像情報、６５　室内画像特徴情報、６６　人体、６７　好みの空気調和設定情報、７１　窓、７２　壁、７３　熱画像、７４　ユーザーの顔画像、８１　温度表示、８２　温度候補、８３　希望する室内温度、８４　矢印のアイコン、８５　黒丸、８６　破線矢印アイコン、１００　空気調和システム、１０１　プロセッサ、１０２　メモリ、２２１，３４１　記憶部、Ａ１，Ａ２，Ａ３，Ａ４，Ａ５，Ａ６，Ａ７　監視範囲。 10 air conditioner, 11 indoor unit, 12 outdoor unit, 13 refrigerant pipe, 14 controller, 21 indoor information acquisition unit, 22 indoor information processing unit, 23 indoor unit communication unit, 24 air conditioning control unit, 25 air conditioning change unit, 25a 1st wind direction changing unit, 25b 2nd wind direction changing unit, 25c 3rd wind direction changing unit, 31 operation unit, 31a decision button, 32 imaging unit, 33 controller communication unit, 34 image processing unit, 35 display unit, 35a touch panel type Display unit, 41, 42, 43, 44, 45, 46, 47 Thermopile element, 61 Temperature distribution information, 62 Thermal image information, 63 Indoor feature information, 64 Indoor image information, 65 Indoor image feature information, 66 Human body, 67 Favorite air conditioning setting information, 71 windows, 72 walls, 73 thermal images, 74 user's face image, 81 temperature display, 82 temperature candidates, 83 desired room temperature, 84 arrow icon, 85 black circle, 86 broken arrow arrow icon, 100 air conditioning system, 101 processor, 102 memory, 221,341 storage, A1, A2, A3, A4, A5, A6, A7 monitoring range.

Claims (10)

  1. 　室内に配置されて調和空気を前記室内へ送風する空気調和機と、前記空気調和機の運転を制御するコントローラとを備え、
    　前記空気調和機は、
    　前記室内の状態に関する情報である室内情報を取得する室内情報取得部と、
    　外部の機器と通信を行う空気調和機通信部と、
    　前記空気調和機の空気調和制御を行う空気調和制御部と、
    　を備え、
    　前記コントローラは、
    　前記空気調和機の運転の設定操作を受け付ける操作部と、
    　前記室内の状態を示す画像である室内画像を撮影する撮像部と、
    　前記空気調和機の運転に関する情報を表示する表示部と、
    　外部の機器と通信を行うコントローラ通信部と、
    　を備え、
    　前記表示部が、前記室内情報の少なくとも一部を前記室内画像に重畳して表示する空気調和システム。     It is provided with an air conditioner that is arranged in the room and blows conditioned air into the room, and a controller that controls the operation of the air conditioner.
    The air conditioner is
    An indoor information acquisition unit that acquires indoor information that is information on the indoor state, and
    The air conditioner communication unit that communicates with external equipment,
    An air conditioning control unit that controls the air conditioning of the air conditioner,
    With
    The controller
    An operation unit that accepts the setting operation of the operation of the air conditioner, and
    An imaging unit that captures an indoor image, which is an image showing the state of the room,
    A display unit that displays information on the operation of the air conditioner and
    With the controller communication unit that communicates with external devices,
    With
    An air conditioning system in which the display unit superimposes at least a part of the indoor information on the indoor image and displays it.
  2. 　前記空気調和機が、前記室内情報から前記室内における特徴を示す情報である室内特徴情報を抽出する室内情報処理部を備え、
    　前記コントローラが、前記室内情報と前記室内画像とを取得して前記室内情報の少なくとも一部を前記室内画像に重畳して前記表示部に表示させる制御を行う画像処理部を備え、
    　前記画像処理部は、前記室内画像から前記室内画像の特徴である室内画像特徴情報を抽出し、前記室内情報と前記室内特徴情報と前記室内画像と前記室内画像特徴情報とに基づいて、前記室内における同一の部分を示す前記室内特徴情報で表される前記室内の部分と前記室内画像特徴情報で表される前記室内の部分とが前記室内画像において予め決められた距離の範囲内に入るように前記室内画像の縮尺を調整して、縮尺が調整された前記室内画像を前記表示部に表示させる請求項１に記載の空気調和システム。     The air conditioner includes an indoor information processing unit that extracts indoor feature information, which is information indicating features in the room, from the indoor information.
    The controller includes an image processing unit that acquires the room information and the room image, superimposes at least a part of the room information on the room image, and displays the room information on the display unit.
    The image processing unit extracts indoor image feature information that is a feature of the indoor image from the indoor image, and based on the indoor information, the indoor feature information, the indoor image, and the indoor image feature information, the indoor image. The indoor part represented by the indoor feature information and the indoor part represented by the indoor image feature information indicating the same part in the indoor image are within a range of a predetermined distance in the indoor image. The air conditioning system according to claim 1, wherein the scale of the indoor image is adjusted so that the scale-adjusted indoor image is displayed on the display unit.
  3. 　前記室内情報処理部は、前記室内情報から人体を抽出し、前記室内情報における前記人体に関する情報である人体情報を抽出して前記画像処理部に送信し、
    　前記画像処理部は、前記撮像部において撮影された画像または前記コントローラの外部の機器から取得された画像もしくはアイコンを、前記室内画像において前記人体情報により特定される人体の位置に重畳する請求項２に記載の空気調和システム。     The indoor information processing unit extracts a human body from the indoor information, extracts human body information which is information about the human body in the indoor information, and transmits the information to the image processing unit.
    2. The image processing unit superimposes an image taken by the imaging unit or an image or icon acquired from an external device of the controller on the position of the human body specified by the human body information in the indoor image. The air conditioning system described in.
  4. 　前記画像処理部は、前記人体情報の特徴に対応する、予め前記画像処理部に記憶された画像またはアイコンを、前記室内画像において前記人体情報により特定される個人の検出位置に重畳する請求項３に記載の空気調和システム。 3. The image processing unit superimposes an image or an icon stored in the image processing unit in advance, which corresponds to the feature of the human body information, on a detection position of an individual specified by the human body information in the indoor image. The air conditioning system described in.
  5. 　前記画像処理部は、
    　前記人体情報の特徴により特定される個人が好む空気調和設定の情報である好みの空気調和設定情報を記憶し、
    　前記人体情報の特徴により特定される、前記表示部に表示されている個人を選択する情報を前記操作部から受信した場合に、前記好みの空気調和設定情報を前記表示部に表示する請求項４に記載の空気調和システム。     The image processing unit
    Stores the preferred air conditioning setting information, which is the information of the preferred air conditioning setting specified by the characteristics of the human body information.
    4. When the information for selecting an individual displayed on the display unit, which is specified by the characteristics of the human body information, is received from the operation unit, the favorite air conditioning setting information is displayed on the display unit. The air conditioning system described in.
  6. 　前記操作部は、タッチパネル式の前記表示部を備え、
    　前記画像処理部は、タッチパネル式の前記表示部に表示された前記好みの空気調和設定情報が選択された場合に、前記画像処理部において前記好みの空気調和設定情報を編集可能となる請求項５に記載の空気調和システム。     The operation unit includes the touch panel type display unit.
    5. The image processing unit can edit the preferred air conditioning setting information in the image processing unit when the preferred air conditioning setting information displayed on the touch panel type display unit is selected. The air conditioning system described in.
  7. 　前記画像処理部は、前記人体情報の特徴により特定した個人の識別結果から、現在の室内環境に基づいて、前記特定した個人の好みと推測される空気調和設定または前記個人に必要とされると推測される空気調和設定の操作メニューを推測して、前記表示部に候補として表示する請求項５または６に記載の空気調和システム。 It is said that the image processing unit is required for the air conditioning setting or the individual, which is presumed to be the preference of the identified individual based on the current indoor environment from the identification result of the individual identified by the characteristics of the human body information. The air conditioning system according to claim 5 or 6, wherein the operation menu of the estimated air conditioning setting is estimated and displayed as a candidate on the display unit.
  8. 　前記画像処理部は、前記人体情報の特徴により特定した個人の識別結果から、前記個人の空気調和設定の好みを推測し、推測した空気調和設定を質問形式で前記表示部に表示する請求項３から７のいずれか１つに記載の空気調和システム。 3. The image processing unit estimates the preference of the individual's air conditioning setting from the identification result of the individual specified by the characteristics of the human body information, and displays the estimated air conditioning setting on the display unit in the form of a question. The air conditioning system according to any one of 7 to 7.
  9. 　前記操作部は、タッチパネル式の前記表示部を備え、
    　前記室内情報が重畳された前記室内画像が表示されたタッチパネル式の前記表示部に触れることで空気調和設定が変更され、
    　前記空気調和制御部は、前記表示部で変更された空気調和設定に基づいて前記空気調和機の空気調和制御を行う請求項１から７のいずれか１つに記載の空気調和システム。     The operation unit includes the touch panel type display unit.
    The air conditioning setting is changed by touching the touch panel type display unit on which the indoor image on which the indoor information is superimposed is displayed.
    The air conditioning system according to any one of claims 1 to 7, wherein the air conditioning control unit controls the air conditioning of the air conditioner based on the air conditioning setting changed on the display unit.
  10. 　タッチパネル式の前記表示部に表示されて前記空気調和機に設定された気流の情報を示すアイコンの形状もしくは大きさ、または形状および大きさの両方が変更されることによって、前記アイコンの形状および大きさに対応した前記気流の設定値が前記空気調和制御部に送信される請求項９に記載の空気調和システム。 The shape and size of the icon displayed on the touch panel type display unit and indicating the airflow information set in the air conditioner, or by changing both the shape and size. The air conditioning system according to claim 9, wherein the set value of the air flow corresponding to the above is transmitted to the air conditioning control unit.
PCT/JP2019/039470 2019-10-07 2019-10-07 Air conditioning system WO2021070219A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021550952A JP7191244B2 (en) 2019-10-07 2019-10-07 air conditioning system
PCT/JP2019/039470 WO2021070219A1 (en) 2019-10-07 2019-10-07 Air conditioning system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/039470 WO2021070219A1 (en) 2019-10-07 2019-10-07 Air conditioning system

Publications (1)

Publication Number Publication Date
WO2021070219A1 true WO2021070219A1 (en) 2021-04-15

Family

ID=75437027

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/039470 WO2021070219A1 (en) 2019-10-07 2019-10-07 Air conditioning system

Country Status (2)

Country Link
JP (1) JP7191244B2 (en)
WO (1) WO2021070219A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61139751A (en) * 1984-12-12 1986-06-27 Seiki Suyama Method for inspecting released part of wall surface
JP2011257071A (en) * 2010-06-09 2011-12-22 Mitsubishi Electric Corp Air conditioner
JP2015055393A (en) * 2013-09-11 2015-03-23 日立アプライアンス株式会社 Air conditioner
JP2016217953A (en) * 2015-05-23 2016-12-22 インフィニテグラ株式会社 Thermal image display method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5836741B2 (en) * 2011-09-30 2015-12-24 日立アプライアンス株式会社 Air conditioning control terminal and air conditioning control setting operation method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61139751A (en) * 1984-12-12 1986-06-27 Seiki Suyama Method for inspecting released part of wall surface
JP2011257071A (en) * 2010-06-09 2011-12-22 Mitsubishi Electric Corp Air conditioner
JP2015055393A (en) * 2013-09-11 2015-03-23 日立アプライアンス株式会社 Air conditioner
JP2016217953A (en) * 2015-05-23 2016-12-22 インフィニテグラ株式会社 Thermal image display method

Also Published As

Publication number Publication date
JPWO2021070219A1 (en) 2021-04-15
JP7191244B2 (en) 2022-12-16

Similar Documents

Publication Publication Date Title
JP5484205B2 (en) Air conditioner
JP6046579B2 (en) Air conditioner
JP5836741B2 (en) Air conditioning control terminal and air conditioning control setting operation method
KR102121785B1 (en) Air-conditioner controlling direction of the wind using artificial intelligence by instructed position and method of controlling thereof
JP5478075B2 (en) Air conditioner
WO2017181662A1 (en) Method and system for linked control of home appliances, and server
JP5819271B2 (en) Air conditioner
JP5788037B2 (en) Air conditioner
JP2006220405A (en) Air conditioner
JP2009139010A (en) Air conditioner
JP2017048929A (en) Air conditioner
JP2012172910A (en) System for operating indoor environmental control device
WO2020089996A1 (en) Remote operation terminal and air-conditioning system
JP2015183964A (en) Air conditioner and indoor unit of the same
WO2016157675A1 (en) Control system, control method, and control program
WO2018220820A1 (en) Air conditioner and air conditioner system
WO2021070219A1 (en) Air conditioning system
JP2016023847A (en) Air conditioner and air conditioner remote control system
JP6933013B2 (en) Air conditioner controller and air conditioner system
KR20180011694A (en) Air conditoiner and control method thereof
WO2021225010A1 (en) Air conditioner
WO2021224987A1 (en) Air conditioning apparatus
KR102398452B1 (en) Controlling system of air conditioner
JP2022088045A (en) Information processing system, device controller and program
JP7438407B2 (en) air conditioning system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19948508

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021550952

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19948508

Country of ref document: EP

Kind code of ref document: A1