WO2023144931A1 - Air conditioner control device, air conditioner control system, air conditioner control method, and program - Google Patents

Air conditioner control device, air conditioner control system, air conditioner control method, and program Download PDF

Info

Publication number
WO2023144931A1
WO2023144931A1 PCT/JP2022/002898 JP2022002898W WO2023144931A1 WO 2023144931 A1 WO2023144931 A1 WO 2023144931A1 JP 2022002898 W JP2022002898 W JP 2022002898W WO 2023144931 A1 WO2023144931 A1 WO 2023144931A1
Authority
WO
WIPO (PCT)
Prior art keywords
air conditioner
information
control
appearance
target space
Prior art date
Application number
PCT/JP2022/002898
Other languages
French (fr)
Japanese (ja)
Inventor
悠太 並木
健全 劉
智史 山崎
登 吉田
諒 川合
テイテイ トウ
カレン ステファン
直樹 進藤
洋平 佐々木
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to PCT/JP2022/002898 priority Critical patent/WO2023144931A1/en
Priority to JP2023576458A priority patent/JPWO2023144931A5/en
Publication of WO2023144931A1 publication Critical patent/WO2023144931A1/en

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00—Control or safety arrangements
    • F24F11/62—Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
    • F24F11/63—Electronic processing
    • F24F11/64—Electronic processing using pre-stored data

Definitions

  • the present invention relates to an air conditioner control device, an air conditioner control system, an air conditioner control method, and a program.
  • the area-based environment management system described in Patent Document 1 includes a biological information sensor 10, an environment information sensor 20, an arousal level estimation unit 30, and an environment provision unit 40.
  • the wakefulness estimation unit 30 estimates, for example, an individual's wakefulness based on the biological information detected by the biological information sensor 10 .
  • the environment providing unit 40 provides an environment for each area based on the awakening level and the environment information. According to the invention of Patent Document 1, it is described in Patent Document 1 that it is possible to provide an environment for controlling the arousal level of an individual, etc., and control the productivity of the individual, etc. to a desired state.
  • Patent Literature 1 describes that the biometric information sensors 10a and 10b are seat-type biometric sensors that are placed on a chair and sense the heartbeat, breathing, and body movement of an individual sitting on the chair. . Also, the biometric information sensor 10 may capture an individual's facial image or the like with a camera in front of the display of the personal computers 3a and 3b, analyze the image data, and detect blinking, posture, body movement, and the like. , there is a description.
  • the environmental facility control system described in Patent Document 2 is a system for bringing the arousal level, which is the physical and mental state of the user, closer to the target arousal level by using multiple types of environmental facilities.
  • the environmental facility control system 1 mainly includes an air conditioner 10 , a ventilator 20 , an aroma diffuser 30 , a biosensor 40 , a remote controller 50 and an environmental facility control device 100 .
  • a biosensor 40 described in Patent Document 2 is a sensor for grasping a user's arousal level, and includes an electrocardiogram waveform sensor 41 that detects the user's electrocardiogram waveform and an expression camera 42 that detects the user's facial expression. .
  • the facial expression camera 42 is placed at a specific position in the room where it is possible to photograph the user's facial expression, and wirelessly transmits the detected facial expression data to surrounding equipment such as the environmental equipment control device 100. is possible.
  • the environmental facility control device 100 can acquire information from the biosensor 40 and the remote controller 50 and control the air conditioner 10 , the ventilator 20 and the aroma diffuser 30 .
  • the wakefulness control system described in Patent Document 3 determines the wakefulness of a person subject to wakefulness control, controls the physical quantity of the surrounding environment of the subject of wakefulness control according to the determination result, and adjusts the wakefulness. Maintain or improve.
  • the alertness control system includes an alertness control device 100 , one or more environment control devices 200 , one or more environment measurement devices 300 , and one or more alertness estimation devices 400 .
  • the environment measuring device 300 described in Patent Document 3 is a device that measures physical quantities such as temperature and illuminance and converts them into numerical data.
  • the arousal level estimation device 400 is a device that estimates a subject's arousal level from biological information or the like and converts it into numerical data. It is described that any one of body temperature, facial moving image, and pulse wave, or a combination thereof may be used as biological information.
  • the arousal level control device 100 described in Patent Document 3 controls the environment control device 200 according to the arousal level of the subject.
  • the awakening level control device 100 includes a monitor control unit 181, a first acquisition unit 182, a second acquisition unit 183, a set value calculation unit 184, and the like.
  • the monitoring control unit 181 described in Patent Document 3 acquires the device setting values set in the environment control device 200 through communication with the environment control device 200 .
  • the first acquisition unit 182 acquires the measured value of the physical quantity measured by the environment measurement device 300 . Air temperature, such as room temperature, is cited as this physical quantity.
  • the second acquisition unit 183 communicates with the awakening level estimation device 400 and acquires the estimated value of the subject's awakening level.
  • the setting value calculation unit 184 acquires the device setting value from the monitoring control unit 181, acquires the measured value of the physical quantity from the first acquisition unit 182, acquires the wakefulness estimated value from the second acquisition unit 183, Based on this, the device setting value is calculated.
  • the device of the system described in Patent Document 4 consists of three parts: a detection unit 1, a determination unit 2, and a control unit 3.
  • the detection unit 1 is for detecting the state of the room or people, and sends the information to the determination unit 2 .
  • the determination unit 2 determines the human condition based on the information received from the detection unit 1 .
  • the control unit 3 has an interface for controlling the equipment, and controls the equipment.
  • the detection unit 1 has a plurality of cameras, microphones, temperature, and humidity sensors as input devices, an input control unit 11 that processes these inputs, detection function units 14, 15, 16, and 17, and various There is a description to the effect that it consists of a result collection unit 13 that integrates the results in the model database 12 and summarizes the output to the determination unit 2 .
  • Functions of the detection unit 1 include a posture detection function, a face detection function, an eye portion observation function, and a mouth portion observation function. Based on the information received from the detection unit 1, the determination unit 2 determines how the device should be controlled, and has a control instruction function.
  • Patent Literature 5 states that the clothing of the user may be determined from the captured image, and the air conditioners 10, 10A, and 10B may be instructed to adjust the temperature based on the clothing. For example, there is a description that if it is confirmed that a person is wearing a short-sleeved shirt or using a blanket in the air-conditioning, the patient is instructed to wear it less, and if he/she wears a long-sleeve, he is instructed to strengthen it.
  • the control device 70 determines the action of the user U1 (S1-2) and indicates that the gesture instruction condition is indicated.
  • the indoor unit 100 of the air conditioner that recognizes (3 of S1) and controls the heat exchanger 4 and the like according to the gesture instruction condition (4 of S1) is described.
  • the air conditioning system 1 of Patent Literature 7 recognizes a request to change air conditioning settings by a user's gesture input operation, and adjusts air blowing according to the change request.
  • the biometric information sensor 10 is provided for each individual. Therefore, provision of the biological information sensor 10 is troublesome. Especially when trying to provide an environment for controlling the arousal level of a plurality of people, it may be difficult to provide the biological information sensor 10 for each of the plurality of people. Moreover, when a person moves, it may be difficult to provide the biological information sensor 10 to the person. Therefore, in the area-specific environment management system described in Patent Document 1, it may be difficult to make the air environment of the space comfortable.
  • Patent Document 2 requires an expression camera 42 that is placed at a specific position in the room and capable of photographing the user's facial expression. Installing the facial expression camera 42 at such a specific position is troublesome. In addition, it may be difficult to specify a position in the room where facial expressions can be captured, or to attach the facial expression camera 42 to that position.
  • Patent Document 3 does not describe a method for acquiring a moving image of a face. Assuming that a camera arranged at a specific position in a room capable of photographing the user's face is used to obtain a moving image of the user's face in the same manner as the facial expression camera 42 described in Patent Document 2, There is a problem similar to the technology described in .
  • Patent Document 4 detects posture, face, eyes, and mouth at a certain time, and detects states such as yawning and opening and closing of eyelids.
  • states such as yawning and opening and closing of eyelids.
  • the device may be controlled based on an accidental state, resulting in a loss of comfort for the person.
  • Patent Document 5 With the technology described in Patent Document 5, it is difficult to determine whether it is comfortable for the person to wear short sleeves or long sleeves during cooling. In addition, if a person using a blanket during cooling can be confirmed, and an instruction to weaken the blanket is given, there is a risk that the comfort of other people will be impaired. That is, with the technique described in Patent Document 5, there is a possibility that the air environment in the space cannot be made comfortable.
  • An example of the object of the present invention is to provide an air conditioner control device, an air conditioner control system, and an air conditioner control that solve the problem that it is difficult to provide a comfortable air environment without making people aware of the above problems. It is to provide a method and a program.
  • history acquisition means for processing image information including an image of a target space and acquiring appearance history information including a history of the appearance of one or more people active in the target space; and control means for outputting control information for controlling the air conditioner based on the appearance history information.
  • the above air conditioner control device a photographing device for photographing the target space;
  • An air conditioner control system including the air conditioner is provided.
  • the computer obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
  • An air conditioner control method is provided, including outputting control information for controlling the air conditioner based on the appearance history information.
  • the computer obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
  • a program is provided for outputting control information for controlling an air conditioner based on the appearance history information.
  • FIG. 4 is a flowchart showing an overview of air conditioner control processing according to one embodiment of the present invention. It is a figure which shows the structural example of the air conditioner control system which concerns on one Embodiment. It is a figure which shows the example of arrangement
  • FIG. 4 is a diagram illustrating a functional configuration example of a history acquisition unit according to one embodiment; It is a figure which shows an example of appearance information. It is a figure which shows an example of appearance history information. It is a figure which shows an example of control pattern information.
  • FIG. 20 is a diagram showing a configuration example of a control system according to modification 8;
  • FIG. 21 is a diagram showing a configuration example of a control system according to Modification 9;
  • FIG. 1 is a diagram showing an overview of an air conditioner control system 100 according to one embodiment of the present invention.
  • the air conditioner control system 100 includes a photographing device 101 a that photographs a target space, an air conditioner (also called an “air conditioner”) 102 a, and an air conditioner control device 103 .
  • the air conditioner control device 103 includes a history acquisition section 104 and a control section 105 .
  • the history acquisition unit 104 processes image information including captured images of the target space, and acquires appearance history information including the appearance history of one or more persons P who are active in the target space.
  • the control unit 105 outputs control information for controlling the air conditioner 102a based on the appearance history information.
  • this air conditioner control device 103 it is possible to easily provide a comfortable air environment without people being conscious of it.
  • this air conditioner control system 100 it is possible to easily provide a comfortable air environment without people being conscious of it.
  • FIG. 2 is a flowchart showing an overview of air conditioner control processing according to one embodiment of the present invention.
  • the history acquisition unit 104 processes image information including captured images of the target space, and acquires appearance history information including the appearance history of one or more persons P who are active in the target space (step S101).
  • the control unit 105 outputs control information for controlling the air conditioner 102a based on the appearance history information (step S102).
  • FIG. 3 is a diagram showing a configuration example of the air conditioner control system 100 according to this embodiment.
  • the air conditioner control system 100 is a system for controlling the air conditioners 102a to 102c.
  • the air conditioner control system 100 includes a plurality of imaging devices 101 a to 101 c, a plurality of air conditioners 102 a to 102 c, and an air conditioner control device 103 .
  • the air conditioner control device 103 is connected via a network N to each of the imaging devices 101a to 101c and the air conditioners 102a to 102c.
  • Network N is a communication network configured by wire, wireless, or a combination thereof.
  • the air conditioner control device 103 and each of the imaging devices 101a to 101c and the air conditioners 102a to 102c exchange information via the network N with each other.
  • air conditioner control system is also referred to as the "control system”.
  • air conditioner control device is also written as "control device”.
  • FIG. 4 is a diagram showing an arrangement example of a plurality of photographing devices 101a to 101c and a plurality of air conditioners 102a to 102c according to this embodiment.
  • This figure is a top view of the conference room R and the corridor C leading to it.
  • a plurality of people P are arranged in a substantially rectangular shape when viewed from above.
  • a doorway D shown in the lower right of FIG. 2 is a passage between the corridor C and the conference room R. The doorway D is opened and closed using a door (not shown).
  • the target space is a space to be photographed using the photographing devices 101a to 101c.
  • the target space may be determined as appropriate.
  • Each of the conference room R and the corridor C according to this embodiment is an example of the target space. That is, in this embodiment, one room and a predetermined section of the corridor C are set as the target space.
  • FIG. 4 shows a part of the corridor C defined as the target space.
  • the target space is not limited to this.
  • One or more target spaces may be set in part or all of indoors or outdoors such as one or more buildings, structures, facilities, and the like.
  • the target space is, for example, each room of a building or building, a predetermined section of a corridor, a predetermined section of stairs, a predetermined indoor space near the entrance, a predetermined outdoor space near the entrance, or a part of the veranda. or all.
  • the size, shape, etc. of the target space may vary. When there are a plurality of target spaces, each size, shape, etc. may be different. When there are a plurality of target spaces, there may be a gap between adjacent target spaces, or they may be adjacent without a gap.
  • Imaging devices 101a to 101c Each of the imaging devices 101a to 101c is, for example, a camera.
  • the camera may be any camera that generates image information that can be transmitted and received via the network N, such as an omnidirectional camera.
  • the photographing devices 101a to 101c photograph parts of the conference room R and the corridor C. Specifically, the imaging devices 101a to 101b capture images of the imaging regions TSa to TSb included in the conference room R, respectively.
  • the photographing device 101c photographs a photographing area TSc included in the corridor C.
  • FIG. in other words, the photographing devices 101a to 101c are photographing devices installed so as to photograph at least the photographing areas TSa to TSc associated therewith.
  • the photographing areas TSa to TSb are two areas obtained by roughly dividing the entire conference room R into two equal parts.
  • the photographing areas TSa to TSb have the same size, and are adjacent to each other in the conference room R without gaps and without overlapping each other.
  • the photographing area TSc is an area of the corridor C adjacent to the conference room R. As shown in FIG. That is, the shooting areas TSa to TSb are areas included in the conference room R as the target space.
  • the imaging area TSc is an area included in the corridor C as the target space.
  • imaging areas TSa to TSc are also simply referred to as "imaging areas TS".
  • One or more imaging regions TS may be set in the target space.
  • the size, shape, etc. of each imaging region TS may vary.
  • each may be different in size, shape, and the like.
  • adjacent photographing regions TS may be spaced apart from each other, may be adjacent to each other without a gap, or may partially overlap each other.
  • the photographing devices 101a to 101c generate image information including images of the photographing areas TSa to TSc respectively photographed.
  • the image information according to the present embodiment further includes shooting time and area ID (Identifier).
  • the image of the photographing areas TSa to TSb is the image of the conference room R.
  • the image of the imaging area TSc is the image of the corridor C.
  • the images captured by the imaging devices 101a to 101b include the image of the conference room R.
  • FIG. The image captured by the imaging device 101c includes the image of the corridor C.
  • the shooting time is the time when the shooting was performed.
  • the photographing devices 101a to 101c keep time, and include the photographing time, which is the time at which each photograph was taken, in the image information.
  • the area ID is information for identifying each of the imaging devices 101a to 101c.
  • a region ID may be assigned according to an appropriate rule. It is assumed that the area IDs of the photographing areas TSa to TSc are "TSa”, “TSb”, and "TSc".
  • the imaging devices 101a to 101c hold in advance the area IDs of the corresponding imaging areas TSa to TSb, and include the area IDs in the image information.
  • Each of the imaging devices 101a to 101c transmits the generated image information to the control device 103 via the network N. Specifically, each of the imaging devices 101a to 101c continuously captures each of the imaging regions TSa to TSc at predetermined time intervals to generate image information.
  • the image information continuously generated by each of the imaging devices 101a to 101c constitutes moving images in which the conference room R and the corridor C are continuously captured.
  • imaging devices 101a to 101c are also simply referred to as "imaging device 101".
  • the control system 100 may have one or more imaging devices 101, and the number may be any.
  • the time interval of photographing may be appropriately determined, and when the time length is long to some extent, the image information does not need to form a moving image.
  • Air conditioners 102a to 102c Each of the air conditioners 102a to 102c is equipment, apparatus, equipment, etc. for adjusting the air environment of the air-conditioned space.
  • the air-conditioned space is a space in which each of the air conditioners 102a to 102c adjusts the air environment.
  • the air-conditioned space is typically the vicinity (predetermined range) of each of the air conditioners 102a to 102c.
  • the air-conditioned spaces of the air conditioners 102a to 102c according to this embodiment are spaces corresponding to the imaging areas TSa to TSc, respectively. That is, the air conditioners 102a to 102c according to the present embodiment are associated with the imaging areas TSa to TSc, respectively.
  • Each of the air conditioners 102a to 102c is an air conditioner (air conditioner) having cooling, heating, dehumidifying, blowing, and air cleaning functions.
  • Each of the air conditioners 102a to 102c acquires control information from the control device 103 via the network N.
  • FIG. The air conditioners 102a to 102c adjust the temperature, humidity, etc. of the air in each air-conditioned space according to the acquired control information.
  • the control information includes instructions for the air conditioners 102a-102c from which it is obtained.
  • the control information includes instructions according to the functions of the air conditioners 102a to 102c from which it is acquired.
  • Instructions included in the control information include, for example, one or more of power on/off, operation mode setting or change, target temperature setting or change, airflow setting or change, and wind direction setting or change.
  • the operation modes include, for example, modes that perform cooling, heating, dehumidification, ventilation, and air purification functions (that is, cooling mode, heating mode, dehumidification mode, ventilation mode, and purification mode).
  • air conditioner 102 when the air conditioners 102a to 102c are not particularly distinguished, they are simply referred to as "air conditioner 102". Note that the number of air conditioners 102 included in the control system 100 may be one or more, and may be any number. An example of the air conditioner 102 other than the air conditioner will be described in modified examples described later.
  • the control device 103 is a device for controlling the air conditioner 102 based on image information including a captured image of the target space.
  • the control device 103 includes a history acquisition unit 104 , a control unit 105 , a history storage unit 106 and a control pattern storage unit 107 .
  • the history acquisition unit 104 processes image information including captured images of the target space, and acquires appearance history information including the appearance history of one or more persons P who are active in the target space.
  • activity mainly means the daily activities of person P (including states and actions). “Activity” shall not include actions and states intended to control the air conditioner 102 , such as gestures to control the air conditioner 102 .
  • the processing for the image information performed by the history acquisition unit 104 is image processing for detecting the person P from the image included in the image information and acquiring the appearance information of the detected person P.
  • the history acquisition unit 104 includes a person detection unit 104a and an analysis unit 104b, as shown in FIG.
  • the human detection unit 104a continuously acquires image information including images obtained by photographing the photographing areas TSa to TSc from each of the photographing devices 101a to 101c via the network N.
  • the person detection unit 104a detects a person P from an image included in each piece of image information.
  • the analysis unit 104b analyzes the image information acquired by the person detection unit 104a, and outputs the appearance information of each person P detected by the person detection unit 104a as an analysis result.
  • the analysis unit 104b includes a face recognition function, a human figure recognition function, a posture recognition function, a motion recognition function, a clothing recognition function, an image gradient feature detection function, an image color feature detection function, an object recognition function, and the like. Details of each of these functions will be described later. Note that the analysis unit 104b may have at least one of the functions exemplified here.
  • the analysis unit 104b analyzes the image information using these functions, and as a result continuously acquires the appearance information of one or more persons P who are active in the target space.
  • FIG. 6 is a diagram showing an example of appearance information.
  • Appearance information is information about the appearance of the person P who is active in the target space. Appearance includes posture, behavior, clothing, and the like.
  • Appearance information is, as shown in the figure, information that associates person IDs, area IDs, positions, photographing times, postures, actions, clothes, and surrounding situations.
  • Position and appearance are information obtained as a result of analyzing image information.
  • Appearance information may include at least one of posture, behavior, clothing, and surroundings.
  • the person ID is information for identifying the person P included in the image information.
  • the area ID and shooting time are the area ID and shooting time included in the image information that is the target of analysis.
  • the position is information indicating the position of the person P whose person ID is associated with it.
  • the posture is information related to the posture of the person P's body.
  • the posture includes at least one of a standing position (a standing posture), a sitting position (a sitting posture), a lying position (a lying posture), and the like.
  • the posture may be further subdivided.
  • subdivided sitting positions include a sitting position (sitting on a chair), an upright sitting position (a posture in which the upper body is raised approximately 90 degrees while leaning), crossed legs, and seiza.
  • subdividing the lying position include supine position (posture of lying on one's back), side lying position (posture of lying on one's side), prone position (posture of lying face down), and the like.
  • An action is information related to the action of a person P. Actions may include person P's stillness and movement.
  • Actions include walking, running, talking, fanning with a paper fan, working, eating, dressing, and undressing.
  • the action may be standing still in a certain posture.
  • the act may be a physiological phenomenon such as yawning, sneezing, shivering when cold (shivering), sweating, coughing. Acts include at least one such as those exemplified herein.
  • Clothing is information about the clothing of person P that can be identified from the appearance.
  • clothes are expressed using scores.
  • This score is an example of an index that indicates the extent to which the person P is overdressed or underdressed. In the present embodiment, a higher score indicates thicker clothing. Also, the score is assumed to be an integer from 1 to 5.
  • a clothing score of "5" indicates that the clothing is worn with a cord or equivalent.
  • a clothing score of "4" indicates, for example, a state in which a jacket is worn or a state corresponding thereto.
  • a clothing score of "3” indicates, for example, that the user is wearing a thin sweater or is in a state corresponding thereto.
  • a dress score of "2" indicates that the user is wearing a long-sleeved shirt or is in a state corresponding thereto.
  • a dress score of "1" indicates that the wearer is lightly dressed, for example, wearing a short-sleeved shirt or equivalent.
  • the index may be, for example, an alphabet, a symbol, or the like.
  • it may be appropriately determined how many levels the degree of overweight clothing or the degree of lightly clothed clothing is to be divided into. Clothing is not an index, but the appearance itself (coat, jumper, jacket, sweater, long-sleeved shirt, short-sleeved shirt, long-sleeved T-shirt, short-sleeved T-shirt, etc.) ) may be indicated.
  • the surrounding situation is information indicating the surrounding situation of person P.
  • the surrounding circumstances include at least one of the presence of food, the presence of books or documents, the presence of equipment such as a personal computer, and the like.
  • the analysis unit 104b acquires appearance history information 106a based on continuously acquired appearance information.
  • the analysis unit 104b stores the appearance history information 106a in the history storage unit 106 (see FIG. 3).
  • the history storage unit 106 is a storage unit for storing appearance history information 106a.
  • FIG. 7 is a diagram showing an example of the appearance history information 106a.
  • the appearance history information 106a is information that associates person IDs, area IDs, positions, times, postures, actions, clothes, and surroundings.
  • Appearance history information 106a includes "time" instead of shooting time included in the appearance information.
  • the time is information indicating the time corresponding to the associated person ID, area ID, position, posture, action, clothing, and surroundings.
  • “ ⁇ ” included in the time indicates that the information associated with that time has continued without change from the time included before it. Also, “ ⁇ " included in the time indicates that each piece of information associated with that time continued without change until the time included thereafter.
  • Appearance history information 106a shown in the figure is an example of appearance history information 106a of persons P with person IDs "P1", “P2”, and “P3" who are sitting and working in the photographing area TSa from time T1 to time T3. including. Since the photographing area TSa is set in the conference room R, the persons P with the person IDs "P1", “P2", and “P3" are conducting business such as meetings in the conference room R.
  • Appearance history information 106a in the figure shows that the area ID, position, posture, behavior, clothing, and surroundings associated with this time have not changed since time T1 for person P with person IDs "P1" and "P2.” Include an example to show that it is continuing. Appearance history information 106a in FIG. 10 shows that the area ID, position, posture, behavior, clothes, and surroundings associated with this time did not change from time T1 to time T3 for a person P with a person ID “P3”. Include an example to indicate continued. Appearance history information 106a in the figure includes an example indicating that person P with person ID “P3” was wearing clothes at time T3 after time T1. Appearance history information 106a in the figure includes an example indicating that person P with person ID "P3” is doing work at time T3 wearing "4" clothes.
  • the appearance history information 106a may include at least one of posture, behavior, clothing, and surroundings.
  • the control unit 105 generates control information for controlling one or more of the air conditioners 102a to 102c based on the appearance history information 106a.
  • the control unit 105 transmits the generated control information via the network N to the target air conditioners 102a to 102c.
  • control unit 105 determines whether or not each of the air conditioners 102a to 102c needs to be controlled based on the appearance history information 106a.
  • control unit 105 determines whether the air conditioner 102 needs to be controlled based on the control pattern information 107a.
  • the control pattern storage unit 107 is a storage unit for storing control pattern information 107a. That is, the control unit 105 according to the present embodiment determines whether control of the air conditioner 102 is necessary based on the control pattern information 107a stored in the control pattern storage unit 107. FIG. The control pattern information 107a may be set as appropriate.
  • FIG. 8 is a diagram showing an example of the control pattern information 107a.
  • the control pattern information 107a includes one or more preset control patterns.
  • a control pattern is information that associates a control condition with a control content. "-" in the control pattern information 107a shown in the figure indicates that the corresponding condition is not set.
  • a control condition is a condition for applying the control content associated with it.
  • the control conditions include time (or season) conditions, space (or area) conditions, appearance conditions, and time conditions.
  • time or season
  • space or area
  • appearance conditions or time conditions.
  • time or time
  • the timing, appearance, and time conditions define the timing, appearance, and time to apply the control pattern, respectively.
  • the control unit 105 determines whether or not the appearance history information 106a satisfies the condition regarding the period and time, for example, based on the time included in the appearance history information 106a.
  • the control unit 105 determines whether or not the appearance history information 106a satisfies the conditions related to the appearance based on, for example, the appearance (posture, behavior, clothing, surroundings) included in the appearance history information 106a.
  • the control unit 105 determines whether or not there is appearance history information 106a that satisfies the control conditions included in the control pattern.
  • the control unit 105 determines that there is appearance history information 106a that satisfies the control condition when there is appearance history information 106a that satisfies all the conditions regarding time, appearance, and time. If there is the appearance history information 106a that satisfies the control condition, the control unit 105 determines that control is necessary, and specifies the area ID included in the appearance history information 106a. Then, the control unit 105 identifies the air conditioner 102 to be controlled based on the identified area ID.
  • the control unit 105 generates control information according to the control details included in the control pattern that satisfies the conditions.
  • the control unit 105 transmits the generated control information via the network N to the air conditioner 102 to be controlled.
  • control system 100 has been mainly described. From here, the physical configuration of the control system 100 according to this embodiment will be described.
  • the control system 100 is physically composed of imaging devices 101a to 101c, air conditioners 102a to 102c, and a control device 103, which are connected via a network N.
  • FIG. 1 Physical Configuration of Air Conditioner Control System 100 According to this Embodiment
  • Each of the imaging devices 101a to 101c and the air conditioners 102a to 102c according to this embodiment is physically configured individually. Some or all of the imaging devices 101a to 101c and the air conditioners 102a to 102c may be configured physically as a single unit.
  • the air conditioner 102a may physically include the imaging device 101a.
  • personal computers, terminal devices, and various types of equipment in the target space may be equipped with the imaging devices 101a to 101c. In these cases, the air conditioner 102a, personal computer, terminal device, and various other devices have the functions of the imaging device 101a.
  • the control device 103 is physically composed of a single device.
  • the control device 103 may be physically composed of a plurality of devices connected via an appropriate communication line such as the network N.
  • the control device 103 may be physically divided into a device that executes processing on image information performed by the history acquisition unit 104 and a device that executes other processing in the control device 103 .
  • the control device 103 is physically, for example, a general-purpose computer. Specifically, for example, the controller 103 physically has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, a network interface 1050, an input interface 1060 and an output interface 1070, as shown in FIG.
  • the bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, network interface 1050, input interface 1060 and output interface 1070 to transmit and receive data to and from each other.
  • the method of connecting processors 1020 and the like to each other is not limited to bus connection.
  • the processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.
  • the memory 1030 is a main memory implemented by RAM (Random Access Memory) or the like.
  • the storage device 1040 is an auxiliary storage device realized by a HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, ROM (Read Only Memory), or the like.
  • the storage device 1040 stores program modules for realizing each function of the control device 103 .
  • Each function corresponding to the program module is realized by the processor 1020 reading each program module into the memory 1030 and executing it.
  • the network interface 1050 is an interface for connecting the control device 103 to the network N.
  • the input interface 1060 is an interface for the user to input information.
  • the input interface 1060 is composed of one or more of, for example, a touch panel, keyboard, mouse, and the like.
  • the output interface 1070 is an interface for presenting information to the user.
  • the output interface 1070 is composed of one or more of a liquid crystal panel, an organic EL (Electro-Luminescence) panel, and the like.
  • control system 100 So far, the physical configuration of the control system 100 according to this embodiment has been described. From here, the operation of the control system 100 according to this embodiment will be described.
  • control device 103 when receiving a start instruction from the user, the control device 103 repeatedly executes the air conditioner control process (see FIG. 2) until receiving an end instruction from the user.
  • the history acquisition unit 104 processes image information including images of the target space (in the present embodiment, the meeting room R and the corridor C), and obtains the appearance of one or more persons P active in the target space. (step S101).
  • step S101 is flowcharts showing a detailed example of the history acquisition process according to this embodiment.
  • image information including an image captured at time T1 of the capturing area TSa shown in FIG. is stored (see FIG. 7). Then, it is assumed that the person P in the conference room R has not moved since time T1. For example, it is assumed that eight persons P are present in the photographing area TSa from time T1 until at least time T3. Based on this assumption, an example in which step S101 is executed for image information including an image of the imaging region TSa captured at time T3 will be described as appropriate.
  • the human detection unit 104a acquires image information including images of the photographing areas TSa to TSc from the photographing devices 101a to 101c via the network N (step S101a).
  • the person detection unit 104a detects the person P from the images included in each piece of image information (step S101b).
  • step S101b the person detection unit 104a assigns a person ID to each person P detected.
  • the person ID is information for identifying each person P that has been detected.
  • a person ID may be assigned according to appropriate rules.
  • the person ID given here is temporary.
  • the human detection unit 104a detects eight people in step S101b for the image included in the image information of the imaging region TSa shown in FIG. 4 captured at time T3.
  • the person detection unit 104a assigns a provisional person ID to each of the eight persons in each step S101b.
  • the analysis unit 104b analyzes the image information acquired in step S101a (step S101c).
  • the analysis unit 104b has a face recognition function, a human type recognition function, a posture recognition function, a motion recognition function, a clothing recognition function, an image gradient feature detection function, an image color feature detection function, and an object recognition function. Equipped with functions, etc.
  • the analysis unit 104b analyzes the image information using these functions.
  • the facial recognition function extracts the facial features of person P.
  • the face recognition function may locate the person P's face in the image.
  • the human type recognition function extracts the human body features of person P.
  • Anthropomorphic features represent overall features such as fatness, height, and clothing.
  • the human recognition function may identify the position of the person P within the image.
  • the posture recognition function detects the joint points of person P and creates a stick figure model by connecting the joint points.
  • the posture recognition function uses the information of the stick figure model to extract the feature amount of the posture and estimate the posture of the person P.
  • the posture recognition function may estimate the height of the person P.
  • the posture recognition function may identify the position of the person P within the image.
  • the motion recognition function identifies changes in the posture of the person P based on the posture feature amount extracted by the posture recognition function, and estimates the motion of the person P.
  • the posture recognition function and motion recognition function are based on the technology disclosed in WO2021/084677, Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh, "Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields", It may be realized using the technology disclosed in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, P. 7291-7299.
  • the clothing recognition function estimates the clothing (coat, jumper, jacket, sweater, long-sleeved shirt, short-sleeved shirt, long-sleeved T-shirt, short-sleeved T-shirt, etc.) that can be identified from the appearance of the person P.
  • Image gradient feature detection functions include SIFT, SURF, RIFF, ORB, BRISK, CARD, and HOG.
  • the image color feature detection function outputs data indicating the color features of the image, such as a color histogram.
  • the object recognition function is configured using technology such as YOLO (which can extract general objects [for example, cars, bicycles, chairs, etc.] and extract people).
  • YOLO which can extract general objects [for example, cars, bicycles, chairs, etc.] and extract people).
  • the object recognition function detects an object as a surrounding situation from an image and identifies the position of the object in the image.
  • the analysis unit 104b acquires the posture of the appearance information using the posture recognition function.
  • the analysis unit 104b uses the motion recognition function to acquire the behavior of the appearance information. For example, the analysis unit 104b holds action data that predetermines actions according to the movement of the person P. FIG. The analysis unit 104b acquires the action of the appearance information based on the movement of the person P estimated using the motion recognition function and the action data.
  • the analysis unit 104b may acquire the action of the appearance information based on the posture of the person P estimated using the posture recognition function and the circumstances around the person P estimated using the object recognition function. For example, the analysis unit 104b may acquire the act of doing business based on the presence of a device such as a personal computer, a book, a document, or the like around the sitting person.
  • a device such as a personal computer, a book, a document, or the like around the sitting person.
  • the analysis unit 104b may acquire the action of the appearance information based on the movement of the person P estimated using the motion recognition function and the circumstances surrounding the person P estimated using the object recognition function. For example, the analysis unit 104b may acquire the act of having a meal based on the presence of a meal around the person P who is moving his hand toward his mouth.
  • the analysis unit 104b analyzes the motion of the person P estimated using the motion recognition function, the posture of the person P estimated using the posture recognition function, and the circumstances around the person P estimated using the object recognition function. Based on the behavior of the appearance information may be obtained. For example, the analysis unit 104b may acquire the act of having a meal based on the presence of a meal around the person P who is sitting and moving his hand toward his mouth.
  • the analysis unit 104b uses the clothing recognition function to estimate clothing that can be determined from the appearance of the person P.
  • the analysis unit 104b holds, for example, clothes data in which clothes and scores are associated in advance.
  • the analysis unit 104b refers to the clothing data and obtains a clothing score corresponding to the estimated clothing. Specifically, for example, the action data associates the clothing “coat” with the score "5". For example, the action data associates the clothing "short-sleeved dress shirt” with the score "1".
  • the analysis unit 104b acquires the surrounding situation using the object recognition function.
  • the analysis unit 104b determines the identity of the person P between different images. For example, the analysis unit 104b analyzes at least one of the facial feature amount, the human body feature amount, the posture feature amount, the action feature amount, the position of the face of the person P in the image, the position of the person P in the image, and the clothing. is used to determine the identity of a person P between different images.
  • the analysis unit 104b corrects the temporary person ID given in step S101b so that the same person has the same person ID. As a result of this correction, the person ID of each person P detected in step S101b is determined. Further, by determining the identity of the person P, it is possible to acquire the line of flow of the person P based on the image information (flow line analysis).
  • Each function such as a face recognition function, a human figure recognition function, a posture recognition function, a motion recognition function, a clothing recognition function, an image gradient feature detection function, an image color feature detection function, an object recognition function, etc., provided in the analysis unit 104b. can be realized, for example, by using a learning model that has been trained by performing machine learning.
  • the analysis unit 104b includes, for example, a learning model for each function.
  • the learning model takes image information as input and outputs an estimation result according to its function. Input data to the learning model during learning is image information.
  • image information In machine learning, it is preferable to perform supervised learning in which an estimation result corresponding to image information is regarded as a correct answer.
  • the processing for image information described here is only an example.
  • the processing for the image information may be processing capable of acquiring appearance information, and various known techniques such as pattern matching may be applied.
  • the analysis unit 104b acquires the appearance information of the person P detected in step S101b as a result of the analysis processing in step S101c (step S101d).
  • the analysis unit 104b sets the person ID determined in step S101c to the "person ID” of the appearance information.
  • the analysis unit 104b sets the area ID and the shooting time included in the image information analyzed in step S101c to the "area ID” and “shooting time” of the appearance information, respectively.
  • the analysis unit 104b uses the position, posture, behavior, clothing, and surroundings of the person P estimated as the result of the analysis in step S101c to obtain the "position”, “posture”, “action”, and “clothes” of the appearance information. , and “Surroundings” respectively.
  • step S101c for each piece of image information including an image of the imaging region TSa captured at time T3, the analysis unit 104b determines the person P detected based on the image and the person ID included in the appearance history information 106a. The identity of "P1" to "P3" with person P is determined. As a result, as shown in FIG. 12, the analysis unit 104b determines that the person IDs of those persons P are "P1" to "P3".
  • FIG. 12 is a diagram showing the relationship between the provisional person ID and the person ID determined as a result of determining the identity of person P.
  • provisional person IDs "Q1" to “Q8” are identified as person IDs "P1" to "P8" contained in appearance history information 106a as a result of the determination of the identity of person P, respectively. Determine.
  • the first appearance information is obtained for person ID "P3."
  • the first appearance information includes person ID "P3", area ID "TSa”, position “X3", time “T2", posture “sitting position”, action "business", clothing “3”, surrounding situation "document”. including.
  • step S101c for the image information including the image of the imaging area TSa captured at time T3 after time T2
  • the second appearance information and the third appearance information are obtained for the person ID “P3”. Assume that you have obtained
  • the second appearance information includes person ID "P3", area ID "TSa”, position "X3", time "T3", posture “sitting position”, action "business", clothing "4", surrounding situation "document”. including.
  • the third appearance information includes person ID "P3", area ID "TSa”, position "X3", time "T3", posture “sitting position”, action “put on clothes”, clothes "4", surrounding situation " including “documents”.
  • the analysis unit 104b repeats steps S101f to S101i for each piece of appearance information acquired in step S101d (step S101e; loop A).
  • the analysis unit 104b determines whether there is appearance history information 106a including the same person ID as the person ID included in the appearance information to be processed (step S101f).
  • step S101f If it is determined that there is no (step S101f; No), the analysis unit 104b newly creates appearance history information 106a based on the appearance information to be processed (step S101g).
  • the analysis unit 104b causes the history storage unit 106 to store the newly created appearance history information 106a.
  • step S101g the analysis unit 104b newly creates appearance history information 106a corresponding to the appearance information to be processed. Specifically, the analysis unit 104b sets each piece of information included in the appearance information to be processed in each corresponding item of the appearance history information 106a. Here, the analysis unit 104b sets the shooting time included in the appearance information to the time of the appearance history information 106a.
  • step S101g After executing step S101g, if there is unprocessed appearance information, the analysis unit 104b executes loop A (step S101e) again. When there is no unprocessed appearance information, the analysis unit 104b ends the history acquisition process (step S101) and returns to the air conditioner control process.
  • step S101f If it is determined that there is (step S101f; Yes), the analysis unit 104b determines whether or not there is a change in the position and appearance (step S101h).
  • step S101h the analysis unit 104b determines whether there is a change in the position and appearance included in each of the appearance information to be processed and the appearance history information 106a including the same person ID as the person ID included therein. judge.
  • step S101h If it is determined that there is no change (step S101h; No), the analysis unit 104b continues the appearance included in the appearance history information 106a including the same person ID. Loop A (step S101e) is executed again. When there is no unprocessed appearance information, the analysis unit 104b ends the history acquisition process (step S101) and returns to the air conditioner control process.
  • step S101h for the first appearance information described above the analysis unit 104b determines that there is no change, and ends loop A (step S101e) for the first appearance information.
  • Step S101h If it is determined that there is a change (Step S101h; Yes), the analysis unit 104b creates new appearance history information 106a and/or updates the appearance history information 106a based on the appearance information to be processed. (Step S101i).
  • “A and/or B” means either one or both of A and B, and the same applies hereinafter. That is, in step S101g, the analysis unit 104b performs one or both of newly creating the appearance history information 106a and updating the appearance history information 106a.
  • the second appearance information indicates changes in the appearance ("clothes" in this example) of the appearance history information 106a continuing from time T1 for the same appearance (posture, action, clothing, and surroundings). Therefore, the analysis unit 104b updates the appearance history information 106a. Then, appearance history information 106a corresponding to the second appearance information is newly created. The process of newly creating appearance history information 106a is the same as that of step S101g described above. The analysis unit 104b causes the history storage unit 106 to store the newly created appearance history information 106a.
  • step S101g the analysis unit 104b sets the person ID "P3", the area ID "TSa”, the position “X3", the time “T1 ⁇ ”, the posture “sitting position”, the action “work”, the clothes “3 ”, and the appearance history information 106a of the surrounding situation “document” is updated.
  • the analysis unit 104b updates the time “T1-” to the time "T1-T3” (see FIG. 7).
  • the analysis unit 104b obtains, as the appearance history information 106a corresponding to the second appearance information, the person ID “P3”, the region ID “TSa”, the position “X3”, the time “T3”, the posture “sitting position”, the action “ Appearance history information 106a including "work", clothes "4", and surroundings "documents” is created (see FIG. 7).
  • the analysis unit 104b converts the appearance history information 106a so as to indicate termination of the appearance indicated by the appearance history information 106a. update the time of Then, the analysis unit 104b newly creates appearance history information 106a corresponding to the appearance information.
  • the above-mentioned third appearance information is to be processed. It is also assumed that there is no appearance history information 106a continuing from time T1 for the same appearance (posture, behavior, clothing, and surroundings). In this case, appearance history information 106a corresponding to the third appearance information is newly created. The process of newly creating appearance history information 106a is the same as that of step S101g described above.
  • the analysis unit 104b causes the history storage unit 106 to store the newly created appearance history information 106a.
  • the analysis unit 104b uses the appearance history information 106a corresponding to the third appearance information as the person ID “P3”, the area ID “TSa”, the position “X3”, the time “T3”, the posture “sitting position”, Appearance history information 106a including action “put on clothes", clothes "4", and surrounding situation “documents” is created (see FIG. 7).
  • step S101i After executing step S101i, if there is unprocessed appearance information, the analysis unit 104b executes loop A (step S101e) again. When there is no unprocessed appearance information, the analysis unit 104b ends the history acquisition process (step S101) and returns to the air conditioner control process.
  • control unit 105 outputs control information for controlling the air conditioner 102 based on the appearance history information 106a (step S102).
  • FIG. 13 is a flowchart showing a detailed example of the control information output process (step S102) according to this embodiment.
  • the history storage unit 106 and the control pattern storage unit 107 store appearance history information 106a shown in FIG. 7 and control pattern information 107a shown in FIG. 8, respectively. is stored.
  • FIG. 8 it is assumed that the "predetermined action when it is cold" is to get dressed in the conference room R.
  • the appearance history information 106a and the control pattern information 107a are appropriately referred to for explanation.
  • the control unit 105 determines whether it is necessary to control the air conditioner 102 based on the appearance history information 106a and the control pattern information 107a (step S102a).
  • the control unit 105 determines whether or not there is appearance history information 106a that satisfies the control conditions included in the control pattern information 107a. If there is appearance history information 106a that satisfies the control condition, the control unit 105 determines that control is necessary. If there is no appearance history information 106a that satisfies the control condition, the control unit 105 determines that control is unnecessary.
  • control unit 105 determines that control is necessary when there is appearance history information 106a that satisfies all of the conditions regarding time, space, appearance, and time.
  • the control unit 105 determines that control is not necessary when there is no appearance history information 106a that satisfies all of the conditions regarding time, space, appearance, and time.
  • the appearance history information 106a is information indicating that a person P with a person ID “P3” performed an action “put on clothes” in a shooting area with an area ID “TSa” at time T3. (hereinafter, this information is referred to as "first appearance history information 106a").
  • the first appearance history information 106a satisfies a control condition (hereinafter referred to as "first control condition") that includes "predetermined action in cold weather” as a condition related to appearance.
  • first control condition a control condition that includes "predetermined action in cold weather” as a condition related to appearance.
  • the control unit 105 determines that control is necessary.
  • the first control condition does not include control conditions relating to (1) time, (2) space and (3) time.
  • a determination method when the control conditions include these conditions will be described.
  • control unit 105 When the control condition includes a period-related condition, the control unit 105 satisfies the period-related condition based on whether or not the "time” included in the appearance history information 106a is included in the "period" of the control condition. Determine whether or not Specifically, when the “time” is included in the “time”, the control unit 105 determines that the condition regarding the time is satisfied. When the "time” is not included in the “time”, the control unit 105 determines that the condition regarding the time is not satisfied. Note that the "time” included in the appearance history information 106a also includes the date.
  • control unit 105 determines whether the attribute of the area indicated by the "area ID" included in the appearance history information 106a corresponds to the attribute indicated by the "space” of the control condition. Based on, it is determined whether or not the space conditions are satisfied.
  • control unit 105 determines that the space condition is satisfied. judge. If the attribute of the area indicated by the "area ID" does not correspond to the attribute indicated by the control condition "space” (for example, if they do not match), the control unit 105 determines that the space condition is not satisfied.
  • control unit 105 identifies the attribute of the area indicated by the "area ID" based on the spatial association information held in advance.
  • FIG. 14 is a diagram showing an example of spatial correspondence information.
  • the space association information is information that associates a target space ID, a space attribute, an area ID, and an air conditioner ID.
  • the target space ID is information for identifying the target space.
  • the target space ID "R” is. This is the target space ID of the conference room R.
  • the target space ID “C” is the target space ID of the corridor C.
  • the space attribute indicates the attributes of the target space and shooting area indicated by the associated target space ID and area ID.
  • the conference room R with the target area ID "R” includes the shooting areas TSa and TSb with the area IDs "TSa” and "TSb", and the attributes of the shooting areas TSa and TSb are " Indicates that it is a conference room.
  • the spatial association information in FIG. 14 indicates that the attribute of the shooting area TSa is "entrance" of "meeting room”.
  • the air conditioner ID is information for identifying the air conditioners 102a to 102c.
  • the air conditioner IDs "AC1”, “AC2”, and “AC3” are the air conditioner IDs of the air conditioners 102a, 102b, and 102c, respectively.
  • the attribute of the shooting area TSa with the area ID "TSa” is "entrance” of "meeting room".
  • the control unit 105 determines that the appearance history information 106a satisfies the space condition "meeting room” or "meeting room doorway”.
  • the attribute of the shooting area TSb with the area ID "TSb” is "meeting room”.
  • the control unit 105 determines that the appearance history information 106a satisfies the space condition “meeting room”.
  • control unit 105 determines whether or not the time-related condition is satisfied based on the "time" included in the appearance history information 106a.
  • control unit 105 performs statistical processing of the appearance history included in the viewing history information 106a.
  • the control unit 105 performs statistical processing according to control conditions.
  • the control unit 105 performs statistical processing to count "the number of people wearing "4" clothes” in the "meeting room” for the most recent appearance history information 106a. As a result of the statistical processing, it is assumed that the most recent appearance history information 106a satisfies the appearance condition "the number of people wearing clothing "4" is equal to or greater than the threshold value K4". If the appearance condition is not satisfied, the control unit 105 terminates the statistical processing.
  • the control unit 105 performs statistical processing to count "the number of people wearing "4" clothes” in the "meeting room” for the past appearance history information 106a. That is, here, the control unit 105 performs statistical processing regarding temporal changes. As a result of this statistical processing, if the state in which “the number of people wearing clothes “4” is equal to or greater than the threshold value K4” continues “for TH4 or longer”, the control unit 105 determines that the time-related condition is satisfied, and performs the statistical processing. exit. If the state satisfying “the number of people wearing clothes “4” is equal to or greater than the threshold value K4” does not “continue for TH4 or more”, the control unit 105 determines that the time-related condition is not satisfied, and terminates the statistical processing.
  • step S102a When it is determined that control is not necessary (step S102a; No), the control unit 105 terminates the control information output process (step S102) and the air conditioner control process (see FIG. 2).
  • control unit 105 identifies the area ID included in the appearance history information 106a that is the basis of the determination (step S102b).
  • control unit 105 identifies the area ID "TSa" included in the first appearance history information 106a.
  • the control unit 105 identifies the air conditioner 102 to be controlled according to the region ID identified in step S102b and the control details included in the control pattern that satisfies the control condition in step S102a (step S102c).
  • control unit 105 refers to the control pattern information 107a and acquires control details associated with the first control condition.
  • the control unit 105 selects the air conditioner 102 to be controlled based on the region ID “TSa” identified in step S102b and the control content “increase the target temperature of the target space by TP from the current temperature” associated with the first control condition. Identify.
  • the control content is the "target space”. Therefore, the control unit 105 identifies the “target space” including the identified region ID “TSa” based on the spatial association information (see FIG. 14). For example, the control unit 105 identifies the target space ID "R" (meeting room R) as the target space including the identified area ID "TSa”.
  • the control unit 105 identifies the air conditioner 102 associated with the identified target space as the air conditioner 102 to be controlled based on the space association information (see FIG. 14). For example, the control unit 105 selects the air conditioner IDs "AC1" and “AC2" (air conditioners 102a and 102b) associated with the identified target space ID "R" (meeting room R) as the air conditioners 102 to be controlled. Identify.
  • the control unit 105 generates control information according to the control details included in the control pattern that satisfies the control condition in step S102a (step S102d).
  • the control unit 105 transmits the control information generated in step S102d to the control target air conditioner 102 identified in step S102c via the network N (step S102e).
  • the control unit 105 ends the control information output process (step S102) and the air conditioner control process (see FIG. 2).
  • the air conditioner 102 acquires the control information transmitted in step S102e via the network N.
  • the air conditioner 102 operates according to the acquired control information. Therefore, the air conditioner 102 can be controlled based on the image information including the captured image of the target space.
  • the appearance history information 106a satisfies a control condition that associates the space condition “meeting room entrance/exit” and the appearance condition “state where the number of people wearing clothes “5” is equal to or greater than the threshold K3” among the control conditions shown in FIG. and
  • the target temperature of the air conditioner 102 for example, the air conditioner 102a
  • the entrance/exit for example, the imaging area TSa
  • the target temperature of the air conditioner 102 associated with the entrance/exit of the conference room can be increased by TP3 degrees from the current temperature. Therefore, even if the person P at the entrance/exit of the meeting room is not aware of it, it is possible to easily provide the person P with a comfortable air environment.
  • the appearance history information 106a satisfies a control condition that associates the space condition “meeting room” and the appearance condition “state where the number of people wearing clothes “4” is equal to or greater than the threshold value K4” among the control conditions shown in FIG. .
  • the air conditioner 102 controls the target temperature of the conference room, which is the target space that satisfies the control conditions, to be 4 degrees TP lower than the standard temperature.
  • suits are worn as a matter of etiquette at meetings.
  • the air conditioner 102 if the air conditioner 102 is operated at the normal target temperature, it may become hot.
  • the target temperature of the air conditioner 102 associated with the conference room can be lowered by TP4 degrees from the standard. Therefore, even if the person P in the meeting room is not aware of it, it is possible to easily provide the person P with a comfortable air environment.
  • the control unit 105 based on the appearance history information 106a obtained as a result of processing the image information including the image of the area (for example, the shooting area TSc) captured in the target space (for example, the corridor C), Output control information.
  • This control information is control information for adjusting a space (eg, conference room R) different from the target space (eg, corridor C).
  • the target temperature of the air conditioners 102 (for example, the air conditioners 102a and 102b) associated with the entrances (for example, the imaging areas TSa and TSb) of the conference room can be raised by TP5 degrees from the standard.
  • the conference room R connected to it may also be cold.
  • the air conditioner 102 is operated at the standard target temperature, the person P using the conference room R may be cold.
  • the target temperature of the air conditioner 102 associated with the conference room can be raised by TP5 degrees from the standard. Therefore, even if the person P in the meeting room is not aware of it, it is possible to easily provide the person P with a comfortable air environment.
  • a space different from the target space means that the air conditioner 102 that adjusts the air environment of the space does not substantially affect the target space.
  • the control device 103 includes a history acquisition unit 104 and a control unit 105.
  • the history acquisition unit 104 processes image information including captured images of the target space, and acquires appearance history information 106a including the appearance history of one or more people active in the target space.
  • the control unit 105 outputs control information for controlling the air conditioner 102 based on the appearance history information 106a.
  • the control device can control the air conditioner 102 based on the appearance history information 106a acquired from the image information including the captured image of the target space.
  • the image information can be obtained by providing a device for photographing the target space, the appearance history information 106a can also be obtained easily. Therefore, it becomes possible to easily control the air environment of the space using the air conditioner 102 .
  • the image information can be obtained based on the shooting of the target space, the person P in the target space does not need to be conscious of it to obtain it. Therefore, it becomes possible to control the air conditioner 102 without making people aware of it.
  • Appearance history information 106a includes the appearance history of one or more people active in the target space. Therefore, it is possible to determine how to control the air conditioner 102 based on the past appearance history information 106a and the control information. As a result, it is possible to provide a more comfortable air environment than, for example, controlling the air conditioner based only on the current appearance.
  • the control unit 105 controls the air conditioner 102 based on the result of statistically processing the appearance history. Since the result of statistically processing the appearance history is used for controlling the air conditioner 102, the air conditioner 102 can be controlled so as to provide a more comfortable air environment. Therefore, it is possible to use the air conditioner 102 to make the air environment of the space more comfortable.
  • statistical processing includes at least one of the attributes of the target space or an area included in the target space, the appearance of a person in the target space or area, and the attribute of a person in the target space or area. Including statistical processing related to Since the results of statistical processing of appearance histories with respect to at least one of area attributes and human attributes are used for controlling the air conditioner 102, the air conditioner 102 can be controlled so as to provide a more comfortable air environment. Therefore, it is possible to use the air conditioner 102 to make the air environment of the space more comfortable.
  • the statistical processing includes the attributes of the target space or an area included in the target space, the appearance of the person in the target space or area, the attribute of the person in the target space or area, and at least one time including statistical processing of changes in Since the results of statistical processing of appearance histories with respect to at least one of area attributes and human attributes are used for controlling the air conditioner 102, the air conditioner 102 can be controlled so as to provide a more comfortable air environment. Therefore, it is possible to use the air conditioner 102 to make the air environment of the space more comfortable.
  • the control unit 105 controls the air conditioner 102 based on control pattern information including control details of the air conditioner 102 according to the result of statistical processing. Since the control pattern information is used to control the air conditioner 102, the air conditioner 102 can be controlled so as to provide a more comfortable air environment. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 .
  • control unit 105 outputs control information for adjusting a space different from the target space based on the appearance history information 106a.
  • the history acquisition unit 104 processes a plurality of pieces of image information each including images obtained by photographing a plurality of target spaces, and obtains appearance history information 106a, which is a history of the appearance of one or more people active in each of the plurality of target spaces. to get
  • control unit 105 outputs control information for controlling at least one air conditioner 102 associated with at least one of the plurality of target spaces.
  • control information for controlling at least one air conditioner 102 associated with at least one of the plurality of target spaces.
  • the air conditioner 102 is not limited to an air conditioner, and may be any device, device, facility, or the like that adjusts the air environment of the space associated therewith.
  • the air conditioner 102 may be cooling, heating, floor heating, a humidifier, a dehumidifier, an air purifier, a ventilation fan, a circulator, an electric fan, an aroma diffuser that sprays aroma oil into the air, or the like.
  • the air conditioner 102 may be a device, device, or facility that has one of a function of cooling air and a function of warming air as a function of adjusting the temperature of air.
  • the air conditioner 102 may be a device, device, or facility that has one of a function of humidifying air and a function of dehumidifying air as a function of adjusting the humidity of air.
  • the air conditioner 102 may be a device, device, or facility having a function of purifying air.
  • the air conditioner 102 may be a device, device, or facility that has a function of moving air.
  • the air conditioner 102 may be a device, device, or facility that has a function of spraying a substance containing an aromatic component into the air.
  • the air conditioner 102 may be a device, device, or facility that has more than one of the functions exemplified here.
  • the target space may be set to a house, a school, or the like.
  • the attributes of the target space may be one or more such as the living room, dining room, kitchen, private room, bedroom, outside the entrance, the dirt floor inside the entrance, and the corridor.
  • the attributes of the target space may be one or more of classrooms, auditoriums, corridors, laboratories, staff rooms, and the like.
  • the attribute of the target space may include the extent of the width of the target space.
  • the control pattern in the case where the target space is set to a house is to lower the target temperature of the bedroom by a predetermined temperature from the current temperature when the state of being in the supine position (sleeping) in the bedroom continues for a predetermined time or longer. can be anything. This allows the target temperature to be lowered if one is about to sleep in the bedroom. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • the control pattern when the target space is set to a house is to raise the target temperature of the bedroom by a predetermined temperature from the current temperature if the state of being in the supine position (sleeping) in the living room continues for a predetermined time or longer. can be anything. As a result, the target temperature can be raised when sleeping in the living room. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • the control pattern when the target space is set to a house may be such that the target temperature of the bedroom is lowered by a predetermined temperature from the current temperature when the sweating state continues for a predetermined time or longer. .
  • the target temperature can be lowered when the user is sweating after taking a bath or returning from going out. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • Appearance information and appearance history information 106a may further include the person P's attributes.
  • the attribute of the person P is at least one of gender, age group, and the like.
  • the following example can be given as a control pattern when the appearance information and appearance history information 106a includes gender and/or age group as attributes of the person P.
  • the control condition of the control pattern may be that women and/or a predetermined age group (e.g., elderly people, children, etc.) occupy a predetermined ratio or more in the target space or an area included in the target space.
  • the control condition of the control pattern is that a state in which women and/or a predetermined age group (e.g., elderly people, children, etc.) occupy a predetermined proportion or more in the target space or region continues for a predetermined time or longer. It may be to
  • control content is to weaken the blowing of air in the target space or an area included in the target space by a predetermined step from the current level, and/or to set the target temperature of the target space or area lower than the current level. It may also be to raise the temperature.
  • the blowing of the air conditioner 102 associated with the target space or the relevant area is weakened.
  • the target temperature can be increased. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • the control pattern may control the air conditioner 102 on the condition that the person P moves and/or enters and exits the target space or an area included in the target space.
  • control condition of the control pattern may be that the number of persons P whose positions change in the target space or an area included in the target space is equal to or greater than a predetermined number and continues for a predetermined time or longer.
  • control condition is predetermined that the number of people P exiting the target space or an area included in the target space and/or the number of people P entering the target space or the area is equal to or greater than a predetermined number. It may be continued for more than the specified time.
  • control in these cases are to increase the blowing of air in the target space or an area included in the target space by a predetermined step from the current level, and/or to set the target temperature of the target space or the target area higher than the current level in advance. It may be to lower a predetermined temperature.
  • the control pattern may control the air conditioner 102 on the condition of the density of the people P in the target space or an area included in the target space.
  • the control condition of the control pattern may be that the density of people P in the target space or an area included in the target space is equal to or higher than a predetermined ratio. Further, the control condition may be that the density of the people P in the target space or an area included in the target space is equal to or higher than a predetermined ratio and continues for a predetermined time or longer.
  • control in these cases are to increase the blowing of air in the target space or an area included in the target space by a predetermined step from the current level, and/or to set the target temperature of the target space or the target area higher than the current level in advance. It may be to lower a predetermined temperature.
  • the control pattern is a change in appearance when and after the person P enters the target space or an area included in the target space, or a change in appearance after the person P enters the target space or an area included in the target space. on the condition that the air conditioner 102 may be controlled.
  • the control condition of the control pattern may be that the clothing changes to light or heavy when the person P enters the target space or an area included in the target space.
  • the control condition may be that a coat was put on when entering the target space or region of interest, and the coat or underlying sweater was removed after entering.
  • the control condition may be that the coat was not worn when entering the target space or region of interest, but was worn after entering.
  • control condition may be that the person P has changed their underwear within a predetermined time after entering the target space or an area included in the target space.
  • the content of control may be to switch the operation mode according to the appearance (clothes) after entering, and to change the target temperature according to a predetermined temperature.
  • the target space or the region is changed according to the change in appearance between when and after the person P enters the target space or the region, or the change in the appearance after the person P enters the target space or the region.
  • the air conditioner 102 associated with can be controlled. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • the control device 103 may acquire various types of information such as weather forecast information related to weather forecasts from an external device (not shown). Various information may be obtained from the device. For example, the control device 103 may estimate the current weather based on image information from a photographing device that is installed at the entrance of a building where the target space is set and photographs the outdoors.
  • control conditions of the control pattern may further include conditions related to various types of information (eg, weather forecast information and/or current weather).
  • the air conditioner 102 associated with the target space or an area included in the target space according to information from an external device and/or various devices installed in a building or the like. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • the control device 103 may create or change the control pattern information 107a.
  • the control device 103 may use one or more of the control pattern information 107a and the control pattern information created or changed to control the air conditioner 102 .
  • the control device 103 may use any one of the plurality of pieces of control pattern information for controlling the air conditioner 102 according to an order of priority determined by an appropriate method.
  • FIG. 15 is a diagram showing the configuration of the control system 100 according to this modified example.
  • the control device 103 according to this modification further includes an operation status acquisition unit 111, an operation history storage unit 112, a creation unit 113, and an individual creation unit 114, as shown in FIG.
  • the operation status acquisition unit 111 acquires operation status information indicating the operation status of the air conditioner 102 from each of one or more air conditioners 102 via the network N.
  • the operation status information includes at least one of, for example, the air conditioner ID, the current time, whether the air conditioner is operating, the operation mode when the air conditioner is operating, and the target temperature.
  • the operation status acquisition unit 111 causes the operation history storage unit 112 to store the acquired operation status information. As a result, the operation history of one or more air conditioners 102 is stored in the operation history storage unit 112 .
  • the operation status acquisition unit 111 uses a remote controller (not shown) of the air conditioner 102 from each of one or more air conditioners 102 via the network N to manually change the settings of the air conditioner 102. If so, obtain change information about the change.
  • the change information includes, for example, the air conditioner ID, the time when the change was manually performed (change time), and the content of the change.
  • the contents of the change include one or more of power on/off, operation mode setting or change, target temperature setting or change, air volume setting or change, and wind direction setting or change.
  • the operation status acquisition unit 111 causes the operation history storage unit 112 to store the acquired change information.
  • the operation history storage unit 112 is a storage unit for storing information regarding the operation of the air conditioner 102 .
  • Information stored in the operation history storage unit 112 includes operation status information, change information, and the like.
  • the creation unit 113 creates control pattern information including control patterns to be applied to one or more air conditioners 102 based on the operation history of one or more air conditioners 102 .
  • the creation unit 113 acquires the operation status information stored in the operation history storage unit 112 as an operation history.
  • the creation unit 113 statistically processes the operation history, and creates a control pattern for the air conditioner 102 as a result.
  • the creation unit 113 causes the control pattern storage unit 107 to store control pattern information including the created control pattern.
  • the creation unit 113 acquires average values of operation modes, target temperatures, air volumes, etc. of all the air conditioners 102 for a predetermined period or based on the operation history. Using these average values, the creation unit 113 creates first control pattern information including a standard control pattern including a standard operation mode, target temperature, air volume, and the like according to the season. The creation unit 113 causes the control pattern storage unit 107 to store the first control pattern information.
  • the creation unit 113 determines variables (thresholds K1 to K7, times TH2 to TH7, temperatures TP1 to TP6, operation mode, etc.) included in the control pattern information 107a based on the appearance history information 106a and the operation history. one or more).
  • the creation unit 113 identifies the air conditioners 102 that operate under conditions corresponding to the control conditions of the control pattern based on a predetermined period or all of the appearance history information 106a.
  • the creation unit 113 acquires the average value of the values corresponding to the variables included in the control pattern based on the identified operation history of the air conditioner 102 .
  • the creating unit 113 acquires the operating mode most frequently used based on the identified operation history of the air conditioner 102 .
  • the average value and mode value are an example of a method of creating control conditions based on the appearance history information 106a, and may be changed as appropriate.
  • the creation unit 113 uses at least one of the acquired average value and the most frequently used operation mode to change the variables of the control pattern or the standard control pattern included in the control pattern information 107a to create a second control pattern to create The creation unit 113 causes the control pattern storage unit 107 to store the second control pattern information.
  • the individual creating unit 114 creates control pattern information for the changed air conditioner 102 based on change information related to the change.
  • the individual creation unit 114 when change information is acquired from the air conditioner 102a within a predetermined time after transmission of control information to the air conditioner 102a, the individual creation unit 114 refers to this change information. . Based on the change information, the individual creation unit 114 acquires values corresponding to variables included in the control pattern applied when the control information was transmitted to the air conditioner 102a.
  • the individual creation unit 114 uses the acquired values to change the variables included in the control pattern applied when the control information was transmitted to the air conditioner 102a. As a result of this change, the individual creation unit 114 creates third control pattern information for the air conditioner 102a. The individual creating unit 114 causes the control pattern storage unit 107 to store the third control pattern information.
  • the creation unit 113 creates control pattern information based on the result of statistically processing the operation history of the air conditioner 102a. Thereby, it is possible to create control pattern information corresponding to the actual operation status of the air conditioner 102a. Therefore, it is possible to easily make the air environment of the space comfortable by using the air conditioner 102a without the person being conscious of it.
  • the user of the control device 103 can save the trouble of creating control pattern information in advance. Therefore, it becomes possible to improve the convenience for the user of the control device 103 .
  • the individual creation unit 114 creates control pattern information for the changed air conditioner 102 based on the change information related to the change. Create individual control pattern information.
  • the control device 103 may control the air conditioner 102 by referring to the usage schedule of the conference room R as the target space and the personal schedule of the user of the conference room R as the target space.
  • FIG. 16 is a diagram showing the configuration of the control system 100 according to this modified example.
  • a control system 100 according to this modification includes a schedule management device 215 .
  • the schedule management device 215 is a device that manages schedule information.
  • the schedule information includes at least one of a usage schedule of the conference room R and a user's personal schedule.
  • the schedule information includes one or more of the subject of the schedule, scheduled time (including scheduled time and period), location, content (for example, meeting), and the like.
  • the schedule management device 215 is connected to the control device 103 via the network N.
  • the control device 103 and the schedule management device 215 exchange information via the network N with each other.
  • control device 103 includes a control unit 205 that replaces the control unit 105 and further includes a schedule acquisition unit 216 .
  • the schedule acquisition unit 216 acquires schedule information from the schedule management device 215 via the network N.
  • the control unit 205 has the functions of the control unit 105 according to the embodiment. Control unit 205 further controls air conditioner 102 based on the schedule information. For example, the control unit 205 controls the air conditioner 102 before the target space is used based on the schedule information.
  • the control unit 205 controls the air conditioner 102 (eg, the air conditioner 102a and/or 102b).
  • the control information at this time is sent to the air conditioners 102 (for example, the air conditioners 102a and/or 102b) provided in the target space (for example, the conference room R) within a predetermined time (for example, the previous time). It is preferable to include the same contents as the transmitted control information.
  • the air conditioner 102 can be controlled in a manner suitable for the target space and adjusted to a comfortable air environment. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • the control unit 205 When the schedule information includes a schedule in which the same subject who used the target space (eg, conference room R) in the past uses the target space (eg, conference room R) again, the control unit 205 The control information is transmitted to the air conditioners 102 (for example, the air conditioners 102a and/or 102b) provided in the target space.
  • the control information at this time is, for example, the air conditioner 102 (for example, the air conditioner 102) provided in the target space (for example, the conference room R) when the subject used the target space (for example, the conference room R) in the past. 102a and/or 102b).
  • the comfortable air environment is often the same as the previous use. Therefore, according to this example, the air environment can be adjusted in advance to be comfortable for the subject. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • control unit 205 controls the air conditioners 102 (for example, the air conditioners 102a and/or 102b) provided in the target space (for example, the conference room R) based on the type of subject included in the usage schedule of the target space (for example, the conference room R).
  • the types of subjects are, for example, public offices, companies, circles, neighborhood associations, and the like.
  • the control information at this time is, for example, the air conditioner 102 (for example, It is preferable to include the same content as the control information transmitted to the air conditioners 102a and/or 102b).
  • the air conditioner 102 is controlled in a manner corresponding to the clothing of the subject to adjust the air environment to a comfortable one. can be kept Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
  • history acquisition means for processing image information including an image of a target space and acquiring appearance history information including a history of the appearance of one or more people active in the target space; and control means for outputting control information for controlling the air conditioner based on the appearance history information.
  • control means controls the air conditioner based on a result of statistically processing the history of the appearance.
  • the statistical processing includes at least one of an attribute of the target space or a region included in the target space, an appearance of a person in the target space or the region, and an attribute of a person in the target space or the region. 3.
  • the air conditioner control device including statistical processing related to 4.
  • the statistical processing includes attributes of the target space or a region included in the target space, appearances of people in the target space or the region, attributes of people in the target space or the region, and at least one time 4.
  • the air conditioner control device according to the above 3, including statistical processing related to changes in nature. 5.
  • the air conditioner control device according to any one of 2 to 4 above, wherein the control means controls the air conditioner based on control pattern information including control details of the air conditioner according to the result of the statistical processing. . 6.
  • the control means further controls the air conditioner based on schedule information including at least one of a usage schedule of the target space and a schedule of users of the target space. An air conditioner controller as described. 9.
  • the air conditioner control device according to any one of 1 to 8 above, wherein the control means outputs control information for adjusting a space different from the target space based on the appearance history information. 10.
  • the target space is plural,
  • the history acquisition means processes a plurality of image information each including images obtained by photographing the plurality of target spaces, and obtains a plurality of histories of the appearance of one or more people active in each of the plurality of target spaces.
  • the air conditioner control device according to any one of 1 to 9 above, which acquires appearance history information.
  • 11. The air conditioner control device according to 10 above, wherein the control means outputs control information for controlling at least one air conditioner associated with at least one of the plurality of target spaces.
  • 12. The air conditioner control device according to any one of 1 to 11 above; a photographing device for photographing the target space; An air conditioner control system comprising: the air conditioner. 13.
  • the computer obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
  • An air conditioner control method comprising: outputting control information for controlling an air conditioner based on the appearance history information. 14. to the computer, obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
  • Air conditioner control system 101, 101a, 101b, 101c Imaging devices 102, 102a, 102b, 103c Air conditioner 103 Air conditioner control device (control device) 104 history acquisition unit 104a human detection unit 104b analysis unit 105 control unit 106 history storage unit 106a appearance history information 107 control pattern storage unit 107a control pattern information 111 operation status acquisition unit 112 operation history storage unit 113 creation unit 114 individual creation unit 215 schedule Management device 216 Schedule acquisition unit C Corridor D Doorway P People R Conference rooms TS, TSa, TSb, TSc Shooting area

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Air Conditioning Control Device (AREA)

Abstract

A control device (103) comprises a history acquisition unit (104) and a control unit (105). The history acquisition unit (104) processes image information including captured images of a target space to acquire appearance history information (106a) including the appearance history of one or more people active in the target space. The control unit (105) outputs control information for controlling an air conditioner (102) on the basis of the appearance history information (106a).

Description

空調機制御装置、空調機制御システム、空調機制御方法及びプログラムAir conditioner control device, air conditioner control system, air conditioner control method and program
　本発明は、空調機制御装置、空調機制御システム、空調機制御方法及びプログラムに関する。 The present invention relates to an air conditioner control device, an air conditioner control system, an air conditioner control method, and a program.
　空調機を用いて快適な空気環境を提供するための技術が種々提案されている。 Various technologies have been proposed to provide a comfortable air environment using air conditioners.
　例えば特許文献１に記載のエリア別環境管理システムは、生体情報センサ１０と、環境情報センサ２０と、覚醒度推定部３０と、環境提供部４０とを備える。覚醒度推定部３０は、生体情報センサ１０で検出された生体情報に基づいて、例えば個人の覚醒度を推定する。環境提供部４０は、覚醒度と環境情報に基づいて、それぞれのエリアの環境に対して環境を提供する。特許文献１の発明によれば、個人等の覚醒度を制御するための環境を提供し、個人等の生産性を所望の状態になるように制御可能になると、特許文献１には記載されている。 For example, the area-based environment management system described in Patent Document 1 includes a biological information sensor 10, an environment information sensor 20, an arousal level estimation unit 30, and an environment provision unit 40. The wakefulness estimation unit 30 estimates, for example, an individual's wakefulness based on the biological information detected by the biological information sensor 10 . The environment providing unit 40 provides an environment for each area based on the awakening level and the environment information. According to the invention of Patent Document 1, it is described in Patent Document 1 that it is possible to provide an environment for controlling the arousal level of an individual, etc., and control the productivity of the individual, etc. to a desired state. there is
　特許文献１には、生体情報センサ１０ａ，１０ｂは、椅子に配設しその上に座っている個人の心拍や呼吸、体動をセンシングするシート型の生体情報センサからなる、との記載がある。また、生体情報センサ１０は、パソコン３ａ、３ｂのディスプレイの前面のカメラで個人の顔画像等を撮像し、画像データを解析して瞬きや姿勢、体動等を検出するものであってもよい、との記載がある。 Patent Literature 1 describes that the biometric information sensors 10a and 10b are seat-type biometric sensors that are placed on a chair and sense the heartbeat, breathing, and body movement of an individual sitting on the chair. . Also, the biometric information sensor 10 may capture an individual's facial image or the like with a camera in front of the display of the personal computers 3a and 3b, analyze the image data, and detect blinking, posture, body movement, and the like. , there is a description.
　例えば特許文献２に記載の環境設備制御システムは、複数種類の環境設備を用いることでユーザの心身状態である覚醒度を目標とする覚醒度に近づけるためのシステムである。環境設備制御システム１は、空気調和装置１０と、換気装置２０と、アロマディフューザ３０と、生体センサ４０と、リモコン５０と、環境設備制御装置１００と、を主として有する。 For example, the environmental facility control system described in Patent Document 2 is a system for bringing the arousal level, which is the physical and mental state of the user, closer to the target arousal level by using multiple types of environmental facilities. The environmental facility control system 1 mainly includes an air conditioner 10 , a ventilator 20 , an aroma diffuser 30 , a biosensor 40 , a remote controller 50 and an environmental facility control device 100 .
　特許文献２に記載の生体センサ４０は、ユーザの覚醒度を把握するためのセンサであり、ユーザの心電図波形を検出する心電図波形センサ４１と、ユーザの表情を検出する表情カメラ４２と、を有する。表情カメラ４２は、ユーザの顔の表情を撮影することが可能な室内の特定の位置に配置されており、検出された表情データを無線により環境設備制御装置１００等の周囲の機器に送信することが可能になっている。環境設備制御装置１００は、生体センサ４０やリモコン５０からの情報を取得し、空気調和装置１０と換気装置２０とアロマディフューザ３０とを制御することが可能である。 A biosensor 40 described in Patent Document 2 is a sensor for grasping a user's arousal level, and includes an electrocardiogram waveform sensor 41 that detects the user's electrocardiogram waveform and an expression camera 42 that detects the user's facial expression. . The facial expression camera 42 is placed at a specific position in the room where it is possible to photograph the user's facial expression, and wirelessly transmits the detected facial expression data to surrounding equipment such as the environmental equipment control device 100. is possible. The environmental facility control device 100 can acquire information from the biosensor 40 and the remote controller 50 and control the air conditioner 10 , the ventilator 20 and the aroma diffuser 30 .
　例えば特許文献３に記載の覚醒度制御システムは、覚醒度制御の対象者の覚醒度を判定し、判定結果に応じて覚醒度制御の対象者の周囲環境の物理量を制御して、覚醒度の維持または向上を図る。覚醒度制御システムは、覚醒度制御装置１００と、１つ以上の環境制御機器２００と、１つ以上の環境測定機器３００と、１つ以上の覚醒度推定機器４００とを備える。 For example, the wakefulness control system described in Patent Document 3 determines the wakefulness of a person subject to wakefulness control, controls the physical quantity of the surrounding environment of the subject of wakefulness control according to the determination result, and adjusts the wakefulness. Maintain or improve. The alertness control system includes an alertness control device 100 , one or more environment control devices 200 , one or more environment measurement devices 300 , and one or more alertness estimation devices 400 .
　特許文献３に記載の環境測定機器３００は、温度、照度などの物理量を測定し数値データ化する機器である。覚醒度推定機器４００は、対象者の覚醒度を生体情報などから推定し、数値データ化する機器である。生体情報として体温、顔の動画および脈波のうち何れか一方、あるいはこれらの組み合わせを用いるようにしてもよい旨の記載がある。 The environment measuring device 300 described in Patent Document 3 is a device that measures physical quantities such as temperature and illuminance and converts them into numerical data. The arousal level estimation device 400 is a device that estimates a subject's arousal level from biological information or the like and converts it into numerical data. It is described that any one of body temperature, facial moving image, and pulse wave, or a combination thereof may be used as biological information.
　特許文献３に記載の覚醒度制御装置１００は、対象者の覚醒度に応じて環境制御機器２００を制御する。覚醒度制御装置１００は、監視制御部１８１、第１取得部１８２、第２取得部１８３、設定値算出部１８４などを備える。 The arousal level control device 100 described in Patent Document 3 controls the environment control device 200 according to the arousal level of the subject. The awakening level control device 100 includes a monitor control unit 181, a first acquisition unit 182, a second acquisition unit 183, a set value calculation unit 184, and the like.
　特許文献３に記載の監視制御部１８１は、監視制御部１８１は、環境制御機器２００との通信で、環境制御機器２００に設定されている機器設定値を取得する。第１取得部１８２は、環境測定機器３００が測定した物理量の測定値を取得する。この物理量として、室温などの空気温度が挙げられている。第２取得部１８３は、覚醒度推定機器４００と通信を行い、対象者の覚醒度の推定値を取得する。設定値算出部１８４は、監視制御部１８１から機器設定値を取得し、第１取得部１８２から物理量の測定値を取得し、第２取得部１８３から覚醒度推定値を取得して、これらに基づいて機器設定値を算出する。 The monitoring control unit 181 described in Patent Document 3 acquires the device setting values set in the environment control device 200 through communication with the environment control device 200 . The first acquisition unit 182 acquires the measured value of the physical quantity measured by the environment measurement device 300 . Air temperature, such as room temperature, is cited as this physical quantity. The second acquisition unit 183 communicates with the awakening level estimation device 400 and acquires the estimated value of the subject's awakening level. The setting value calculation unit 184 acquires the device setting value from the monitoring control unit 181, acquires the measured value of the physical quantity from the first acquisition unit 182, acquires the wakefulness estimated value from the second acquisition unit 183, Based on this, the device setting value is calculated.
　例えば特許文献４に記載のシステムの装置は、検出部１、判断部２、制御部３の３つからなる。検出部１は、室内または人間の状態を検出するためのものであり、その情報を判断部２に送る。判断部２は、検出部１から受け取った情報に基づき人間の状態を判断する。制御部３は、機器の制御を行うためのインタフェースを持ち、機器のコントロールを行う。 For example, the device of the system described in Patent Document 4 consists of three parts: a detection unit 1, a determination unit 2, and a control unit 3. The detection unit 1 is for detecting the state of the room or people, and sends the information to the determination unit 2 . The determination unit 2 determines the human condition based on the information received from the detection unit 1 . The control unit 3 has an interface for controlling the equipment, and controls the equipment.
　検出部１は、複数台のカメラ、マイク、温度、湿度センサを入力機器として持ち、これらの入力を処理する入力制御部１１と、それぞれの検出機能部１４，１５，１６，１７と、各種のモデルデータベース１２で結果を統合し、判断部２への出力をまとめる結果収集部１３からなる旨の記載がある。検出部１の機能としては、姿勢検出機能、顔検出機能、目部分観測機能、口部分観測機能がある。判断部２は、検出部１から受けとった情報に基づいて、機器をどのように制御すればよいかなどを決定し、制御指示機能などを有する。 The detection unit 1 has a plurality of cameras, microphones, temperature, and humidity sensors as input devices, an input control unit 11 that processes these inputs, detection function units 14, 15, 16, and 17, and various There is a description to the effect that it consists of a result collection unit 13 that integrates the results in the model database 12 and summarizes the output to the determination unit 2 . Functions of the detection unit 1 include a posture detection function, a face detection function, an eye portion observation function, and a mouth portion observation function. Based on the information received from the detection unit 1, the determination unit 2 determines how the device should be controlled, and has a control instruction function.
　例えば特許文献５には、撮影した映像よりユーザの服装を判定して、服装によってエアコン１０，１０Ａ，１０Ｂに温度調整を指示する構成としてもよい、との記載がある。例えば、冷房時に、半袖を着用していたり、ひざかけを用いていたりすることが確認できると、弱めるように指示し、長袖着用時は強めるように指示する、との記載がある。 For example, Patent Literature 5 states that the clothing of the user may be determined from the captured image, and the air conditioners 10, 10A, and 10B may be instructed to adjust the temperature based on the clothing. For example, there is a description that if it is confirmed that a person is wearing a short-sleeved shirt or using a blanket in the air-conditioning, the patient is instructed to wear it less, and if he/she wears a long-sleeve, he is instructed to strengthen it.
　例えば特許文献６には、ユーザＵ１が所定の動作をすると（Ｓ１の１）、制御装置７０は、ユーザＵ１の動作を判断して（Ｓ１の２）、ジェスチャ指示条件が指示されていることを認識し（Ｓ１の３）、ジェスチャ指示条件でもって熱交換器４等を制御する（Ｓ１の４）空気調和機の室内機１００が記載されている。 For example, in Patent Document 6, when the user U1 performs a predetermined action (S1-1), the control device 70 determines the action of the user U1 (S1-2) and indicates that the gesture instruction condition is indicated. The indoor unit 100 of the air conditioner that recognizes (3 of S1) and controls the heat exchanger 4 and the like according to the gesture instruction condition (4 of S1) is described.
　例えば特許文献７の空調システム１は、ユーザのジェスチャ入力操作による空調設定の変更要求を認識して、当該変更要求に応じて送風を調節する。 For example, the air conditioning system 1 of Patent Literature 7 recognizes a request to change air conditioning settings by a user's gesture input operation, and adjusts air blowing according to the change request.
国際公開第２０１８／１７９２８９号WO2018/179289 国際公開第２０１９／０２２０７９号WO2019/022079 国際公開第２０２０／１６２３５８号WO2020/162358 特開平８－２５７０１７号公報JP-A-8-257017 特開２０１５－２１６６６号公報JP 2015-21666 A 特開２０１３－２１３６１０号公報JP 2013-213610 A 特開２０１７－０２６２３０号公報JP 2017-026230 A
　特許文献１に記載のエリア別環境管理システムでは、生体情報センサ１０は、個人に対して設けられる。そのため、生体情報センサ１０を設ける手間が掛かる。特に複数の人の覚醒度を制御するための環境を提供しようとする場合、複数の人の各々に生体情報センサ１０を設けることは困難なこともある。また、人が移動する場合、その人に生体情報センサ１０を設けることは困難なこともある。そのため、特許文献１に記載のエリア別環境管理システムでは、空間の空気環境を快適にすることが困難なことがある。 In the area-specific environment management system described in Patent Document 1, the biometric information sensor 10 is provided for each individual. Therefore, provision of the biological information sensor 10 is troublesome. Especially when trying to provide an environment for controlling the arousal level of a plurality of people, it may be difficult to provide the biological information sensor 10 for each of the plurality of people. Moreover, when a person moves, it may be difficult to provide the biological information sensor 10 to the person. Therefore, in the area-specific environment management system described in Patent Document 1, it may be difficult to make the air environment of the space comfortable.
　特許文献２に記載の環境設備制御システムでは、ユーザの顔の表情を撮影することが可能な室内の特定の位置に配置される表情カメラ４２が必要である。表情カメラ４２をこのような特定の位置に設置することは、手間が掛かる。また、顔の表情を撮影することが可能な室内の位置を特定することや、その位置に表情カメラ４２を取り付けることが困難なこともある。 The environmental facility control system described in Patent Document 2 requires an expression camera 42 that is placed at a specific position in the room and capable of photographing the user's facial expression. Installing the facial expression camera 42 at such a specific position is troublesome. In addition, it may be difficult to specify a position in the room where facial expressions can be captured, or to attach the facial expression camera 42 to that position.
　特許文献３に記載の覚醒度制御システムでは、機器設定値を算出するために、物理量としての室温、生体情報としての顔の動画を用いることが記載されている。仮に室温のみを用いて機器設定値を算出した場合、空間の空気環境を快適にすることが困難なことがある。 In the wakefulness control system described in Patent Document 3, it is described that the room temperature as the physical quantity and the moving image of the face as the biometric information are used to calculate the device setting values. If the device settings are calculated using only the room temperature, it may be difficult to make the air environment of the space comfortable.
　また、特許文献３には、顔の動画を取得する方法が記載されていない。仮に顔の動画を取得するために、特許文献２に記載の表情カメラ４２と同様に、ユーザの顔を撮影することが可能な室内の特定の位置に配置されるカメラを用いる場合、特許文献２に記載の技術と同様の課題がある。 Also, Patent Document 3 does not describe a method for acquiring a moving image of a face. Assuming that a camera arranged at a specific position in a room capable of photographing the user's face is used to obtain a moving image of the user's face in the same manner as the facial expression camera 42 described in Patent Document 2, There is a problem similar to the technology described in .
　特許文献４に記載のシステムでは、ある時の姿勢、顔、目、口を検出し、あくび、まぶたの開閉などの状態を検出する。しかしながら、例えば、その時の人の状態を基に機器を制御すると、偶発的な状態を基に機器を制御し、その結果、その人の快適さを損なうおそれがある。 The system described in Patent Document 4 detects posture, face, eyes, and mouth at a certain time, and detects states such as yawning and opening and closing of eyelids. However, for example, if the device is controlled based on the current state of the person, the device may be controlled based on an accidental state, resulting in a loss of comfort for the person.
　特許文献５に記載の技術では、冷房時に半袖と長袖のいずれを着用することが、その人にとって快適であるかを判定することは困難である。また、冷房時にひざかけを用いている人が確認できた場合に、弱める指示をすると、その他の人の快適さを損なうおそれがある。すなわち、特許文献５に記載の技術では、空間の空気環境を快適にできない可能性がある。 With the technology described in Patent Document 5, it is difficult to determine whether it is comfortable for the person to wear short sleeves or long sleeves during cooling. In addition, if a person using a blanket during cooling can be confirmed, and an instruction to weaken the blanket is given, there is a risk that the comfort of other people will be impaired. That is, with the technique described in Patent Document 5, there is a possibility that the air environment in the space cannot be made comfortable.
　特許文献６，７に記載の技術では、ユーザの意識的な動作であるジェスチャに基づいて、熱交換器４等の制御や送風の調節を行う。そのため、快適な空気環境を得るには、人が意識的に動作を行う必要があるという課題がある。 With the techniques described in Patent Documents 6 and 7, the heat exchanger 4 and the like are controlled and the ventilation is adjusted based on gestures, which are conscious actions of the user. Therefore, in order to obtain a comfortable air environment, there is a problem that a person needs to move consciously.
　本発明の目的の一例は、上述した課題を鑑み、人に意識させずに快適な空気環境を提供することが困難であるという課題を解決する空調機制御装置、空調機制御システム、空調機制御方法及びプログラムを提供することにある。 An example of the object of the present invention is to provide an air conditioner control device, an air conditioner control system, and an air conditioner control that solve the problem that it is difficult to provide a comfortable air environment without making people aware of the above problems. It is to provide a method and a program.
　本発明の一態様によれば、
　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得する履歴取得手段と、
　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力する制御手段とを備える
　空調機制御装置が提供される。 According to one aspect of the invention,
history acquisition means for processing image information including an image of a target space and acquiring appearance history information including a history of the appearance of one or more people active in the target space;
and control means for outputting control information for controlling the air conditioner based on the appearance history information.
　本発明の一態様によれば、
　上記の空調機制御装置と、
　前記対象空間を撮影する撮影装置と、
　前記空調機とを備える
　空調機制御システムが提供される。 According to one aspect of the invention,
the above air conditioner control device;
a photographing device for photographing the target space;
An air conditioner control system including the air conditioner is provided.
　本発明の一態様によれば、
　コンピュータが、
　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得し、
　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力することを含む
　空調機制御方法が提供される。 According to one aspect of the invention,
the computer
obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
An air conditioner control method is provided, including outputting control information for controlling the air conditioner based on the appearance history information.
　本発明の一態様によれば、
　コンピュータに、
　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得し、
　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力することを実行させるためのプログラムが提供される。 According to one aspect of the invention,
to the computer,
obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
A program is provided for outputting control information for controlling an air conditioner based on the appearance history information.
　本発明によれば、人が意識しなくても、快適な空気環境を容易に提供することが可能になる。 According to the present invention, it is possible to easily provide a comfortable air environment without people being conscious of it.
本発明の一実施形態に係る空調機制御システムの概要を示す図である。BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows the outline|summary of the air conditioner control system which concerns on one Embodiment of this invention. 本発明の一実施形態に係る空調機制御処理の概要を示すフローチャートである。4 is a flowchart showing an overview of air conditioner control processing according to one embodiment of the present invention; 一実施形態に係る空調機制御システムの構成例を示す図である。It is a figure which shows the structural example of the air conditioner control system which concerns on one Embodiment. 一実施形態に係る複数の撮影装置及び複数の空調機の配置例を示す図である。It is a figure which shows the example of arrangement|positioning of several imaging devices and several air conditioners which concern on one Embodiment. 一実施形態に係る履歴取得部の機能的な構成例を示す図である。FIG. 4 is a diagram illustrating a functional configuration example of a history acquisition unit according to one embodiment; 外観情報の一例を示す図である。It is a figure which shows an example of appearance information. 外観履歴情報の一例を示す図である。It is a figure which shows an example of appearance history information. 制御パターン情報の一例を示す図である。It is a figure which shows an example of control pattern information. 本発明の一実施形態に係る空調機制御装置の物理的構成を示す図である。It is a figure showing physical composition of an air-conditioner control device concerning one embodiment of the present invention. 本発明の一実施形態に係る履歴取得処理の詳細な一例を示すフローチャートである。6 is a flowchart showing a detailed example of history acquisition processing according to an embodiment of the present invention; 本発明の一実施形態に係る履歴取得処理の詳細な一例を示すフローチャートである。6 is a flowchart showing a detailed example of history acquisition processing according to an embodiment of the present invention; 暫定的な人ＩＤと、人Ｐの同一性の判定の結果として確定した人ＩＤと、の関係を示す図である。FIG. 4 is a diagram showing the relationship between a provisional person ID and a person ID determined as a result of identity determination of person P; 本発明の一実施形態に係る制御情報出力処理の詳細な一例を示すフローチャートである。4 is a flowchart showing a detailed example of control information output processing according to an embodiment of the present invention; 空間対応付け情報の一例を示す図である。It is a figure which shows an example of spatial correspondence information. 変形例８に係る制御システムの構成例を示す図である。FIG. 20 is a diagram showing a configuration example of a control system according to modification 8; 変形例９に係る制御システムの構成例を示す図である。FIG. 21 is a diagram showing a configuration example of a control system according to Modification 9;
　以下、本発明の一実施の形態について、図面を用いて説明する。なお、すべての図面において、同様な構成要素には同様の符号を付し、適宜説明を省略する。 An embodiment of the present invention will be described below with reference to the drawings. In addition, in all the drawings, the same constituent elements are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.
（空調機制御システム１００の概要）
　図１は、本発明の一実施形態に係る空調機制御システム１００の概要を示す図である。空調機制御システム１００は、対象空間を撮影する撮影装置１０１ａと、空調機（「空気調和機」などとも称される。）１０２ａと、空調機制御装置１０３とを備える。 (Overview of Air Conditioner Control System 100)
FIG. 1 is a diagram showing an overview of an air conditioner control system 100 according to one embodiment of the present invention. The air conditioner control system 100 includes a photographing device 101 a that photographs a target space, an air conditioner (also called an “air conditioner”) 102 a, and an air conditioner control device 103 .
　空調機制御装置１０３は、履歴取得部１０４と、制御部１０５とを備える。 The air conditioner control device 103 includes a history acquisition section 104 and a control section 105 .
　履歴取得部１０４は、対象空間を撮影した画像を含む画像情報を処理して、対象空間において活動する１以上の人Ｐの外観の履歴を含む外観履歴情報を取得する。 The history acquisition unit 104 processes image information including captured images of the target space, and acquires appearance history information including the appearance history of one or more persons P who are active in the target space.
　制御部１０５は、外観履歴情報に基づいて、空調機１０２ａを制御するための制御情報を出力する。 The control unit 105 outputs control information for controlling the air conditioner 102a based on the appearance history information.
　この空調機制御装置１０３によれば、人が意識しなくても、快適な空気環境を容易に提供することが可能になる。この空調機制御システム１００によれば、人が意識しなくても、快適な空気環境を容易に提供することが可能になる。 According to this air conditioner control device 103, it is possible to easily provide a comfortable air environment without people being conscious of it. According to this air conditioner control system 100, it is possible to easily provide a comfortable air environment without people being conscious of it.
（本発明の一実施形態に係る空調機制御処理の概要）
　図２は、本発明の一実施形態に係る空調機制御処理の概要を示すフローチャートである。 (Overview of air conditioner control processing according to one embodiment of the present invention)
FIG. 2 is a flowchart showing an overview of air conditioner control processing according to one embodiment of the present invention.
　履歴取得部１０４は、対象空間を撮影した画像を含む画像情報を処理して、対象空間において活動する１以上の人Ｐの外観の履歴を含む外観履歴情報を取得する（ステップＳ１０１）。 The history acquisition unit 104 processes image information including captured images of the target space, and acquires appearance history information including the appearance history of one or more persons P who are active in the target space (step S101).
　制御部１０５は、外観履歴情報に基づいて、空調機１０２ａを制御するための制御情報を出力する（ステップＳ１０２）。 The control unit 105 outputs control information for controlling the air conditioner 102a based on the appearance history information (step S102).
　この空調機制御処理によれば、人が意識しなくても、快適な空気環境を容易に提供することが可能になる。 According to this air conditioner control process, it is possible to easily provide a comfortable air environment without people being conscious of it.
　以下、本実施形態に係る空調機制御システム１００の詳細例について説明する。 A detailed example of the air conditioner control system 100 according to the present embodiment will be described below.
（本実施形態に係る空調機制御システム１００の構成）
　図３は、本実施形態に係る空調機制御システム１００の構成例を示す図である。空調機制御システム１００は、空調機１０２ａ～１０２ｃを制御するためのシステムである。空調機制御システム１００は、複数の撮影装置１０１ａ～１０１ｃと、複数の空調機１０２ａ～１０２ｃと、空調機制御装置１０３とを備える。 (Configuration of air conditioner control system 100 according to this embodiment)
FIG. 3 is a diagram showing a configuration example of the air conditioner control system 100 according to this embodiment. The air conditioner control system 100 is a system for controlling the air conditioners 102a to 102c. The air conditioner control system 100 includes a plurality of imaging devices 101 a to 101 c, a plurality of air conditioners 102 a to 102 c, and an air conditioner control device 103 .
　空調機制御装置１０３と、撮影装置１０１ａ～１０１ｃ及び空調機１０２ａ～１０２ｃの各々とは、ネットワークＮを介して接続されている。ネットワークＮは、有線、無線又はこれらを組み合わせて構成される通信ネットワークである。空調機制御装置１０３と、撮影装置１０１ａ～１０１ｃ及び空調機１０２ａ～１０２ｃの各々とは、ネットワークＮを介して情報を互いに送受信する。 The air conditioner control device 103 is connected via a network N to each of the imaging devices 101a to 101c and the air conditioners 102a to 102c. Network N is a communication network configured by wire, wireless, or a combination thereof. The air conditioner control device 103 and each of the imaging devices 101a to 101c and the air conditioners 102a to 102c exchange information via the network N with each other.
　以下、「空調機制御システム」を「制御システム」とも表記する。また、「空調機制御装置」を「制御装置」とも表記する。 Hereinafter, the "air conditioner control system" is also referred to as the "control system". In addition, "air conditioner control device" is also written as "control device".
　図４は、本実施形態に係る複数の撮影装置１０１ａ～１０１ｃ及び複数の空調機１０２ａ～１０２ｃの配置例を示す図である。同図は、会議室Ｒ及びこれに繋がる廊下Ｃを上方から見た図である。同図の会議室Ｒでは、複数の人Ｐが上方から見て略矩形に並んでいる。図２の右下に示す出入口Ｄは、廊下Ｃと会議室Ｒとの間の通路である。出入口Ｄは、図示しないドアを用いて開閉する。 FIG. 4 is a diagram showing an arrangement example of a plurality of photographing devices 101a to 101c and a plurality of air conditioners 102a to 102c according to this embodiment. This figure is a top view of the conference room R and the corridor C leading to it. In the conference room R shown in the figure, a plurality of people P are arranged in a substantially rectangular shape when viewed from above. A doorway D shown in the lower right of FIG. 2 is a passage between the corridor C and the conference room R. The doorway D is opened and closed using a door (not shown).
（対象空間について）
　対象空間は、撮影装置１０１ａ～１０１ｃを用いた撮影の対象となる空間である。対象空間は、適宜定められればよい。本実施形態に係る会議室Ｒ及び廊下Ｃの各々は、対象空間の例である。すなわち、本実施形態では、一室、廊下Ｃの予め定められる区間を対象空間としている。図４では、対象空間として定められる廊下Ｃの区間の一部を示している。 (About target space)
The target space is a space to be photographed using the photographing devices 101a to 101c. The target space may be determined as appropriate. Each of the conference room R and the corridor C according to this embodiment is an example of the target space. That is, in this embodiment, one room and a predetermined section of the corridor C are set as the target space. FIG. 4 shows a part of the corridor C defined as the target space.
　対象空間は、これに限られない。対象空間は、１つ又は複数の建物、建造物、施設などの屋内又は屋外の一部又は全部に１つ以上設定されればよい。対象空間は、例えば、建物や建造物の各部屋、廊下の予め定められる区間、階段の予め定められる区間、玄関近傍にて予め定められる屋内、玄関近傍にて予め定められる屋外、ベランダの一部又は全部などである。対象空間の大きさ、形状などは種々であってもよい。対象空間が複数の場合、各々の大きさ、形状などが異なっていてもよい。対象空間が複数の場合、隣接する対象空間の間に間隔が空いていてもよく、隙間なく隣接していてもよい。 The target space is not limited to this. One or more target spaces may be set in part or all of indoors or outdoors such as one or more buildings, structures, facilities, and the like. The target space is, for example, each room of a building or building, a predetermined section of a corridor, a predetermined section of stairs, a predetermined indoor space near the entrance, a predetermined outdoor space near the entrance, or a part of the veranda. or all. The size, shape, etc. of the target space may vary. When there are a plurality of target spaces, each size, shape, etc. may be different. When there are a plurality of target spaces, there may be a gap between adjacent target spaces, or they may be adjacent without a gap.
（撮影装置１０１ａ～１０１ｃ）
　撮影装置１０１ａ～１０１ｃの各々は、例えばカメラである。カメラは、ネットワークＮを介して送受信可能な画像情報を生成するカメラであればよく、例えば全方位カメラである。 (Imaging devices 101a to 101c)
Each of the imaging devices 101a to 101c is, for example, a camera. The camera may be any camera that generates image information that can be transmitted and received via the network N, such as an omnidirectional camera.
　撮影装置１０１ａ～１０１ｃは、会議室Ｒ及び廊下Ｃの一部を撮影する。詳細には、撮影装置１０１ａ～１０１ｂは、会議室Ｒに含まれる撮影領域ＴＳａ～ＴＳｂのそれぞれを撮影する。撮影装置１０１ｃは、廊下Ｃに含まれる撮影領域ＴＳｃを撮影する。言い換えると、撮影装置１０１ａ～１０１ｃは、少なくともそれぞれに対応付けられた撮影領域ＴＳａ～ＴＳｃを撮影できるように設置された撮影装置である。 The photographing devices 101a to 101c photograph parts of the conference room R and the corridor C. Specifically, the imaging devices 101a to 101b capture images of the imaging regions TSa to TSb included in the conference room R, respectively. The photographing device 101c photographs a photographing area TSc included in the corridor C. FIG. In other words, the photographing devices 101a to 101c are photographing devices installed so as to photograph at least the photographing areas TSa to TSc associated therewith.
　本実施形態に係る撮影領域ＴＳａ～ＴＳｂは、会議室Ｒの全体を概ね２等分した２つの領域である。撮影領域ＴＳａ～ＴＳｂは、同じ大きさであり、会議室Ｒ内においてすき間なく、かつ、互いに重複することなく隣接している。撮影領域ＴＳｃは、廊下Ｃのうち、会議室Ｒと隣り合う領域である。すなわち、撮影領域ＴＳａ～ＴＳｂは、対象空間としての会議室Ｒに含まれる領域である。撮影領域ＴＳｃは、対象空間としての廊下Ｃに含まれる領域である。 The photographing areas TSa to TSb according to the present embodiment are two areas obtained by roughly dividing the entire conference room R into two equal parts. The photographing areas TSa to TSb have the same size, and are adjacent to each other in the conference room R without gaps and without overlapping each other. The photographing area TSc is an area of the corridor C adjacent to the conference room R. As shown in FIG. That is, the shooting areas TSa to TSb are areas included in the conference room R as the target space. The imaging area TSc is an area included in the corridor C as the target space.
　以下において、撮影領域ＴＳａ～ＴＳｃを特に区別しない場合、単に「撮影領域ＴＳ」とも表記する。なお、撮影領域ＴＳは、対象空間に１つ以上設定されればよい。撮影領域ＴＳの各々の大きさ、形状などは種々であってもよい。撮影領域ＴＳが複数の場合、各々の大きさ、形状などが異なっていてもよい。撮影領域ＴＳが複数の場合、隣接する撮影領域ＴＳは、互いに間隔が空いていてもよく、隙間なく隣接していてもよく、一部が互いに重複してもよい。 In the following, when the imaging areas TSa to TSc are not particularly distinguished, they are also simply referred to as "imaging areas TS". One or more imaging regions TS may be set in the target space. The size, shape, etc. of each imaging region TS may vary. When there are a plurality of photographing areas TS, each may be different in size, shape, and the like. When there are a plurality of photographing regions TS, adjacent photographing regions TS may be spaced apart from each other, may be adjacent to each other without a gap, or may partially overlap each other.
　撮影装置１０１ａ～１０１ｃは、それぞれが撮影した撮影領域ＴＳａ～ＴＳｃの画像を含む画像情報を生成する。本実施形態に係る画像情報は、撮影時刻と領域ＩＤ（Ｉｄｅｎｔｉｆｉｅｒ）とをさらに含む。 The photographing devices 101a to 101c generate image information including images of the photographing areas TSa to TSc respectively photographed. The image information according to the present embodiment further includes shooting time and area ID (Identifier).
　撮影領域ＴＳａ～ＴＳｂの画像は、会議室Ｒの画像である。撮影領域ＴＳｃの画像は、廊下Ｃの画像である。すなわち、撮影装置１０１ａ～１０１ｂが撮影した画像は、会議室Ｒの画像を含む。撮影装置１０１ｃが撮影した画像は、廊下Ｃの画像を含む。 The image of the photographing areas TSa to TSb is the image of the conference room R. The image of the imaging area TSc is the image of the corridor C. As shown in FIG. That is, the images captured by the imaging devices 101a to 101b include the image of the conference room R. FIG. The image captured by the imaging device 101c includes the image of the corridor C.
　撮影時刻は、撮影が行われた時刻である。撮影装置１０１ａ～１０１ｃは、計時しており、各々が撮影を行った時刻である撮影時刻を画像情報に含める。 The shooting time is the time when the shooting was performed. The photographing devices 101a to 101c keep time, and include the photographing time, which is the time at which each photograph was taken, in the image information.
　領域ＩＤは、撮影装置１０１ａ～１０１ｃの各々を識別するための情報である。領域ＩＤは、適宜の規則に従って付与されるとよい。撮影領域ＴＳａ～ＴＳｃそれぞれの領域ＩＤは、「ＴＳａ」「ＴＳｂ」「ＴＳｃ」であるとする。撮影装置１０１ａ～１０１ｃは、それぞれに対応付けられた撮影領域ＴＳａ～ＴＳｂの領域ＩＤを予め保持し、その領域ＩＤを画像情報に含める。 The area ID is information for identifying each of the imaging devices 101a to 101c. A region ID may be assigned according to an appropriate rule. It is assumed that the area IDs of the photographing areas TSa to TSc are "TSa", "TSb", and "TSc". The imaging devices 101a to 101c hold in advance the area IDs of the corresponding imaging areas TSa to TSb, and include the area IDs in the image information.
　撮影装置１０１ａ～１０１ｃの各々は、生成した画像情報を、ネットワークＮを介して制御装置１０３へ送信する。詳細には、撮影装置１０１ａ～１０１ｃの各々は、予め定められた時間間隔で継続的に、撮影領域ＴＳａ～ＴＳｃのそれぞれを撮影して画像情報を生成する。撮影装置１０１ａ～１０１ｃのそれぞれから継続的に生成される画像情報は、会議室Ｒ及び廊下Ｃを継続的に撮影した動画像を構成する。 Each of the imaging devices 101a to 101c transmits the generated image information to the control device 103 via the network N. Specifically, each of the imaging devices 101a to 101c continuously captures each of the imaging regions TSa to TSc at predetermined time intervals to generate image information. The image information continuously generated by each of the imaging devices 101a to 101c constitutes moving images in which the conference room R and the corridor C are continuously captured.
　以下において、撮影装置１０１ａ～１０１ｃを特に区別しない場合、単に「撮影装置１０１」とも表記する。なお、制御システム１００が備える撮影装置１０１は、１つ以上であればよく、幾つであってもよい。また、撮影の時間間隔は、適宜定められればよく、ある程度長い時間長さの場合などには、画像情報は動画像を構成しなくてもよい。 In the following, when the imaging devices 101a to 101c are not particularly distinguished, they are also simply referred to as "imaging device 101". Note that the control system 100 may have one or more imaging devices 101, and the number may be any. In addition, the time interval of photographing may be appropriately determined, and when the time length is long to some extent, the image information does not need to form a moving image.
（空調機１０２ａ～１０２ｃ）
　空調機１０２ａ～１０２ｃの各々は、空調空間の空気環境を調節する機器、装置、設備などである。 (Air conditioners 102a to 102c)
Each of the air conditioners 102a to 102c is equipment, apparatus, equipment, etc. for adjusting the air environment of the air-conditioned space.
　空調空間とは、空調機１０２ａ～１０２ｃの各々が空気環境を調節する空間である。空調空間は、典型的には、空調機１０２ａ～１０２ｃの各々の近傍（予め定められる範囲）である。本実施形態に係る空調機１０２ａ～１０２ｃの空調空間は、それぞれ、撮影領域ＴＳａ～ＴＳｃに対応する空間である。すなわち、本実施形態に係る空調機１０２ａ～１０２ｃは、撮影領域ＴＳａ～ＴＳｃのそれぞれに対応付けられている。 The air-conditioned space is a space in which each of the air conditioners 102a to 102c adjusts the air environment. The air-conditioned space is typically the vicinity (predetermined range) of each of the air conditioners 102a to 102c. The air-conditioned spaces of the air conditioners 102a to 102c according to this embodiment are spaces corresponding to the imaging areas TSa to TSc, respectively. That is, the air conditioners 102a to 102c according to the present embodiment are associated with the imaging areas TSa to TSc, respectively.
　本実施形態に係る空調機１０２ａ～１０２ｃの各々は、冷房、暖房、除湿、送風、空気浄化の各機能を備えたエアコン（エアコンディショナ）である。空調機１０２ａ～１０２ｃの各々は、制御装置１０３からネットワークＮを介して制御情報を取得する。空調機１０２ａ～１０２ｃは、取得した制御情報に従って、各々の空調空間の空気の温度、湿度などを調節する。 Each of the air conditioners 102a to 102c according to the present embodiment is an air conditioner (air conditioner) having cooling, heating, dehumidifying, blowing, and air cleaning functions. Each of the air conditioners 102a to 102c acquires control information from the control device 103 via the network N. FIG. The air conditioners 102a to 102c adjust the temperature, humidity, etc. of the air in each air-conditioned space according to the acquired control information.
　制御情報は、それが取得される空調機１０２ａ～１０２ｃに対する指示を含む。制御情報は、それが取得される空調機１０２ａ～１０２ｃが備える機能に応じた指示を含む。 The control information includes instructions for the air conditioners 102a-102c from which it is obtained. The control information includes instructions according to the functions of the air conditioners 102a to 102c from which it is acquired.
　制御情報に含まれる指示は、例えば、電源のオン及びオフ、運転モードの設定又は変更、目標温度の設定又は変更、風量の設定又は変更，風向の設定又は変更の１つ又は複数を含む。運転モードは、例えば、冷房、暖房、除湿、送風、空気浄化の各機能を発揮するモード（すなわち、冷房モード、暖房モード、除湿モード、送風モード、浄化モード）を含む。 Instructions included in the control information include, for example, one or more of power on/off, operation mode setting or change, target temperature setting or change, airflow setting or change, and wind direction setting or change. The operation modes include, for example, modes that perform cooling, heating, dehumidification, ventilation, and air purification functions (that is, cooling mode, heating mode, dehumidification mode, ventilation mode, and purification mode).
　以下において、空調機１０２ａ～１０２ｃを特に区別しない場合、単に「空調機１０２」とも表記する。なお、制御システム１００が備える空調機１０２は、１つ以上であればよく、幾つであってもよい。エアコン以外の空調機１０２の例については、後述の変形例で説明する。 In the following, when the air conditioners 102a to 102c are not particularly distinguished, they are simply referred to as "air conditioner 102". Note that the number of air conditioners 102 included in the control system 100 may be one or more, and may be any number. An example of the air conditioner 102 other than the air conditioner will be described in modified examples described later.
（本実施形態に係る制御装置１０３の機能的構成例）
　図３を再び参照する。
　制御装置１０３は、対象空間を撮影した画像を含む画像情報に基づいて、空調機１０２を制御するための装置である。制御装置１０３は、履歴取得部１０４と、制御部１０５と、履歴記憶部１０６と、制御パターン記憶部１０７を備える。 (Example of functional configuration of control device 103 according to this embodiment)
Please refer to FIG. 3 again.
The control device 103 is a device for controlling the air conditioner 102 based on image information including a captured image of the target space. The control device 103 includes a history acquisition unit 104 , a control unit 105 , a history storage unit 106 and a control pattern storage unit 107 .
　履歴取得部１０４は、対象空間を撮影した画像を含む画像情報を処理して、対象空間において活動する１以上の人Ｐの外観の履歴を含む外観履歴情報を取得する。 The history acquisition unit 104 processes image information including captured images of the target space, and acquires appearance history information including the appearance history of one or more persons P who are active in the target space.
　ここで、「活動」は、主に、人Ｐの日常的な活動（状態及び行為を含む。）を意味する。「活動」は、空調機１０２を制御するためのジェスチャなど、空調機１０２の制御を意図した動作及び状態を含まないものとする。 Here, "activity" mainly means the daily activities of person P (including states and actions). “Activity” shall not include actions and states intended to control the air conditioner 102 , such as gestures to control the air conditioner 102 .
　履歴取得部１０４が行う画像情報に対する処理は、画像情報に含まれる画像から人Ｐを検出するとともに、検出した人Ｐの外観情報を取得するための画像処理である。 The processing for the image information performed by the history acquisition unit 104 is image processing for detecting the person P from the image included in the image information and acquiring the appearance information of the detected person P.
　詳細には例えば、履歴取得部１０４は、図５に示すように、人検出部１０４ａと、解析部１０４ｂとを含む。 Specifically, for example, the history acquisition unit 104 includes a person detection unit 104a and an analysis unit 104b, as shown in FIG.
　人検出部１０４ａは、撮影領域ＴＳａ～ＴＳｃを撮影した画像を含む画像情報を撮影装置１０１ａ～１０１ｃのそれぞれからネットワークＮを介して継続的に取得する。人検出部１０４ａは、画像情報の各々に含まれる画像から人Ｐを検出する。 The human detection unit 104a continuously acquires image information including images obtained by photographing the photographing areas TSa to TSc from each of the photographing devices 101a to 101c via the network N. The person detection unit 104a detects a person P from an image included in each piece of image information.
　解析部１０４ｂは、人検出部１０４ａが取得した画像情報を解析し、人検出部１０４ａが検出した人Ｐの各々の外観情報を解析結果として出力する。解析部１０４ｂは、顔認識機能、人型認識機能、姿勢認識機能、動き認識機能、着衣認識機能、画像の勾配特徴検出機能、画像の色特徴検出機能、物体認識機能などを備える。これらの各機能の詳細は後述する。なお、解析部１０４ｂは、ここで例示した機能などの少なくとも１つを備えればよい。 The analysis unit 104b analyzes the image information acquired by the person detection unit 104a, and outputs the appearance information of each person P detected by the person detection unit 104a as an analysis result. The analysis unit 104b includes a face recognition function, a human figure recognition function, a posture recognition function, a motion recognition function, a clothing recognition function, an image gradient feature detection function, an image color feature detection function, an object recognition function, and the like. Details of each of these functions will be described later. Note that the analysis unit 104b may have at least one of the functions exemplified here.
　解析部１０４ｂは、これらの機能を用いて画像情報を解析し、その結果として、対象空間において活動する１以上の人Ｐの外観情報を継続的に取得する。 The analysis unit 104b analyzes the image information using these functions, and as a result continuously acquires the appearance information of one or more persons P who are active in the target space.
　図６は、外観情報の一例を示す図である。外観情報は、対象空間において活動する人Ｐの外観に関する情報である。外観は、姿勢、行為、服装などである。 FIG. 6 is a diagram showing an example of appearance information. Appearance information is information about the appearance of the person P who is active in the target space. Appearance includes posture, behavior, clothing, and the like.
　本実施形態に係る外観情報は、同図に示すように、人ＩＤ、領域ＩＤ、位置、撮影時刻、姿勢、行為、服装、周囲の状況を関連付ける情報である。位置及び外観（姿勢、行為、服装、周囲の状況）は、画像情報を解析した結果として得られる情報である。なお、外観情報は、姿勢、行為、服装、周囲の状況の少なくとも１つを含めばよい。 Appearance information according to the present embodiment is, as shown in the figure, information that associates person IDs, area IDs, positions, photographing times, postures, actions, clothes, and surrounding situations. Position and appearance (posture, behavior, clothing, surroundings) are information obtained as a result of analyzing image information. Appearance information may include at least one of posture, behavior, clothing, and surroundings.
　人ＩＤは、画像情報に含まれる人Ｐを識別するための情報である。 The person ID is information for identifying the person P included in the image information.
　領域ＩＤ及び撮影時刻は、解析の対象となった画像情報に含まれる領域ＩＤ及び撮影時刻である。 The area ID and shooting time are the area ID and shooting time included in the image information that is the target of analysis.
　位置は、これに関連付けられた人ＩＤの人Ｐの位置を示す情報である。 The position is information indicating the position of the person P whose person ID is associated with it.
　人ＩＤ、領域ＩＤ、位置及び撮影時刻を参照することで、外観情報が、いつのどこにおける誰の外観に関する情報であるかを特定することができる。 By referring to the person ID, area ID, position, and shooting time, it is possible to identify when, where, and whose appearance the appearance information is.
　姿勢は、人Ｐの体の構えに関する情報である。姿勢は、立位（立った状態の姿勢）、座位（座った状態の姿勢）、臥位（寝た状態の姿勢）などの少なくとも１つを含む。 The posture is information related to the posture of the person P's body. The posture includes at least one of a standing position (a standing posture), a sitting position (a sitting posture), a lying position (a lying posture), and the like.
　姿勢はさらに細分化されてもよい。座位を細分化した例として、椅座位（椅子に腰掛けた状態の姿勢）、起座位（座った状態で、上半身を概ね９０度に起こして寄りかかる姿勢）、胡座、正座などがある。臥位を細分化した例として、背臥位（仰向けで寝た状態の姿勢）、側臥位（横向きで寝た状態の姿勢）、腹臥位（うつ伏せで寝た状態の姿勢）などがある。 The posture may be further subdivided. Examples of subdivided sitting positions include a sitting position (sitting on a chair), an upright sitting position (a posture in which the upper body is raised approximately 90 degrees while leaning), crossed legs, and seiza. Examples of subdividing the lying position include supine position (posture of lying on one's back), side lying position (posture of lying on one's side), prone position (posture of lying face down), and the like.
　行為は、人Ｐの動作に関する情報である。行為は、人Ｐの静動を含んでよい。 An action is information related to the action of a person P. Actions may include person P's stillness and movement.
　行為は、歩くこと、走ること、話すこと、うちわなどで扇いでいること、業務をしていること、食事をしていること、服を着ること、服を脱ぐことなどである。行為は、ある姿勢で停止していることであってもよい。行為は、あくび、くしゃみ、寒いときの震え（身震い）、発汗、せきなどの生理現象であってもよい。行為は、ここで例示したものなどの少なくとも１つを含む。 Actions include walking, running, talking, fanning with a paper fan, working, eating, dressing, and undressing. The action may be standing still in a certain posture. The act may be a physiological phenomenon such as yawning, sneezing, shivering when cold (shivering), sweating, coughing. Acts include at least one such as those exemplified herein.
　服装は、外観から判別できる人Ｐの服装に関する情報である。 "Clothing" is information about the clothing of person P that can be identified from the appearance.
　本実施形態では服装は、スコアを用いて表す。このスコアは、人Ｐの厚着或いは薄着の程度を表す指標の例である。本実施形態では、スコアは、大きいほど厚着であることを表すものとする。また、スコアは、１～５の整数であるとする。 In this embodiment, clothes are expressed using scores. This score is an example of an index that indicates the extent to which the person P is overdressed or underdressed. In the present embodiment, a higher score indicates thicker clothing. Also, the score is assumed to be an integer from 1 to 5.
　具体的には例えば、服装のスコア「５」は、コードを着た状態或いはそれに相当する状態の厚着であることを表す。服装のスコア「４」は、例えばジャケットを着た状態或いはそれに相当する状態であることを表す。服装のスコア「３」は、例えば薄手のセータを着た状態或いはそれに相当する状態であることを表す。服装のスコア「２」は、長袖のワイシャツを着た状態或いはそれに相当する状態であることを表す。服装のスコア「１」は、例えば半袖のワイシャツを着た状態或いはそれに相当する状態の薄着であることを表す。 Specifically, for example, a clothing score of "5" indicates that the clothing is worn with a cord or equivalent. A clothing score of "4" indicates, for example, a state in which a jacket is worn or a state corresponding thereto. A clothing score of "3" indicates, for example, that the user is wearing a thin sweater or is in a state corresponding thereto. A dress score of "2" indicates that the user is wearing a long-sleeved shirt or is in a state corresponding thereto. A dress score of "1" indicates that the wearer is lightly dressed, for example, wearing a short-sleeved shirt or equivalent.
　なお、指標は、例えば、アルファベット、記号などであってもよい。また、服装の厚着の程度、或いは薄着の程度を何段階に分けるかは、適宜定められてよい。服装は、指標ではなく、外観上の着衣そのもの（コート、ジャンパ、ジャケット、セータ、長袖のワイシャツ、半袖のワイシャツ、長袖のＴシャツ、半袖のＴシャツなどのいずれを一番上に身につけた状態であるか）を示してもよい。 It should be noted that the index may be, for example, an alphabet, a symbol, or the like. In addition, it may be appropriately determined how many levels the degree of overweight clothing or the degree of lightly clothed clothing is to be divided into. Clothing is not an index, but the appearance itself (coat, jumper, jacket, sweater, long-sleeved shirt, short-sleeved shirt, long-sleeved T-shirt, short-sleeved T-shirt, etc.) ) may be indicated.
　周囲の状況は、人Ｐの周囲の状況を示す情報である。周囲の状況は、食事があること、書籍或いは書類があること、パーソナルコンピュータなどの機器があることなどの少なくとも１つを含む。 The surrounding situation is information indicating the surrounding situation of person P. The surrounding circumstances include at least one of the presence of food, the presence of books or documents, the presence of equipment such as a personal computer, and the like.
　図５を再び参照する。
　解析部１０４ｂは、継続的に取得する外観情報に基づいて、外観履歴情報１０６ａを取得する。解析部１０４ｂは、外観履歴情報１０６ａを履歴記憶部１０６（図３参照）に記憶させる。 Please refer to FIG. 5 again.
The analysis unit 104b acquires appearance history information 106a based on continuously acquired appearance information. The analysis unit 104b stores the appearance history information 106a in the history storage unit 106 (see FIG. 3).
　履歴記憶部１０６は、外観履歴情報１０６ａを記憶するための記憶部である。 The history storage unit 106 is a storage unit for storing appearance history information 106a.
　図７は、外観履歴情報１０６ａの一例を示す図である。同図に示すように、外観履歴情報１０６ａは、人ＩＤ、領域ＩＤ、位置、時刻、姿勢、行為、服装、周囲の状況を関連付ける情報である。外観履歴情報１０６ａは、外観情報に含まれる撮影時刻に代わる「時刻」を含む。 FIG. 7 is a diagram showing an example of the appearance history information 106a. As shown in the figure, the appearance history information 106a is information that associates person IDs, area IDs, positions, times, postures, actions, clothes, and surroundings. Appearance history information 106a includes "time" instead of shooting time included in the appearance information.
　時刻は、これに関連付けられた人ＩＤ、領域ＩＤ、位置、姿勢、行為、服装、周囲の状況に対応する時刻を示す情報である。 The time is information indicating the time corresponding to the associated person ID, area ID, position, posture, action, clothing, and surroundings.
　時刻に含まれる「～」は、その前に含まれる時刻から、当該時刻に関連付けられた各情報に変化がなく継続していることを示す。また、時刻に含まれる「～」は、その後に含まれる時刻まで、当該時刻に関連付けられた各情報に変化がなく継続していたことを示す。 "~" included in the time indicates that the information associated with that time has continued without change from the time included before it. Also, "~" included in the time indicates that each piece of information associated with that time continued without change until the time included thereafter.
　同図に示す外観履歴情報１０６ａは、撮影領域ＴＳａにて時刻Ｔ１から時刻Ｔ３まで座って業務を行っている、人ＩＤ「Ｐ１」「Ｐ２」「Ｐ３」の人Ｐの外観履歴情報１０６ａの例を含む。撮影領域ＴＳａは、会議室Ｒに設定されている撮影領域であるので、人ＩＤ「Ｐ１」「Ｐ２」「Ｐ３」の人Ｐは、会議室Ｒにて会議などの業務を行っている。 Appearance history information 106a shown in the figure is an example of appearance history information 106a of persons P with person IDs "P1", "P2", and "P3" who are sitting and working in the photographing area TSa from time T1 to time T3. including. Since the photographing area TSa is set in the conference room R, the persons P with the person IDs "P1", "P2", and "P3" are conducting business such as meetings in the conference room R.
　同図の外観履歴情報１０６ａは、人ＩＤ「Ｐ１」「Ｐ２」の人Ｐについて、時刻Ｔ１以降、この時刻に関連付けられた領域ＩＤ、位置、姿勢、行為、服装、周囲の状況に変更がなく継続していることを示す例を含む。同図の外観履歴情報１０６ａは、人ＩＤ「Ｐ３」の人Ｐについて、時刻Ｔ１から時刻Ｔ３まで、この時刻に関連付けられた領域ＩＤ、位置、姿勢、行為、服装、周囲の状況に変更がなく継続したことを示す例を含む。同図の外観履歴情報１０６ａは、人ＩＤ「Ｐ３」の人Ｐについて、時刻Ｔ１の後の時刻Ｔ３に服を着ていることを示す例を含む。同図の外観履歴情報１０６ａは、人ＩＤ「Ｐ３」の人Ｐについて、時刻Ｔ３で服装が「４」での業務を行っていることを示す例を含む。 Appearance history information 106a in the figure shows that the area ID, position, posture, behavior, clothing, and surroundings associated with this time have not changed since time T1 for person P with person IDs "P1" and "P2." Include an example to show that it is continuing. Appearance history information 106a in FIG. 10 shows that the area ID, position, posture, behavior, clothes, and surroundings associated with this time did not change from time T1 to time T3 for a person P with a person ID “P3”. Include an example to indicate continued. Appearance history information 106a in the figure includes an example indicating that person P with person ID “P3” was wearing clothes at time T3 after time T1. Appearance history information 106a in the figure includes an example indicating that person P with person ID "P3" is doing work at time T3 wearing "4" clothes.
　なお、外観履歴情報１０６ａは、姿勢、行為、服装、周囲の状況の少なくとも１つを含めばよい。 It should be noted that the appearance history information 106a may include at least one of posture, behavior, clothing, and surroundings.
　図３を再び参照する。
　制御部１０５は、外観履歴情報１０６ａに基づいて、空調機１０２ａ～１０２ｃのいずれか１つ又は複数を制御するための制御情報を生成する。制御部１０５は、生成した制御情報を対象となる空調機１０２ａ～１０２ｃへネットワークＮを介して送信する。 Please refer to FIG. 3 again.
The control unit 105 generates control information for controlling one or more of the air conditioners 102a to 102c based on the appearance history information 106a. The control unit 105 transmits the generated control information via the network N to the target air conditioners 102a to 102c.
　詳細には、制御部１０５は、外観履歴情報１０６ａに基づいて、空調機１０２ａ～１０２ｃの各々について制御が必要であるか否かを判定する。 Specifically, the control unit 105 determines whether or not each of the air conditioners 102a to 102c needs to be controlled based on the appearance history information 106a.
　制御部１０５は、例えば、空調機１０２の制御が必要であるかを制御パターン情報１０７ａに基づいて判定する。 For example, the control unit 105 determines whether the air conditioner 102 needs to be controlled based on the control pattern information 107a.
　制御パターン記憶部１０７は、制御パターン情報１０７ａを記憶するための記憶部である。すなわち、本実施形態に係る制御部１０５は、制御パターン記憶部１０７に記憶された制御パターン情報１０７ａに基づいて、空調機１０２の制御が必要であるかを判定する。制御パターン情報１０７ａは、適宜設定されてよい。 The control pattern storage unit 107 is a storage unit for storing control pattern information 107a. That is, the control unit 105 according to the present embodiment determines whether control of the air conditioner 102 is necessary based on the control pattern information 107a stored in the control pattern storage unit 107. FIG. The control pattern information 107a may be set as appropriate.
　図８は、制御パターン情報１０７ａの一例を示す図である。制御パターン情報１０７ａは、１つ以上の予め設定される制御パターンを含む。制御パターンは、制御条件と制御内容とを関連付ける情報である。同図に示す制御パターン情報１０７ａの「－」は、対応する条件が設定されていないことを示す。 FIG. 8 is a diagram showing an example of the control pattern information 107a. The control pattern information 107a includes one or more preset control patterns. A control pattern is information that associates a control condition with a control content. "-" in the control pattern information 107a shown in the figure indicates that the corresponding condition is not set.
　制御条件は、これに関連付けられた制御内容を適用するための条件である。制御条件は、時期（又は季節）に関する条件と、空間（又は領域）に関する条件と、外観に関する条件と、時間に関する条件とを含む。図８において、「寒い場合の所定行為」は、適宜定められてよいが、例えば、会議室Ｒで服を着ることである。 A control condition is a condition for applying the control content associated with it. The control conditions include time (or season) conditions, space (or area) conditions, appearance conditions, and time conditions. In FIG. 8, the "predetermined action when it is cold" may be determined as appropriate, but is, for example, getting dressed in the conference room R. FIG.
　時期、外観及び時間に関する条件は、それぞれ、制御パターンを適用する時期、外観及び時間を定める。制御部１０５は、時期及び時間に関する条件について、例えば外観履歴情報１０６ａに含まれる時刻に基づいて、外観履歴情報１０６ａが当該条件を満たすか否かを判定する。制御部１０５は、外観に関する条件について、例えば外観履歴情報１０６ａに含まれる外観（姿勢、行為、服装、周囲の状況）に基づいて、外観履歴情報１０６ａが当該条件を満たすか否かを判定する。 The timing, appearance, and time conditions define the timing, appearance, and time to apply the control pattern, respectively. The control unit 105 determines whether or not the appearance history information 106a satisfies the condition regarding the period and time, for example, based on the time included in the appearance history information 106a. The control unit 105 determines whether or not the appearance history information 106a satisfies the conditions related to the appearance based on, for example, the appearance (posture, behavior, clothing, surroundings) included in the appearance history information 106a.
　制御部１０５は、例えば、外観履歴情報１０６ａと制御パターンとに基づいて、制御パターンに含まれる制御条件を満たす外観履歴情報１０６ａがあるか否かを判定する。制御部１０５は、時期、外観及び時間に関する条件のすべてを満たす外観履歴情報１０６ａがある場合に、制御条件を満たす外観履歴情報１０６ａがあると判定する。制御条件を満たす外観履歴情報１０６ａがある場合、制御部１０５は、制御が必要であると判定し、当該外観履歴情報１０６ａに含まれる領域ＩＤを特定する。そして、制御部１０５は、特定した領域ＩＤに基づいて、制御対象の空調機１０２を特定する。 For example, based on the appearance history information 106a and the control pattern, the control unit 105 determines whether or not there is appearance history information 106a that satisfies the control conditions included in the control pattern. The control unit 105 determines that there is appearance history information 106a that satisfies the control condition when there is appearance history information 106a that satisfies all the conditions regarding time, appearance, and time. If there is the appearance history information 106a that satisfies the control condition, the control unit 105 determines that control is necessary, and specifies the area ID included in the appearance history information 106a. Then, the control unit 105 identifies the air conditioner 102 to be controlled based on the identified area ID.
　制御部１０５は、条件を満たした制御パターンに含まれる制御内容に従って、制御情報を生成する。制御部１０５は、制御対象の空調機１０２へネットワークＮを介して、生成した制御情報を送信する。 The control unit 105 generates control information according to the control details included in the control pattern that satisfies the conditions. The control unit 105 transmits the generated control information via the network N to the air conditioner 102 to be controlled.
　これまで、本実施形態に係る制御システム１００の機能的な構成について主に説明した。ここから、本実施形態に係る制御システム１００の物理的な構成について説明する。 So far, the functional configuration of the control system 100 according to this embodiment has been mainly described. From here, the physical configuration of the control system 100 according to this embodiment will be described.
（本実施形態に係る空調機制御システム１００の物理的構成）
　制御システム１００は、物理的に、ネットワークＮを介して接続された撮影装置１０１ａ～１０１ｃ及び空調機１０２ａ～１０２ｃと制御装置１０３とから構成される。 (Physical Configuration of Air Conditioner Control System 100 According to this Embodiment)
The control system 100 is physically composed of imaging devices 101a to 101c, air conditioners 102a to 102c, and a control device 103, which are connected via a network N. FIG.
　本実施形態に係る撮影装置１０１ａ～１０１ｃ及び空調機１０２ａ～１０２ｃの各々は、物理的に個別に構成される。なお、撮影装置１０１ａ～１０１ｃ及び空調機１０２ａ～１０２ｃの一部又は全部は、物理的に単一に構成されてもよい。例えば、空調機１０２ａが物理的に撮影装置１０１ａを備えてもよい。また例えば、対象空間にあるパーソナルコンピュータ、端末装置、各種の機器が、撮影装置１０１ａ～１０１ｃを備えてもよい。これらの場合、空調機１０２ａ、パーソナルコンピュータ、端末装置、各種の機器は、撮影装置１０１ａの機能を備える。 Each of the imaging devices 101a to 101c and the air conditioners 102a to 102c according to this embodiment is physically configured individually. Some or all of the imaging devices 101a to 101c and the air conditioners 102a to 102c may be configured physically as a single unit. For example, the air conditioner 102a may physically include the imaging device 101a. Also, for example, personal computers, terminal devices, and various types of equipment in the target space may be equipped with the imaging devices 101a to 101c. In these cases, the air conditioner 102a, personal computer, terminal device, and various other devices have the functions of the imaging device 101a.
　本実施形態に係る制御装置１０３は、物理的に単一の装置から構成される。なお、制御装置１０３は、物理的に、ネットワークＮなどの適宜の通信回線を介して接続された複数の装置から構成されてもよい。例えば、制御装置１０３は、履歴取得部１０４が行う画像情報に対する処理を実行する装置と、その他の制御装置１０３における処理を実行する装置と、に物理的に分けて構成されてもよい。 The control device 103 according to this embodiment is physically composed of a single device. Note that the control device 103 may be physically composed of a plurality of devices connected via an appropriate communication line such as the network N. For example, the control device 103 may be physically divided into a device that executes processing on image information performed by the history acquisition unit 104 and a device that executes other processing in the control device 103 .
（本実施形態に係る空調機制御装置１０３の物理的構成）
　制御装置１０３は、物理的には例えば、汎用のコンピュータなどである。詳細には例えば、制御装置１０３は物理的に、図９に示すように、バス１０１０、プロセッサ１０２０、メモリ１０３０、ストレージデバイス１０４０、ネットワークインタフェース１０５０、入力インタフェース１０６０及び出力インタフェース１０７０を有する。 (Physical configuration of the air conditioner control device 103 according to this embodiment)
The control device 103 is physically, for example, a general-purpose computer. Specifically, for example, the controller 103 physically has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, a network interface 1050, an input interface 1060 and an output interface 1070, as shown in FIG.
　バス１０１０は、プロセッサ１０２０、メモリ１０３０、ストレージデバイス１０４０、ネットワークインタフェース１０５０、入力インタフェース１０６０及び出力インタフェース１０７０が、相互にデータを送受信するためのデータ伝送路である。ただし、プロセッサ１０２０などを互いに接続する方法は、バス接続に限定されない。 The bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, network interface 1050, input interface 1060 and output interface 1070 to transmit and receive data to and from each other. However, the method of connecting processors 1020 and the like to each other is not limited to bus connection.
　プロセッサ１０２０は、ＣＰＵ（Ｃｅｎｔｒａｌ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）やＧＰＵ（Ｇｒａｐｈｉｃｓ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）などで実現されるプロセッサである。 The processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.
　メモリ１０３０は、ＲＡＭ（Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ）などで実現される主記憶装置である。 The memory 1030 is a main memory implemented by RAM (Random Access Memory) or the like.
　ストレージデバイス１０４０は、ＨＤＤ（Ｈａｒｄ　Ｄｉｓｋ　Ｄｒｉｖｅ）、ＳＳＤ（Ｓｏｌｉｄ　Ｓｔａｔｅ　Ｄｒｉｖｅ）、メモリカード、又はＲＯＭ（Ｒｅａｄ　Ｏｎｌｙ　Ｍｅｍｏｒｙ）などで実現される補助記憶装置である。ストレージデバイス１０４０は、制御装置１０３の各機能を実現するためのプログラムモジュールを記憶している。プロセッサ１０２０がこれら各プログラムモジュールをメモリ１０３０に読み込んで実行することで、そのプログラムモジュールに対応する各機能が実現される。 The storage device 1040 is an auxiliary storage device realized by a HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, ROM (Read Only Memory), or the like. The storage device 1040 stores program modules for realizing each function of the control device 103 . Each function corresponding to the program module is realized by the processor 1020 reading each program module into the memory 1030 and executing it.
　ネットワークインタフェース１０５０は、制御装置１０３をネットワークＮに接続するためのインタフェースである。 The network interface 1050 is an interface for connecting the control device 103 to the network N.
　入力インタフェース１０６０は、ユーザが情報を入力するためのインタフェースである。入力インタフェース１０６０は、例えば、タッチパネル、キーボード、マウスなどの１つ又は複数から構成される。 The input interface 1060 is an interface for the user to input information. The input interface 1060 is composed of one or more of, for example, a touch panel, keyboard, mouse, and the like.
　出力インタフェース１０７０は、ユーザに情報を提示するためのインタフェースである。出力インタフェース１０７０は、液晶パネル、有機ＥＬ（Ｅｌｅｃｔｒｏ－Ｌｕｍｉｎｅｓｃｅｎｃｅ）パネルなどの１つ又は複数から構成される。 The output interface 1070 is an interface for presenting information to the user. The output interface 1070 is composed of one or more of a liquid crystal panel, an organic EL (Electro-Luminescence) panel, and the like.
　これまで、本実施形態に係る制御システム１００の物理的な構成について説明した。ここから、本実施形態に係る制御システム１００の動作について説明する。 So far, the physical configuration of the control system 100 according to this embodiment has been described. From here, the operation of the control system 100 according to this embodiment will be described.
（本実施形態に係る空調機制御システム１００の動作） (Operation of air conditioner control system 100 according to this embodiment)
　制御装置１０３は、例えばユーザから開始指示を受けると、ユーザから終了指示を受けるまで、空調機制御処理（図２参照）を繰り返し実行する。 For example, when receiving a start instruction from the user, the control device 103 repeatedly executes the air conditioner control process (see FIG. 2) until receiving an end instruction from the user.
　履歴取得部１０４は、上述の通り、対象空間（本実施形態では、会議室Ｒ及び廊下Ｃ）を撮影した画像を含む画像情報を処理して、対象空間において活動する１以上の人Ｐの外観の履歴を含む外観履歴情報１０６ａを取得する（ステップＳ１０１）。 As described above, the history acquisition unit 104 processes image information including images of the target space (in the present embodiment, the meeting room R and the corridor C), and obtains the appearance of one or more persons P active in the target space. (step S101).
　図１０～１１は、本実施形態に係る履歴取得処理（ステップＳ１０１）の詳細な一例を示すフローチャートである。 10 and 11 are flowcharts showing a detailed example of the history acquisition process (step S101) according to this embodiment.
　例えば、図４に示す撮影領域ＴＳａを時刻Ｔ１に撮影した画像を含む画像情報を処理し、履歴記憶部１０６は、時刻「Ｔ１」及び人ＩＤ「Ｐ１」～「Ｐ３」を含む外観履歴情報１０６ａを記憶しているとする（図７参照）。そして、時刻Ｔ１以降、会議室Ｒの人Ｐが移動していないとする。例えば、撮影領域ＴＳａには、時刻Ｔ１以降の少なくとも時刻Ｔ３まで、８人の人Ｐが居るとする。これを前提に、以下では、時刻Ｔ３に撮影領域ＴＳａを撮影した画像を含む画像情報にステップＳ１０１を実行する場合の例を適宜参照して説明する。 For example, image information including an image captured at time T1 of the capturing area TSa shown in FIG. is stored (see FIG. 7). Then, it is assumed that the person P in the conference room R has not moved since time T1. For example, it is assumed that eight persons P are present in the photographing area TSa from time T1 until at least time T3. Based on this assumption, an example in which step S101 is executed for image information including an image of the imaging region TSa captured at time T3 will be described as appropriate.
　図１０を参照する。
　人検出部１０４ａは、撮影装置１０１ａ～１０１ｃのそれぞれからネットワークＮを介して、撮影領域ＴＳａ～ＴＳｃを撮影した画像を含む画像情報を取得する（ステップＳ１０１ａ）。 Please refer to FIG.
The human detection unit 104a acquires image information including images of the photographing areas TSa to TSc from the photographing devices 101a to 101c via the network N (step S101a).
　人検出部１０４ａは、画像情報の各々に含まれる画像から人Ｐを検出する（ステップＳ１０１ｂ）。 The person detection unit 104a detects the person P from the images included in each piece of image information (step S101b).
　ステップＳ１０１ｂにおいて、人検出部１０４ａは、検出した人Ｐの各々に人ＩＤを付与する。人ＩＤは、検出された人Ｐの各々を識別するための情報である。人ＩＤは、適宜の規則に従って付与されるとよい。ここで付与される人ＩＤは、暫定的なものである。 In step S101b, the person detection unit 104a assigns a person ID to each person P detected. The person ID is information for identifying each person P that has been detected. A person ID may be assigned according to appropriate rules. The person ID given here is temporary.
　例えば、人検出部１０４ａは、図４に示す撮影領域ＴＳａを時刻Ｔ３に撮影した画像情報に含まれる画像についてのステップＳ１０１ｂで、８人の人を検出する。人検出部１０４ａは、ステップＳ１０１ｂの各々で、８人の人の各々に暫定的な人ＩＤを付与する。 For example, the human detection unit 104a detects eight people in step S101b for the image included in the image information of the imaging region TSa shown in FIG. 4 captured at time T3. The person detection unit 104a assigns a provisional person ID to each of the eight persons in each step S101b.
　解析部１０４ｂは、ステップＳ１０１ａにて取得した画像情報を解析する（ステップＳ１０１ｃ）。 The analysis unit 104b analyzes the image information acquired in step S101a (step S101c).
　詳細には、解析部１０４ｂは、上述の通り、顔認識機能、人型認識機能、姿勢認識機能、動き認識機能、着衣認識機能、画像の勾配特徴検出機能、画像の色特徴検出機能、物体認識機能などを備える。ステップＳ１０１ｃにおいて、解析部１０４ｂは、これらの機能を用いて画像情報を解析する。 Specifically, as described above, the analysis unit 104b has a face recognition function, a human type recognition function, a posture recognition function, a motion recognition function, a clothing recognition function, an image gradient feature detection function, an image color feature detection function, and an object recognition function. Equipped with functions, etc. In step S101c, the analysis unit 104b analyzes the image information using these functions.
　顔認識機能は、人Ｐの顔特徴量を抽出する。顔認識機能は、人Ｐの顔の画像内の位置を特定しもてよい。 The facial recognition function extracts the facial features of person P. The face recognition function may locate the person P's face in the image.
　人型認識機能は、人Ｐの人体的特徴量を抽出する。人体的特徴量は、体形の肥痩、身長、服装などの全体的な特徴を示す。人型認識機能は、人Ｐの画像内の位置を特定してもよい。 The human type recognition function extracts the human body features of person P. Anthropomorphic features represent overall features such as fatness, height, and clothing. The human recognition function may identify the position of the person P within the image.
　姿勢認識機能は、人Ｐの関節点を検出し、関節点を繋げた棒人間モデルを作成する。姿勢認識機能は、棒人間モデルの情報を用いて、姿勢の特徴量を抽出し、人Ｐの姿勢を推定する。姿勢認識機能は、人Ｐの身長を推定してもよい。姿勢認識機能は、人Ｐの画像内の位置を特定してもよい。 The posture recognition function detects the joint points of person P and creates a stick figure model by connecting the joint points. The posture recognition function uses the information of the stick figure model to extract the feature amount of the posture and estimate the posture of the person P. The posture recognition function may estimate the height of the person P. The posture recognition function may identify the position of the person P within the image.
　動き認識機能は、姿勢認識機能が抽出した姿勢の特徴量に基づいて、人Ｐの姿勢の変化を特定し、その人Ｐの動きを推定する。 The motion recognition function identifies changes in the posture of the person P based on the posture feature amount extracted by the posture recognition function, and estimates the motion of the person P.
　姿勢認識機能及び動き認識機能は、国際公開第２０２１／０８４６７７号に開示された技術、Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh, "Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields", The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, P. 7291-7299に開示された技術などを用いて実現されてもよい。 The posture recognition function and motion recognition function are based on the technology disclosed in WO2021/084677, Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh, "Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields", It may be realized using the technology disclosed in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, P. 7291-7299.
　着衣認識機能では、人Ｐの外観から判別できる着衣（コート、ジャンパ、ジャケット、セータ、長袖のシャツ、半袖のシャツ、長袖のＴシャツ、半袖のＴシャツなど）を推定する。 The clothing recognition function estimates the clothing (coat, jumper, jacket, sweater, long-sleeved shirt, short-sleeved shirt, long-sleeved T-shirt, short-sleeved T-shirt, etc.) that can be identified from the appearance of the person P.
　画像の勾配特徴検出機能は、ＳＩＦＴ、ＳＵＲＦ、ＲＩＦＦ、ＯＲＢ、ＢＲＩＳＫ、ＣＡＲＤ、ＨＯＧなどである。画像の色特徴検出機能は、例えばカラーヒストグラムなど、画像の色の特徴を示すデータを出力する。 　Image gradient feature detection functions include SIFT, SURF, RIFF, ORB, BRISK, CARD, and HOG. The image color feature detection function outputs data indicating the color features of the image, such as a color histogram.
　物体認識機能は、例えばＹＯＬＯ（一般物体[例えば、車・自転車・椅子など]の抽出や、人の抽出ができる）等の技術を用いて構成される。物体認識機能は、周囲の状況としての物体を画像から検出し、当該物体の画像中の位置を特定する。 The object recognition function is configured using technology such as YOLO (which can extract general objects [for example, cars, bicycles, chairs, etc.] and extract people). The object recognition function detects an object as a surrounding situation from an image and identifies the position of the object in the image.
　解析部１０４ｂは、姿勢認識機能を用いて、外観情報の姿勢を取得する。 The analysis unit 104b acquires the posture of the appearance information using the posture recognition function.
　解析部１０４ｂは、動き認識機能を用いて、外観情報の行為を取得する。例えば、解析部１０４ｂは、人Ｐの動きに応じた行為を予め定めた行為データを保持する。解析部１０４ｂは、動き認識機能を用いて推定した人Ｐの動きと行為データとに基づいて、外観情報の行為を取得する。 The analysis unit 104b uses the motion recognition function to acquire the behavior of the appearance information. For example, the analysis unit 104b holds action data that predetermines actions according to the movement of the person P. FIG. The analysis unit 104b acquires the action of the appearance information based on the movement of the person P estimated using the motion recognition function and the action data.
　解析部１０４ｂは、姿勢認識機能を用いて推定した人Ｐの姿勢と、物体認識機能を用いて推定したその人Ｐの周囲の状況とに基づいて、外観情報の行為を取得してもよい。例えば、解析部１０４ｂは、業務をしているという行為を、座っている人の周囲にパーソナルコンピュータなどの機器、書籍や書類などがあることに基づいて取得してもよい。 The analysis unit 104b may acquire the action of the appearance information based on the posture of the person P estimated using the posture recognition function and the circumstances around the person P estimated using the object recognition function. For example, the analysis unit 104b may acquire the act of doing business based on the presence of a device such as a personal computer, a book, a document, or the like around the sitting person.
　解析部１０４ｂは、動き認識機能を用いて推定した人Ｐの動きと、物体認識機能を用いて推定したその人Ｐの周囲の状況とに基づいて、外観情報の行為を取得してもよい。例えば、解析部１０４ｂは、食事をしているという行為を、口の方へ手を動かす動きをしている人Ｐの周囲に食事があることに基づいて取得してもよい。 The analysis unit 104b may acquire the action of the appearance information based on the movement of the person P estimated using the motion recognition function and the circumstances surrounding the person P estimated using the object recognition function. For example, the analysis unit 104b may acquire the act of having a meal based on the presence of a meal around the person P who is moving his hand toward his mouth.
　解析部１０４ｂは、動き認識機能を用いて推定した人Ｐの動きと、姿勢認識機能を用いて推定した人Ｐの姿勢と、物体認識機能を用いて推定したその人Ｐの周囲の状況とに基づいて、外観情報の行為を取得してもよい。例えば、解析部１０４ｂは、食事をしているという行為を、座って口の方へ手を動かす動きをしている人Ｐの周囲に食事があることに基づいて取得してもよい。 The analysis unit 104b analyzes the motion of the person P estimated using the motion recognition function, the posture of the person P estimated using the posture recognition function, and the circumstances around the person P estimated using the object recognition function. Based on the behavior of the appearance information may be obtained. For example, the analysis unit 104b may acquire the act of having a meal based on the presence of a meal around the person P who is sitting and moving his hand toward his mouth.
　解析部１０４ｂは、服装認識機能を用いて、人Ｐの外観から判別できる着衣を推定する。解析部１０４ｂは、例えば、着衣とスコアとを関連付けた服装データを予め保持する。解析部１０４ｂは、服装データを参照して、推定された着衣に応じた服装のスコアを取得する。具体的には例えば、行為データは、着衣「コート」とスコア「５」とを関連付ける。行為データは例えば、着衣「半袖のワイシャツ」とスコア「１」とを関連付ける。 The analysis unit 104b uses the clothing recognition function to estimate clothing that can be determined from the appearance of the person P. The analysis unit 104b holds, for example, clothes data in which clothes and scores are associated in advance. The analysis unit 104b refers to the clothing data and obtains a clothing score corresponding to the estimated clothing. Specifically, for example, the action data associates the clothing "coat" with the score "5". For example, the action data associates the clothing "short-sleeved dress shirt" with the score "1".
　解析部１０４ｂは、物体認識機能を用いて、周囲の状況を取得する。 The analysis unit 104b acquires the surrounding situation using the object recognition function.
　解析部１０４ｂは、異なる画像間の人Ｐの同一性を判定する。例えば、解析部１０４ｂは、顔特徴量、人体的特徴量、姿勢の特徴量、行為の特徴量、人Ｐの顔の画像内の位置、人Ｐの画像内の位置、着衣などの少なくとも１つを用いて、異なる画像間の人Ｐの同一性を判定する。 The analysis unit 104b determines the identity of the person P between different images. For example, the analysis unit 104b analyzes at least one of the facial feature amount, the human body feature amount, the posture feature amount, the action feature amount, the position of the face of the person P in the image, the position of the person P in the image, and the clothing. is used to determine the identity of a person P between different images.
　解析部１０４ｂは、同一の人が同一の人ＩＤとなるように、ステップＳ１０１ｂにて付与された暫定的な人ＩＤを修正する。この修正の結果、ステップＳ１０１ｂにて検出された人Ｐの各々の人ＩＤが確定する。また、人Ｐの同一性を判定することで、画像情報に基づいて人Ｐの動線を取得すること（動線解析）ができる。 The analysis unit 104b corrects the temporary person ID given in step S101b so that the same person has the same person ID. As a result of this correction, the person ID of each person P detected in step S101b is determined. Further, by determining the identity of the person P, it is possible to acquire the line of flow of the person P based on the image information (flow line analysis).
　このような解析部１０４ｂが備える顔認識機能、人型認識機能、姿勢認識機能、動き認識機能、着衣認識機能、画像の勾配特徴検出機能、画像の色特徴検出機能、物体認識機能などの各機能は、例えば機械学習を行って学習済みの学習モデルを用いて実現できる。 Each function such as a face recognition function, a human figure recognition function, a posture recognition function, a motion recognition function, a clothing recognition function, an image gradient feature detection function, an image color feature detection function, an object recognition function, etc., provided in the analysis unit 104b. can be realized, for example, by using a learning model that has been trained by performing machine learning.
　解析部１０４ｂは、例えば機能ごとの学習モデルを含む。学習モデルは、画像情報を入力とし、その機能に応じた推定結果を出力する。学習時の学習モデルへのインプットデータは、画像情報である。機械学習においては、画像情報に応じた推定結果を正解とする教師あり学習を行うとよい。 The analysis unit 104b includes, for example, a learning model for each function. The learning model takes image information as input and outputs an estimation result according to its function. Input data to the learning model during learning is image information. In machine learning, it is preferable to perform supervised learning in which an estimation result corresponding to image information is regarded as a correct answer.
　ここで、説明した画像情報に対する処理は、一例に過ぎない。画像情報に対する処理は、外観情報を取得できる処理であればよく、パターンマッチングなどの種々の公知の技術が適用されてもよい。 Here, the processing for image information described here is only an example. The processing for the image information may be processing capable of acquiring appearance information, and various known techniques such as pattern matching may be applied.
　解析部１０４ｂは、ステップＳ１０１ｃの解析処理の結果として、ステップＳ１０１ｂにて検出された人Ｐの外観情報を取得する（ステップＳ１０１ｄ）。 The analysis unit 104b acquires the appearance information of the person P detected in step S101b as a result of the analysis processing in step S101c (step S101d).
　詳細には、解析部１０４ｂは、ステップＳ１０１ｃにて確定した人ＩＤを、外観情報の「人ＩＤ」に設定する。解析部１０４ｂは、ステップＳ１０１ｃにて解析の対象となった画像情報に含まれる領域ＩＤ及び撮影時刻を、外観情報の「領域ＩＤ」及び「撮影時刻」のそれぞれに設定する。 Specifically, the analysis unit 104b sets the person ID determined in step S101c to the "person ID" of the appearance information. The analysis unit 104b sets the area ID and the shooting time included in the image information analyzed in step S101c to the "area ID" and "shooting time" of the appearance information, respectively.
　解析部１０４ｂは、ステップＳ１０１ｃでの解析の結果として推定される人Ｐの位置、姿勢、行為、服装、周囲の状況を、外観情報の「位置」、「姿勢」、「行為」、「服装」、「周囲の状況」のそれぞれに設定する。 The analysis unit 104b uses the position, posture, behavior, clothing, and surroundings of the person P estimated as the result of the analysis in step S101c to obtain the "position", "posture", "action", and "clothes" of the appearance information. , and "Surroundings" respectively.
　例えば、解析部１０４ｂは、時刻Ｔ３に撮影領域ＴＳａを撮影した画像を含む画像情報の各々に対するステップＳ１０１ｃにて、当該画像に基づいて検出された人Ｐと、外観履歴情報１０６ａに含まれる人ＩＤ「Ｐ１」～「Ｐ３」の人Ｐとの同一性を判定する。その結果、図１２に示すように、解析部１０４ｂは、それらの人Ｐの人ＩＤは、「Ｐ１」～「Ｐ３」と確定する。 For example, in step S101c for each piece of image information including an image of the imaging region TSa captured at time T3, the analysis unit 104b determines the person P detected based on the image and the person ID included in the appearance history information 106a. The identity of "P1" to "P3" with person P is determined. As a result, as shown in FIG. 12, the analysis unit 104b determines that the person IDs of those persons P are "P1" to "P3".
　図１２は、暫定的な人ＩＤと、人Ｐの同一性の判定の結果として確定した人ＩＤと、の関係を示す図である。同図に示すように、暫定的な人ＩＤ「Ｑ１」～「Ｑ８」が、それぞれ、人Ｐの同一性の判定の結果、外観履歴情報１０６ａに含まれる人ＩＤ「Ｐ１」～「Ｐ８」と確定する。 FIG. 12 is a diagram showing the relationship between the provisional person ID and the person ID determined as a result of determining the identity of person P. As shown in the figure, provisional person IDs "Q1" to "Q8" are identified as person IDs "P1" to "P8" contained in appearance history information 106a as a result of the determination of the identity of person P, respectively. Determine.
　そして、例えば、時刻Ｔ１と時刻Ｔ３との間の時刻Ｔ２に撮影領域ＴＳａを撮影した画像を含む画像情報に対する解析処理（ステップＳ１０１ｃ）の結果、人ＩＤ「Ｐ３」について、第１の外観情報を取得したとする。第１の外観情報は、人ＩＤ「Ｐ３」、領域ＩＤ「ＴＳａ」、位置「Ｘ３」、時刻「Ｔ２」、姿勢「座位」、行為「業務」、服装「３」、周囲の状況「書類」を含む。 Then, for example, as a result of the analysis processing (step S101c) for the image information including the image of the imaging region TSa captured at time T2 between time T1 and time T3, the first appearance information is obtained for person ID "P3." Assume that you have obtained The first appearance information includes person ID "P3", area ID "TSa", position "X3", time "T2", posture "sitting position", action "business", clothing "3", surrounding situation "document". including.
　例えば、時刻Ｔ２の後の時刻Ｔ３に撮影領域ＴＳａを撮影した画像を含む画像情報に対する解析処理（ステップＳ１０１ｃ）の結果、人ＩＤ「Ｐ３」について、第２の外観情報及び第３の外観情報を取得したとする。 For example, as a result of the analysis processing (step S101c) for the image information including the image of the imaging area TSa captured at time T3 after time T2, the second appearance information and the third appearance information are obtained for the person ID “P3”. Assume that you have obtained
　第２の外観情報は、人ＩＤ「Ｐ３」、領域ＩＤ「ＴＳａ」、位置「Ｘ３」、時刻「Ｔ３」、姿勢「座位」、行為「業務」、服装「４」、周囲の状況「書類」を含む。 The second appearance information includes person ID "P3", area ID "TSa", position "X3", time "T3", posture "sitting position", action "business", clothing "4", surrounding situation "document". including.
　第３の外観情報は、人ＩＤ「Ｐ３」、領域ＩＤ「ＴＳａ」、位置「Ｘ３」、時刻「Ｔ３」、姿勢「座位」、行為「服を着る」、服装「４」、周囲の状況「書類」を含む。 The third appearance information includes person ID "P3", area ID "TSa", position "X3", time "T3", posture "sitting position", action "put on clothes", clothes "4", surrounding situation " including “documents”.
　このように１つの画像情報を解析した結果、一人の人Ｐが複数の外観を有する場合（例えば、服を着ながら、業務をしている）、一人の人Ｐに複数の外観情報が取得される。 As a result of analyzing one piece of image information in this way, when one person P has multiple appearances (for example, he/she is working while wearing clothes), multiple pieces of appearance information are acquired for one person P. be.
　図１１を参照する。
　解析部１０４ｂは、ステップＳ１０１ｄにて取得した外観情報の各々について、ステップＳ１０１ｆ～Ｓ１０１ｉを繰り返す（ステップＳ１０１ｅ；ループＡ）。 Please refer to FIG.
The analysis unit 104b repeats steps S101f to S101i for each piece of appearance information acquired in step S101d (step S101e; loop A).
　解析部１０４ｂは、処理対象である外観情報に含まれる人ＩＤと同じ人ＩＤを含む外観履歴情報１０６ａがあるか否かを判定する（ステップＳ１０１ｆ）。 The analysis unit 104b determines whether there is appearance history information 106a including the same person ID as the person ID included in the appearance information to be processed (step S101f).
　ないと判定した場合（ステップＳ１０１ｆ；Ｎｏ）、解析部１０４ｂは、処理対象である外観情報に基づいて、外観履歴情報１０６ａを新たに作成する（ステップＳ１０１ｇ）。解析部１０４ｂは、新たに作成した外観履歴情報１０６ａを履歴記憶部１０６に記憶させる。 If it is determined that there is no (step S101f; No), the analysis unit 104b newly creates appearance history information 106a based on the appearance information to be processed (step S101g). The analysis unit 104b causes the history storage unit 106 to store the newly created appearance history information 106a.
　ステップＳ１０１ｇにおいて、解析部１０４ｂは、処理対象である外観情報に対応する外観履歴情報１０６ａを新たに作成する。詳細には、解析部１０４ｂは、処理対象である外観情報に含まれる各情報を、外観履歴情報１０６ａの対応する各項目に設定する。ここで、解析部１０４ｂは、外観情報に含まれる撮影時刻を、外観履歴情報１０６ａの時刻に設定する。 In step S101g, the analysis unit 104b newly creates appearance history information 106a corresponding to the appearance information to be processed. Specifically, the analysis unit 104b sets each piece of information included in the appearance information to be processed in each corresponding item of the appearance history information 106a. Here, the analysis unit 104b sets the shooting time included in the appearance information to the time of the appearance history information 106a.
　解析部１０４ｂは、ステップＳ１０１ｇを実行すると、未処理の外観情報がある場合、ループＡ（ステップＳ１０１ｅ）を再び実行する。未処理の外観情報がない場合、解析部１０４ｂは、履歴取得処理（ステップＳ１０１）を終了して、空調機制御処理に戻る。 After executing step S101g, if there is unprocessed appearance information, the analysis unit 104b executes loop A (step S101e) again. When there is no unprocessed appearance information, the analysis unit 104b ends the history acquisition process (step S101) and returns to the air conditioner control process.
　あると判定した場合（ステップＳ１０１ｆ；Ｙｅｓ）、解析部１０４ｂは、位置及び外観に変化があるか否かを判定する（ステップＳ１０１ｈ）。 If it is determined that there is (step S101f; Yes), the analysis unit 104b determines whether or not there is a change in the position and appearance (step S101h).
　ステップＳ１０１ｈでは、解析部１０４ｂは、処理対象である外観情報と、これに含まれる人ＩＤと同じ人ＩＤを含む外観履歴情報１０６ａと、の各々に含まれる位置及び外観に変化があるか否かを判定する。 In step S101h, the analysis unit 104b determines whether there is a change in the position and appearance included in each of the appearance information to be processed and the appearance history information 106a including the same person ID as the person ID included therein. judge.
　変化がないと判定した場合（ステップＳ１０１ｈ；Ｎｏ）、解析部１０４ｂは、同じ人ＩＤを含む外観履歴情報１０６ａに含まれる外観が継続しているので、未処理の外観情報がある場合には、ループＡ（ステップＳ１０１ｅ）を再び実行する。未処理の外観情報がない場合、解析部１０４ｂは、履歴取得処理（ステップＳ１０１）を終了して、空調機制御処理に戻る。 If it is determined that there is no change (step S101h; No), the analysis unit 104b continues the appearance included in the appearance history information 106a including the same person ID. Loop A (step S101e) is executed again. When there is no unprocessed appearance information, the analysis unit 104b ends the history acquisition process (step S101) and returns to the air conditioner control process.
　例えば、上述の第１の外観情報についてのステップＳ１０１ｈでは、解析部１０４ｂは、変化がないと判定し、第１の外観情報についてのループＡ（ステップＳ１０１ｅ）を終了する。 For example, in step S101h for the first appearance information described above, the analysis unit 104b determines that there is no change, and ends loop A (step S101e) for the first appearance information.
　変化があると判定した場合（ステップＳ１０１ｈ；Ｙｅｓ）、解析部１０４ｂは、処理対象である外観情報に基づいて、外観履歴情報１０６ａを新たに作成すること、及び／又は、外観履歴情報１０６ａを更新することを行う（ステップＳ１０１ｉ）。ここで、「Ａ及び／又はＢ」は、ＡとＢとのいずれか一方又は両方を意味し、以下においても同様である。すなわち、ステップＳ１０１ｇでは、解析部１０４ｂは、外観履歴情報１０６ａを新たに作成することと、外観履歴情報１０６ａを更新することと、のいずれか一方又は両方を実行する。 If it is determined that there is a change (Step S101h; Yes), the analysis unit 104b creates new appearance history information 106a and/or updates the appearance history information 106a based on the appearance information to be processed. (Step S101i). Here, "A and/or B" means either one or both of A and B, and the same applies hereinafter. That is, in step S101g, the analysis unit 104b performs one or both of newly creating the appearance history information 106a and updating the appearance history information 106a.
　例えば、上述の第２の外観情報が処理対象であるとする。第２の外観情報は、同じ外観（姿勢、行為、服装及び周囲の状況）について時刻Ｔ１から継続している外観履歴情報１０６ａの外観（この例では「服装」）の変化を示す。そのため、解析部１０４ｂは、当該外観履歴情報１０６ａを更新する。そして、第２の外観情報に対応する外観履歴情報１０６ａを新たに作成する。外観履歴情報１０６ａを新たに作成する処理は、上述のステップＳ１０１ｇと同様である。解析部１０４ｂは、新たに作成した外観履歴情報１０６ａを履歴記憶部１０６に記憶させる。 For example, assume that the above-mentioned second appearance information is to be processed. The second appearance information indicates changes in the appearance ("clothes" in this example) of the appearance history information 106a continuing from time T1 for the same appearance (posture, action, clothing, and surroundings). Therefore, the analysis unit 104b updates the appearance history information 106a. Then, appearance history information 106a corresponding to the second appearance information is newly created. The process of newly creating appearance history information 106a is the same as that of step S101g described above. The analysis unit 104b causes the history storage unit 106 to store the newly created appearance history information 106a.
　詳細には、解析部１０４ｂは、ステップＳ１０１ｇにて、人ＩＤ「Ｐ３」、領域ＩＤ「ＴＳａ」、位置「Ｘ３」、時刻「Ｔ１～」、姿勢「座位」、行為「業務」、服装「３」、周囲の状況「書類」の外観履歴情報１０６ａを更新する。この更新では、解析部１０４ｂは、時刻「Ｔ１～」を時刻「Ｔ１～Ｔ３」に更新する（図７参照）。 Specifically, in step S101g, the analysis unit 104b sets the person ID "P3", the area ID "TSa", the position "X3", the time "T1~", the posture "sitting position", the action "work", the clothes "3 ”, and the appearance history information 106a of the surrounding situation “document” is updated. In this update, the analysis unit 104b updates the time "T1-" to the time "T1-T3" (see FIG. 7).
　そして、解析部１０４ｂは、第２の外観情報に対応する外観履歴情報１０６ａとして、人ＩＤ「Ｐ３」、領域ＩＤ「ＴＳａ」、位置「Ｘ３」、時刻「Ｔ３」、姿勢「座位」、行為「業務」、服装「４」、周囲の状況「書類」を含む外観履歴情報１０６ａを作成する（図７参照）。 Then, the analysis unit 104b obtains, as the appearance history information 106a corresponding to the second appearance information, the person ID “P3”, the region ID “TSa”, the position “X3”, the time “T3”, the posture “sitting position”, the action “ Appearance history information 106a including "work", clothes "4", and surroundings "documents" is created (see FIG. 7).
　すなわち、外観履歴情報１０６ａにて継続が示される外観について変化を示す外観情報が取得された場合、解析部１０４ｂは、当該外観履歴情報１０６ａが示す外観の終了を示すように、当該外観履歴情報１０６ａの時刻を更新する。そして、解析部１０４ｂは、当該外観情報に対応する外観履歴情報１０６ａを新たに作成する。 That is, when appearance information indicating a change in the appearance indicated by the appearance history information 106a to be continued is obtained, the analysis unit 104b converts the appearance history information 106a so as to indicate termination of the appearance indicated by the appearance history information 106a. update the time of Then, the analysis unit 104b newly creates appearance history information 106a corresponding to the appearance information.
　また例えば、上述の第３の外観情報が処理対象であるとする。また、同じ外観（姿勢、行為、服装及び周囲の状況）について時刻Ｔ１から継続している外観履歴情報１０６ａがないとする。この場合、第３の外観情報に対応する外観履歴情報１０６ａを新たに作成する。外観履歴情報１０６ａを新たに作成する処理は、上述のステップＳ１０１ｇと同様である。解析部１０４ｂは、新たに作成した外観履歴情報１０６ａを履歴記憶部１０６に記憶させる。 Also, for example, assume that the above-mentioned third appearance information is to be processed. It is also assumed that there is no appearance history information 106a continuing from time T1 for the same appearance (posture, behavior, clothing, and surroundings). In this case, appearance history information 106a corresponding to the third appearance information is newly created. The process of newly creating appearance history information 106a is the same as that of step S101g described above. The analysis unit 104b causes the history storage unit 106 to store the newly created appearance history information 106a.
　詳細には、解析部１０４ｂは、第３の外観情報に対応する外観履歴情報１０６ａとして、人ＩＤ「Ｐ３」、領域ＩＤ「ＴＳａ」、位置「Ｘ３」、時刻「Ｔ３」、姿勢「座位」、行為「服を着る」、服装「４」、周囲の状況「書類」を含む外観履歴情報１０６ａを作成する（図７参照）。 Specifically, the analysis unit 104b uses the appearance history information 106a corresponding to the third appearance information as the person ID “P3”, the area ID “TSa”, the position “X3”, the time “T3”, the posture “sitting position”, Appearance history information 106a including action "put on clothes", clothes "4", and surrounding situation "documents" is created (see FIG. 7).
　解析部１０４ｂは、ステップＳ１０１ｉを実行すると、未処理の外観情報がある場合、ループＡ（ステップＳ１０１ｅ）を再び実行する。未処理の外観情報がない場合、解析部１０４ｂは、履歴取得処理（ステップＳ１０１）を終了して、空調機制御処理に戻る。 After executing step S101i, if there is unprocessed appearance information, the analysis unit 104b executes loop A (step S101e) again. When there is no unprocessed appearance information, the analysis unit 104b ends the history acquisition process (step S101) and returns to the air conditioner control process.
　図２を再び参照する。
　制御部１０５は、上述の通り、外観履歴情報１０６ａに基づいて、空調機１０２を制御するための制御情報を出力する（ステップＳ１０２）。 Refer to FIG. 2 again.
As described above, the control unit 105 outputs control information for controlling the air conditioner 102 based on the appearance history information 106a (step S102).
　図１３は、本実施形態に係る制御情報出力処理（ステップＳ１０２）の詳細な一例を示すフローチャートである。 FIG. 13 is a flowchart showing a detailed example of the control information output process (step S102) according to this embodiment.
　例えば、履歴記憶部１０６及び制御パターン記憶部１０７は、それぞれ、図７に示す外観履歴情報１０６ａ及び図８に示す制御パターン情報１０７ａを記憶しているとする。
を記憶しているとする。図８において、「寒い場合の所定行為」は、会議室Ｒで服を着ることであるとする。以下では、これらの外観履歴情報１０６ａ及び制御パターン情報１０７ａの例を適宜参照して説明する。 For example, it is assumed that the history storage unit 106 and the control pattern storage unit 107 store appearance history information 106a shown in FIG. 7 and control pattern information 107a shown in FIG. 8, respectively.
is stored. In FIG. 8, it is assumed that the "predetermined action when it is cold" is to get dressed in the conference room R. In FIG. In the following, examples of the appearance history information 106a and the control pattern information 107a are appropriately referred to for explanation.
　制御部１０５は、外観履歴情報１０６ａと制御パターン情報１０７ａとに基づいて、空調機１０２の制御が必要であるか否かを判定する（ステップＳ１０２ａ）。 The control unit 105 determines whether it is necessary to control the air conditioner 102 based on the appearance history information 106a and the control pattern information 107a (step S102a).
　詳細には、制御部１０５は、外観履歴情報１０６ａと制御パターンとに基づいて、制御パターン情報１０７ａに含まれる制御条件を満たす外観履歴情報１０６ａがあるか否かを判定する。制御条件を満たす外観履歴情報１０６ａがある場合、制御部１０５は、制御が必要であると判定する。制御条件を満たす外観履歴情報１０６ａがない場合、制御部１０５は、制御が必要でないと判定する。 Specifically, based on the appearance history information 106a and the control pattern, the control unit 105 determines whether or not there is appearance history information 106a that satisfies the control conditions included in the control pattern information 107a. If there is appearance history information 106a that satisfies the control condition, the control unit 105 determines that control is necessary. If there is no appearance history information 106a that satisfies the control condition, the control unit 105 determines that control is unnecessary.
　より詳細には、制御部１０５は、時期、空間、外観及び時間に関する条件のすべてを満たす外観履歴情報１０６ａがある場合に、制御が必要であると判定する。制御部１０５は、時期、空間、外観及び時間に関する条件のすべてを満たす外観履歴情報１０６ａがない場合に、制御が必要でないと判定する。 More specifically, the control unit 105 determines that control is necessary when there is appearance history information 106a that satisfies all of the conditions regarding time, space, appearance, and time. The control unit 105 determines that control is not necessary when there is no appearance history information 106a that satisfies all of the conditions regarding time, space, appearance, and time.
　例えば、図７を参照すると、外観履歴情報１０６ａは、人ＩＤ「Ｐ３」の人Ｐが時刻Ｔ３に、領域ＩＤ「ＴＳａ」の撮影領域で、行為「服を着る」を行ったことを示す情報（以下、この情報を「第１の外観履歴情報１０６ａ」と称する。）を含む。 For example, referring to FIG. 7, the appearance history information 106a is information indicating that a person P with a person ID “P3” performed an action “put on clothes” in a shooting area with an area ID “TSa” at time T3. (hereinafter, this information is referred to as "first appearance history information 106a").
　第１の外観履歴情報１０６ａは、外観に関する条件に「寒い場合の所定行為が発生したこと」を含む制御条件（以下、この制御条件を「第１の制御条件」と称する。）満たす。この場合、制御条件を満たす外観履歴情報１０６ａがあるので、制御部１０５は、制御が必要であると判定する。 The first appearance history information 106a satisfies a control condition (hereinafter referred to as "first control condition") that includes "predetermined action in cold weather" as a condition related to appearance. In this case, since there is the appearance history information 106a that satisfies the control condition, the control unit 105 determines that control is necessary.
　ここで、第１の制御条件は、（１）時期、（２）空間及び（３）時間に関する制御条件を含まない。制御条件がこれらの条件を含む場合の判定方法について説明する。 Here, the first control condition does not include control conditions relating to (1) time, (2) space and (3) time. A determination method when the control conditions include these conditions will be described.
　（１）制御条件が時期に関する条件を含む場合、制御部１０５は、外観履歴情報１０６ａに含まれる「時刻」が制御条件の「時期」に含まれるか否かに基づいて、時期に関する条件を満たすか否かを判定する。詳細には、「時刻」が「時期」に含まれる場合に、制御部１０５は、時期に関する条件を満たすと判定する。「時刻」が「時期」に含まれない場合に、制御部１０５は、時期に関する条件を満たさないと判定する。なお、外観履歴情報１０６ａに含まれる「時刻」は、年月日も含むものとする。 (1) When the control condition includes a period-related condition, the control unit 105 satisfies the period-related condition based on whether or not the "time" included in the appearance history information 106a is included in the "period" of the control condition. Determine whether or not Specifically, when the “time” is included in the “time”, the control unit 105 determines that the condition regarding the time is satisfied. When the "time" is not included in the "time", the control unit 105 determines that the condition regarding the time is not satisfied. Note that the "time" included in the appearance history information 106a also includes the date.
　（２）制御条件が空間に関する条件を含む場合、制御部１０５は、外観履歴情報１０６ａに含まれる「領域ＩＤ」が示す領域の属性が制御条件の「空間」が示す属性に対応するか否かに基づいて、空間に関する条件を満たすか否かを判定する。 (2) When the control condition includes a condition regarding space, the control unit 105 determines whether the attribute of the area indicated by the "area ID" included in the appearance history information 106a corresponds to the attribute indicated by the "space" of the control condition. Based on, it is determined whether or not the space conditions are satisfied.
　詳細には、「領域ＩＤ」が示す領域の属性が制御条件の「空間」が示す属性に対応している場合（例えば、一致している場合）、制御部１０５は、空間に関する条件を満たすと判定する。「領域ＩＤ」が示す領域の属性が制御条件の「空間」が示す属性に対応していない場合（例えば、一致していない場合）、制御部１０５は、空間に関する条件を満たさないと判定する。 Specifically, when the attribute of the area indicated by the "area ID" corresponds to the attribute indicated by the control condition "space" (for example, when they match), the control unit 105 determines that the space condition is satisfied. judge. If the attribute of the area indicated by the "area ID" does not correspond to the attribute indicated by the control condition "space" (for example, if they do not match), the control unit 105 determines that the space condition is not satisfied.
　例えば、制御部１０５は、予め保持する空間対応付け情報に基づいて、「領域ＩＤ」が示す領域の属性を特定する。 For example, the control unit 105 identifies the attribute of the area indicated by the "area ID" based on the spatial association information held in advance.
　図１４は、空間対応付け情報の一例を示す図である。空間対応付け情報は、対象空間ＩＤと、空間の属性と、領域ＩＤと、空調機ＩＤとを関連付ける情報である。 FIG. 14 is a diagram showing an example of spatial correspondence information. The space association information is information that associates a target space ID, a space attribute, an area ID, and an air conditioner ID.
　対象空間ＩＤは、対象空間を識別するための情報である。対象空間ＩＤ「Ｒ」は。会議室Ｒの対象空間ＩＤである。対象空間ＩＤ「Ｃ」は、廊下Ｃの対象空間ＩＤである。 The target space ID is information for identifying the target space. The target space ID "R" is. This is the target space ID of the conference room R. The target space ID “C” is the target space ID of the corridor C.
　空間の属性は、関連付けられた対象空間ＩＤ及び領域ＩＤが示す対象空間及び撮影領域の属性を示す。例えば、図１４の空間対応付け情報は、対象領域ＩＤ「Ｒ」の会議室Ｒは、領域ＩＤ「ＴＳａ」及び「ＴＳｂ」の撮影領域ＴＳａ及びＴＳｂを含み、撮影領域ＴＳａ及びＴＳｂの属性が「会議室」であることを示す。また、図１４の空間対応付け情報は、撮影領域ＴＳａの属性が「会議室」の「出入口」であることを示す。 The space attribute indicates the attributes of the target space and shooting area indicated by the associated target space ID and area ID. For example, in the spatial association information of FIG. 14, the conference room R with the target area ID "R" includes the shooting areas TSa and TSb with the area IDs "TSa" and "TSb", and the attributes of the shooting areas TSa and TSb are " Indicates that it is a conference room. Further, the spatial association information in FIG. 14 indicates that the attribute of the shooting area TSa is "entrance" of "meeting room".
　空調機ＩＤは、空調機１０２ａ～１０２ｃを識別するための情報である。空調機ＩＤ「ＡＣ１」、「ＡＣ２」、「ＡＣ３」は、それぞれ、空調機１０２ａ、空調機１０２ｂ、空調機１０２ｃの空調機ＩＤである。 The air conditioner ID is information for identifying the air conditioners 102a to 102c. The air conditioner IDs "AC1", "AC2", and "AC3" are the air conditioner IDs of the air conditioners 102a, 102b, and 102c, respectively.
　図１４の空間対応付け情報を参照すると、領域ＩＤ「ＴＳａ」である撮影領域ＴＳａの属性は、「会議室」の「出入口」である。制御部１０５は、外観履歴情報１０６ａが領域ＩＤ「ＴＳａ」を含む場合、当該外観履歴情報１０６ａが空間に関する条件「会議室」又は「会議室の出入口」を満たすと判定する。また、領域ＩＤ「ＴＳｂ」である撮影領域ＴＳｂの属性は、「会議室」である。制御部１０５は、外観履歴情報１０６ａが領域ＩＤ「ＴＳｂ」を含む場合、当該外観履歴情報１０６ａが空間に関する条件「会議室」を満たすと判定する。 Referring to the spatial association information in FIG. 14, the attribute of the shooting area TSa with the area ID "TSa" is "entrance" of "meeting room". When the appearance history information 106a includes the area ID "TSa", the control unit 105 determines that the appearance history information 106a satisfies the space condition "meeting room" or "meeting room doorway". Also, the attribute of the shooting area TSb with the area ID "TSb" is "meeting room". When the appearance history information 106a includes the area ID “TSb”, the control unit 105 determines that the appearance history information 106a satisfies the space condition “meeting room”.
　（３）制御条件が時間に関する条件を含む場合、制御部１０５は、外観履歴情報１０６ａに含まれる「時刻」に基づいて、時間に関する条件を満たすか否かを判定する。 (3) When the control condition includes a time-related condition, the control unit 105 determines whether or not the time-related condition is satisfied based on the "time" included in the appearance history information 106a.
　詳細には、制御部１０５は、観履歴情報１０６ａに含まれる外観の履歴の統計処理を行う。制御部１０５は、制御条件に応じた統計処理を行う。 Specifically, the control unit 105 performs statistical processing of the appearance history included in the viewing history information 106a. The control unit 105 performs statistical processing according to control conditions.
　以下では、外観に関する条件「服装『４』の人数が閾値Ｋ４以上の状態」及び時間に関する条件「時間ＴＨ４以上継続」を関連付ける制御条件に応じた統計処理の例を説明する。 In the following, an example of statistical processing according to the control condition that associates the appearance condition "the number of people wearing "4" clothing is the threshold K4 or more" and the time condition "continue for TH4 or more" will be described.
　制御部１０５は、直近の時刻の外観履歴情報１０６ａに対して、「会議室」にて「服装『４』の人数」を計数する統計処理を行う。統計処理の結果、直近の時刻の外観履歴情報１０６ａが外観に関する条件である「服装『４』の人数が閾値Ｋ４以上」を満たすとする。外観に関する条件を満たさない場合、制御部１０５は、統計処理を終了する。 The control unit 105 performs statistical processing to count "the number of people wearing "4" clothes" in the "meeting room" for the most recent appearance history information 106a. As a result of the statistical processing, it is assumed that the most recent appearance history information 106a satisfies the appearance condition "the number of people wearing clothing "4" is equal to or greater than the threshold value K4". If the appearance condition is not satisfied, the control unit 105 terminates the statistical processing.
　この場合、制御部１０５は、過去の外観履歴情報１０６ａに対して、「会議室」にて「服装『４』の人数」を計数する統計処理を行う。すなわち、ここでは制御部１０５は、時間的な変化に関する統計処理を行う。この統計処理の結果、「服装『４』の人数が閾値Ｋ４以上」を満たす状態が「時間ＴＨ４以上継続」している場合、制御部１０５は、時間に関する条件を満たすと判定して、統計処理を終了する。「服装『４』の人数が閾値Ｋ４以上」を満たす状態が「時間ＴＨ４以上継続」していない場合、制御部１０５は、時間に関する条件を満たさないと判定して、統計処理を終了する。 In this case, the control unit 105 performs statistical processing to count "the number of people wearing "4" clothes" in the "meeting room" for the past appearance history information 106a. That is, here, the control unit 105 performs statistical processing regarding temporal changes. As a result of this statistical processing, if the state in which “the number of people wearing clothes “4” is equal to or greater than the threshold value K4” continues “for TH4 or longer”, the control unit 105 determines that the time-related condition is satisfied, and performs the statistical processing. exit. If the state satisfying “the number of people wearing clothes “4” is equal to or greater than the threshold value K4” does not “continue for TH4 or more”, the control unit 105 determines that the time-related condition is not satisfied, and terminates the statistical processing.
　図１３を再び参照する。
　制御が必要でないと判定した場合（ステップＳ１０２ａ；Ｎｏ）、制御部１０５は、制御情報出力処理（ステップＳ１０２）を終了するとともに空調機制御処理を終了する（図２参照）。 Please refer to FIG. 13 again.
When it is determined that control is not necessary (step S102a; No), the control unit 105 terminates the control information output process (step S102) and the air conditioner control process (see FIG. 2).
　制御が必要であると判定した場合（ステップＳ１０２ａ；Ｙｅｓ）、制御部１０５は、当該判定の基となった外観履歴情報１０６ａに含まれる領域ＩＤを特定する（ステップＳ１０２ｂ）。 If it is determined that control is necessary (step S102a; Yes), the control unit 105 identifies the area ID included in the appearance history information 106a that is the basis of the determination (step S102b).
　例えば、制御部１０５は、第１の外観履歴情報１０６ａに含まれる領域ＩＤ「ＴＳａ」を特定する。 For example, the control unit 105 identifies the area ID "TSa" included in the first appearance history information 106a.
　制御部１０５は、ステップＳ１０２ｂにて特定した領域ＩＤと、ステップＳ１０２ａにて制御条件を満たした制御パターンに含まれる制御内容に従って、制御対象の空調機１０２を特定する（ステップＳ１０２ｃ）。 The control unit 105 identifies the air conditioner 102 to be controlled according to the region ID identified in step S102b and the control details included in the control pattern that satisfies the control condition in step S102a (step S102c).
　例えば、制御部１０５は、制御パターン情報１０７ａを参照し、第１の制御条件に関連付けられる制御内容を取得する。制御部１０５は、ステップＳ１０２ｂ特定した領域ＩＤ「ＴＳａ」と、第１の制御条件に関連付けられる制御内容「対象空間の目標温度を現在よりＴＰ１度上げる」に基づいて、制御対象の空調機１０２を特定する。 For example, the control unit 105 refers to the control pattern information 107a and acquires control details associated with the first control condition. The control unit 105 selects the air conditioner 102 to be controlled based on the region ID “TSa” identified in step S102b and the control content “increase the target temperature of the target space by TP from the current temperature” associated with the first control condition. Identify.
　制御内容は、「対象空間」を制御の対象とする。そのため、制御部１０５は、空間対応付け情報（図１４参照）に基づいて、特定した領域ＩＤ「ＴＳａ」を含む「対象空間」を特定する。例えば、制御部１０５は、特定した領域ＩＤ「ＴＳａ」を含む対象空間として、対象空間ＩＤ「Ｒ」（会議室Ｒ）を特定する。 　The control content is the "target space". Therefore, the control unit 105 identifies the “target space” including the identified region ID “TSa” based on the spatial association information (see FIG. 14). For example, the control unit 105 identifies the target space ID "R" (meeting room R) as the target space including the identified area ID "TSa".
　制御部１０５は、空間対応付け情報（図１４参照）に基づいて、特定した対象空間に対応付けられた空調機１０２を、制御対象の空調機１０２として特定する。例えば、制御部１０５は、特定した対象空間ＩＤ「Ｒ」（会議室Ｒ）に関連付けられた空調機ＩＤ「ＡＣ１」及び「ＡＣ２」（空調機１０２ａ及び１０２ｂ）を、制御対象の空調機１０２として特定する。 The control unit 105 identifies the air conditioner 102 associated with the identified target space as the air conditioner 102 to be controlled based on the space association information (see FIG. 14). For example, the control unit 105 selects the air conditioner IDs "AC1" and "AC2" ( air conditioners 102a and 102b) associated with the identified target space ID "R" (meeting room R) as the air conditioners 102 to be controlled. Identify.
　制御部１０５は、ステップＳ１０２ａにて制御条件を満たした制御パターンに含まれる制御内容に従って、制御情報を生成する（ステップＳ１０２ｄ）。 The control unit 105 generates control information according to the control details included in the control pattern that satisfies the control condition in step S102a (step S102d).
　制御部１０５は、ステップＳ１０２ｃにて特定した制御対象の空調機１０２へネットワークＮを介して、ステップＳ１０２ｄにて生成した制御情報を送信する（ステップＳ１０２ｅ）。制御部１０５は、制御情報出力処理（ステップＳ１０２）を終了するとともに空調機制御処理を終了する（図２参照）。 The control unit 105 transmits the control information generated in step S102d to the control target air conditioner 102 identified in step S102c via the network N (step S102e). The control unit 105 ends the control information output process (step S102) and the air conditioner control process (see FIG. 2).
　空調機１０２は、ステップＳ１０２ｅにて送信された制御情報を、ネットワークＮを介して取得する。空調機１０２は、取得した制御情報に従って運転する。そのため、対象空間を撮影した画像を含む画像情報に基づいて、空調機１０２を制御することができる。 The air conditioner 102 acquires the control information transmitted in step S102e via the network N. The air conditioner 102 operates according to the acquired control information. Therefore, the air conditioner 102 can be controlled based on the image information including the captured image of the target space.
　例えば、外観履歴情報１０６ａが、図８に示す制御条件のうち、空間に関する条件「会議室の出入口」及び外観に関する条件「服装『５』の人数が閾値Ｋ３以上の状態」を関連付ける制御条件を満たすとする。この場合、会議室の出入口（例えば、撮影領域ＴＳａ）に対応付けられた空調機１０２（例えば、空調機１０２ａ）の目標温度を現在よりＴＰ３度上げることができる。 For example, the appearance history information 106a satisfies a control condition that associates the space condition “meeting room entrance/exit” and the appearance condition “state where the number of people wearing clothes “5” is equal to or greater than the threshold K3” among the control conditions shown in FIG. and In this case, the target temperature of the air conditioner 102 (for example, the air conditioner 102a) associated with the entrance/exit (for example, the imaging area TSa) of the conference room can be raised by TP3 degrees from the current temperature.
　一般的に、秋・冬の会議室の出入口では冷たい空気が入り込んで、出入口から離れた会議室内よりも寒いことがある。そのため、会議室の出入口で厚着の人Ｐが多いことがある。このような場合、会議室の出入口に対応付けられた空調機１０２の目標温度を現在よりＴＰ３度上げることができる。従って、会議室の出入口の人Ｐが意識しなくても、その人Ｐに快適な空気環境を容易に提供することが可能になる。 In general, cold air enters the doorway of a conference room in autumn and winter, making it colder than a conference room away from the doorway. Therefore, there may be many people P wearing thick clothes at the entrance of the conference room. In such a case, the target temperature of the air conditioner 102 associated with the entrance/exit of the conference room can be increased by TP3 degrees from the current temperature. Therefore, even if the person P at the entrance/exit of the meeting room is not aware of it, it is possible to easily provide the person P with a comfortable air environment.
　例えば、外観履歴情報１０６ａが、図８に示す制御条件のうち、空間に関する条件「会議室」及び外観に関する条件「服装『４』の人数が閾値Ｋ４以上の状態」を関連付ける制御条件を満たすとする。この場合、空調機１０２は、制御条件を満たす対象空間である会議室の目標温度が標準よりＴＰ４度下げて制御する。 For example, it is assumed that the appearance history information 106a satisfies a control condition that associates the space condition “meeting room” and the appearance condition “state where the number of people wearing clothes “4” is equal to or greater than the threshold value K4” among the control conditions shown in FIG. . In this case, the air conditioner 102 controls the target temperature of the conference room, which is the target space that satisfies the control conditions, to be 4 degrees TP lower than the standard temperature.
　一般的に、会議ではマナーとしてスーツが着用されることがある。そのような場合に、通常の目標温度で空調機１０２を運転すると、暑いことがある。このような場合、会議室に対応付けられた空調機１０２の目標温度を標準よりＴＰ４度下げることができる。従って、会議室の人Ｐが意識しなくても、その人Ｐに快適な空気環境を容易に提供することが可能になる。 In general, suits are worn as a matter of etiquette at meetings. In such a case, if the air conditioner 102 is operated at the normal target temperature, it may become hot. In such a case, the target temperature of the air conditioner 102 associated with the conference room can be lowered by TP4 degrees from the standard. Therefore, even if the person P in the meeting room is not aware of it, it is possible to easily provide the person P with a comfortable air environment.
　例えば、外観履歴情報１０６ａが、図８に示す制御条件のうち、空間に関する条件「廊下」及び外観に関する条件「寒い場合の所定行為が閾値Ｋ５以上の発生」を関連付ける制御条件を満たすとする。この場合、制御部１０５は、対象空間（例えば、廊下Ｃ）に含まれる領域（例えば、撮影領域ＴＳｃ）を撮影した画像を含む画像情報を処理した結果として得られる外観履歴情報１０６ａに基づいて、制御情報を出力する。この制御情報は、当該対象空間（例えば、廊下Ｃ）とは異なる空間（例えば、会議室Ｒ）を調節するための制御情報である。その結果、会議室の出入口（例えば、撮影領域ＴＳａ，ＴＳｂ）に対応付けられた空調機１０２（例えば、空調機１０２ａ，１０２ｂ）の目標温度を標準よりＴＰ５度上げることができる。 For example, it is assumed that the appearance history information 106a satisfies a control condition that associates the space-related condition "corridor" and the appearance-related condition "predetermined action occurs at a threshold value K5 or higher when it is cold" among the control conditions shown in FIG. In this case, the control unit 105, based on the appearance history information 106a obtained as a result of processing the image information including the image of the area (for example, the shooting area TSc) captured in the target space (for example, the corridor C), Output control information. This control information is control information for adjusting a space (eg, conference room R) different from the target space (eg, corridor C). As a result, the target temperature of the air conditioners 102 (for example, the air conditioners 102a and 102b) associated with the entrances (for example, the imaging areas TSa and TSb) of the conference room can be raised by TP5 degrees from the standard.
　一般的に、廊下Ｃが寒い場合、そこに繋がる会議室Ｒも冷えていることがある。そのような場合に、標準の目標温度で空調機１０２を運転すると、会議室Ｒを利用する人Ｐが寒いことがある。この例によれば、会議室に対応付けられた空調機１０２の目標温度を標準よりＴＰ５度上げることができる。従って、会議室の人Ｐが意識しなくても、その人Ｐに快適な空気環境を容易に提供することが可能になる。 In general, if the corridor C is cold, the conference room R connected to it may also be cold. In such a case, if the air conditioner 102 is operated at the standard target temperature, the person P using the conference room R may be cold. According to this example, the target temperature of the air conditioner 102 associated with the conference room can be raised by TP5 degrees from the standard. Therefore, even if the person P in the meeting room is not aware of it, it is possible to easily provide the person P with a comfortable air environment.
　「対象空間とは異なる空間」は、当該空間の空気環境を調節する空調機１０２が当該対象空間に実質的に影響を及ぼさないことを意味する。 "A space different from the target space" means that the air conditioner 102 that adjusts the air environment of the space does not substantially affect the target space.
　これまで、本発明の一実施形態について説明した。 So far, one embodiment of the present invention has been described.
　本実施形態によれば、制御装置１０３は、履歴取得部１０４と、制御部１０５とを備える。履歴取得部１０４は、対象空間を撮影した画像を含む画像情報を処理して、対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報１０６ａを取得する。制御部１０５は、外観履歴情報１０６ａに基づいて、空調機１０２を制御するための制御情報を出力する。 According to this embodiment, the control device 103 includes a history acquisition unit 104 and a control unit 105. The history acquisition unit 104 processes image information including captured images of the target space, and acquires appearance history information 106a including the appearance history of one or more people active in the target space. The control unit 105 outputs control information for controlling the air conditioner 102 based on the appearance history information 106a.
　制御装置は、対象空間を撮影した画像を含む画像情報から取得される外観履歴情報１０６ａに基づいて、空調機１０２を制御することができる。 The control device can control the air conditioner 102 based on the appearance history information 106a acquired from the image information including the captured image of the target space.
　画像情報は、対象空間を撮影する装置を設ければ取得することができるので、外観履歴情報１０６ａも容易に取得することができる。そのため、空調機１０２を用いて空間の空気環境を容易に制御することが可能になる。 Since the image information can be obtained by providing a device for photographing the target space, the appearance history information 106a can also be obtained easily. Therefore, it becomes possible to easily control the air environment of the space using the air conditioner 102 .
　画像情報は、対象空間の撮影に基づいて取得することができるので、それを取得するために、対象空間にいる人Ｐが意識することは殆どない。そのため、人に意識させることなく空調機１０２を制御することが可能になる。 Since the image information can be obtained based on the shooting of the target space, the person P in the target space does not need to be conscious of it to obtain it. Therefore, it becomes possible to control the air conditioner 102 without making people aware of it.
　外観履歴情報１０６ａは、対象空間において活動する１以上の人の外観の履歴を含む。そのため、過去の外観履歴情報１０６ａと制御情報とに基づいて、どのように空調機１０２を制御するかを決定することができる。その結果、例えば現在の外観のみに基づいて空調機を制御よりも、快適な空気環境を提供することが可能になる。 Appearance history information 106a includes the appearance history of one or more people active in the target space. Therefore, it is possible to determine how to control the air conditioner 102 based on the past appearance history information 106a and the control information. As a result, it is possible to provide a more comfortable air environment than, for example, controlling the air conditioner based only on the current appearance.
　従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without people being conscious of it.
　本実施形態によれば、制御部１０５は、前記外観の履歴を統計処理した結果に基づいて、空調機１０２を制御する。外観の履歴を統計処理した結果を空調機１０２の制御に用いるので、より快適な空気環境を提供できるように空調機１０２を制御することができる。従って、空調機１０２を用いて空間の空気環境をより快適にすることが可能になる。 According to this embodiment, the control unit 105 controls the air conditioner 102 based on the result of statistically processing the appearance history. Since the result of statistically processing the appearance history is used for controlling the air conditioner 102, the air conditioner 102 can be controlled so as to provide a more comfortable air environment. Therefore, it is possible to use the air conditioner 102 to make the air environment of the space more comfortable.
　本実施形態によれば、統計処理は、対象空間又は対象空間に含まれる領域の属性と、対象空間又は領域に居る人の外観と、対象空間又は領域に居る人の属性と、の少なくとも１つに関する統計処理を含む。領域の属性、人の属性の少なくとも１つに関して外観の履歴を統計処理した結果を空調機１０２の制御に用いるので、より快適な空気環境を提供できるように空調機１０２を制御することができる。従って、空調機１０２を用いて空間の空気環境をより快適にすることが可能になる。 According to the present embodiment, statistical processing includes at least one of the attributes of the target space or an area included in the target space, the appearance of a person in the target space or area, and the attribute of a person in the target space or area. Including statistical processing related to Since the results of statistical processing of appearance histories with respect to at least one of area attributes and human attributes are used for controlling the air conditioner 102, the air conditioner 102 can be controlled so as to provide a more comfortable air environment. Therefore, it is possible to use the air conditioner 102 to make the air environment of the space more comfortable.
　本実施形態によれば、統計処理は、対象空間又は対象空間に含まれる領域の属性と、対象空間又は領域に居る人の外観と、対象空間又は領域に居る人の属性と、少なくとも１つの時間的な変化に関する統計処理を含む。領域の属性、人の属性の少なくとも１つに関して外観の履歴を統計処理した結果を空調機１０２の制御に用いるので、より快適な空気環境を提供できるように空調機１０２を制御することができる。従って、空調機１０２を用いて空間の空気環境をより快適にすることが可能になる。 According to this embodiment, the statistical processing includes the attributes of the target space or an area included in the target space, the appearance of the person in the target space or area, the attribute of the person in the target space or area, and at least one time including statistical processing of changes in Since the results of statistical processing of appearance histories with respect to at least one of area attributes and human attributes are used for controlling the air conditioner 102, the air conditioner 102 can be controlled so as to provide a more comfortable air environment. Therefore, it is possible to use the air conditioner 102 to make the air environment of the space more comfortable.
　本実施形態によれば、制御部１０５は、統計処理の結果に応じた空調機１０２の制御内容を含む制御パターン情報に基づいて、空調機１０２を制御する。制御パターン情報を空調機１０２の制御に用いるので、より快適な空気環境を提供できるように空調機１０２を制御することができる。従って、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 According to the present embodiment, the control unit 105 controls the air conditioner 102 based on control pattern information including control details of the air conditioner 102 according to the result of statistical processing. Since the control pattern information is used to control the air conditioner 102, the air conditioner 102 can be controlled so as to provide a more comfortable air environment. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 .
　本実施形態によれば、制御部１０５は、外観履歴情報１０６ａに基づいて、対象空間とは異なる空間を調節するための制御情報を出力する。 According to this embodiment, the control unit 105 outputs control information for adjusting a space different from the target space based on the appearance history information 106a.
　これにより、対象空間とは異なる空間を快適になるように調節することができる。従って、空調機１０２を用いて空間の空気環境をより快適にすることが可能になる。 With this, it is possible to adjust a space different from the target space so that it is comfortable. Therefore, it is possible to use the air conditioner 102 to make the air environment of the space more comfortable.
　本実施形態によれば、対象空間は、複数である。履歴取得部１０４は、複数の対象空間を撮影した画像をそれぞれに含む複数の画像情報を処理して、複数の対象空間のそれぞれにおいて活動する１以上の人の外観の履歴である外観履歴情報１０６ａを取得する。 According to this embodiment, there are multiple target spaces. The history acquisition unit 104 processes a plurality of pieces of image information each including images obtained by photographing a plurality of target spaces, and obtains appearance history information 106a, which is a history of the appearance of one or more people active in each of the plurality of target spaces. to get
　これにより、複数の対象空間を快適になるように調節することができる。従って、空調機１０２を用いて空間の空気環境をより快適にすることが可能になる。 With this, it is possible to adjust multiple target spaces to be comfortable. Therefore, it is possible to use the air conditioner 102 to make the air environment of the space more comfortable.
　本実施形態によれば、制御部１０５は、前記複数の対象空間の少なくとも１つに対応付けられた少なくとも１つの空調機１０２を制御するための制御情報を出力する。これにより、対象空間の各々の空気環境を調節することができる。従って、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 According to this embodiment, the control unit 105 outputs control information for controlling at least one air conditioner 102 associated with at least one of the plurality of target spaces. Thereby, the air environment of each of the target spaces can be adjusted. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 .
　上述の実施形態は、以下のように変形されてもよい。
（変形例１）
　空調機１０２は、エアコンに限らず、それに対応付けられた空間の空気環境を調節する機器、装置、設備などであればよい。 The above-described embodiment may be modified as follows.
(Modification 1)
The air conditioner 102 is not limited to an air conditioner, and may be any device, device, facility, or the like that adjusts the air environment of the space associated therewith.
　例えば、空調機１０２は、冷房、暖房、床暖房、加湿器、除湿器、空気清浄機、換気扇、サーキュレータ、扇風機、アロマオイルを空気中に噴霧するアロマディフューザなどであってもよい。 For example, the air conditioner 102 may be cooling, heating, floor heating, a humidifier, a dehumidifier, an air purifier, a ventilation fan, a circulator, an electric fan, an aroma diffuser that sprays aroma oil into the air, or the like.
　すなわち例えば、空調機１０２は、空気の温度を調節する機能として、空気を冷やす機能と空気を暖める機能との一方を備えた機器、装置又は設備であってもよい。空調機１０２は、空気の湿度を調節する機能として、空気を加湿する機能と空気を除湿する機能との一方を備えた機器、装置又は設備であってもよい。空調機１０２は、空気を浄化する機能を備えた機器、装置又は設備であってもよい。空調機１０２は、空気を流動させる機能を備えた機器、装置又は設備であってもよい。空調機１０２は、空気に芳香成分を含む物質を噴霧する機能を備えた機器、装置又は設備であってもよい。空調機１０２は、ここで例示した機能のいずれか複数を兼ね備えた機器、装置又は設備であってもよい。 That is, for example, the air conditioner 102 may be a device, device, or facility that has one of a function of cooling air and a function of warming air as a function of adjusting the temperature of air. The air conditioner 102 may be a device, device, or facility that has one of a function of humidifying air and a function of dehumidifying air as a function of adjusting the humidity of air. The air conditioner 102 may be a device, device, or facility having a function of purifying air. The air conditioner 102 may be a device, device, or facility that has a function of moving air. The air conditioner 102 may be a device, device, or facility that has a function of spraying a substance containing an aromatic component into the air. The air conditioner 102 may be a device, device, or facility that has more than one of the functions exemplified here.
（変形例２）
　対象空間は、家屋、学校などに設定されてもよい。 (Modification 2)
The target space may be set to a house, a school, or the like.
　家屋の場合、対象空間の属性は、リビング、ダイニング、キッチン、個室、寝室、玄関外、玄関内の土間、廊下などの１つ又は複数であればよい。学校の場合、対象空間の属性は、教室、講堂、廊下、実験室、職員室などの１つ又は複数であればよい。また、対象空間の属性は、当該対象空間の広さの程度を含んでもよい。 In the case of a house, the attributes of the target space may be one or more such as the living room, dining room, kitchen, private room, bedroom, outside the entrance, the dirt floor inside the entrance, and the corridor. In the case of a school, the attributes of the target space may be one or more of classrooms, auditoriums, corridors, laboratories, staff rooms, and the like. Also, the attribute of the target space may include the extent of the width of the target space.
　対象空間が家屋に設定される場合の制御パターンは、寝室で臥位である（寝ている）状態が予め定められた時間以上継続すると、寝室の目標温度を現在よりも予め定められた温度下げるものであってもよい。これにより、寝室で寝ようとしている場合に、目標温度を下げることができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 The control pattern in the case where the target space is set to a house is to lower the target temperature of the bedroom by a predetermined temperature from the current temperature when the state of being in the supine position (sleeping) in the bedroom continues for a predetermined time or longer. can be anything. This allows the target temperature to be lowered if one is about to sleep in the bedroom. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
　対象空間が家屋に設定される場合の制御パターンは、リビングで臥位である（寝ている）状態が予め定められた時間以上継続すると、寝室の目標温度を現在よりも予め定められた温度上げるものであってもよい。これにより、リビングで寝てしまっている場合に、目標温度を上げることができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 The control pattern when the target space is set to a house is to raise the target temperature of the bedroom by a predetermined temperature from the current temperature if the state of being in the supine position (sleeping) in the living room continues for a predetermined time or longer. can be anything. As a result, the target temperature can be raised when sleeping in the living room. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
　対象空間が家屋に設定される場合の制御パターンは、汗をかいている状態が予め定められた時間以上継続すると、寝室の目標温度を現在よりも予め定められた温度下げるものであってもよい。これにより、風呂上りや外出から帰って来た等で汗をかいている場合に、目標温度を下げることができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 The control pattern when the target space is set to a house may be such that the target temperature of the bedroom is lowered by a predetermined temperature from the current temperature when the sweating state continues for a predetermined time or longer. . As a result, the target temperature can be lowered when the user is sweating after taking a bath or returning from going out. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
（変形例３）
　外観情報及び外観履歴情報１０６ａは、人Ｐの属性をさらに含んでもよい。人Ｐの属性は、性別、年齢層などの少なくとも１つである。 (Modification 3)
Appearance information and appearance history information 106a may further include the person P's attributes. The attribute of the person P is at least one of gender, age group, and the like.
　外観情報及び外観履歴情報１０６ａが人Ｐの属性として性別及び／又は年齢層を含む場合の制御パターンとして、以下の例を挙げることができる。 The following example can be given as a control pattern when the appearance information and appearance history information 106a includes gender and/or age group as attributes of the person P.
　制御パターンの制御条件は、対象空間又は対象空間に含まれる領域に、女性及び／又は所定の年齢層（例えば、高齢者、子供など）が予め定められた割合以上であることであってもよい。また、制御パターンの制御条件は、対象空間又は領域に、女性及び／又は所定の年齢層（例えば、高齢者、子供など）が予め定められた割合以上である状態が予め定められた時間以上継続することであってもよい。 The control condition of the control pattern may be that women and/or a predetermined age group (e.g., elderly people, children, etc.) occupy a predetermined ratio or more in the target space or an area included in the target space. . In addition, the control condition of the control pattern is that a state in which women and/or a predetermined age group (e.g., elderly people, children, etc.) occupy a predetermined proportion or more in the target space or region continues for a predetermined time or longer. It may be to
　これらの場合の制御内容は、対象空間又は対象空間に含まれる領域の送風を現在よりも予め定められた段階だけ弱くすること、及び／又は、対象空間又は領域の目標温度を現在よりも予め定められた温度上げることであってもよい。 In these cases, the control content is to weaken the blowing of air in the target space or an area included in the target space by a predetermined step from the current level, and/or to set the target temperature of the target space or area lower than the current level. It may also be to raise the temperature.
　これにより、対象空間又は当該領域に女性及び／又は所定の年齢層の人Ｐが予め定められた割合以上居る場合に、対象空間又は当該領域に対応付けられた空調機１０２の送風を弱くしたり、目標温度を上げたりすることができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 As a result, when women and/or people P of a predetermined age group are present in the target space or the relevant area at a predetermined ratio or more, the blowing of the air conditioner 102 associated with the target space or the relevant area is weakened. , the target temperature can be increased. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
（変形例４）
　制御パターンは、対象空間又は対象空間に含まれる領域における人Ｐの移動及び／又は出入りを条件として、空調機１０２を制御するものであってもよい。 (Modification 4)
The control pattern may control the air conditioner 102 on the condition that the person P moves and/or enters and exits the target space or an area included in the target space.
　例えば、制御パターンの制御条件は、対象空間又は対象空間に含まれる領域において位置が変化する人Ｐが予め定められた人数以上である状態が予め定められた時間以上継続することであってもよい。また、制御条件は、対象空間又は対象空間に含まれる領域から出る人Ｐ、及び／又は、当該対象空間又は当該領域に入る人Ｐ、の人数が予め定められた人数以上である状態が予め定められた時間以上継続することであってもよい。 For example, the control condition of the control pattern may be that the number of persons P whose positions change in the target space or an area included in the target space is equal to or greater than a predetermined number and continues for a predetermined time or longer. . In addition, the control condition is predetermined that the number of people P exiting the target space or an area included in the target space and/or the number of people P entering the target space or the area is equal to or greater than a predetermined number. It may be continued for more than the specified time.
　これらの場合の制御内容は、対象空間又は対象空間に含まれる領域の送風を現在よりも予め定められた段階だけ強くすること、及び／又は、対象空間又は当該領域の目標温度を現在よりも予め定められた温度下げることであってもよい。 The contents of control in these cases are to increase the blowing of air in the target space or an area included in the target space by a predetermined step from the current level, and/or to set the target temperature of the target space or the target area higher than the current level in advance. It may be to lower a predetermined temperature.
　これにより、人Ｐの移動及び／又は出入りで暑い場合に、対象空間又は当該領域に対応付けられた空調機１０２の送風を強くしたり、目標温度を下げたりすることができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 As a result, when it is hot due to the movement and/or entry and exit of the person P, it is possible to increase the blowing power of the air conditioner 102 associated with the target space or the area, or lower the target temperature. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
（変形例５）
　制御パターンは、対象空間又は対象空間に含まれる領域における人Ｐの密度を条件として、空調機１０２を制御するものであってもよい。 (Modification 5)
The control pattern may control the air conditioner 102 on the condition of the density of the people P in the target space or an area included in the target space.
　制御パターンの制御条件は、対象空間又は対象空間に含まれる領域における人Ｐの密度が予め定められた割合以上であることであってもよい。また、制御条件は、対象空間又は対象空間に含まれる領域における人Ｐの密度が予め定められた割合以上の状態が予め定められた時間以上継続することであってもよい。 The control condition of the control pattern may be that the density of people P in the target space or an area included in the target space is equal to or higher than a predetermined ratio. Further, the control condition may be that the density of the people P in the target space or an area included in the target space is equal to or higher than a predetermined ratio and continues for a predetermined time or longer.
　これらの場合の制御内容は、対象空間又は対象空間に含まれる領域の送風を現在よりも予め定められた段階だけ強くすること、及び／又は、対象空間又は当該領域の目標温度を現在よりも予め定められた温度下げることであってもよい。 The contents of control in these cases are to increase the blowing of air in the target space or an area included in the target space by a predetermined step from the current level, and/or to set the target temperature of the target space or the target area higher than the current level in advance. It may be to lower a predetermined temperature.
　これにより、人Ｐが密集して暑い場合などに、対象空間又は当該領域に対応付けられた空調機１０２の送風を強くしたり、目標温度を下げたりすることができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 As a result, when people P are densely packed and it is hot, it is possible to increase the blowing power of the air conditioner 102 associated with the target space or the area concerned, or lower the target temperature. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
（変形例６）
　制御パターンは、対象空間又は対象空間に含まれる領域に人Ｐが入る時と入った後との外観の変化、又は対象空間又は対象空間に含まれる領域に人Ｐが入った後の外観の変化を条件として、空調機１０２を制御するものであってもよい。 (Modification 6)
The control pattern is a change in appearance when and after the person P enters the target space or an area included in the target space, or a change in appearance after the person P enters the target space or an area included in the target space. on the condition that the air conditioner 102 may be controlled.
　制御パターンの制御条件は、対象空間又は対象空間に含まれる領域に人Ｐが入った時の服装が薄着又は厚着に変化したことであってもよい。例えば、制御条件は、対象空間又は当該領域に入る時にコートを着用し、入った後にコート又はその下のセータを脱いだことであってもよい。例えば、制御条件は、対象空間又は当該領域に入る時にコートを着用せず、入った後にコートを着用したことであってもよい。 The control condition of the control pattern may be that the clothing changes to light or heavy when the person P enters the target space or an area included in the target space. For example, the control condition may be that a coat was put on when entering the target space or region of interest, and the coat or underlying sweater was removed after entering. For example, the control condition may be that the coat was not worn when entering the target space or region of interest, but was worn after entering.
　また、制御条件は、対象空間又は対象空間に含まれる領域に人Ｐが入ってから、予め定められた時間内に肌着を着替えたことであってもよい。 In addition, the control condition may be that the person P has changed their underwear within a predetermined time after entering the target space or an area included in the target space.
　この場合の制御内容は、入った後の外観（服装）に応じて、運転モードを切り替えること、目標温度を予め定められた温度に従って変更することであってもよい。 In this case, the content of control may be to switch the operation mode according to the appearance (clothes) after entering, and to change the target temperature according to a predetermined temperature.
　これにより、対象空間又は当該領域に人Ｐが入る時と入った後との外観の変化、又は対象空間又は当該領域に人Ｐが入った後の外観の変化に応じて、対象空間又は当該領域に対応付けられた空調機１０２を制御することができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 As a result, the target space or the region is changed according to the change in appearance between when and after the person P enters the target space or the region, or the change in the appearance after the person P enters the target space or the region. The air conditioner 102 associated with can be controlled. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
（変形例７）
　制御装置１０３は、図示しない外部の装置から、天気の予報に関する天気予報情報などの各種情報を取得してもよい、また、制御装置１０３は、対象空間が設定される建物などに設置される各種装置から各種情報を取得してもよい。例えば、制御装置１０３は、対象空間が設定される建物などの出入口に設置されて屋外を撮影する撮影装置からの画像情報に基づいて、現在の天候を推定してもよい。 (Modification 7)
The control device 103 may acquire various types of information such as weather forecast information related to weather forecasts from an external device (not shown). Various information may be obtained from the device. For example, the control device 103 may estimate the current weather based on image information from a photographing device that is installed at the entrance of a building where the target space is set and photographs the outdoors.
　この場合、制御パターンの制御条件は、各種情報（例えば、天気予報情報又は／及び現在の天候）に関する条件をさらに含んでもよい。 In this case, the control conditions of the control pattern may further include conditions related to various types of information (eg, weather forecast information and/or current weather).
　これにより、外部の装置及び／又は建物などに設置される各種装置からの情報に応じて、対象空間又は対象空間に含まれる領域に対応付けられた空調機１０２を制御することができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 Accordingly, it is possible to control the air conditioner 102 associated with the target space or an area included in the target space according to information from an external device and/or various devices installed in a building or the like. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
（変形例８）
　実施形態では、制御パターン情報１０７ａが適宜設定される例を説明した。制御装置１０３は、制御パターン情報１０７ａの作成、変更などをしてもよい。制御装置１０３は、空調機１０２の制御のために、制御パターン情報１０７ａ、これを作成、変更などした制御パターン情報のいずれか１つ又は複数を用いるとよい。複数の制御パターン情報を用いる場合、制御装置１０３は、適宜の方法定められた優先順位に従って、複数の制御パターン情報のいずれかを、空調機１０２の制御のために用いるとよい。 (Modification 8)
In the embodiment, an example in which the control pattern information 107a is appropriately set has been described. The control device 103 may create or change the control pattern information 107a. The control device 103 may use one or more of the control pattern information 107a and the control pattern information created or changed to control the air conditioner 102 . When using a plurality of pieces of control pattern information, the control device 103 may use any one of the plurality of pieces of control pattern information for controlling the air conditioner 102 according to an order of priority determined by an appropriate method.
　図１５は、本変形例に係る制御システム１００の構成を示す図である。本変形例に係る制御装置１０３は、同図に示すように、動作状況取得部１１１と、動作履歴記憶部１１２と、作成部１１３と、個別作成部１１４とをさらに備える。 FIG. 15 is a diagram showing the configuration of the control system 100 according to this modified example. The control device 103 according to this modification further includes an operation status acquisition unit 111, an operation history storage unit 112, a creation unit 113, and an individual creation unit 114, as shown in FIG.
　動作状況取得部１１１は、ネットワークＮを介して１つ又は複数の空調機１０２の各々から、空調機１０２の動作状況を示す動作状況情報を取得する。動作状況情報は、例えば、空調機ＩＤと、現在時刻と、動作しているか否かと、動作している場合の運転モード及び目標温度などの少なくとも１つを含む。動作状況取得部１１１は、取得した動作状況情報を動作履歴記憶部１１２に記憶させる。これにより、動作履歴記憶部１１２には、１つ又は複数の空調機１０２の動作履歴が記憶される。 The operation status acquisition unit 111 acquires operation status information indicating the operation status of the air conditioner 102 from each of one or more air conditioners 102 via the network N. The operation status information includes at least one of, for example, the air conditioner ID, the current time, whether the air conditioner is operating, the operation mode when the air conditioner is operating, and the target temperature. The operation status acquisition unit 111 causes the operation history storage unit 112 to store the acquired operation status information. As a result, the operation history of one or more air conditioners 102 is stored in the operation history storage unit 112 .
　また、動作状況取得部１１１は、ネットワークＮを介して１つ又は複数の空調機１０２の各々から、図示しない空調機１０２のリモートコントローラなどを用いて、空調機１０２の設定が手動で変更された場合に、当該変更に関する変更情報を取得する。変更情報は、例えば、空調機ＩＤと、手動で変更が行われた時刻（変更時刻）と、当該変更の内容とを含む。変更の内容は、電源のオン及びオフ、運転モードの設定又は変更、目標温度の設定又は変更、風量の設定又は変更，風向の設定又は変更の１つ又は複数を含む。動作状況取得部１１１は、取得した変更情報を動作履歴記憶部１１２に記憶させる。 In addition, the operation status acquisition unit 111 uses a remote controller (not shown) of the air conditioner 102 from each of one or more air conditioners 102 via the network N to manually change the settings of the air conditioner 102. If so, obtain change information about the change. The change information includes, for example, the air conditioner ID, the time when the change was manually performed (change time), and the content of the change. The contents of the change include one or more of power on/off, operation mode setting or change, target temperature setting or change, air volume setting or change, and wind direction setting or change. The operation status acquisition unit 111 causes the operation history storage unit 112 to store the acquired change information.
　動作履歴記憶部１１２は、空調機１０２の動作に関する情報を記憶するための記憶部である。動作履歴記憶部１１２に記憶される情報は、動作状況情報、変更情報などである。 The operation history storage unit 112 is a storage unit for storing information regarding the operation of the air conditioner 102 . Information stored in the operation history storage unit 112 includes operation status information, change information, and the like.
　作成部１１３は、１つ又は複数の空調機１０２の動作履歴に基づいて、当該１つ又は複数の空調機１０２に適用される制御パターンを含む制御パターン情報を作成する。 The creation unit 113 creates control pattern information including control patterns to be applied to one or more air conditioners 102 based on the operation history of one or more air conditioners 102 .
　詳細には、作成部１１３は、動作履歴記憶部１１２に記憶された動作状況情報を、動作履歴として取得する。作成部１１３は、動作履歴を統計処理し、その結果として、空調機１０２の制御パターンを作成する。作成部１１３は、作成した制御パターンを含む制御パターン情報を制御パターン記憶部１０７に記憶させる。 Specifically, the creation unit 113 acquires the operation status information stored in the operation history storage unit 112 as an operation history. The creation unit 113 statistically processes the operation history, and creates a control pattern for the air conditioner 102 as a result. The creation unit 113 causes the control pattern storage unit 107 to store control pattern information including the created control pattern.
　詳細には例えば、作成部１１３は、動作履歴に基づいて、予め定められた期間又はすべての空調機１０２の運転モード、目標温度、風量などの平均値を取得する。これらの平均値を用いて、作成部１１３は、時期に応じた標準的な運転モード、目標温度、風量などを含む標準制御パターンを含む第１の制御パターン情報を作成する。作成部１１３は、第１の制御パターン情報を制御パターン記憶部１０７に記憶させる。 Specifically, for example, the creation unit 113 acquires average values of operation modes, target temperatures, air volumes, etc. of all the air conditioners 102 for a predetermined period or based on the operation history. Using these average values, the creation unit 113 creates first control pattern information including a standard control pattern including a standard operation mode, target temperature, air volume, and the like according to the season. The creation unit 113 causes the control pattern storage unit 107 to store the first control pattern information.
　詳細には例えば、作成部１１３は、外観履歴情報１０６ａと動作履歴とに基づいて、制御パターン情報１０７ａに含まれる変数（閾値Ｋ１～Ｋ７、時間ＴＨ２～ＴＨ７、温度ＴＰ１～ＴＰ６、運転モードなどの１つ又は複数）を決定する。 More specifically, for example, the creation unit 113 determines variables (thresholds K1 to K7, times TH2 to TH7, temperatures TP1 to TP6, operation mode, etc.) included in the control pattern information 107a based on the appearance history information 106a and the operation history. one or more).
　より詳細には例えば、作成部１１３は、予め定められた期間又はすべての外観履歴情報１０６ａに基づいて、制御パターンの制御条件に対応する状況で動作する空調機１０２を特定する。作成部１１３は、特定した空調機１０２の動作履歴に基づいて、制御パターンに含まれる変数に対応する値の平均値を取得する。作成部１１３は、特定した空調機１０２の動作履歴に基づいて、最も多く採用されている運転モードを取得する。ここでの、平均値、最頻値（最も多く採用されている運転モード）は、外観履歴情報１０６ａに基づいて制御条件を作成する方法の一例であり、適宜変更されてもよい。 More specifically, for example, the creation unit 113 identifies the air conditioners 102 that operate under conditions corresponding to the control conditions of the control pattern based on a predetermined period or all of the appearance history information 106a. The creation unit 113 acquires the average value of the values corresponding to the variables included in the control pattern based on the identified operation history of the air conditioner 102 . The creating unit 113 acquires the operating mode most frequently used based on the identified operation history of the air conditioner 102 . Here, the average value and mode value (operating mode most frequently used) are an example of a method of creating control conditions based on the appearance history information 106a, and may be changed as appropriate.
　作成部１１３は、取得した平均値、最も多く採用されている運転モードの少なくとも１つを用いて、制御パターン情報１０７ａに含まれる制御パターン又は標準制御パターンの変数を変更した、第２の制御パターンを作成する。作成部１１３は、第２の制御パターン情報を制御パターン記憶部１０７に記憶させる。 The creation unit 113 uses at least one of the acquired average value and the most frequently used operation mode to change the variables of the control pattern or the standard control pattern included in the control pattern information 107a to create a second control pattern to create The creation unit 113 causes the control pattern storage unit 107 to store the second control pattern information.
　個別作成部１１４は、空調機１０２の設定が手動で変更された場合に、当該変更に関する変更情報に基づいて、当該変更がなされた空調機１０２に対する制御パターン情報を作成する。 When the setting of the air conditioner 102 is manually changed, the individual creating unit 114 creates control pattern information for the changed air conditioner 102 based on change information related to the change.
　詳細には例えば、個別作成部１１４は、空調機１０２ａへ制御情報を送信してから予め定められた時間内に当該空調機１０２ａからの変更情報が取得された場合に、この変更情報を参照する。個別作成部１１４は、変更情報に基づいて、空調機１０２ａへ制御情報を送信したときに適用した制御パターンに含まれる変数に対応する値を取得する。 More specifically, for example, when change information is acquired from the air conditioner 102a within a predetermined time after transmission of control information to the air conditioner 102a, the individual creation unit 114 refers to this change information. . Based on the change information, the individual creation unit 114 acquires values corresponding to variables included in the control pattern applied when the control information was transmitted to the air conditioner 102a.
　個別作成部１１４は、取得した値を用いて、空調機１０２ａへ制御情報を送信したときに適用した制御パターンに含まれる変数を変更する。この変更の結果、個別作成部１１４は、空調機１０２ａに対する第３の制御パターン情報を作成する。個別作成部１１４は、第３の制御パターン情報を制御パターン記憶部１０７に記憶させる。 The individual creation unit 114 uses the acquired values to change the variables included in the control pattern applied when the control information was transmitted to the air conditioner 102a. As a result of this change, the individual creation unit 114 creates third control pattern information for the air conditioner 102a. The individual creating unit 114 causes the control pattern storage unit 107 to store the third control pattern information.
　本変形例によれば、作成部１１３は、空調機１０２ａの動作履歴を統計処理した結果に基づいて、制御パターン情報を作成する。これにより、実際の空調機１０２ａの動作状況に応じた制御パターン情報を作成することができる。従って、人が意識しなくても、空調機１０２ａを用いて空間の空気環境を容易に快適にすることが可能になる。 According to this modification, the creation unit 113 creates control pattern information based on the result of statistically processing the operation history of the air conditioner 102a. Thereby, it is possible to create control pattern information corresponding to the actual operation status of the air conditioner 102a. Therefore, it is possible to easily make the air environment of the space comfortable by using the air conditioner 102a without the person being conscious of it.
　また、制御装置１０３の利用者が予め制御パターン情報を作成する手間を省くことができる。従って、制御装置１０３の利用者の利便性を向上さえることが可能になる。 Also, the user of the control device 103 can save the trouble of creating control pattern information in advance. Therefore, it becomes possible to improve the convenience for the user of the control device 103 .
　本変形例によれば、個別作成部１１４は、空調機１０２の設定が手動で変更された場合に、当該変更に関する変更情報に基づいて、当該変更がなされた空調機１０２に対する制御パターン情報である個別制御パターン情報を作成する。 According to this modification, when the setting of the air conditioner 102 is manually changed, the individual creation unit 114 creates control pattern information for the changed air conditioner 102 based on the change information related to the change. Create individual control pattern information.
　これにより、手動で変更された空調機１０２の利用環境に応じた個別制御パターン情報を作成することができる。そして、この個別制御パターン情報に従って、当該変更がなされた空調機１０２を制御することができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 As a result, individual control pattern information corresponding to the manually changed usage environment of the air conditioner 102 can be created. Then, according to this individual control pattern information, the changed air conditioner 102 can be controlled. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
（変形例９）
　制御装置１０３は、対象空間としての会議室Ｒの利用スケジュール、対象空間としての会議室Ｒの利用者の個人スケジュールを参照して、空調機１０２を制御してもよい。 (Modification 9)
The control device 103 may control the air conditioner 102 by referring to the usage schedule of the conference room R as the target space and the personal schedule of the user of the conference room R as the target space.
　図１６は、本変形例に係る制御システム１００の構成を示す図である。本変形例に係る制御システム１００は、スケジュール管理装置２１５を備える。スケジュール管理装置２１５は、スケジュール情報を管理する装置である。スケジュール情報は、会議室Ｒの利用スケジュール、利用者の個人スケジュールの少なくとも一方を含む。 FIG. 16 is a diagram showing the configuration of the control system 100 according to this modified example. A control system 100 according to this modification includes a schedule management device 215 . The schedule management device 215 is a device that manages schedule information. The schedule information includes at least one of a usage schedule of the conference room R and a user's personal schedule.
　スケジュール情報は、スケジュールの主体、予定時期（予定時刻及び期間を含む。）、場所、内容（例えば、会議）などの１つ又は複数を含む。 The schedule information includes one or more of the subject of the schedule, scheduled time (including scheduled time and period), location, content (for example, meeting), and the like.
　スケジュール管理装置２１５は、ネットワークＮを介して制御装置１０３と接続されている。制御装置１０３とスケジュール管理装置２１５とは、ネットワークＮを介して情報を互いに送受信する。 The schedule management device 215 is connected to the control device 103 via the network N. The control device 103 and the schedule management device 215 exchange information via the network N with each other.
　本変形例に係る制御装置１０３は、同図に示すように、制御部１０５に代わる制御部２０５を備えるとともに、スケジュール取得部２１６をさらに備える。 As shown in the figure, the control device 103 according to this modification includes a control unit 205 that replaces the control unit 105 and further includes a schedule acquisition unit 216 .
　スケジュール取得部２１６は、ネットワークＮを介してスケジュール管理装置２１５からスケジュール情報を取得する。 The schedule acquisition unit 216 acquires schedule information from the schedule management device 215 via the network N.
　制御部２０５は、実施形態に係る制御部１０５の機能を備える。制御部２０５は、さらに、スケジュール情報に基づいて、空調機１０２を制御する。例えば、制御部２０５は、スケジュール情報に基づいて、対象空間が利用される前に空調機１０２を制御する。 The control unit 205 has the functions of the control unit 105 according to the embodiment. Control unit 205 further controls air conditioner 102 based on the schedule information. For example, the control unit 205 controls the air conditioner 102 before the target space is used based on the schedule information.
　詳細には例えば、制御部２０５は、対象空間がスケジュール情報に含まれる場所（例えば、会議室Ｒ）である場合に、当該対象空間に設けられた空調機１０２（例えば、空調機１０２ａ及び／又は１０２ｂ）へ制御情報を送信する。このときの制御情報は、例えば、予め定められた時間内（例えば、前回）に当該対象空間（例えば、会議室Ｒ）に設けられた空調機１０２（例えば、空調機１０２ａ及び／又は１０２ｂ）へ送信した制御情報と同じ内容を含むとよい。 Specifically, for example, when the target space is a place (eg, conference room R) included in the schedule information, the control unit 205 controls the air conditioner 102 (eg, the air conditioner 102a and/or 102b). For example, the control information at this time is sent to the air conditioners 102 (for example, the air conditioners 102a and/or 102b) provided in the target space (for example, the conference room R) within a predetermined time (for example, the previous time). It is preferable to include the same contents as the transmitted control information.
　これにより、対象空間が利用される前に、その対象空間に適した態様で空調機１０２を制御し、快適な空気環境に調節しておくことができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 As a result, before the target space is used, the air conditioner 102 can be controlled in a manner suitable for the target space and adjusted to a comfortable air environment. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
　例えば、制御部２０５は、スケジュール情報が対象空間（例えば、会議室Ｒ）を過去に利用した主体と同じ主体が当該対象空間（例えば、会議室Ｒ）を再び利用するスケジュールを含む場合に、当該対象空間に設けられた空調機１０２（例えば、空調機１０２ａ及び／又は１０２ｂ）へ制御情報を送信する。このときの制御情報は、例えば、当該主体が過去に当該対象空間（例えば、会議室Ｒ）を利用した時に当該対象空間（例えば、会議室Ｒ）に設けられた空調機１０２（例えば、空調機１０２ａ及び／又は１０２ｂ）へ送信した制御情報と同じ内容を含むとよい。 For example, when the schedule information includes a schedule in which the same subject who used the target space (eg, conference room R) in the past uses the target space (eg, conference room R) again, the control unit 205 The control information is transmitted to the air conditioners 102 (for example, the air conditioners 102a and/or 102b) provided in the target space. The control information at this time is, for example, the air conditioner 102 (for example, the air conditioner 102) provided in the target space (for example, the conference room R) when the subject used the target space (for example, the conference room R) in the past. 102a and/or 102b).
　一般的に同じ主体が対象空間を再び利用する場合、快適な空気環境は、前回の利用時の空気環境と同じであることが多い。そのため、この例によれば、その主体にとって快適な空気環境に予め調節しておくことができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 　Generally, when the same subject uses the target space again, the comfortable air environment is often the same as the previous use. Therefore, according to this example, the air environment can be adjusted in advance to be comfortable for the subject. Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
　例えば、制御部２０５は、対象空間（例えば、会議室Ｒ）の利用スケジュールに含まれる主体の種類に基づいて、当該対象空間に設けられた空調機１０２（例えば、空調機１０２ａ及び／又は１０２ｂ）へ制御情報を送信する。主体の種類とは、例えば、官公庁、企業、サークル、町内会などである。 For example, the control unit 205 controls the air conditioners 102 (for example, the air conditioners 102a and/or 102b) provided in the target space (for example, the conference room R) based on the type of subject included in the usage schedule of the target space (for example, the conference room R). Send control information to The types of subjects are, for example, public offices, companies, circles, neighborhood associations, and the like.
　このときの制御情報は、例えば、同じ種類の主体が過去に当該対象空間（例えば、会議室Ｒ）を利用した時に当該対象空間（例えば、会議室Ｒ）に設けられた空調機１０２（例えば、空調機１０２ａ及び／又は１０２ｂ）へ送信した制御情報と同じ内容を含むとよい。 The control information at this time is, for example, the air conditioner 102 (for example, It is preferable to include the same content as the control information transmitted to the air conditioners 102a and/or 102b).
　一般的に同じ種類の主体が対象空間を利用する場合、同様の服装であることが多い。例えば、会議室Ｒを利用する主体が、官公庁、企業であれば、スーツを着用していることが多い。会議室Ｒを利用する主体が、サークル、町内会であれば、カジュアルな服装であることが多い。 In general, when subjects of the same type use the target space, they often wear similar clothing. For example, if the subject who uses the conference room R is a government agency or a company, they often wear a suit. If the subject using the conference room R is a circle or a neighborhood association, casual clothes are often worn.
　そのため、対象空間の利用スケジュールに含まれる主体の種類に基づいて、空調機１０２を制御することで、主体の服装に応じた態様で空調機１０２を制御して、快適な空気環境に調節しておくことができる。従って、人が意識しなくても、空調機１０２を用いて空間の空気環境を容易に快適にすることが可能になる。 Therefore, by controlling the air conditioner 102 based on the type of subject included in the usage schedule of the target space, the air conditioner 102 is controlled in a manner corresponding to the clothing of the subject to adjust the air environment to a comfortable one. can be kept Therefore, it is possible to easily make the air environment of the space comfortable using the air conditioner 102 without the person being conscious of it.
　以上、図面を参照して本発明の実施の形態及び変形例について述べたが、これらは本発明の例示であり、上記以外の様々な構成を採用することもできる。 Although the embodiments and modifications of the present invention have been described above with reference to the drawings, these are examples of the present invention, and various configurations other than those described above can also be adopted.
　また、上述の説明で用いた複数のフローチャートでは、複数の工程（処理）が順番に記載されているが、実施の形態の各々で実行される工程の実行順序は、その記載の順番に制限されない。実施の形態の各々では、図示される工程の順番を内容的に支障のない範囲で変更することができる。また、上述の実施の形態及び変形例は、内容が相反しない範囲で組み合わせることができる。 Also, in the plurality of flowcharts used in the above description, a plurality of steps (processes) are described in order, but the execution order of the steps executed in each embodiment is not limited to the described order. . In each of the embodiments, the order of the illustrated steps can be changed within a scope that does not interfere with the content. Also, the above-described embodiments and modifications can be combined within a range in which the contents do not contradict each other.
　上記の実施の形態の一部または全部は、以下の付記のようにも記載されうるが、以下に限られない。 A part or all of the above embodiments can be described as the following additional remarks, but are not limited to the following.
　１． 
　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得する履歴取得手段と、
　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力する制御手段とを備える
　空調機制御装置。
２．
　前記制御手段は、前記外観の履歴を統計処理した結果に基づいて、前記空調機を制御する
　上記１に記載の空調機制御装置。
３．
　前記統計処理は、前記対象空間又は前記対象空間に含まれる領域の属性と、前記対象空間又は前記領域に居る人の外観と、前記対象空間又は前記領域に居る人の属性と、の少なくとも１つに関する統計処理を含む
　上記２に記載の空調機制御装置。
４．
　前記統計処理は、前記対象空間又は前記対象空間に含まれる領域の属性と、前記対象空間又は前記領域に居る人の外観と、前記対象空間又は前記領域に居る人の属性と、少なくとも１つの時間的な変化に関する統計処理を含む
　上記３に記載の空調機制御装置。
５．
　前記制御手段は、前記統計処理の結果に応じた前記空調機の制御内容を含む制御パターン情報に基づいて、前記空調機を制御する
　上記２から４のいずれか１つに記載の空調機制御装置。
６．
　前記空調機の動作履歴を統計処理した結果に基づいて、前記制御パターン情報を作成する作成手段をさらに備える
　上記５に記載の空調機制御装置。
７．
　前記空調機の設定が手動で変更された場合に、当該変更に関する変更情報に基づいて、当該変更がなされた空調機に対する制御パターン情報を作成する個別作成手段をさらに備える
　上記５又は６に記載の空調機制御装置。
８．
　前記制御手段は、さらに、前記対象空間の利用スケジュール、前記対象空間の利用者のスケジュールの少なくとも１つを含むスケジュール情報に基づいて、前記空調機を制御する
　上記１から７のいずれか１つに記載の空調機制御装置。
９．
　前記制御手段は、前記外観履歴情報に基づいて、前記対象空間とは異なる空間を調節するための制御情報を出力する
　上記１から８のいずれか１つに記載の空調機制御装置。
１０．
　前記対象空間は、複数であり、
　前記履歴取得手段は、前記複数の対象空間を撮影した画像をそれぞれに含む複数の画像情報を処理して、前記複数の対象空間のそれぞれにおいて活動する１以上の人の外観の履歴である複数の外観履歴情報を取得する
　上記１から９のいずれか１つに記載の空調機制御装置。
１１．
　前記制御手段は、前記複数の対象空間の少なくとも１つに対応付けられた少なくとも１つの空調機を制御するための制御情報を出力する
　上記１０に記載の空調機制御装置。
１２．
　上記１から１１のいずれか１つに記載の空調機制御装置と、
　前記対象空間を撮影する撮影装置と、
　前記空調機とを備える
　空調機制御システム。
１３．
　コンピュータが、
　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得し、
　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力することを含む
　空調機制御方法。
１４．
　コンピュータに、
　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得し、
　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力することを実行させるためのプログラム。 1.
history acquisition means for processing image information including an image of a target space and acquiring appearance history information including a history of the appearance of one or more people active in the target space;
and control means for outputting control information for controlling the air conditioner based on the appearance history information.
2.
2. The air conditioner control device according to the above 1, wherein the control means controls the air conditioner based on a result of statistically processing the history of the appearance.
3.
The statistical processing includes at least one of an attribute of the target space or a region included in the target space, an appearance of a person in the target space or the region, and an attribute of a person in the target space or the region. 3. The air conditioner control device according to 2 above, including statistical processing related to
4.
The statistical processing includes attributes of the target space or a region included in the target space, appearances of people in the target space or the region, attributes of people in the target space or the region, and at least one time 4. The air conditioner control device according to the above 3, including statistical processing related to changes in nature.
5.
5. The air conditioner control device according to any one of 2 to 4 above, wherein the control means controls the air conditioner based on control pattern information including control details of the air conditioner according to the result of the statistical processing. .
6.
6. The air conditioner control device according to 5 above, further comprising creating means for creating the control pattern information based on a result of statistically processing the operation history of the air conditioner.
7.
7. The above-mentioned 5 or 6, further comprising individual creation means for creating control pattern information for the changed air conditioner based on change information related to the change when the setting of the air conditioner is manually changed. Air conditioner controller.
8.
The control means further controls the air conditioner based on schedule information including at least one of a usage schedule of the target space and a schedule of users of the target space. An air conditioner controller as described.
9.
9. The air conditioner control device according to any one of 1 to 8 above, wherein the control means outputs control information for adjusting a space different from the target space based on the appearance history information.
10.
The target space is plural,
The history acquisition means processes a plurality of image information each including images obtained by photographing the plurality of target spaces, and obtains a plurality of histories of the appearance of one or more people active in each of the plurality of target spaces. 10. The air conditioner control device according to any one of 1 to 9 above, which acquires appearance history information.
11.
11. The air conditioner control device according to 10 above, wherein the control means outputs control information for controlling at least one air conditioner associated with at least one of the plurality of target spaces.
12.
12. The air conditioner control device according to any one of 1 to 11 above;
a photographing device for photographing the target space;
An air conditioner control system comprising: the air conditioner.
13.
the computer
obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
An air conditioner control method, comprising: outputting control information for controlling an air conditioner based on the appearance history information.
14.
to the computer,
obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
A program for outputting control information for controlling an air conditioner based on the appearance history information.
１００　空調機制御システム（制御システム）
１０１，１０１ａ，１０１ｂ，１０１ｃ　撮影装置
１０２，１０２ａ，１０２ｂ，１０３ｃ　空調機
１０３　空調機制御装置（制御装置）
１０４　履歴取得部
１０４ａ　人検出部
１０４ｂ　解析部
１０５　制御部
１０６　履歴記憶部
１０６ａ　外観履歴情報
１０７　制御パターン記憶部
１０７ａ　制御パターン情報
１１１　動作状況取得部
１１２　動作履歴記憶部
１１３　作成部
１１４　個別作成部
２１５　スケジュール管理装置
２１６　スケジュール取得部
Ｃ　廊下
Ｄ　出入口
Ｐ　人
Ｒ　会議室
ＴＳ，ＴＳａ，ＴＳｂ，ＴＳｃ　撮影領域 100 air conditioner control system (control system)
101, 101a, 101b, 101c Imaging devices 102, 102a, 102b, 103c Air conditioner 103 Air conditioner control device (control device)
104 history acquisition unit 104a human detection unit 104b analysis unit 105 control unit 106 history storage unit 106a appearance history information 107 control pattern storage unit 107a control pattern information 111 operation status acquisition unit 112 operation history storage unit 113 creation unit 114 individual creation unit 215 schedule Management device 216 Schedule acquisition unit C Corridor D Doorway P People R Conference rooms TS, TSa, TSb, TSc Shooting area

Claims (14)

  1. 　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得する履歴取得手段と、
    　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力する制御手段とを備える
    　空調機制御装置。     history acquisition means for processing image information including an image of a target space and acquiring appearance history information including a history of the appearance of one or more people active in the target space;
    and control means for outputting control information for controlling the air conditioner based on the appearance history information.
  2. 　前記制御手段は、前記外観の履歴を統計処理した結果に基づいて、前記空調機を制御する
    　請求項１に記載の空調機制御装置。     The air conditioner control device according to claim 1, wherein the control means controls the air conditioner based on a result of statistically processing the history of the appearance.
  3. 　前記統計処理は、前記対象空間又は前記対象空間に含まれる領域の属性と、前記対象空間又は前記領域に居る人の外観と、前記対象空間又は前記領域に居る人の属性と、の少なくとも１つに関する統計処理を含む
    　請求項２に記載の空調機制御装置。     The statistical processing includes at least one of an attribute of the target space or a region included in the target space, an appearance of a person in the target space or the region, and an attribute of a person in the target space or the region. The air conditioner control device according to claim 2, including statistical processing relating to.
  4. 　前記統計処理は、前記対象空間又は前記対象空間に含まれる領域の属性と、前記対象空間又は前記領域に居る人の外観と、前記対象空間又は前記領域に居る人の属性と、少なくとも１つの時間的な変化に関する統計処理を含む
    　請求項３に記載の空調機制御装置。     The statistical processing includes attributes of the target space or a region included in the target space, appearances of people in the target space or the region, attributes of people in the target space or the region, and at least one time 4. The air conditioner control device according to claim 3, including statistical processing related to changes in the air conditioner.
  5. 　前記制御手段は、前記統計処理の結果に応じた前記空調機の制御内容を含む制御パターン情報に基づいて、前記空調機を制御する
    　請求項２から４のいずれか１項に記載の空調機制御装置。     The air conditioner control according to any one of claims 2 to 4, wherein the control means controls the air conditioner based on control pattern information including control details of the air conditioner according to the result of the statistical processing. Device.
  6. 　前記空調機の動作履歴を統計処理した結果に基づいて、前記制御パターン情報を作成する作成手段をさらに備える
    　請求項５に記載の空調機制御装置。     The air conditioner control device according to claim 5, further comprising creating means for creating the control pattern information based on a result of statistically processing the operation history of the air conditioner.
  7. 　前記空調機の設定が手動で変更された場合に、当該変更に関する変更情報に基づいて、当該変更がなされた空調機に対する制御パターン情報を作成する個別作成手段をさらに備える
    　請求項５又は６に記載の空調機制御装置。     7. The apparatus according to claim 5, further comprising individual creation means for creating control pattern information for the changed air conditioner based on change information about the change when the setting of the air conditioner is manually changed. air conditioner controller.
  8. 　前記制御手段は、さらに、前記対象空間の利用スケジュール、前記対象空間の利用者のスケジュールの少なくとも１つを含むスケジュール情報に基づいて、前記空調機を制御する
    　請求項１から７のいずれか１項に記載の空調機制御装置。     8. The control means further controls the air conditioner based on schedule information including at least one of a usage schedule of the target space and a schedule of users of the target space. The air conditioner control device according to .
  9. 　前記制御手段は、前記外観履歴情報に基づいて、前記対象空間とは異なる空間を調節するための制御情報を出力する
    　請求項１から８のいずれか１項に記載の空調機制御装置。     The air conditioner control device according to any one of claims 1 to 8, wherein the control means outputs control information for adjusting a space different from the target space based on the appearance history information.
  10. 　前記対象空間は、複数であり、
    　前記履歴取得手段は、前記複数の対象空間を撮影した画像をそれぞれに含む複数の画像情報を処理して、前記複数の対象空間のそれぞれにおいて活動する１以上の人の外観の履歴である複数の外観履歴情報を取得する
    　請求項１から９のいずれか１項に記載の空調機制御装置。     The target space is plural,
    The history acquisition means processes a plurality of image information each including images obtained by photographing the plurality of target spaces, and obtains a plurality of histories of the appearance of one or more people active in each of the plurality of target spaces. The air conditioner control device according to any one of claims 1 to 9, wherein appearance history information is acquired.
  11. 　前記制御手段は、前記複数の対象空間の少なくとも１つに対応付けられた少なくとも１つの空調機を制御するための制御情報を出力する
    　請求項１０に記載の空調機制御装置。     The air conditioner control device according to claim 10, wherein said control means outputs control information for controlling at least one air conditioner associated with at least one of said plurality of target spaces.
  12. 　請求項１から１１のいずれか１項に記載の空調機制御装置と、
    　前記対象空間を撮影する撮影装置と、
    　前記空調機とを備える
    　空調機制御システム。     An air conditioner control device according to any one of claims 1 to 11;
    a photographing device for photographing the target space;
    An air conditioner control system comprising: the air conditioner.
  13. 　コンピュータが、
    　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得し、
    　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力することを含む
    　空調機制御方法。     the computer
    obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
    An air conditioner control method, comprising: outputting control information for controlling an air conditioner based on the appearance history information.
  14. 　コンピュータに、
    　対象空間を撮影した画像を含む画像情報を処理して、前記対象空間において活動する１以上の人の外観の履歴を含む外観履歴情報を取得し、
    　前記外観履歴情報に基づいて、空調機を制御するための制御情報を出力することを実行させるためのプログラム。     to the computer,
    obtaining appearance history information including appearance histories of one or more people active in the target space by processing image information including images of the target space;
    A program for outputting control information for controlling an air conditioner based on the appearance history information.
PCT/JP2022/002898 2022-01-26 2022-01-26 Air conditioner control device, air conditioner control system, air conditioner control method, and program WO2023144931A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2022/002898 WO2023144931A1 (en) 2022-01-26 2022-01-26 Air conditioner control device, air conditioner control system, air conditioner control method, and program
JP2023576458A JPWO2023144931A5 (en) 2022-01-26 Air conditioner control device, air conditioner control method and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/002898 WO2023144931A1 (en) 2022-01-26 2022-01-26 Air conditioner control device, air conditioner control system, air conditioner control method, and program

Publications (1)

Publication Number Publication Date
WO2023144931A1 true WO2023144931A1 (en) 2023-08-03

Family

ID=87471229

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/002898 WO2023144931A1 (en) 2022-01-26 2022-01-26 Air conditioner control device, air conditioner control system, air conditioner control method, and program

Country Status (1)

Country Link
WO (1) WO2023144931A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06195323A (en) * 1992-12-24 1994-07-15 Nippondenso Co Ltd Neural network type additional learning device
CN102840647A (en) * 2012-04-25 2012-12-26 中华电信股份有限公司 Air conditioner comfort control system and method combining image identification
JP2019019988A (en) * 2017-07-11 2019-02-07 株式会社東芝 Air conditioning operation condition creation device, air conditioning operation condition creation method, program and air conditioning system
WO2019087537A1 (en) * 2017-10-30 2019-05-09 ダイキン工業株式会社 Air-conditioning control device
WO2019189179A1 (en) * 2018-03-30 2019-10-03 ダイキン工業株式会社 Information management system
JP2019179523A (en) * 2018-03-30 2019-10-17 ダイキン工業株式会社 Psychosomatic state recognition system
WO2020230269A1 (en) * 2019-05-14 2020-11-19 三菱電機株式会社 Air-conditioning management device and air-conditioning system
WO2021107053A1 (en) * 2019-11-26 2021-06-03 ダイキン工業株式会社 Machine learning device and environment adjustment device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06195323A (en) * 1992-12-24 1994-07-15 Nippondenso Co Ltd Neural network type additional learning device
CN102840647A (en) * 2012-04-25 2012-12-26 中华电信股份有限公司 Air conditioner comfort control system and method combining image identification
JP2019019988A (en) * 2017-07-11 2019-02-07 株式会社東芝 Air conditioning operation condition creation device, air conditioning operation condition creation method, program and air conditioning system
WO2019087537A1 (en) * 2017-10-30 2019-05-09 ダイキン工業株式会社 Air-conditioning control device
WO2019189179A1 (en) * 2018-03-30 2019-10-03 ダイキン工業株式会社 Information management system
JP2019179523A (en) * 2018-03-30 2019-10-17 ダイキン工業株式会社 Psychosomatic state recognition system
WO2020230269A1 (en) * 2019-05-14 2020-11-19 三菱電機株式会社 Air-conditioning management device and air-conditioning system
WO2021107053A1 (en) * 2019-11-26 2021-06-03 ダイキン工業株式会社 Machine learning device and environment adjustment device

Also Published As

Publication number Publication date
JPWO2023144931A1 (en) 2023-08-03

Similar Documents

Publication Publication Date Title
WO2020177498A1 (en) Non-intrusive human body thermal comfort detection method and system based on posture estimation
Yang et al. Real-time and contactless measurements of thermal discomfort based on human poses for energy efficient control of buildings
US9863660B2 (en) Sensing method and sensing system, and air conditioning device having the same
Ranjan et al. ThermalSense: determining dynamic thermal comfort preferences using thermographic imaging
CN109114741B (en) Air conditioner control method and device, storage medium and air conditioner
CN113808309A (en) Method and system for maintaining a healthy building
CN115943466A (en) Method and system for reducing the risk of disease transmission in a building
Roaf et al. Twentieth century standards for thermal comfort: promoting high energy buildings
TWI648507B (en) Intelligent energy-saving environment control system and method
US20160061472A1 (en) Method and device for controlling room temperature and humidity
US11655995B2 (en) Method of controlling operation of air conditioner by analyzing user's behavior pattern and air conditioner
Cosma et al. Using the contrast within a single face heat map to assess personal thermal comfort
JP7338886B2 (en) Area-based environmental management system, method and program
JPH06117836A (en) Image processing apparatus, controller of air conditioner, and applied equipment using the apparatus
JP2010025548A (en) Environment equipment control system
CN112303861A (en) Air conditioner temperature adjusting method and system based on human body thermal adaptability behavior
JP2013088105A (en) Air-conditioning control system
JP2019125061A (en) System for estimating condition of person
JP7127347B2 (en) Environmental control system and environmental control device
CN113280484A (en) Air environment conditioning system and control device
CN112666837A (en) Indoor environment monitoring system and method based on group adaptive behavior recognition
JPH08257017A (en) Condition monitoring device and its method
Wu et al. Comparison among different modeling approaches for personalized thermal comfort prediction when using personal comfort systems
Li et al. Non-invasive human thermal comfort assessment based on multiple angle/distance facial key-region temperatures recognition
Xu et al. Action-based personalized dynamic thermal demand prediction with video cameras

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22923798

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023576458

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE