JP6512086B2 - Device control system and device control method - Google Patents

Description

  The present invention relates to a control system and a control method of a machine tool, particularly a home electric machine tool (hereinafter, may be described only as a home appliance).

  2. Description of the Related Art Conventionally, a technology has been proposed that includes a sensor provided inside a home appliance, stores information from the sensor installed in a home, and controls the home appliance according to the contents and the analysis result.

  For example, information processing capable of analyzing the atmosphere information of the space from the space information acquired by the sensor and the data on human behavior, and executing appropriate processing for the action content based on the atmosphere information that is the analysis result There is a technology related to an apparatus, an information processing method, and a computer program. (See Patent Document 1).

JP, 2014-130467, A (paragraphs 0007-0011, FIG. 1)

  However, in the device control system of Patent Document 1, it is not assumed that there are two or more people in a space or zone, but one condition control is given to one space. There is a possibility that at least one of the persons in the two spaces is provided with a space which is not comfortable.

  Furthermore, since only devices that can be automatically controlled are used, there is a limit to what can be controlled, and there is a risk of providing a space that is not comfortable for people in the space.

According to the device control system of the present invention, there is provided a device control system comprising: a home appliance having a predetermined sensor; a portable terminal; and an information processing apparatus capable of bi-directional communication with the home appliance and the portable terminal. The information processing apparatus includes a receiving unit that receives the information acquired by the sensor or information included in the mobile terminal, an accumulating unit that accumulates the information received by the receiving unit, and the predetermined information from the accumulated information or the received information. A position analysis unit for analyzing position information of a person in the space, an environment analysis unit for analyzing the environment of the predetermined space from the accumulated information or the received information, the accumulated information or the received information The human condition analysis unit analyzes the condition of the person present in the predetermined space from the above, and the human position analysis unit analyzes the result of analysis by the environment analysis unit as a result of analysis by the human position analysis unit. As a result, based on the position information of the person, the environment of the space, and the state of the person, the operation of the home appliance is determined for each person for the person who is in the predetermined space, and And a motion temporary determination unit for determining, for each person, the priority among the people, and when there is a conflicting operation between the motions of the home device determined by the motion temporary determination unit, operation is against the person said low priority while instructed to the operation of the home appliance the operation provisional determining unit has determined as an operation of the home appliance for higher the priority human among people competing It is characterized in that an external device which does not perform two-way communication with the information processing apparatus is operated or a content for promoting an action of a person is indicated.

  According to the device control system of the present invention, even when a plurality of persons exist in the same space, a comfortable environment can be provided to each person.

It is the schematic which shows the structure of the control system in Embodiment 1 of this invention. It is a block diagram which shows an example of a structure of the air-conditioner in Embodiment 1 of this invention. It is a block diagram which shows an example of a structure of the portable terminal in this Embodiment 1, and a vital sign measuring machine. It is a block diagram which shows an example of a structure of the display in Embodiment 1 of this invention. It is a block diagram which shows an example of a structure of the information processing apparatus in Embodiment 1 of this invention. It is a flowchart which shows the procedure which adjusts the competition operation | movement of the operation | movement competition elimination part in Embodiment 1 of this invention, and performs operation | movement determination of an external apparatus. It is a block diagram which shows an example of a structure of the information processing apparatus in Embodiment 2 of this invention. It is a block diagram which shows an example of a structure of the information processing apparatus in Embodiment 3 of this invention.

Embodiment 1
Next, embodiments of the present invention will be described using the drawings. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. However, it should be noted that the drawings are schematic, and the ratio of each dimension is different from the actual one. Therefore, specific dimensions and the like should be determined in consideration of the following description. Moreover, it is a matter of course that portions having different dimensional relationships and ratios among the drawings are included.

  FIG. 1 is a schematic diagram showing a configuration of a control system using a home appliance according to Embodiment 1 of the present invention.

  In the figure, the home appliance control system 1 according to the first embodiment of the present invention includes an air conditioner 2 for air conditioning which is an external device, personal information (sex, age), face image, and vital signs (pulse, temperature, blood pressure) Etc., a display unit 4 for displaying an image, and a fan 5 for generating wind, and further, information processing for collecting sensor information of a home electric appliance in the room and operating the home electric appliance A device 6 is provided. The mobile terminal 3 further communicates with a wearable terminal that measures vital signs, for example, a vital sign measurement device 310 such as a smart watch. In addition, although each external apparatus is shown as one in FIG. 1, two or more of these may exist in the same room.

  The information processing device 6 is connected to the air conditioner 2, the portable terminal 3, and the display device 4 via a network, and can mutually communicate.

  The information processing apparatus 6 acquires information from an external device connected via a network. For example, from the air conditioner 2, information of the set temperature, room temperature, air volume, infrared sensor image, and color image, from the portable terminal 3, age, sex, face information of the portable terminal owner who is portable terminal owner information, And receive vital sign information.

  The information processing apparatus 6 has a function of transmitting an operation command to an external device connected via a network via the network to execute an operation. Further, the information processing apparatus 6 displays the operation contents on the display 4 or / and the portable terminal 3 for an external device not connected by a network, in this case, the fan 5, for the system user in the room, It has a function to prompt the operation of the external device.

  The information processing device 6 stores in advance information on the setting of the external device. The information to be stored includes, for example, the upper limit and the lower limit of the set temperature for the air conditioner 2 and the type of operation mode (heating, cooling, dehumidification), etc. For example, for the fan 5, a combination of air volume and speed of the fan, and It includes the presence and the angle of the swinging movement of the fan. The information processing apparatus 6 may obtain and store these pieces of information by the input of the user of the system, or may obtain them from a specification table of the device uploaded on the Internet.

  The communication means may be wired or wireless. In the case of wireless, for example, a Wi-Fi (registered trademark) (Wireless Fidelity) system, a Bluetooth (registered trademark) system, a Wi-SUN (registered trademark) (Wireless Smart Utility Network) system, and the like can be mentioned. In the case of wired communication, Ethernet (registered trademark), IEEE 1394, and the like can be mentioned.

  FIG. 2 is a block diagram showing an example of the internal configuration of the air conditioner according to Embodiment 1 of the present invention. In the figure, the air conditioner 2 includes a communication unit 201 that communicates with the information processing apparatus 6, a temperature sensor 202 that measures room temperature, a humidity sensor 203 that measures indoor humidity, a camera 204 that acquires an indoor image, and an indoor infrared sensor It includes an infrared camera 205 for acquiring an image, and an air conditioning unit 206 for controlling air conditioning in the room.

  The communication unit 201 communicates with the information processing device 6. The communication unit 201 is an information acquisition unit of the air conditioner 2 and includes a temperature sensor 202 for acquiring information such as temperature and humidity which is an environmental factor in the room, a humidity sensor 203, a camera 204, and an infrared camera 205. Sensor information and image information acquired by these sensors and cameras are transmitted to the information processing apparatus 6. Further, the communication unit 201 receives the instruction information transmitted by the operation instruction transmission unit 607 of the information processing device 6, and transmits the instruction information to the air conditioning unit 206.

  The temperature sensor 202 measures room temperature. The obtained temperature information is transmitted to the communication unit 201. The humidity sensor 203 measures the humidity in the room. The obtained humidity information is transmitted to the communication unit 201.

  The camera 204 acquires a color image in the room. Although it is preferable to use a wide-angle lens so that the camera 204 can shoot a wide range in the room, a lens having an angle of view that can cover the entire room may be used. The acquired image information is sent to the communication unit 201. The color image is, for example, an image in which each color of RGB is expressed in 8 bits. Although high resolution (1024 × 768) is desirable for the resolution, it is not the main function of the air conditioner, so it may be determined in consideration of the cost. It may be 4K (3840 × 2160) or 8K (7680 × 4320), which is super high image quality, or may be standard image quality (640 × 480).

  The infrared camera 205 acquires an infrared image of the room. The infrared camera 205 preferably uses a wide-angle lens so as to capture a wide area in the room as much as possible, but a lens having an angle of view that can cover the entire room may be used. The acquired image information is sent to the communication unit 201. An infrared image is an image representing the surface temperature distribution of an object present in a room, and it is a color image in which the difference in temperature is shown as a difference in color, even in the case of a single color image represented only by color shading. It may be. Also, the image quality is not particularly limited, but it is better if the temperature distribution is shown with finer resolution. The resolution is as shown for the camera 204.

  The infrared camera 205 may have any shape. It may be constructed by arranging commercially available infrared sensors, but the above-mentioned performance may not be obtained.

  The air conditioning unit 206 controls air conditioning in the room. For example, it has functions such as cooling, heating and dehumidification. The air conditioning unit 206 also controls air conditioning in response to an instruction from the communication unit 201.

  FIG. 3 is a block diagram showing an example of the configuration of a portable terminal and a vital sign measuring instrument in accordance with Embodiment 1 of the present invention. In the figure, for example, a smartphone corresponds to the mobile terminal 3. Further, the vital sign measuring device 310 corresponds to, for example, a wearable terminal such as a smart watch.

  The mobile terminal 3 includes a communication unit 301 and a presentation unit 302. The communication unit 301 performs communication between the information processing device 6 and the vital sign measuring device 310. The communication unit 301 receives a vital sign from the vital sign measuring device 310 and transmits the vital sign to the information processing device 6. Further, the communication unit 301 receives the action presentation content transmitted by the presentation content transmission unit 608 of the information processing device 6, and transmits the action presentation content to the presentation unit 302.

  The presentation unit 302 presents the user with the action presentation content sent from the information processing device 6. The notification method of the action presentation content performed by the presentation unit 302 may be a method of displaying characters or a video, or may be a method of notifying by voice.

  The vital sign measurement instrument 310 includes a communication unit 311 that communicates with the mobile terminal 3 and a vital sign acquisition unit 312 that acquires a vital sign of the user. The information that can be acquired by the vital sign acquisition unit 312 is, for example, the user's body temperature, blood pressure, and pulse. Further, the vital sign acquisition unit 312 has a function of estimating the daily fluctuation tendency of these vital signs by using the past vital sign data records.

  As a method of deriving the daily fluctuation tendency of vital signs, for example, with an application in a smart watch, the average value of the values of each vital sign per day and the average value per hour are derived A function that approximates the mean value-the mean value of the values of each vital sign of the day) is defined as the daily fluctuation tendency. As the function, a sine function having a period of 24 hours is used.

  In addition, although the portable terminal 3 and the vital sign measuring device 310 are different devices, a communication unit performing communication with the information processing device 6 in one device and the action presentation content sent from the information processing device 6 are presented to the user The present invention may be configured to have a presentation unit to perform, and a vital sign acquisition unit to acquire the vital sign of the user.

  FIG. 4 is a block diagram showing an example of the structure of the display according to the first embodiment of the present invention. In the figure, the display 4 includes a communication unit 401 and a presentation unit 402. For example, a digital television or the like corresponds to the display 4.

  The communication unit 401 receives information on the action presentation content transmitted by the information processing device 6 and presented by the presentation unit 402, and transmits the information to the presentation unit 402.

  The presentation unit 402 displays the action presentation content. The notification method of the action presentation content performed by the presentation unit 402 may be a method of displaying characters or a video, or may be a method of notifying by voice.

  FIG. 5 is a block diagram showing an example of the configuration of the information processing apparatus in the first embodiment of the present invention. In the figure, the information processing apparatus 6 receives and / or stores a reception unit 601 that receives and stores information transmitted by an external device, a person position analysis unit 602 that analyzes the position of a person from received and / or stored information, and The temperature distribution analysis unit 603 that analyzes the temperature distribution in the room, which is one of the factors that affect the indoor environment from the information, the state of the person who analyzes the position and health status of each person in the room from the received or / The analysis unit 604, an operation temporary determination unit 605 that temporarily determines how an external device should operate for each person in the room, an operation that resolves conflicting operations among the temporarily determined operations and determines an appropriate operation Contention cancellation unit 606, operation instruction transmission unit 607 for transmitting operation instruction to air conditioner 2, and presentation content transmission unit 608 for transmitting presentation content of operation related to fan 5 to display 4 and portable terminal 3. Provided.

  The receiving unit 601 receives information from the air conditioner 2 and the portable terminal 3 which are external devices connected via a network. Specifically, from the air conditioner 2, information regarding the set temperature, room temperature, air volume, infrared image, and color image, and from the mobile terminal 3, information including the age, sex, face information, and vital sign of the owner of the mobile terminal. To receive. Note that the information is not limited to this, and may be part of the information shown here.

  The receiving unit 601 may receive information from each external device by waiting for information transmission from the external device. Alternatively, the receiving unit 601 may transmit an information request message to the external device and return it as a response. Information may be received.

  The human position analysis unit 602 analyzes the position in the room where the human exists. Data used as an input in the analysis processing of the position of a person is information on a color image and an infrared image received by the receiving unit 601.

  In the analysis processing of the position of a person, first, a difference image obtained by subtracting a background image stored in advance from a color image based on the acquired information is obtained. The background image is an average image of color images acquired in the past. The average image is an image obtained by averaging bright images in a room during a specific period, for example, one day.

  Next, the HOG (Histograms of Oriented Gradients) feature value of the difference image is calculated. For example, it is assumed that cells of the HOG feature amount are configured by 5 × 5 pixels, and normalization is performed by 3 × 3 cells. The number of constituent pixels of the cell in the HOG feature amount and the unit of the cell to be normalized with respect to the histogram may be appropriately determined.

  Subsequently, the position area of the person in the image is detected with respect to the acquired HOG feature amount. To detect the location area of a person in an image. A human region detection support vector machine (SVM) generated based on HOG features of human and non-human images collected in advance is used. In addition, in the detection of the position area of the person in the image, a scanning process is performed such that the determination by the classifier is performed from the upper left portion of the image.

  Finally, the infrared image is superimposed on the position area of the person in the acquired image to filter out the area where no human-like heat source exists. A heat source indicating a human body, a heat source showing a head located near the top in a predetermined area and an area where the temperature is extremely high and a temperature extremely low with respect to body temperature, and a body part existing near the center Exclude areas where there is no heat source. The heat source indicating the head and the heat source indicating the torso portion are determined based on an infrared image of a person photographed in advance. Note that, since the radiant heat from the human body and clothes depends on the season or the temperature and the weather, for example, images to be compared may be switched for each season. Information on the area left after filter out is output as position information of a person.

  The temperature distribution analysis unit 603 creates a temperature map corresponding to the temperature distribution in the room, which is one of the factors affecting the indoor environment. In addition, although the case where the temperature map of the floor surface ceiling surface which made the room a rectangular solid is created for simplification of calculation, it can not be overemphasized that it is according to this also when creating the map with respect to the whole room.

  The data used to calculate the temperature map in the room is the information of the infrared image received by the receiving unit 601 and the position information of the person analyzed by the person position analysis unit 602.

  First, the temperature distribution analysis unit 603 performs a masking process on an area where it is determined that a person is present in the infrared image. Subsequently, for each pixel of the area subjected to the masking process, a pixel in the non-mask portion adjacent to the area subjected to the masking process is used to complement the area subjected to the masking process. In this case, interpolation with an average value of the predetermined number of adjacent pixels, interpolation with an intermediate value, and interpolation by approximation using other statistical methods can be considered.

  Next, the infrared image subjected to the masking process is applied to the temperature map of the floor surface ceiling surface. The correspondence between each pixel of the infrared image and the coordinates of the temperature map is, for example, determined in advance as a look-up table. The wall surface not included in the image is assumed to be at the same temperature as the room temperature.

  The state analysis unit 604 of the person analyzes the correspondence between the mobile terminal owner information of the person in the room and the detected area of the person in the room, the degree of comfort, and the health state. The "person's condition" of a predetermined person in the room is defined by the position, comfort, and health condition of the person's room. The state analysis unit 604 of the person has the person analyzed by the person position analysis unit 602 with the image of the room acquired by the reception unit 601 and the information of the portable terminal owner for the analysis of the “state of the person”. The position and the indoor temperature map analyzed by the temperature distribution analysis unit 603 are used.

  The state analysis unit 604 of the person first determines the correspondence between the portable terminal owner information of the person in the room and the occupied area of the detected person in the room. The correspondence between the portable terminal owner information of the person in the room and the occupied area of the detected person in the room differs depending on whether or not the face of the person in the image is displayed. Similarity of Speeded-Up Robust Features (SURF) feature quantity vector using a person's face image stored in the portable terminal in advance and an indoor image for a person whose face appears in the image at a predetermined time The mobile terminal owner information is associated with the data of the person position by the association using In addition, for a person whose face does not appear in the image at a predetermined time, the portable terminal 3 emits a beacon or the like to reach the position, thereby associating portable terminal owner information with the data of the human position. . The beacon of Bluetooth (registered trademark) can be applied to the beacon referred to here.

  Next, the comfort level of each person in the room is calculated. As the degree of comfort, for example, PMV (Predicted Mean Vote) can be used. Information necessary for the derivation is room temperature, humidity, average radiation temperature, which is a factor affecting indoor environment, and metabolic amount, which is a human factor. The room temperature is obtained from the information of the temperature sensor of the air conditioner 2. The humidity is obtained from the information of the humidity sensor of the air conditioner 2. The average radiation temperature can be calculated using the wall surface temperature and the floor surface temperature shown in the temperature map of the room and the position information of each person in the room. In the calculation of the average radiation temperature, the distance from the wall can be estimated from the image. The height from the ground may be determined on the basis of extension which is data of the owner obtained in advance, or may be estimated from an image. If it is uniformly 1 m from the floor, calculation can be simplified. The amount of metabolism can be calculated from the vital signs of each person in the room.

  Next, analyze the health condition of each person in the room. Moreover, as a relaxation level which is an index of health condition, power of low frequency component (0.04 Hz to 0.15 Hz) by frequency analysis of heart rate fluctuation, power of low frequency component and high frequency component (0.15 Hz to 0.40 Hz) The ratio to the total value of the power of) can be used.

  The operation tentative determination unit 605 determines, for each person, the operation of the external device for providing the most comfortable space to the person in the room, and determines the priority thereof. The operation temporary determination unit 605 performs the human position information analyzed by the human position analysis unit 602, the indoor temperature map information analyzed by the temperature distribution analysis unit 603, and the person's The state information of the person in the room analyzed by the state analysis unit 604 is used. The operation of the external device determined at this time is the optimum operation for each individual.

The operation provisional determination unit 605 performs the operation determination of the external device using the comfort level PMV and the relaxation level. First, when the absolute value of PMV of a person exceeds 1, the operation of the air conditioner 2 is assigned to the person. The mode is cooling if the PMV is a positive value and heating if it is a negative value. The set temperature is determined based on the value of PMV. For example, it can be determined based on the following equation 1 or equation 2 or the like.
Setting temperature = room temperature-sign (PMV) (PMV) ² [Formula 1]
Set temperature = room temperature-sign (PMV) | PMV | [Expression 2]
Here, the priority corresponds to the relaxation level.

  The above description is an example, and when the season is summer and the room temperature is high, it is possible to take measures to stop the cooling without heating even if the PMV is a negative value. If the season is winter, the operation control may be reversed.

  Also, in this case, the operation of the air conditioner 2 was started on the assumption that one person's absolute value of PMV exceeded 1 and it felt uncomfortable, but the absolute value exceeded 0.5 or 1.5. It may be set to be offensive. These set values are design values, and may be a specification that can be freely determined by each person.

  The above operation control can be sequentially performed at predetermined time intervals. In this case, the set temperature is sequentially changed by data collected at predetermined time intervals, and converges to a value that each person feels comfortable It will be done.

  The operation conflict resolution unit 606 determines, with respect to the external device, which of the operations determined by the operation tentative determination unit 605 competes with each other based on the priority calculated by the operation tentative determination unit 605. Decide if you want to do something like this. The determined operation content is transmitted to the operation command transmission unit 607 and the presentation content transmission unit 608. In addition, about the operation which a conflict does not generate | occur | produce, it transmits to the operation command transmission part 607 and the presentation content transmission part 608 as it is.

  Below, the outline of the operation of the operation conflict resolution unit 606 is shown. Detailed steps will be described based on FIG.

  The conflicting operation is an operation in which it is not possible to sort the processing for each person by switching the operation or the like because a plurality of people are in proximity. For example, it is tentatively determined that A and B, who are persons present in a certain room, control to lower the sensible temperature for the air conditioner 2 in the room where they exist and that no particular control is performed for B. It is assumed that the determination is made by the part 605.

If A and B are sufficiently separated, and the operation for A does not affect B due to the right and left blow-off function of the air conditioner 2, the operations can be regarded as not competing.
When the operations do not compete, the operation conflict resolution unit 606 transmits information (data) on the control content of the air conditioner 2 determined by the operation tentative determination unit 605 to the operation instruction transmission unit 607. In addition, the operation conflict resolution unit 606 transmits information (data) relating to the presentation content in order to cause the display unit 4 to present that the operation content transmitted to the operation command transmission unit 607 is executed indoors. Transmit to section 608.

  On the other hand, when A and B are close, and the action on A of the air conditioner 2 affects B, it is considered that the operations are in competition. At this time, the operation conflict resolution unit 606 determines an operation based on the priorities of A and B.

  If the priority of A is high, the operation conflict resolution unit 606 transmits, to the operation command transmission unit 607, information regarding the action of the air conditioner 2 for A determined by the operation tentative determination unit 605. In addition, the action conflict resolution unit 606 causes the presentation content transmission unit 608 to display information about the display content in order to cause the display unit 4 to display that the action based on the information transmitted to the operation command transmission unit 607 is to be performed indoors. Transmit Furthermore, the action conflict resolution unit 606 presents the contents to the portable terminal 3 of B for the purpose of promoting the action of maintaining the body temperature to the B, for example, the action of putting on clothes. Information on the content is transmitted to the presentation content transmission unit 608.

  When the priority of B is high, the operation conflict resolution unit 606 transmits, to the operation command transmission unit 607, information on the action of the air conditioner 2 for B determined by the operation tentative determination unit 605. In addition, the action conflict resolution unit 606 causes the presentation content transmission unit 608 to display information about the display content in order to cause the display unit 4 to display that the action based on the information transmitted to the operation command transmission unit 607 is to be performed indoors. Transmit Furthermore, the operation conflict resolution unit 606 causes the mobile terminal 3 of B to present the contents for the purpose of promoting an operation of lowering the body temperature to A, for example, an operation of blowing the wind of the fan 5 or the like. The information on the presentation content is transmitted to the presentation content transmission unit 608.

  Furthermore, when the priorities of the two compete with each other, for example, when there is almost no difference between the priorities of A and B, and the priority of A slightly exceeds the priority of B, the temporary action determination unit 605 The control content of the air conditioner 2 with respect to the determined A is transmitted to the operation command transmission unit 607 as a new cooling setting temperature with a value obtained by weighting the setting temperature using a factor as a factor. In addition, the action conflict resolution unit 606 causes the presentation content transmission unit 608 to display information about the display content in order to cause the display unit 4 to display that the action based on the information transmitted to the operation command transmission unit 607 is to be performed indoors. Transmit Furthermore, the action conflict resolution unit 606 presents the contents to the portable terminal 3 of B for the purpose of promoting the action of maintaining the body temperature to the B, for example, the action of putting on clothes. Information on the content is transmitted to the presentation content transmission unit 608.

  The operation command transmission unit 607 transmits an operation command through the network to the external device connected to the information processing apparatus 6 via the network among the measures for the external device determined by the operation conflict resolution unit 606.

  Among the measures for the external device determined by the operation conflict resolution unit 606, the presentation content transmission unit 608 causes the user to act on the operation of the external device with respect to the external device not connected with the information processing apparatus 6 via the network. The information for proposing is sent to the portable terminal 3 and the display unit 4. The information transmitted from the presentation content transmission unit 608 is, for example, the installation position, wind power and wind direction as a measure for the fan 5, and as the measure for a person in the room, is there.

  For example, for control regarding the entire room “cooling operation is performed at a set temperature of 28 degrees”, the presentation content transmission unit 608 transmits information for displaying that on the display unit 4. Also, for example, in the case of proposing to an individual that “the cooling operation will be performed. If you feel cold, please put on the jacket, etc.” the presentation content transmission unit 608 is the portable object to be presented. The information is transmitted to the terminal 3.

  FIG. 6 is a flow chart showing the operation procedure of the operation conflict resolution unit in the first embodiment of the present invention. Here, the information used to resolve the competition operation is information related to the operation of the external device for each person in the room and information related to the priority of each operation determined by the operation tentative determination unit 605.

  In the figure, step S101 is a step of a loop start end of the processing performed for all the people in the room in the order of priority of each person. Step S102 is a step of determining whether there is a competition of the operations of the external devices for which the operation has been determined. Step S103 is a step of assigning an operation to an external device. Step S104 is a step of determining whether the difference in priority is sufficiently small with respect to other persons in the room to be subjected to the competing operation. Step S105 is to compete against each other while maintaining the respective comfort levels at a predetermined level for a plurality of people in the room to be subjected to the conflicting action with respect to the external device having the conflicting action It is the process of setting the operation which is not done. Step S106 is a step of setting another action having the same effect as the action presentation content regarding the conflicted action. Step S107 is a step of loop end of the process starting from step S101. Step S108 is a step of transmitting an operation command to the operation command transmission unit 607. Step S109 is a step of transmitting the action presentation content to the presentation content transmission unit 608.

  First, the operation conflict resolution unit 606 sets one person at a time as the processing target in descending order of priority for all the people in the room, and proceeds with the loop processing. Let the whole person who is the target of loop processing be the population, and let it be X. The loop processing is a priority processing performed in order from a person (specimen) having a high priority.

  The loop process is a process in which steps S101 and S107 are loop ends (steps S101 to S107). Here, the loop processing will be briefly described for the person with the highest overall priority, which is assumed to be A here. It should be noted that in the subsequent loop processing, a person with the second highest overall priority is targeted, and in the next loop processing, the target with the third highest overall priority is targeted, and thereafter the loop processing is repeated in order. Processing is repeated one by one in order of people with high overall priority, but since the basic idea is the same, the explanation is omitted here.

  First, it is determined whether a specific external device whose operation has been determined has a conflict with the operation to be performed on the target A (step S102). The operation competition is determined to occur, for example, when setting of a different operation mode is required for the air conditioner 2 or the like. The operation mode is the same, and it is determined that no competition has occurred when there is a difference in mere set temperature.

  Further, for example, in the case of the fan 5, when it is determined that the number of fans 5 more than the number existing in the room is required, it is determined that the operation competition occurs. Moreover, when the person who needs the fan 5 is close to the person who does not need the fan 5 and the wind is applied to one of them, the operation competition occurs if it is determined that the wind inevitably falls on the other I will judge.

  When it is determined that the specific external device whose operation has been determined does not have a conflict in the operation to be performed on C (step S102: no), the operation of the external device is preferentially allocated to C (step S103) ).

In addition, when parameters, such as preset temperature, differ, after weighting using a priority as a factor, a gravity center position is calculated. For example, when the set temperature for one sample is 25 degrees and the priority is 0.4 and the set temperature for the other sample is 28 degrees and the priority is 0.6 among X existing in the room. The set temperature of the entire room is 26.8 degrees according to the following formula 3.
[Equation 3]
25 × 0.4 / (0.4 + 0.6) + 28 × 0.6 / (0.4 + 0.6) = 26.8
If only the set temperature of 1 ° C. can be obtained according to the specifications of the air conditioner 2, it may be rounded to the first decimal place to 27 degrees.

  If a specific external device whose operation has been determined is in competition for the operation to be performed on the second side (step S102: yes), the priority is compared between the second side and the other whose operation is in competition, and the priority is prioritized. It is determined whether the difference between the degrees is sufficiently small (step S104). The target to which the priority is compared is only the person with the highest priority among the set of competitors in the sample of the population X.

  If it is determined that the difference in priority is sufficiently small (step S104: yes), the external device is not satisfied with the external device while satisfying the mutual comfort level between the user and the user who competes with the user. Setting so as not to conflict with the operation to be performed on (step S105).

  For example, with regard to the operation of the air conditioner 2, for the operation mode, the higher priority is given priority, and for the set temperature, as in step S103, the value of gravity center calculation with priority given as the weight is set as the set temperature.

  Also, for example, with regard to the fan 5, when a plurality of people in X want a fan, the fan-shaped position candidate for circular fan, which is an internal division point sequence weighted by the priority between the upper two priority groups, is operated The conflict resolution unit 606 calculates. In the circular fan position candidates, the operation conflict resolution unit 606 searches for a region where the winds emitted by the fan 5 hit the top two priority persons, taking into consideration the swing angle and the air volume of the fan 5 and the like.

  If the area does not exist, an arbitrary place where the wind from the fan 5 hits the person with the highest priority is determined as the position of the fan 5.

  If the area is present, a new area is searched such that the fan 5 emits a wind to a person with the next highest priority. Subsequently, new areas are searched in order of priority, and when there is no new area, an arbitrary place in the immediately preceding search area is determined as the position of the fan 5.

  Furthermore, with regard to the fan 5, the operation conflict resolution unit 606 prevents the person who does not need the wind of the fan 5 from being exposed when a person who needs the wind of the fan 5 and a person who does not need the wind are close. The position of the fan 5 is determined.

  Also, when the operation conflict resolution unit 606 determines that the person who needs the fan 5 is close to the person who does not need the fan 5 and the wind is applied to one of them, the wind inevitably falls on the other side, etc. Make a decision to lower the fan volume.

  If the difference in priority is large (step S104: no), the operation conflict resolution unit 606 determines the operation for a person with high priority as it is as the operation of the device. On the other hand, with respect to a person whose priority is considered to be low, another action having the same effect is set as the action presentation content with respect to the competing action (step S106).

  For example, it is described below about the case where the temperature of the air conditioner falls against the comfort level of the person who is considered to be low priority, because the priority is low. In such a case, the action conflict resolution unit 606 determines the action presentation of putting on a long sleeve for the person. In addition, when the temperature of the air conditioner rises against the degree of comfort of the person, the fan 5 is placed at a position close to the person or the action of removing the heat source causing the temperature unevenness in the room is presented. Decide.

  After loop processing is performed on all the samples of the population X (step S107), the motion conflict resolution unit 606 transmits the motion command determined in the loop processing to the motion command transmission unit 607 ( Step S108). The operation command to be transmitted is an operation process performed by an external device connected to the information processing apparatus 6 through the network among the determined operation processes of the external device.

  Next, the action conflict resolution unit 606 transmits information on the action presentation content determined in the loop processing to the presentation content transmission unit 608 (step S109). The information transmitted to the display unit 4 affects the environment of the entire room, and the information transmitted to the portable terminal 3 affects the experience of the owner.

  As described above, according to the device control system in the present embodiment, when there are a plurality of people in the room, the operation of the home appliance for providing an efficient and comfortable environment for each person is provided. it can.

  In addition, when competition occurs in the operation of the home appliance among the persons, the information for the elimination thereof is transmitted to the home appliance solution through the network, so that each person is efficient and comfortable. Can provide the operation of home appliances to provide a comfortable environment.

  In addition, with regard to the operation for home appliances that are not connected to the network, by using the display section of the home appliance connected to the network, by proposing the operation to each person, an efficient and comfortable environment for each person Can provide the operation of the home appliance to bring.

Second Embodiment
FIG. 7 is a block diagram showing an example of the configuration of the information processing apparatus in the second embodiment of the present invention. The configuration of the information processing apparatus in the above embodiment differs from the configuration of the information processing apparatus in the above embodiment in that the information processing apparatus 6 includes a received data storage unit 609. The received data storage unit 609 has a function of storing the information acquired by the reception unit 601 and the information analyzed by the human position analysis unit 602 and the human condition analysis unit 604. Further, the received data storage unit 609 has a function of transmitting the stored information to the respective blocks in response to a request from the human position analysis unit 602, the human state analysis unit 604, and the temporary movement determination unit 605.

  According to this configuration, the person position analysis unit 602, the person's condition analysis unit 604, and the motion predetermination unit 605 can also use the information stored in the received data storage unit 609 as each input. It differs from the first embodiment.

  The human position analysis unit 602 can acquire detection data of a human position at a predetermined time in the past from the received data storage unit 609. In the present embodiment, in addition to the input information in the first embodiment, the human position analysis unit 602 detects detection data of the human position at a predetermined time in the past, and performs rule-based processing, for example, It becomes possible to analyze the position of the person at the current time more accurately by combining with such rules as “does not appear or disappear”.

  In addition, the human position analysis unit 602 acquires position information of a person at a predetermined time in the past from the received data storage unit 609, so that not only the position information of the person but also the movement route of the person is analyzed. Can be transmitted to

  The state analysis unit 604 of the person can obtain the moving route of the person and the correspondence relationship between the portable terminal owner information of the person in the room detected at a predetermined time in the past and the person area from the received data storage unit 609. .

  In the present embodiment, in addition to the input information in the first embodiment, the human condition analysis unit 604 determines the movement route of the person, and the position of the person detected at a predetermined time in the past and the portable terminal owner information In the image at a certain time, it is possible to associate the person whose face is not shown with the portable terminal owner information by using the association data with.

  The movement tentative determination unit 605 can obtain time-series data from the reception data storage unit 609, including the movement route of the person and the change of the state of the person according to the time-series.

  In the present embodiment, in addition to the input information in the first embodiment, the operation tentative determination unit 605 further includes the reception data storage unit 609 in addition to the input information in the first embodiment. Time series data of the state of each person in the room can be newly used as input information. Therefore, it is possible to predict, for example, the state of a person several minutes ahead by performing operations such as linear regression using time series data. As a result of predicting the state of the person, if it is found that the state of comfort of the person is significantly reduced, the operation tentative determination unit 605 may determine the operation of the external device to prevent the state from becoming the situation in advance. it can.

  For example, if the PMV value of a person does not exceed 1 but tends to rise, it is possible to suppress the rise in PMV by lowering the heating setting temperature, and the person seems to be more comfortable Environment can be provided efficiently.

  According to the above, in the present embodiment, the reception data storage unit accumulates the information of the external device acquired in the past, so that the movement route of the person, the indoor temperature map, and the person more accurate than those of Embodiment 1 are obtained. It is possible to obtain time series data including the state of. Moreover, since the operation of each external device can be determined based on the state of the person predicted from the time-series data, the degree of comfort of the person can be prevented in advance from being greatly reduced for a plurality of people in the room. Can effectively provide an environment where people are more comfortable.

Third Embodiment
FIG. 8 is a block diagram showing an example of a configuration of an information processing device in Embodiment 3 of the present invention. The figure differs from the configuration of the information processing apparatus in the above embodiment in that the information processing apparatus 6 includes an indoor monitoring unit 610.

  The indoor monitoring unit 610 receives the presentation content after the presentation content transmission unit 608 transmits the presentation content to the portable terminal 3 and the display unit 4, and then the reception unit 601 determines whether the person in the room actually performed the action according to the presentation content. Has a function to monitor using the information acquired by

  In addition, when the person in the room does not perform the action in accordance with the presented content, the indoor monitoring unit 610 provides the temporary work determination unit 605 with the most comfortable space for the person in the room. It has a function of determining the operation of the external device for each person in the room and calculating the priority thereof. In the operation of the temporary movement determination unit 605, it is assumed that the device whose movement is not performed by the person in the room is not the target of the movement determination. This embodiment differs from the above-described embodiment in that processing is performed to verify whether or not an action based on the information transmitted from the presentation content transmission unit 608 has been made, and to feed back to the temporary operation determination unit 605.

  For example, it is assumed that a specific person is urged to “wear a long sleeve” through the display screen of the portable terminal 3. After the predetermined time has elapsed, the clothes of the person are verified based on the infrared sensor image. In this case, for example, it may be verified with reference to what area the temperature distribution indicating a temperature close to the body temperature occupies in both arms.

  Further, for example, it is assumed that a display prompting to change the position of the fan 5 is performed on the display unit 4 placed in the room. In this case, for example, after a predetermined time has elapsed, it is verified based on the image information whether there is a fan at a position prompting to change. In this case, the shape of the fan 5 may be stored in advance in the storage unit of the information processing device 6, and the position of the fan 5 may be determined based on where the image along the shape is present on the screen.

  As described above, in the present embodiment, after the action presentation, whether or not the action was performed is verified, and the presented action content is in the room by feeding back the result to the operation temporary determination unit. Even if it is not acceptable to people, it is possible to determine the operation of the external device to provide the most comfortable space for people in the room after excluding the action from the action presentation target. it can.

Reference Signs List 1 home appliance control system 2 air conditioner 201 communication unit 202 temperature sensor 203 humidity sensor 204 camera 205 infrared camera 206 air conditioning unit 3 portable terminal 301 communication unit 302 presentation unit 310 vital sign measurement device 311 communication unit 312 vital sign acquisition unit 4 display unit 401 communication unit 402 presentation unit 5 fan 6 information processing apparatus 601 reception unit 602 human position analysis unit 603 temperature distribution analysis unit 604 human condition analysis unit 605 motion temporary determination unit 606 motion conflict resolution unit 607 motion command transmission unit 608 presentation content transmission Part 609 Received data storage part 610 Indoor monitoring part

Claims (5)

A home appliance having a predetermined sensor;
A mobile terminal,
An information processing apparatus capable of bi-directional communication with the home appliance and the portable terminal;
Device control system with
The information processing apparatus is
A receiver configured to receive the information acquired by the sensor or the information possessed by the mobile terminal;
An accumulation unit that accumulates the information received by the reception unit;
A person position analysis unit that analyzes position information of a person present in a predetermined space from the stored information or the received information;
An environment analysis unit that analyzes the environment of the predetermined space from the accumulated information or the received information;
A human condition analysis unit that analyzes the condition of a person present in the predetermined space from the accumulated information or the received information;
As a result of analysis by the human position analysis unit, as a result of analysis by the environmental analysis unit, as a result of analysis by the human condition analysis unit, the predetermined based on position information of the person, environment of the space and condition of the person An operation temporary determination unit which determines the operation of the home electric appliance for each person in the space and further determines the priority among the people in the predetermined space for each person;
If there is operation to compete during the operation of the home appliance determined by the operation provisional determining unit, the operation as an operation of the home appliance for people with high the priority of the person operating the home appliance compete The temporary determination unit instructs the person with low priority to operate the home appliance determined while operating the external device that does not perform two-way communication with the information processing apparatus or promotes the person's action. An apparatus control system characterized by indicating contents. The apparatus according to claim 1, wherein information related to control of the external device not performing bidirectional communication is displayed on a display device capable of bidirectional communication with the information processing apparatus or a display unit of the portable terminal. Control system. Equipment control system according to claim 1, characterized in that to said information processing apparatus and capable of bidirectional communication display device or display unit of the mobile terminal, to display information about the person's behavior. Verifying the implementation status of information displayed on the display unit capable of bi-directional communication with the information processing apparatus or the display unit of the portable terminal, and controlling the external device not performing bi-directional communication based on the verified result The device control system according to claim 2 or 3 , characterized in that A home appliance having a predetermined sensor and an information processing apparatus capable of performing two-way communication with a portable terminal are apparatus control methods for controlling the home appliance,
Receiving information acquired by the sensor or information possessed by the mobile terminal;
Accumulate the received information,
Analyzing position information of a person who is in a predetermined space from the stored information or the received information;
Analyzing the environment of the predetermined space from the accumulated information or the received information;
Analyzing the state of the person present in the predetermined space from the accumulated information or the received information;
Based on the analysis results, the position information of the person, the environment of the space, and the state of the person, the operation of the home appliance is determined for each person with respect to the person in the predetermined space,
Furthermore, the priority among the people in the predetermined space is determined for each person,
When there is a conflicting action between the actions of the home appliance determined for each person, the home appliance determined as the action of the home appliance with respect to the person with high priority among the people competing with the action of the home appliance And instructing the person having the low priority to operate an external device that does not perform two-way communication with the information processing apparatus or instructing the person having the low priority to operate, or instructing a person to perform an action. Device control method.

Images