JP2009087074A - Equipment control system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an equipment control system capable of automatically controlling each control object equipment with accurate control contents by detecting a user's behavior in a house in addition to presumption of feelings. <P>SOLUTION: The equipment control system has multiple kinds of control object equipment Ld arranged in the house M. A home server Sv presumes the user's feelings and detects the user's behavior using the output of a feeling sensor means Se and a behavior sensor means Sm. A determining section determines control contents referring to a control content storage section 14 associating a combination of the user's feelings and behavior with the control contents of the control object equipment Ld. The control object equipment Ld is operated according to the control contents by a control signal generated by an output section 15 according to the control contents. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a device control system that automatically controls a plurality of control target devices arranged in a house according to a user's mood and behavior without instructing the user.

  Generally, a user's instruction is required to control devices such as lighting devices, AV devices, and air conditioning devices arranged in a house. Some devices are controlled according to the time schedule, but the control content is simply related to the time, so the operation of the device may not match the user's mood. For example, even at the same time, it is desirable to adjust the light intensity and color tone of the lighting in a relaxed and comfortable state and a state of discomfort such as stress buildup. Even if the device is controlled only by the schedule, this kind of device control cannot be performed.

On the other hand, although it is limited to music playback, it estimates at least one of mental and physical situations based on keywords and prosody information (prosodic information) contained in the user's utterances, and estimates A music playback device that classifies results into preset categories and plays back music data belonging to the categories has been proposed (see, for example, Patent Document 1). In the music reproduction device described in Patent Document 1, “sleepy”, “tired”, “tired and sleepy”, “irritated”, “not feeling well”, “fun”, “relaxed” It has been proposed that music is automatically selected according to the situation and the mental and physical situations are improved or the music is not reproduced.
JP 2005-49773 A

  The technique described in Patent Literature 1 estimates a user's mental state and physical state for the purpose of selecting music pieces. In other words, in a single control target device (music playback device), it is used for the purpose of selecting the control contents (music) and only the music is selected, so only estimation of the user's emotion is performed. .

  However, if there are multiple types of devices to be controlled in the house, there are many control contents compared to the selection of music, so the control contents are specified only by estimating the mental situation and the physical situation. I can't.

  For example, it is necessary to change the control target device according to the location where the user exists, and when there are multiple types of control target devices in the same location, which control target device should be instructed to control Cannot be determined solely by estimation of mental and physical conditions.

  The present invention has been made in view of the above-mentioned reasons, and its purpose is to automatically detect each control target device with accurate control contents by detecting a user's behavior in a house in addition to emotion estimation. It is an object of the present invention to provide a device control system that can be controlled.

  The invention of claim 1 includes a plurality of types of control target devices arranged in a house, a behavior detection unit that detects a user's behavior in the home, an emotion estimation unit that estimates a user's emotion, and a behavior detection unit. A control content storage unit that associates the combination of the detection result of the detection and the estimation result of the emotion estimation unit with the control content of each control target device, and the detection result of the behavior detection unit and the estimation result of the emotion estimation unit for a specific control target device A determination unit that extracts the control content related to the combination from the control content storage unit, and an output unit that outputs a control signal corresponding to the control content extracted by the determination unit to the control target device It is characterized by.

  The emotion mainly means feelings of pleasure / discomfort. When estimating emotions, emotions are equivalent to emotions in the comfort direction, and emotions are equivalent to feelings in the direction of discomfort. Further, the action means the whole series of actions that can be classified into one category, and means, for example, meal, bathing, washing, sleeping. However, if it cannot be classified into one category but can be expressed as a series of actions, it may be treated as an action. For example, there is a case where an action of moving along a route of bedroom → toilet → entrance → living room is regarded as an action. The specific control target device means a control target device that is determined in advance or a control target device that is determined by the behavior detected by the behavior detection unit.

  In the invention of claim 2, in the invention of claim 1, the emotion estimation unit estimates a user's emotion existing in an effective area affected by each control target device, and the specific control target device is: The user whose emotion is estimated by the emotion estimation unit is a control target device existing in the effective area.

  In the invention of claim 3, in the invention of claim 1 or claim 2, the emotion estimation unit includes a plurality of emotion sensor means for detecting information emitted from the user's body, and an output pattern of the emotion sensor means. Emotion classification means for classifying into any of a plurality of prescribed emotions, and emotion classification means, the control content storage unit, the determination unit, and the output unit are provided in a home server that is a computer server, and emotion sensor means And the device to be controlled are connected to a home server via a communication network.

  The emotion sensor means can be a TV camera that captures the user's face, a thermo camera that detects changes in the user's body temperature without contact, a microphone to which the user's voice is input, etc. The emotion is classified from the facial expression change pattern, the emotion is detected from the body temperature change pattern detected by the thermo camera, and the emotion is classified from the phoneme information and prosodic information (prosody information) included in the speech.

  According to a fourth aspect of the present invention, in the third aspect of the invention, the behavior detection unit determines a behavior of a user by using, as behavior information, control information transmitted when the in-home server controls the control target device. It is characterized by comprising an action determination means.

  According to a fifth aspect of the present invention, in the third or fourth aspect of the present invention, the behavior detection unit is provided in behavior sensor means for detecting the positions of users installed at a plurality of locations in a house, and in the in-home server. And action determination means for determining a user's action using information detected by the action sensor means as action information.

  According to a sixth aspect of the present invention, in the invention according to any one of the third to fifth aspects, the behavior detecting unit is provided in a number detecting means for counting the number of persons existing within a prescribed range in a house, and in the home server. And a behavior determining means for determining a user's behavior using the number of people detected by the number of people detecting means as behavior information.

  According to a seventh aspect of the present invention, in the invention according to any one of the third to sixth aspects, the in-home server includes a control period for instructing the control target device about the control content extracted by the determination unit, and the control target device includes: An evaluation period for estimating the emotion of the user after being controlled by the emotion estimation unit and determining the change direction of the emotion, and the change direction of the emotion determined in the evaluation period is an uncomfortable direction with respect to the control period It is characterized in that the control content instructed in the control period is canceled at a certain time to return to the previous state.

  In the invention of claim 8, in the invention of claim 7, the in-home server adds a specified score when the change direction of the emotion determined in the evaluation period is a comfortable direction with respect to the control period, and changes the emotion A score storage unit for storing the emotion score obtained by subtracting the specified score when the direction is an uncomfortable direction with respect to the control period in association with the control content, and the output unit includes a new determination unit When the control content is extracted, if the emotion score stored in the score storage unit for the control content is equal to or less than the predetermined score, the control signal corresponding to the control content is not output to the control target device. Features.

  In the invention of claim 9, in the invention of claim 7, the in-home server adds a specified score when the change direction of the emotion determined in the evaluation period is a comfortable direction with respect to the control period, thereby changing the emotion. When the direction is an uncomfortable direction with respect to the control period, the score storage unit that stores the emotion score obtained by subtracting the specified score in relation to the control content, and when the determination unit extracts new control content And a confirmation means for presenting the control content to the user and having the user select whether or not the control content is appropriate if the emotion score stored in the score storage unit for the control content is equal to or less than a predetermined score. Features.

  In the invention of claim 10, in the invention of claim 9, the confirmation means generates new control contents based on the control contents extracted from the control contents storage unit and presents them to the user, and whether the control contents are appropriate or not. The control signal corresponding to the control content is output to the control target device when there is a response indicating that the control content is appropriate for the presented control content.

  According to the configuration of the invention of claim 1, the combinations of the user's emotion and the user's behavior in the house are classified into categories, and the control target device is controlled with the control content corresponding to the classified category. By using not only the user's emotion but also the action, it is possible to accurately determine the control content and automatically and accurately control the control target device without waiting for the user's instruction.

  According to the configuration of the second aspect of the present invention, the effective area that is the range affected by the control target device (for example, if the control target device is a video device, the region where the displayed video can be viewed is the effective region, and the control If the target device is a luminaire, the area illuminated by the luminaire becomes the effective area), and the control target device is controlled according to the user's emotion. When is controlled, the influence of the control of the control target device can be immediately reflected in the emotion of the user.

  According to the configuration of the invention of claim 3, the emotion classification means for classifying the emotion from the output pattern of the emotion sensor means, the control content storage section, the judgment section and the output section are provided in the home server, and the emotion sensor means and the control target device Are connected to the in-house server via a communication network, and while the in-home server is arranged in one place in the house, the emotion sensor means and the control target device are arranged in any place in the house, and various control objects Devices can be centrally managed and controlled by a home server.

  According to the configuration of the invention of claim 4, the control information that the home server controls the control target device is used as the behavior information, and the control information that indicates which control target device is controlled by the home server is used. It is used interchangeably with action information of where and what the person is doing. By adopting this configuration, it is possible to detect the user's behavior from the operation of the existing control target device and the content of the control without using a sensor or the like for detecting the user's behavior.

  According to the configuration of the invention of claim 5, since the behavior sensor means for detecting the user's behavior is provided, the user's behavior can be accurately grasped.

  According to the configuration of the invention of claim 6, by counting the number of people, it can be used as information for detecting the user's behavior. For example, it is used as additional information to distinguish whether there are multiple people or only one person, whether the user is talking or eating. Can do.

  According to the configuration of the invention of claim 7, after controlling the control target device, it is determined whether the user feels comfortable or uncomfortable by the control, and when it feels uncomfortable, the control of the control target device is controlled. Returning to the state can alleviate discomfort.

  According to the configuration of the invention of claim 8, the reliability of control can be improved by digitizing emotions and expressing them as emotion scores. Further, since the emotion score at the time of the previous control is used, it becomes possible to perform control that is more comfortable for the user with reference to the past control content.

  According to the configuration of the invention of claim 9, when the control content for controlling the device to be controlled is extracted, and the control content is control content that the user has felt uncomfortable in the past, the control content is given to the user. By confirming, the user is allowed to select whether or not the control content is permitted, so that the user can perform more comfortable control.

  According to the configuration of the invention of claim 10, new control content is generated from the control content stored in the control content storage unit and presented to the user, the user is allowed to select whether the presented control content is appropriate, If there is a response that the user has determined to be appropriate, the control target device is controlled using the control content, so that the user's request can be taken in and control that is more comfortable for the user is possible.

  In the present embodiment, as shown in FIG. 2, a plurality of types of control target devices Ld arranged in a house M are connected to a home network NT that is a communication network, and a control target is transmitted from the home server Sv that is a computer server through the home network NT. A configuration for controlling the device Ld is employed. The home network NT uses LAN technology having a wired or wireless transmission path and power line carrier communication technology.

  The control target device Ld is a device that affects the mood of the user by its operation, and includes a lighting device, an AV device, an air conditioning device, an electric blind, and the like.

  For example, in the case of lighting equipment, the user relaxes or becomes nervous due to differences in brightness, color, lighting position (ceiling lighting, wall lighting, etc.), and light distribution (direct lighting, indirect lighting, etc.). Will do. In addition, differences in content / type, volume, brightness, etc., for AV equipment, and differences in temperature and humidity, for air conditioning equipment, affect user emotions. The content in the AV device means music, a language learning program, news, and the like. If the type is music, it means classic, jazz, pop or environmental music.

  Devices that are not controlled devices Ld may be connected to the in-home server Sv via the in-home network NT. By connecting devices such as refrigerators and washing machines to the in-home network NT, the usage state of these devices Can be managed by the in-home server Sv, and remote monitoring control of these devices can be performed via the in-home server Sv.

  The home net NT is also connected with behavior sensor means Sm and emotion sensor means Se. Although various configurations can be adopted for the behavior sensor means Sm, here, human sensors installed at a plurality of locations in the house M, TV cameras for photographing the user's body, control targets Assume a position sensor including an operation unit that gives an instruction to the device Ld. When the human sensor or TV camera is used as the behavior sensor means Sm, by registering information on the location where the human sensor, TV camera, and control target device Ld are installed in the in-home server Sv, the user's Since an existing position (such as a room) can be known, the operation unit of the human sensor, the TV camera, and the control target device Ld functions as a position sensor. The output of the behavior sensor means Sm includes the output time, the operation amount of the operation unit of the control target device Ld, and the like.

  The emotion sensor means Se is assumed to be a microphone to which the user's voice is input, a TV camera that captures the user's face, a thermo camera that detects the user's body temperature, and the like. The emotion sensor means Se is provided in the house M in a range that covers the effective area due to the operation of each control target device Ld. When the user is allowed to wear it, an electroencephalogram sensor worn on the head may be used as the emotion sensor means Se.

  The effective region affected by the operation of the control target device Ld is a region that is illuminated if the control target device Ld is a lighting device, and if the control target device Ld is an AV device, listening to sound or watching a video. If the control target device Ld is an air conditioner, the temperature and humidity are adjusted. The effective area often corresponds to one room in the house M, but it may extend over a plurality of rooms or be a place other than a room.

  Further, the control target device Ld controlled by the user's behavior and emotion does not have to be present in the effective area of the control target device Ld. For example, the control target device Ld may be a water heater that supplies hot water to a bathtub, and the temperature of the hot water supplied may be adjusted according to emotions and actions when the user is in the living room.

  As shown in FIG. 1, the in-home server Sv includes an emotion classification means for classifying into one of a plurality of types of emotions using the output pattern of the emotion sensor means Se (feature quantity distribution or feature quantity temporal change pattern). 11 is provided. That is, an emotion estimation unit is configured by the emotion sensor means Se and the emotion classification means 11.

  When a microphone is used as the emotion sensor means Se, the emotion classification means 11 classifies emotions by extracting a keyword (vocabulary representing emotion) from phonological information and adding prosodic information (prosody information). When a TV camera that captures a face is used, emotions are classified based on facial expressions (positional relationships and history of each part) using face recognition technology. Alternatively, when a thermo camera is used, emotions are classified based on changes in body temperature and changed parts, and emotions are classified based on the type of electroencephalogram detected by the electroencephalogram sensor.

  In the present embodiment, the case where a microphone is used as the emotion sensor means Se is illustrated, and the emotion classification means 11 extracts phonological information from the output of the microphone and matches a keyword registered in the dictionary in advance with a keyword extraction unit 11a. A prosody information extraction unit 11b that extracts prosody information from the output of the microphone, and a classification unit 11c that classifies emotions by combining the keywords extracted by the keyword extraction unit 11a and the prosodic information extracted by the prosody information extraction unit 11b Is provided.

  In the keyword extracting unit 11a, an attribute related to emotion (such as emotions) is given to each keyword, and if the attribute and prosodic information are input to the classifying unit 11c, the emotion set in advance in the classifying unit 11c. Can be classified. As the classification unit 11c, for example, a neurocomputer can be used.

  The neurocomputer can be used with either a computer with a teacher signal or a competitive learning type without a teacher signal. Since the generation of learning data is somewhat troublesome, it is preferable to have a teacher signal. In this embodiment, the emotions classified by the classification unit 11c are classified into three categories: comfortable (satisfied), unpleasant (unsatisfied), and normal.

  The detection output of the behavior sensor unit Sm is input to the behavior determination unit 12 to determine the user's behavior. The user's behavior is classified into a plurality of categories similar to emotions. An action means the whole of a series of actions that have been given meaning. Therefore, meals, bathing, washing, sleeping, etc. are actions. In addition, an action of moving along the route bedroom → toilet → entrance → living is also an action. Furthermore, there is a case where at least one piece of information on the location of the user, the time zone, the attitude of the user, and the operation of the control target device Ld (or control information from the home server Sv to the control target device Ld) is used as the action information. .

  For example, if the place is in the kitchen and the time zone is between 4 pm and 6 pm, it can be determined that the action is cooking, the place is in the living room, the posture is lying down or sitting, and the TV If it is lit, it can be judged as an action of watching TV in the living room.

  The behavior determination unit 12 uses the behavior information obtained from the behavior sensor unit Sm or the control information given to the control target device Ld as the behavior information, and classifies and determines the behavior from the behavior information as described above. That is, the behavior detection unit is configured by the behavior sensor Sm and the behavior determination unit 12. Since the movement path may be determined for the action determination, the action determination means 12 may be provided with a function for storing the action history within the unit period and determining the action type. In this case, a storage area of the action history storage unit 12a provided in the action determination unit 12 is secured so that an action history for each unit period (fixed time) can be stored, and the action information and the action information in the unit period are stored. What is necessary is just to register a pair with the generation time as an action history.

  The emotion estimated by the emotion classification unit 11 and the behavior determined by the behavior determination unit 12 are input to the determination unit 13, and the combination of the emotion and the behavior is stored in relation to the control content of each control target device Ld. The determination content is collated with the stored content of the control content storage unit 14. That is, in the control content storage unit 14, as shown in Table 1, a set of the emotion classified by the emotion classification unit 11 and the behavior determined by the behavior determination unit 12 is previously controlled by each control target machine Ld. When the emotion classification unit 11 estimates the user's emotion and the behavior determination unit 12 detects the user's behavior, the determination unit 13 determines the combination of the emotion and the behavior by the control content storage unit. 14 is matched. As the collation result, the determination unit 13 obtains the control content, so that the output unit 15 gives the control content, and generates a control signal to each control target device Ld corresponding to the control content.

  The control target device Ld is given a control signal from the output unit 15 when the control target device Ld exists in the effective region where the user whose emotion is classified by the emotion classification unit 11 exists. In the example of Table 1, the video displayed on the television screen may be a television program, or may be a video stored in the home server Sv in advance. Further, when the home server Sv is connected to a wide area communication network such as the Internet, video data may be acquired on demand. The same applies to music. In the example of Table 1, AV equipment (television and audio equipment) and lighting equipment (healing light) are used as the control target equipment Ld.

  With the above-described configuration, an accurate control signal can be given to each control target device Ld from a combination of action and emotion, and the control target device Ld is automatically and accurately operated without any operation by the user. It becomes possible to make it.

  By the way, as described above, the control information transmitted from the home server Sv when controlling the control target device Ld can be used as the behavior information used in the behavior determination unit 12. In the example of Table 1, there is an action of watching TV, which is equal to the information that the TV is turned on, that is, the TV is turned on by a control signal from the home server Sv, or the user turns on the TV. This means that the home server Sv recognizes that

  In other words, the control information for controlling the control target device Ld can be read and used as behavior information indicating where and what the user is doing. Alternatively, the number of behavior sensor means Sm can be reduced. In addition, the user's behavior can be detected from the operation of the existing control target device Ld and the content of the control. By using the control information as the behavior information in this way, it becomes possible to detect the behavior without using the behavior sensor means Sm such as a human sensor or a TV camera.

  By the way, when the action history is stored in the action history storage unit 12a, a combination of the action information and the occurrence time of the action information and the determined action is set as an action event, and the action history is generated when new action information is generated. It is possible to determine the user's action with reference to past action events stored in the storage unit 12a. When the action is determined from the action history, the current action can be determined in consideration of the time zone during which the action is performed, so that the action can be detected more accurately.

  In the above-mentioned example, it is assumed that the behavior of one user is detected by the behavior sensor means Sm. However, when an imaging device such as a TV camera is used for the behavior sensor means Sm, it is used by computer image processing. Since the number of persons can be known, the number of persons may be included in the behavior information. In this case, an arithmetic processing device (computer) that performs computer image processing is provided in the home server Sv, and this arithmetic processing device functions as a number detection means for counting the number of people.

  If you count the number of people, for example, if you are alone in the living room and your emotions are estimated to be comfortable, an educational video like a language learning program is displayed on the TV, and there are multiple people in your living room When the emotion is estimated to be comfortable, the user can select to display a movie on the television. Or, if you combine the action information of whether there are multiple people or only one person with the time zone as the action information, whether the user is talking or eating It can be used for information to be estimated.

  In addition, when there are a plurality of people, the emotions of individual users are evaluated and consensus is formed. For consensus building, the simplest is to evaluate by majority vote whether the direction of emotion changes is more comfortable or uncomfortable. Alternatively, consensus may be formed by scoring each user's emotion and weighting the user, and evaluating the result of the weighted addition. In this case, it is necessary to individually recognize the user using a face recognition technique or the like.

  The control content acquired by the determination unit 13 by estimating the emotion and detecting the behavior is information preset in the control content storage unit 14, and even if the control is performed, the user is not necessarily satisfied. Of course, depending on the content of the control, such as displaying a language learning program on a TV, there are some control content that must be enforced regardless of whether the user wants it or not. It is inconvenient that the control content not to be selected is selected.

  In order to evaluate whether or not the control content output from the determination unit 13 satisfies the user, it is only necessary to evaluate a change in the emotion of the user before and after the control of the control target device Ld. Therefore, in the operation of the home server Sv, a control period for instructing the control target device Ld about the control content extracted by the determination unit 13 and the emotion of the user after the control target device Ld is controlled are sent to the emotion estimation unit (emotion sensor). There is provided an evaluation period for estimating the change direction of emotion estimated by means Se and emotion water distribution means 11).

  The home server Sv is provided with a control evaluation unit 16 that stores the emotion estimated during the control period and compares it with the emotion estimated during the evaluation period. The control evaluation unit 16 shifts from the control period to the evaluation period. When the emotion change direction is an uncomfortable direction, the control contents instructed in the control period are canceled and the previous state is restored. For example, when the control content of the transition from the stop to the operation of the air conditioner that is the control target device Ld is selected in the control period and it is determined that the direction is uncomfortable in the evaluation period, the air conditioner is stopped.

  By such an operation, when the user's emotion changes unpleasantly according to the automatically selected control content, it is possible to return to the previous state and to control the control target device Ld so that the user does not feel uncomfortable. Is possible. Although the user's emotions were comfortable during the control period, the direction of change was also an uncomfortable direction when the user's emotions changed normally during the evaluation period. Absent.

  The emotion change direction may be scored as an emotion score depending on whether the emotion change direction is a comfortable direction or an uncomfortable direction, and the instruction to the control target device Ld may be changed according to the emotion score. In this case, the control evaluation unit 16 adds a specified score (for example, 1 point) when the emotion change direction determined during the evaluation period is a comfortable direction, and specifies when the emotion change direction is an uncomfortable direction. The emotion score is obtained by subtracting the score (for example, 1 point), and is stored in the score storage unit 17 in relation to the control content selected by the determination unit 13. In the output unit 15, when the emotion score stored in the score storage unit 17 with respect to the control content when the determination unit 13 extracts new control content is equal to or less than a predetermined score (for example, a negative number), the control is performed. The control signal corresponding to the content is not output to the control target device Ld. In this operation, since the emotion score at the previous control is used, it becomes possible to perform control that is more comfortable for the user with reference to the past control content.

  In the above operation example, the control signal to the control target device Ld is not output when the emotion score is equal to or less than the predetermined score, but the confirmation means (a combination of the display and the operation unit is provided in the man-machine interface). ) 18 is provided, and when the emotion score is equal to or less than a predetermined score, the confirmation means 18 may present the control content to the user and allow the user to select whether the control content is appropriate. By making the user confirm the control content, the user can select whether or not the control content is permitted, so that the user can perform more comfortable control.

  Further, when the emotion score is equal to or lower than the predetermined score, the confirmation means 18 modifies the control content selected from the control content storage unit 14 to generate new control content, and uses the newly generated control content. It may have a function to be presented to a person. In this case, when the user selects whether the control content newly generated by the confirmation means 18 is appropriate and accepts the presented control content (that is, the control content is recognized as appropriate), the control content is selected. A control signal according to the above may be output to the control target device Ld. In this operation, the user's request can be taken in, and control that is more comfortable for the user becomes possible.

It is a block diagram which shows embodiment. It is a schematic block diagram same as the above.

Explanation of symbols

11 Emotion classification means (Emotion estimation unit)
12 Behavior determination means (Behavior determination unit)
12a Action history storage means 13 Judgment part 14 Control content storage part 15 Output part 17 Point storage part 18 Confirmation means M Residential NT Communication network Ld Control target device Se Emotion sensor means (Emotion estimation part)
Sm Behavior sensor means (behavior determination unit)
Sv home server

Claims (10)

  Multiple types of control target devices arranged in a house, a behavior detection unit that detects user behavior in the home, an emotion estimation unit that estimates user's emotion, a detection result and an emotion estimation unit of the behavior detection unit The control content storage unit that associates the combination of the estimation result with the control content of each control target device, and the combination of the detection result of the behavior detection unit and the estimation result of the emotion estimation unit for a specific control target device A control unit comprising: a determination unit that extracts the control content from the control content storage unit; and an output unit that outputs a control signal corresponding to the control content extracted by the determination unit to the control target device. .   The emotion estimation unit estimates a user's emotion that exists in an effective area affected by each control target device, and the specific control target device is included in the effective region by a user whose emotion is estimated by the emotion estimation unit. The device control system according to claim 1, wherein the device is a control target device.   The emotion estimation unit includes a plurality of emotion sensor means for detecting information emitted from the user's body, and an emotion classification means for classifying the output pattern of the emotion sensor means into one of a plurality of prescribed types of emotions. The emotion classification unit, the control content storage unit, the determination unit, and the output unit are provided in a home server that is a computer server, and the emotion sensor unit and the control target device are connected to the home server via a communication network. The device control system according to claim 1, wherein the device control system is a device.   4. The behavior detection unit includes behavior determination means for determining a user's behavior by using, as behavior information, control information transmitted when the in-home server controls the control target device. Equipment control system.   The behavior detection unit includes behavior sensor means for detecting positions of users installed at a plurality of locations in a house, and user behavior using information detected by the behavior sensor means provided in the home server as behavior information. The device control system according to claim 3, further comprising behavior determination means for determining   The behavior detection unit determines a user's behavior by using, as behavior information, a number detection unit that counts the number of people existing within a specified range in a house, and the number of people detected by the number detection unit provided in the home server. The device control system according to claim 3, further comprising an action determination unit.   The home server uses the control period for instructing the control target device to control the content extracted by the determination unit, and the emotion estimation unit estimates the emotion of the user after the control target device is controlled. When the change direction of the emotion determined during the evaluation period is an uncomfortable direction with respect to the emotion during the control period, the control content instructed during the control period is canceled and returned to the previous state. The device control system according to any one of claims 3 to 6, wherein the device control system is configured as described above.   The in-home server adds a specified score when the emotion change direction determined in the evaluation period is a comfortable direction with respect to the control period, and is specified when the emotion change direction is an uncomfortable direction with respect to the control period. A score storage unit that stores the emotional score obtained by subtracting the score in relation to the control content, and the output unit scores points for the control content when the determination unit extracts new control content 8. The device control system according to claim 7, wherein if the emotion score stored in the storage unit is a predetermined score or less, a control signal corresponding to the control content is not output to the control target device.   The in-home server adds a specified score when the emotion change direction determined in the evaluation period is a comfortable direction with respect to the control period, and is specified when the emotion change direction is an uncomfortable direction with respect to the control period. A score storage unit that stores the emotional score obtained by subtracting the score in relation to the control content, and when the determination unit extracts new control content, the control content is stored in the score storage unit. 8. The device control system according to claim 7, further comprising confirmation means for presenting the control content to the user and having the user select whether or not the control content is appropriate when the emotion score is equal to or less than a predetermined score.   The confirmation means generates a new control content based on the control content extracted from the control content storage unit and presents the control content to the user, and allows the user to select whether the control content is appropriate. 10. The device control system according to claim 9, wherein when there is a response indicating that the response is appropriate, a control signal corresponding to the control content is output to the device to be controlled.

Images