JP2017223812A - Apparatus control system, apparatus control method and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an apparatus control system for performing apparatus control in order for an organism such as a human being to learn an intended action, with which it is possible to heighten the possibility that the organism can execute the intended action even when away from the command of apparatus control.SOLUTION: An apparatus control system 10 for performing apparatus control that affects an organism such as a human baby, for example, comprises: an evaluation unit 110 for successively evaluating actions of an organism on the basis of observation data pertaining to the actions of the organism that are successively obtained from a camera 200, for example; a determination unit 120 for determining a content of apparatus control under a fixed condition on the basis of an evaluation result of the evaluation unit 110; and a control unit 140 for exercising apparatus control on the basis of the content of apparatus control each time the content of apparatus control is determined by the determination unit 120. The determination unit 120 determines a new content of apparatus control so as to, for example, cause the content to change newly, in accordance with the evaluation result of the evaluation unit 110 and the content of apparatus control determined in the past by the determination unit 120.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a device control system for controlling a device, and a device control method and a control program used in the device control system.

  2. Description of the Related Art Conventionally, a technique for controlling a device to make an infant or a dog learn a specific action is known. For example, Patent Document 1 discloses a technique for monitoring the invasion behavior of an infant into a monitoring area by image data recorded by a camera and performing control for raising the fence according to the behavior, or outputting discipline information. Have been described. Patent Document 2 describes a technique for feeding food by controlling a feeder if a dog bark is not detected for a certain period of time in order to efficiently train the dog.

JP 2004-78304 A JP 2007-82488 A

  In the conventional technology, a human or a dog behaves according to a certain kind of device control (device control), but it is not always possible to act away from the control of that kind of device control.

  Therefore, the present invention is a device control system that performs device control in order to acquire a specific behavior (target behavior) such as a human being, a dog, or the like, and the target is controlled even if the organism leaves control of the device control. An object of the present invention is to provide a device control system that can increase the possibility of performing an action. Another object of the present invention is to provide a device control method and a control program used in this device control system.

  In order to achieve the above object, an apparatus control system according to an aspect of the present invention is an apparatus control system that performs apparatus control that affects living organisms, and is based on observation data relating to the behavior of the organisms obtained sequentially. An evaluation unit that sequentially evaluates the behavior of the organism, a determination unit that determines the device control content under a certain condition based on the evaluation result of the evaluation unit, and each time the device control content is determined by the determination unit, the device control A control unit that performs device control based on the content, and the determination unit newly determines the device control content according to the evaluation result of the evaluation unit and the device control content determined by the determination unit in the past .

  In order to achieve the above object, a device control method according to an aspect of the present invention is a device control method for performing device control that affects a living organism, wherein the biological control method is based on observation data relating to the behavior of the living organism. A first evaluation step for evaluating the behavior of the device, a first determination step for determining the device control content under a certain condition based on the evaluation result in the first evaluation step, and the device control determined in the first determination step A first control step for performing device control based on the content; a second evaluation step for evaluating the behavior of the organism based on observation data relating to the behavior of the organism after the device control is performed in the first control step; A second determination step for determining the device control content under a certain condition according to the evaluation result in the second evaluation step and the device control content determined in the first determination step; and the second determination Based on the device control contents determined in step and a second control step of performing a device control.

  In order to achieve the above object, a control program according to an aspect of the present invention is a control program for causing a device control apparatus including a microprocessor to execute device control processing for performing device control that affects a living organism. The device control processing includes a first evaluation step for evaluating the behavior of the organism based on observation data relating to the behavior of the organism, and device control under a certain condition based on the evaluation result in the first evaluation step. A first determination step for determining content, a first control step for performing device control based on the device control content determined in the first determination step, and the organism after the device control is performed in the first control step. A second evaluation step for evaluating the behavior of the organism based on the observation data relating to the behavior of the first, an evaluation result in the second evaluation step, and the first determination step A second determination step for determining the device control content under a predetermined condition in accordance with the determined device control content; and a second control step for performing device control based on the device control content determined in the second determination step. Including.

  According to the device control system concerning one mode of the present invention, even if a person etc. leave control of the device control by a device control system, possibility that a target action will be able to be performed can increase.

1 is a schematic configuration diagram of a device control system according to Embodiment 1. FIG. It is a figure which shows an example of the apparatus control content table which the apparatus control apparatus which concerns on Embodiment 1 hold | maintains. 6 is a flowchart illustrating an example of device control content determination processing by the device control apparatus according to the first embodiment. 6 is a diagram showing an example of device control recording according to Embodiment 1. FIG. 6 is a flowchart illustrating an example of device control content determination processing by a device control apparatus according to a modification of the first embodiment. FIG. 10 is a diagram showing an example of device control recording according to a modification of the first embodiment. It is a figure which shows an example of the apparatus control content table which the apparatus control apparatus which concerns on the modification of Embodiment 1 hold | maintains. It is a schematic block diagram of the apparatus control system which concerns on Embodiment 2. 10 is a flowchart illustrating an example of device control content determination processing by the device control apparatus according to the second embodiment.

(Embodiment 1)
Hereinafter, embodiments will be described with reference to the drawings. Each of the embodiments shown here shows a specific example of the present invention. Accordingly, the numerical values, shapes, materials, components, component arrangement and connection forms, steps (steps) and order of steps, and the like shown in the following embodiments are examples and limit the present invention. is not. Among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims can be arbitrarily added. Each figure is a mimetic diagram and is not necessarily illustrated strictly.

  Hereinafter, a device control system according to an embodiment of the present invention will be described.

(Constitution)
FIG. 1 is a diagram showing a schematic configuration of a device control system 10 according to the present embodiment. The device control system 10 is an example of a system (device control system) that performs device control so that a living organism such as a human being or a dog can learn a specific behavior (target behavior). Here, as an example of a device control system for mainly letting humans learn the target behavior, it is mainly composed of devices installed in the house, and device control that performs device control to let the infant learn the organized storage behavior The system 10 will be described. A guardian (such as a parent) of an infant can use the device control system 10 to cause the infant to properly learn the organizing and storing behavior after playing with a toy. Here, the organizing and storing action used as an example of the target action is an action of clearing the toy after playing with the toy.

  As shown in FIG. 1, the device control system 10 includes a device control apparatus 100, a camera 200, and devices 300a to 300c.

  The camera 200 is communicable with the device control apparatus 100. The camera 200 captures an image of an area in the house (a room where an infant plays), generates image data of the area, and transmits the image data to the apparatus control apparatus 100. Have

  The devices 300a to 300c are examples of devices installed in, for example, a room where an infant plays, for example, a music playback device, a lighting device, and a display device capable of displaying video content (for example, moving images) (for example, recording and playback with a display). Device etc.). The display device may be capable of reproducing the audio attached to the video content. Each of the devices 300a to 300c has a function of operating in accordance with the control content indicated by the control signal by receiving a predetermined control signal from the device control apparatus 100.

  For example, the device control apparatus 100 analyzes image data generated by imaging with the camera 200 to evaluate the child's behavior in order to allow the infant to learn the organizing and storing behavior, and controls the device based on the evaluation result ( A computer having a function of performing control of the devices 300a to 300c. The device control apparatus 100 includes a communication interface (I / F), a memory, a processor (microprocessor), and the like. The communication I / F is a communication circuit for wireless communication or wired communication. With the communication I / F, the device control apparatus 100 can communicate with the camera 200, the devices 300a to 300c, and the like, for example. The memory is a ROM that stores a program and data in advance, a RAM that is used to store data or the like when the program is executed, and may include, for example, a nonvolatile memory. The device control apparatus 100 may include a storage device such as a hard disk device in addition to the memory. The processor performs various processes by controlling the communication I / F and the like by executing a program (control program) stored in the memory. The device control apparatus 100 may include an input device (such as a keyboard, a touch panel, or a voice input device) and a display as a user interface for accepting an operation by an infant guardian. In addition, the device control apparatus 100 communicates with an information terminal (smartphone, tablet, etc. carried by an infant guardian) using a communication I / F, so that the information terminal is connected to a user interface (input device) of the device control apparatus 100. And a display).

  In order to realize a function of performing device control by determining device control content by evaluation based on image data, the device control apparatus 100 has an evaluation unit 110, a determination unit 120, and a storage unit as shown in FIG. 130 and a control unit 140.

  The evaluation unit 110 is realized by, for example, a communication I / F of the device control apparatus 100 and a processor that executes a control program. The evaluation unit 110 has a function of sequentially obtaining image data related to the behavior of the infant from the camera 200 and sequentially evaluating the behavior of the infant based on the image data. For example, the evaluation unit 110 is imaged in a state where an image of a room in which an infant is playing, which is captured by the camera 200 in a time zone after the infant has played with a toy, and an appropriate organizing and storing action is performed in advance. The behavior of the infant is evaluated by comparing with the reference image data. The state in which appropriate organizing and storing behavior has been performed in advance is a state in which toys are organized and stored. The result of this evaluation is an evaluation result for distinguishing whether or not the infant has properly executed the organizing and storing behavior, that is, whether or not the organizing and storing behavior (target behavior) that is the learning target has been executed. For example, if the difference between the image data (images) is smaller than a predetermined threshold, the infant is evaluated to have achieved the target action (executed the target action), and the difference exceeds the predetermined threshold. It is evaluated that the infant did not execute the target action (it did not execute it). The reference image data indicates, for example, an image with no toys on the floor of a room where an infant plays. When the image data acquired from the camera 200 at the end of the cleaning time after the infant has played shows an image in which a plurality of toys are scattered on the floor, the difference from the reference image data exceeds the threshold value. It will be. The device control apparatus 100 can specify the time period for tidying up after the infant has played, based on, for example, an operation performed by an infant guardian on the input device of the device control apparatus 100, voice input, or the like. The evaluation of the action of the infant by the evaluation unit 110 is sequentially performed, and can be performed, for example, once or a plurality of times every day in a time zone in which the infant is to organize and store toys.

  The determination unit 120 is realized by a processor that executes a control program in the device control apparatus 100, for example. The determination unit 120 has a function of determining the device control content under a certain condition based on the evaluation result (evaluation result) by the evaluation unit 110. Specifically, the determination unit 120 refers to the device control content table held in the storage unit 130 when the evaluation unit 110 evaluates that the infant has executed the target action (organization storage action), One device control content is determined. The device control content table is a table showing a plurality of device control details determined in advance so as to increase the frequency with which the infant voluntarily executes the target action, and will be described in detail later. That is, the determination unit 120 selects one device control content by selecting from a plurality of predetermined device control contents based on the evaluation result of the evaluation unit 110. When the evaluation unit 110 evaluates that the infant has not performed the target action, the determination unit 120 does not determine the device control content. The determination unit 120 records a device control record as information regarding the determined device control content in the storage unit 130. Then, when newly determining the device control content, by referring to the information (device control record) recorded in the past, the new control result is determined according to the evaluation result of the evaluation unit 110 and the device control content determined in the past. Appropriate device control details. However, even when the infant performs the target action, the determination unit 120 does not change the device in a certain case according to the device control content determined in the past (a certain case where it is estimated that the infant has learned the target action). Do not decide what to control.

  The storage unit 130 is realized in one area of a storage medium such as a memory or a hard disk device in the device control apparatus 100, for example. The storage unit 130 holds a device control content table, and can also hold information (device control record) related to device control content recorded by the determination unit 120. The device control record may include information indicating an evaluation of the infant's behavior such as whether or not the infant has performed the target behavior. And the apparatus control apparatus 100 may display an apparatus control record on a display according to operation by the guardian of an infant, for example. FIG. 2 is a diagram illustrating an example of a device control content table held by the storage unit 130. The device control content table is information in which a plurality of device control content is classified into groups (control groups) and levels are associated with each other. In the device control content table illustrated in FIG. 2, three different levels of device control content of levels 1 to 3 are defined for each control group. Each device control content is a control content that causes a device to be controlled (device control target) to perform an output that affects human (infant) perception (such as vision and hearing). In addition, each device control content is, for example, control content that is defined with the intention of increasing the frequency of voluntarily executing the target behavior (organization storage behavior) on the infant according to the operant conditioning theory. . In each control group, the level 3 device control content is determined so as to have a relatively large influence on the infant to increase the execution frequency of the target action. Further, the level 2 device control content is determined so as to give the infant an effect of increasing the execution frequency of the target action smaller than the level 3 device control content. Further, the level 1 device control content is determined so that the influence of increasing the execution frequency of the target action on the infant is smaller than the level 2 device control content. In the example of FIG. 2, the control group “1” displays the video of the character A (for example, a movie in which the character A praises the behavior of the infant) on the display device to be controlled as the level 3 device control content for 30 seconds. The control to be performed is defined. Further, as the level 2 device control contents of the control group “1”, control for displaying the image of the character A (for example, a moving image in which the character A considerably gives up the action of the infant) on the display device is defined for 15 seconds. Then, as the level 1 device control contents of the control group “1”, the control for displaying the image of the character A (for example, a moving image in which the character A slightly gives up the action of the infant for 5 seconds) on the display device is defined. In the example of FIG. 2, the control group “3” defines the control of causing the music playback device to be controlled to play music (for example, music that makes an infant feel great joy) for 30 seconds as the level 3 device control content. ing. In addition, as a level 2 device control content of the control group “3”, a control for causing the music playback device to play the music for 15 seconds is defined. In addition, as the level 1 device control contents of the control group “3”, control is set so that music (for example, music that makes an infant feel a little joy) is played for 5 seconds by the music playback device. The contents of video, music, etc. may be set in advance by an infant guardian on the device to be controlled, or the device control device 100 may specify the content to control the device to be controlled. It is good.

  The control unit 140 is realized by, for example, a communication I / F of the device control apparatus 100 and a processor that executes a control program. The control unit 140 performs device control based on the device control content every time the device control content is determined by the determination unit 120. For example, in response to various device control details that can be determined by the determination unit 120, the control unit 140 holds in advance a control signal to be transmitted to a device and information on the transmission destination in order to realize the device control content. ing. For example, when the level 3 device control content of the control group “1” in the example of FIG. 2 is determined by the determination unit 120, the control unit 140 sends a character to a device that is a display device among the devices 300a to 300c. A predetermined control signal is transmitted so that the image of A is displayed for 30 seconds. Thereby, the control unit 140 controls the device (display device) so as to realize the determined device control content. For example, when the level 3 device control content of the control group “3” in the example of FIG. 2 is determined by the determination unit 120, the control unit 140 is a device that is a music playback device among the devices 300a to 300c. In addition, a predetermined control signal is transmitted so that music is played back for 30 seconds. Thereby, the control unit 140 controls the device (music playback device) to play back music.

  The device control apparatus 100 including the above-described functional components is for controlling the devices 300a to 300c when the organizing and storing action can be executed so that the infant can learn the organizing and storing action after playing with a toy, for example. Device control content determination processing is performed.

(Operation)
Hereinafter, an operation example of the device control system 10 having the above-described configuration will be described focusing on the operation of the device control apparatus 100.

  FIG. 3 is a flowchart illustrating an example of device control content determination processing by the device control apparatus 100. The device control content determination process will be described below with reference to FIG. Here, for convenience of explanation, the device control system 10 is used for the infant guardian to learn the organizing and storing behavior in which the infant guards the toy after playing with the toy, and the time for the infant to play with the toy and clear the toy. Will be explained once per day. The device control apparatus 100 performs device control content determination processing related to device control for allowing an infant to learn organizing and storing behavior. This device control content determination process can be executed over a long period of time, for example, over several days or months. However, since the device control apparatus 100 performs evaluation related to whether or not the organizing and storing action is executed after the infant plays with the toy and performs device control based on the evaluation result or the like, the device control content determination process of FIG. The processing procedure (step) can proceed intermittently (with a time interval) for each fixed unit.

  First, in a time zone after an infant plays with a toy, the device control apparatus 100 causes the evaluation unit 110 to acquire and analyze image data obtained by capturing an image of the floor of the room where the infant plays from the camera 200, thereby analyzing the behavior of the infant ( It is evaluated whether or not the target action has been executed (step S11). The analysis of the acquired image data is performed by comparing an image related to the image data with a reference image without a toy on the floor.

  Subsequently, when the evaluation unit 110 evaluates that the infant has performed the target action, the determination unit 120 of the device control apparatus 100 determines one of the control groups (for example, control group “1”) according to a predetermined order. Level 3 device control content is determined (step S12). And the control part 140 controls any one of apparatus 300a-300c so that the apparatus control content determined by step S12 may be implement | achieved. Thereby, for example, when the level 3 device control content of the control group “1” shown in FIG. 2 is determined, as a result of device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video such as a movie that praises is displayed for 30 seconds. As a result, it can be expected that the infant who sees the image of the character A on the display device feels joy and increases the frequency of voluntarily performing the organizing and storing action of clearing the toy after playing with the toy. If it is determined in step S11 that the infant has not performed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content and the control unit 140 does not perform device control (step S11). S13). When the device control apparatus 100 evaluates in step S11 that the infant has not performed the target action and does not perform device control, the device control device 100 returns to step S11 again in the time zone after the infant has played with the toy on the next day. The evaluation unit 110 evaluates whether or not the infant has performed the target action by acquiring and analyzing the image data from the camera 200.

  In addition, the device control apparatus 100 determines the level 3 device control content in step S12 and performs device control on the next day after the infant plays with the toy. It is evaluated whether the infant has executed the target action by acquiring and analyzing the image data (step S14). This step S14 is the same as step S11. Subsequently, when the evaluation unit 110 evaluates that the infant has executed the target action, the determination unit 120 of the device control apparatus 100 has the same control group as the device control content because the previously determined device control content is level 3. For example, the device control content of level 2 (one level lower than level 3) of the control group “1”) is determined (step S15). In step S15, the control unit 140 controls any one of the devices 300a to 300c so as to realize the determined device control content. The determination unit 120 determines the device control content according to the evaluation result of the evaluation unit 110 and the previously determined device control content, and the device control content determined by the determination unit 120 in step S15 is determined in step S12. It is different from the device control contents. Thereby, for example, when the level 2 device control content of the control group “1” shown in FIG. 2 is determined, as a result of the device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video, such as a movie, that gives up on the screen is displayed for 15 seconds. As a result, it can be expected that the infant who sees the image of the character A on the display device feels joy and the frequency of spontaneously organizing and storing the behavior increases. If it is determined in step S14 that the infant has not performed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content and the control unit 140 does not perform device control (step S14). S16). The device control apparatus 100 evaluates that the infant has not performed the target action in step S14 and does not perform the device control. The device control apparatus 100 returns to step S14 again in the time zone after the infant has played with the toy. Returning, the evaluation unit 110 evaluates whether or not the infant has executed the target action by acquiring and analyzing the image data from the camera 200.

  The device control apparatus 100 determines the level 2 device control content in step S15 and performs device control on the next day after the infant has played with the toy, the evaluation unit 110 causes the camera 200 to It is evaluated whether the infant has executed the target action by acquiring and analyzing the image data (step S17). This step S17 is the same as step S11. Subsequently, when the evaluation unit 110 evaluates that the infant has executed the target action, the determination unit 120 of the device control apparatus 100 has the same control group as the device control content because the previously determined device control content is level 2. For example, the device control contents of level 1 (one level lower than level 2) of the control group “1”) are determined (step S18). The control unit 140 controls any one of the devices 300a to 300c so as to realize the device control content determined in step S18. The device control content determined by the determination unit 120 in step S18 is different from the device control content determined in step S12 or step S15. Thereby, for example, when the level 1 device control content of the control group “1” shown in FIG. 2 is determined, as a result of the device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video such as a movie that gives up a little is displayed for 5 seconds. As a result, it can be expected that the infant who sees the image of the character A on the display device feels joy and the frequency of spontaneously organizing and storing the behavior increases. If it is determined in step S17 that the infant has not performed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content and the control unit 140 does not perform device control (step S17). S19). The device control apparatus 100 evaluates that the infant did not execute the target action in step S17 and does not perform device control, the next day when the child played with the toy, again in step S17. Returning, the evaluation unit 110 evaluates whether or not the infant has executed the target action by acquiring and analyzing the image data from the camera 200.

  In addition, the device control apparatus 100 determines the level 1 device control content in step S18 and performs device control on the next day after the infant plays with the toy, the evaluation unit 110 performs the camera control from the camera 200. It is evaluated whether the infant has performed the target action by acquiring and analyzing the image data (step S20). This step S20 is the same as step S11. Subsequently, when the evaluation unit 110 evaluates that the infant has performed the target action, the determination unit 120 of the device control apparatus 100 has the level 1 of the previously determined device control level, which is one level lower than the level 1. Therefore, the device control content is not determined (step S21). Thus, the device control apparatus 100 ends the device control content determination process without performing device control by the control unit 140. That is, when it is evaluated in step S20 that the infant has performed the target action, it is assumed that the infant has learned the organizing and storing action, and thus the device control apparatus 100 does not perform device control. If it is determined in step S20 that the infant has not performed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content, and the control unit 140 does not perform device control (step S20). S22). Subsequently to step S22, the process returns to step S17, which is a state in which the level 1 device control content can be determined next. Even after step S21, the same evaluation as step S20 is performed once or a plurality of times, and when it is evaluated that the infant has not performed the target action, the next level 1 is performed without performing the device control. It is good also as returning to step S17 which is a state which can determine apparatus control content.

  In addition, although the determination part 120 showed the example which determines the apparatus control content from which the level of the same control group as the last time differs when determining apparatus control content in step S15 or step S18, it is not necessarily the same control group. Also good. For example, the device control content of a control group different from the previous time may be determined.

  FIG. 4 shows a device control record, which is information indicating the level of device control content sequentially determined by performing the above-described device control content determination process, and the evaluation result of the infant's behavior that is the basis of the determination. It is a figure which shows an example.

  The example shown in the figure is an assumed example, and indicates that the infant can execute the target action on January 19, and the device control of the device control content of level 3 was performed at that time. In addition, on January 20, the infant can execute the target action, and at that time, the device control of the level 2 device control content that is assumed to have a smaller influence on the child than the level 3 is performed. . Further, it is shown that on January 22, the infant can execute the target action, and at that time, the device control of the device control content of level 1 that has a smaller influence on the child than level 2 is performed. Then, the infant can execute the target action on January 23, and it is shown that the device control was not performed because the infant succeeded in acquiring the target action.

  As the device control apparatus 100 performs the device control content determination process in this manner, the device control content gradually decreases from level 3 to level 1 as the infant can execute the target action (organization / storage action). That is, device control with a small degree of influence on the infant is gradually performed. When the infant can execute the target action after the device control with the device control content of level 1, the device control is not performed. Therefore, according to the device control system 10, the infant can voluntarily execute the target action without depending on the device control in the end. Therefore, the device control system 10 is useful for nurturing an infant to a human who can execute a target action without depending on an external stimulus by device control.

(Modification 1 of Embodiment 1)
When the infant can execute the target action, the device control apparatus 100 according to Embodiment 1 described above determines the device control content that is gradually lower in level as the number of times increases. In other words, the device control apparatus 100 sequentially determines the device control contents so as to gradually reduce the influence of voluntarily increasing the execution frequency of the target action on the infant. In addition to this, if the infant can execute the target action continuously, the device control content of the lower level is gradually determined as the number of times increases, and if the target action cannot be executed, the higher level of equipment will be The device control apparatus 100 may be modified so that the control content can be determined. The modified device control apparatus 100 is the same as the device control apparatus 100 shown in the first embodiment in the points not described here, and will be described using the same reference numerals as those shown in FIG.

  Hereinafter, device control content determination processing by the modified device control apparatus 100 will be described.

  FIG. 5 is a flowchart illustrating an example of device control content determination processing by the device control apparatus 100 according to the first modification. Hereinafter, the device control content determination process by the device control apparatus 100 modified according to FIG. 5 will be described. Here, similarly to the explanation using FIG. 3 described above, the device control system 10 is used by the infant guardian to allow the infant to learn the organizing and storing behavior, and the time for the infant to clear the toy is 1 per day. Explain that there are times.

  First, in a time zone after an infant plays with a toy, the device control apparatus 100 causes the evaluation unit 110 to acquire and analyze image data obtained by capturing an image of the floor of the room where the infant plays from the camera 200, thereby analyzing the behavior of the infant ( It is evaluated whether or not the target action has been executed (step S31).

  Subsequently, when the evaluation unit 110 evaluates that the infant has executed the target action, the determination unit 120 of the device control apparatus 100 determines one of the control groups (for example, the control group “1”) according to a predetermined order. Level 3 device control content is determined (step S32). And the control part 140 controls any one of apparatus 300a-300c so that the apparatus control content determined by step S32 may be implement | achieved. Thereby, for example, when the level 3 device control content of the control group “1” shown in FIG. 2 is determined, as a result of device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video such as a movie that praises is displayed for 30 seconds. If it is determined in step S31 that the infant has not performed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content and the control unit 140 does not perform device control (step S31). S33). When the device control apparatus 100 evaluates that the infant has not performed the target action in step S31 and does not perform device control, the device control apparatus 100 returns to step S31 again in the time zone after the infant has played with the toy on the next day. Returning, the evaluation unit 110 evaluates whether or not the infant has executed the target action by acquiring and analyzing the image data from the camera 200.

  In addition, the device control apparatus 100 determines the level 3 device control content in step S32 and performs device control on the next day after the infant has played with the toy, the evaluation unit 110 performs the control from the camera 200. It is evaluated whether or not the infant has executed the target action by acquiring and analyzing the image data (step S34). This step S34 is the same as step S31. Subsequently, when the evaluation unit 110 evaluates that the infant has executed the target action, the determination unit 120 of the device control apparatus 100 has the same control group as the device control content because the previously determined device control content is level 3. For example, the device control content of level 2 (one level lower than level 3) of the control group “1”) is determined (step S35). And the control part 140 controls any one of apparatus 300a-300c so that the apparatus control content determined by step S35 may be implement | achieved. The determination unit 120 determines the device control content according to the evaluation result of the evaluation unit 110 and the previously determined device control content, and the device control content determined by the determination unit 120 in step S35 is determined in step S32. It is different from the device control contents. Thereby, for example, when the level 2 device control content of the control group “1” shown in FIG. 2 is determined, as a result of the device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video, such as a movie, that gives up on the screen is displayed for 15 seconds. If it is determined in step S34 that the infant has not performed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content and the control unit 140 does not perform device control (step S34). S36). The device control apparatus 100 evaluates that the infant has not performed the target action in step S34 and does not perform the device control, the next day when the child has played with the toy, and the level 3 Returning to step S31 so that the device control content can be determined, the evaluation unit 110 evaluates whether the infant has performed the target action by acquiring and analyzing the image data from the camera 200. Once the level 3 device control content is determined in step S32, when the device control content is determined again in step S32 via steps S34, S36, S31, etc., the device control content is determined. Can be changed to a control group different from the previous one.

  The device control apparatus 100 determines the level 2 device control content in step S35 and performs device control on the next day after the infant plays with the toy, the evaluation unit 110 causes the camera 200 to It is evaluated whether the infant has executed the target action by acquiring and analyzing the image data (step S37). This step S37 is the same as step S31. Subsequently, when the evaluation unit 110 evaluates that the infant has executed the target action, the determination unit 120 of the device control apparatus 100 has the same control group as the device control content because the previously determined device control content is level 2. For example, device control contents of level 1 (one level lower than level 2) of the control group “1”) are determined (step S38). And the control part 140 controls any one of apparatus 300a-300c so that the apparatus control content determined by step S38 may be implement | achieved. The device control content determined by the determination unit 120 in step S38 is different from the device control content determined in step S32 or step S35. Thereby, for example, when the level 1 device control content of the control group “1” shown in FIG. 2 is determined, as a result of the device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video such as a video that slightly gives up is displayed for 5 seconds. If it is determined in step S37 that the infant has not executed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content and the control unit 140 does not perform device control (step S37). S39). The device control apparatus 100 evaluates that the infant has not performed the target action in step S37 and does not perform device control, the next day when the child has played with the toy, the device determined last time is the next day. Return to step S31 so that the device control content of level 3 that is one level higher than level 2 of the control content can be determined, and the infant performs the target action by acquiring and analyzing the image data from the camera 200 by the evaluation unit 110 Evaluate whether or not

  The device control apparatus 100 determines the level 1 device control content in step S38 and performs device control on the next day after the infant has played with the toy. It is evaluated whether the infant has executed the target action by acquiring and analyzing the image data (step S40). This step S40 is the same as step S31. Subsequently, when the evaluation unit 110 evaluates that the infant has performed the target action, the determination unit 120 of the device control apparatus 100 has the level 1 of the previously determined device control level, which is one level lower than the level 1. Therefore, the device control content is not determined (step S41). As a result, the device control apparatus 100 does not perform device control, but further proceeds to step S43. If it is determined in step S40 that the infant has not performed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content, and the control unit 140 does not perform device control (step S40). S42). The device control apparatus 100 evaluates that the infant has not performed the target action in step S40 and does not perform the device control on the next day when the device is determined in the time zone after the infant has played with the toy. Returning to step S34 so that the device control content of level 2 that is one level higher than level 1 of the control content can be determined, the infant executes the target action by acquiring and analyzing the image data from the camera 200 by the evaluation unit 110 Evaluate whether or not

  On the next day when the device control is not performed without determining the device control content in step S41, the device control apparatus 100 receives the image data from the camera 200 by the evaluation unit 110 in the time zone after the infant has played with the toy. By acquiring and analyzing, it is evaluated whether or not the infant has executed the target action (step S43). This step S43 is the same as step S31. Subsequently, when the evaluation unit 110 evaluates that the infant has executed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content (step S44). Thus, the device control apparatus 100 ends the device control content determination process without performing device control by the control unit 140. That is, when it is determined in step S43 that the infant has performed the target action, it is assumed that the infant has learned the organizing and storing action, and thus the device control apparatus 100 does not perform device control. If it is determined in step S43 that the infant has not performed the target action, the determination unit 120 of the device control apparatus 100 does not determine the device control content and the control unit 140 does not perform device control (step S43). S45). Subsequently to step S45, the process returns to step S37, which is a state in which the level 1 device control content can be determined.

  FIG. 6 is information indicating information indicating the level of device control content sequentially determined by performing device control content determination processing according to the first modification, and an evaluation result of an infant's behavior that is the basis of the determination. It is a figure which shows an example of control recording.

  The example shown in the figure is an assumed example, and indicates that the infant can execute the target action on January 19, and the device control of the device control content of level 3 was performed at that time. In addition, on January 20, the infant can execute the target action, and at that time, the device control of the level 2 device control content that is assumed to have a smaller influence on the child than the level 3 is performed. . In addition, since the infant failed to execute the target action on January 21 (it could not be executed), the device control was not performed. When the infant can execute the target action on January 22 of the next day when the execution of the target action has failed, the fact that the level 3 device control content that has a greater influence on the infant than the previous level 2 has been implemented. Show. The reason why the level of the device control content is increased after the execution of the target action is failed is to increase the possibility that the infant can execute the target action next time. Then, the infant can execute the target action on January 23, and at that time, the device control of the device control content of level 2 which is one level lower than the previous level 3 is performed. The reason why the level of device control content is lowered by one after the target behavior can be executed is to gradually increase the possibility that the target behavior can be executed spontaneously without depending on the device control. In this example, the infant can execute the target action on January 28 thereafter, and the device control is not executed at that time. Further, it is shown that the infant can execute the target action on January 29, the next day when the device control is not executed, and the device control is not performed.

  As described above, the device control apparatus 100 according to the modified example 1 performs device control in the device control content determination process, reflecting the acquired state of the target behavior of the infant, and sets the level of the device control content when the infant can execute the target behavior. Decrease by one. Further, if the infant fails to execute the target action, the level of device control content can be increased by one. Then, when the infant learns the target behavior and can execute the target behavior without performing device control, the device control content determination process is terminated.

(Modification 2 of Embodiment 1)
The device control apparatus 100 in the first embodiment and the modification 1 described above controls any one of the devices 300a to 300c according to the determined device control content, but the device to be controlled is not necessarily 1 It is not limited to the stand. Here, a modified example will be described in which the device control apparatus 100 is modified so as to perform device control by determining device control content so as to include a case where there are a plurality of devices to be controlled.

  In the device control apparatus 100 according to this modification, the content of the device control content table held mainly by the storage unit 130 is different from the content described above (see FIG. 2). An example of the device control content table held by the storage unit 130 of the device control apparatus 100 according to this modification is shown in FIG.

  The device control content table shown in FIG. 7 is information in which a plurality of device control content is classified into groups (control groups) and levels are associated with each other, as in the device control content table of FIG. In the device control content table of FIG. 7, three different levels of device control content of levels 1 to 3 are defined for each control group. However, unlike the device control content table of FIG. The control content may include control information for each of a plurality of devices to be controlled.

  In the example of FIG. 7, the control group “1” displays the image of the character A (for example, a movie in which the character A praises the action of the infant) for 15 seconds on the display device to be controlled as the level 3 device control content. And control for temporarily increasing the illuminance by 100 lux (Lx) in the lighting device to be controlled. Further, in the control group “11”, as the level 3 device control content, the control is such that the music playback device to be controlled plays music (for example, music that makes an infant feel great joy) for 15 seconds, And a control for temporarily increasing the illuminance by 100 lux (Lx).

  In each control group, the level 3 device control content is defined as a control content for a plurality of devices. In addition, the device control content of level 2 or lower is defined as a control content for controlling the same number or a small number of devices as the higher level device control content in the same control group. The level 1 device control content is defined as a control content for a smaller number of devices than the level 3 device control content in the same control group. In the same control group, each time the level is lowered from level 3 to level 1, the device control content is determined so that the energy consumed by one or a plurality of devices to be controlled becomes smaller. It has been.

  The determination unit 120 in the device control apparatus 100 according to the present modification selects (determines) device control content from a device control content table that can include a plurality of devices as illustrated in FIG.

  The device control apparatus 100 according to the present modified example is a device control content determination process according to the first embodiment (see FIG. 3) or a device control content determination process according to the first modification of the first embodiment (see FIG. 5). Execute. However, the control unit 140 controls any one or a plurality of devices 300a to 300c so that the device control content determined by the determination unit 120 is realized.

  Therefore, as the device control apparatus 100 performs the device control content determination process, the device control content gradually decreases from level 3 to level 1 as the infant can execute the target action. That is, the number of devices that are subject to device control gradually decreases. When the infant can execute the target action after the device control with the device control content of level 1, the device control is not performed. As described above, the device control apparatus 100 can promote that the infant can finally execute the target action without depending on the device control.

(Embodiment 2)
Hereinafter, a device control system 10a in which a part of the device control system 10 shown in the first embodiment is modified so that the device control apparatus further performs device control based on the facial expression of the infant will be described. Here, in the same manner as in the first embodiment, an explanation will be given assuming an example in which an infant guardian uses the device control system 10a in order to allow an infant to properly learn organizing and storing behavior after playing with a toy.

  FIG. 8 is a diagram showing a schematic configuration of the device control system 10a according to the present embodiment. Among the components of the device control system 10a shown in the figure, the same components as those of the device control system 10 described above are denoted by the same reference numerals as those in FIG. The device control system 10a includes a device control device 100a, a camera 200, and devices 300a to 300c.

  As described in Embodiment 1, the camera 200 captures a room where an infant plays and generates image data. The image of the image data may include an infant's facial expression in the captured room. In order to generate image data relating to an image capturing an infant's facial expression, the imaging direction, the angle of view, and the like of the camera 200 are appropriately set and used. Note that the camera 200 captures the timing of imaging the room where the infant plays for the evaluation of the infant's behavior shown in Embodiment 1, and the infant's facial expression after the device control is performed by the device control apparatus 100a. It may be controlled so as to obtain an appropriate imaging direction and angle of view depending on the timing at which the infant's face is captured. The camera 200 may be a set of two cameras: a camera suitable for imaging a room in which an infant plays to evaluate the behavior of the infant and a camera suitable for imaging an infant's facial expression after device control. .

  The device control apparatus 100a has the same configuration as the device control apparatus 100 except that the device control apparatus 100a includes a determination unit 120a that is a part of the determination unit 120 of the device control apparatus 100 described in the first embodiment. The storage unit 130 holds the device control content table (see FIG. 2) shown in the first embodiment.

  The determination unit 120a is realized by a processor that executes a control program in the device control apparatus 100a, for example. The determination unit 120a has a function of determining the device control content under a certain condition based on the infant's facial expression detected from the image data acquired from the camera 200 and the evaluation result by the evaluation unit 110. Unlike the determination unit 120 shown in the first embodiment, the determination unit 120a is an infant detected from image data acquired from the camera 200 after the control unit 140 performs device control according to the determined device control content. The level of the device control content to be determined thereafter is varied depending on whether the facial expression is a predetermined facial expression. The predetermined facial expression is a facial expression that represents a favorable emotion such as joy or joy. If the infant has a predetermined expression that expresses a favorite emotion after the device control, the device control may have effectively acted to increase the frequency at which the child performs the target action. Here, the predetermined expression is also referred to as “joy expression”. If the infant has a joyful expression, the determination unit 120a performs processing control that can determine the device control content at a lower level than the previous time. The process control is performed so that the device control content at the level of can be determined. In addition, the existing face detection technique etc. are used for the detection of the infant's facial expression from image data. The determination unit 120a extracts the feature amount of the infant's facial expression from the image data, and performs an operation of collating it with the feature amount of the predetermined pleasure expression, so that the infant's facial expression is a pleasure expression. It is determined whether or not.

  Hereinafter, an operation example of the device control system 10a having the above-described configuration will be described focusing on the operation of the device control apparatus 100a.

  FIG. 9 is a flowchart illustrating an example of device control content determination processing by the device control apparatus 100a. The device control content determination process will be described below with reference to FIG. Here, for convenience of explanation, it is assumed that the infant has time to play with the toy and clear the toy once a day. This device control content determination process can be executed over a long period of time, for example, over several days or months.

  First, in a time zone after an infant plays with a toy, the device control apparatus 100a uses the evaluation unit 110 to acquire and analyze image data obtained by capturing the floor of the room where the infant plays from the camera 200 and analyze the behavior of the infant ( It is evaluated whether or not the target action has been executed (step S51).

  Subsequently, when the evaluation unit 110 evaluates that the infant has performed the target action, the determination unit 120a of the device control apparatus 100a selects one of the control groups (for example, the control group “1”) according to a predetermined order. Level 3 device control content is determined (step S52). And the control part 140 controls any of apparatus 300a-300c so that the apparatus control content determined by step S52 may be implement | achieved. Steps S51 and S52 are the same as steps S11 and S12 described in the first embodiment. Thereby, for example, when the level 3 device control content of the control group “1” shown in FIG. 2 is determined, as a result of device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video such as a movie that praises is displayed for 30 seconds.

  Subsequent to step S52, the determination unit 120a determines, based on the image data acquired from the camera 200, whether the infant's facial expression after device control is a joyful facial expression (step S53). In addition, if the desired behavior is obtained from the environment by the output of the device (video display or the like) when the target behavior can be executed, the infant may learn appropriate behavior adapted to the environment.

  If it is determined in step S51 that the infant has not performed the target action, the determination unit 120a of the device control apparatus 100a does not determine the device control content and the control unit 140 does not perform device control (step S54). . On the next day, in the time zone after the infant has played with the toy, the process returns to step S51 again, and the evaluation unit 110 acquires and analyzes the image data from the camera 200, so that the infant executes the target action. Evaluate whether or not.

  On the next day when it is determined in step S53 that the infant did not have a joyful expression, the process returns to step S51 again in the time zone after the infant has played with the toy. Evaluate whether the infant has performed the target action by acquiring and analyzing the data.

  On the other hand, on the next day when it is determined in step S53 that the infant has a joyful expression, the evaluation unit 110 acquires and analyzes the image data from the camera 200 in the time period after the infant has played with the toy. Thus, it is evaluated whether or not the infant has executed the target action (step S55). There is a possibility that the device control has acted appropriately because the infant has a joyful expression, and the evaluation result in step S55 is one level lower than the previous level 3 device control content under a certain condition. Device control content can be determined.

  When the evaluation unit 110 evaluates that the infant has executed the target action in step S55, the determination unit 120a uses the same control group as the previously determined device control content (for example, control group “1”) and level 2 device. The control content is determined (step S56). Then, the control unit 140 controls one of the devices 300a to 300c so as to realize the device control content determined in step S56. Thereby, for example, when the level 2 device control content of the control group “1” shown in FIG. 2 is determined, as a result of the device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video, such as a movie, that gives up on the screen is displayed for 15 seconds.

  Subsequent to step S56, the determination unit 120a determines whether the infant's facial expression after the device control is a joyful expression based on the image data acquired from the camera 200 (step S57).

  If it is determined in step S55 that the infant has not performed the target action, the determination unit 120a of the device control apparatus 100a does not determine the device control content and the control unit 140 does not perform device control (step S58). . On the next day, in the time zone after the infant has played with the toy, the process returns to step S55 again, and the evaluation unit 110 acquires and analyzes the image data from the camera 200 so that the infant performs the target action. Evaluate whether or not.

  On the next day when it is determined in step S57 that the infant did not have a joyful expression, the process returns to step S55 again in the time zone after the infant has played with the toy, and the evaluation unit 110 causes the image from the camera 200 to return. Evaluate whether the infant has performed the target action by acquiring and analyzing the data. In the case where the device control content is determined again in step S56 after returning to step S55 again after the infant does not have a joyful expression after device control with the level 2 device control content determined in step S56. The determination unit 120a may determine the device control content of a control group different from the previous one.

  On the other hand, on the next day when it is determined in step S57 that the infant has a joyful expression, the evaluation unit 110 acquires and analyzes image data from the camera 200 in the time period after the infant has played with the toy. Thus, it is evaluated whether or not the infant has executed the target action (step S59). There is a possibility that the device control has acted appropriately because the infant has a joyful expression, and the level 1 level, which is one lower than the previous level 2 device control content, is determined under certain conditions according to the evaluation result in step S59. Device control content can be determined.

  If the evaluation unit 110 evaluates that the infant has executed the target action in step S59, the determination unit 120a uses the same control group as the previously determined device control content (for example, control group “1”) and level 1 device. The control content is determined (step S60). Then, the control unit 140 controls one of the devices 300a to 300c so as to realize the device control content determined in step S60. Thereby, for example, when the level 1 device control content of the control group “1” shown in FIG. 2 is determined, as a result of the device control, for example, the character A is displayed on the display device among the devices 300a to 300c. A video such as a movie that gives up a little is displayed for 5 seconds.

  Subsequent to step S60, the determination unit 120a uses the image data acquired from the camera 200 to determine whether or not the infant has a joyful expression after the device control, that is, the infant's facial expression after the device control becomes a joyful expression. It is determined whether or not (step S61).

  If it is determined in step S59 that the infant has not performed the target action, the determination unit 120a of the device control apparatus 100a does not determine the device control content and the control unit 140 does not perform device control (step S62). . On the next day, in the time zone after the infant has played with the toy, the process returns to step S59 again, and the evaluation unit 110 acquires and analyzes the image data from the camera 200 so that the infant performs the target action. Evaluate whether or not.

  On the next day when it is determined in step S61 that the infant did not have a joyful expression, the process returns to step S59 again in the time zone after the infant has played with the toy. Evaluate whether the infant has performed the target action by acquiring and analyzing the data. In the case where the device control content is determined again in step S60 after returning to step S59 after the infant does not have a joyful expression after device control with the level 1 device control content determined in step S60. The determination unit 120a may determine the device control content of a control group different from the previous one.

  On the other hand, on the next day when it is determined in step S61 that the infant has a joyful expression, the evaluation unit 110 acquires and analyzes image data from the camera 200 in the time period after the infant has played with the toy. Thus, it is evaluated whether or not the infant has executed the target action (step S63). There is a possibility that the device control has acted appropriately because the infant has a joyful expression, and the device control content determination process can be terminated under certain conditions according to the evaluation result in step S63.

  When the evaluation unit 110 evaluates that the infant has executed the target behavior in step S63, the determination unit 120a is assumed to have learned the target behavior (organization and storage behavior), and thus determines the device control content. Not performed. Thereby, the device control apparatus 100a does not perform device control (step S64), and ends the device control content determination process.

  If it is determined in step S63 that the infant has not performed the target action, the determination unit 120a of the device control apparatus 100a does not determine the device control content and the control unit 140 does not perform device control (step S65). . On the next day, in the time zone after the infant has played with the toy, the process returns to step S59 again, and the evaluation unit 110 acquires and analyzes the image data from the camera 200 so that the infant performs the target action. Evaluate whether or not.

  As described above, the device control apparatus 100a feeds back the detection result of the infant's facial expression after the device control to the next device control, and effectively performs the device control, so that the infant increases the execution frequency of the target action. Can promote that. In addition, the device control apparatus 100a gradually decreases the level of device control content as the possibility that the infant can voluntarily execute the target action increases. For this reason, device control (control based on operant conditioning theory, etc.) encourages the child to learn the target behavior, and ultimately the child can voluntarily execute the target behavior without performing device control. The possibility of becoming may increase.

(Other embodiments, etc.)
As described above, the device control systems 10 and 10a have been described according to the first and second embodiments. However, the above-described embodiment is merely an example, and it is needless to say that various modifications, additions, omissions, and the like are possible.

  In the above-described embodiment, in the device control systems 10 and 10a, the device control apparatuses 100 and 100a have shown an example in which the behavior of the infant is evaluated based on the image data from the camera 200. You may perform based on observation data other than. The observation data necessary for evaluating the behavior may be changed according to the relationship with the target behavior. The observation data may be, for example, voice data obtained by measuring sound with a microphone or the like, or data obtained by sensing with various sensors. Note that the evaluation of the action may be, for example, an evaluation in which the case where the execution of the target action is completely successful is 100% and the degree is expressed by a numerical value when the target action is executed to some extent. When the evaluation unit 110 evaluates numerically as described above, the determination units 120 and 120a of the device control devices 100 and 100a greatly determine whether or not the target action has been executed using a certain threshold value. Separately, it can be switched whether or not to determine the device control content.

  In the above-described embodiment, the example in which the device control apparatuses 100 and 100a perform device control that affects an infant mainly to assist the infant to acquire the target behavior of organizing and storing behavior has been described. However, the device control devices 100 and 100a may perform device control aiming to affect humans other than infants (for example, children, students, etc.), for example, to train animals such as dogs and cats. Furthermore, it is also possible to perform device control that affects the animal. That is, the device control apparatuses 100 and 100a can perform device control that affects a living organism in order to support that the living organism can voluntarily execute a target action. Further, the target action is not limited to the organizing / storing action, and may be any action such as early sleep and early waking. Note that it is valuable for humans to be able to voluntarily execute actions such as organizing and storing actions away from device control, and the device control devices 100 and 100a are useful for training humans such as infants.

  Moreover, the apparatus control apparatuses 100 and 100a mentioned above may bear the function as a HEMS controller in HEMS (Home Energy Management System) which manages energy, such as electric power in a house, for example. The HEMS controller controls various HEMS devices (devices 300a to 300c such as air conditioners and home appliances) in a home via a HAN (Home Area Network), for example, to suppress power consumption. In addition, the HEMS controller can measure the power usage state by the HEMS device and display information such as power consumption in the house based on the measurement result.

  In the above-described embodiment, the example (FIGS. 2, 7, etc.) in which the device control content determined by the device control apparatus 100 is classified according to the three levels of levels 1 to 3 is shown. The number may be less than 3 or 4 or more. Further, the device control contents may not be classified for each control group.

  Moreover, although the apparatus control system 10 showed the example comprised by the apparatuses mainly installed in the house in embodiment mentioned above, the apparatus control systems 10 and 10a are the apparatuses installed in the house. May or may not be included, may be configured to include devices installed outside the house, or may be configured to include devices having portability. For example, the device control apparatuses 100 and 100a may be information terminals such as smartphones. Moreover, about the apparatus used as the object of apparatus control by the apparatus control apparatuses 100 and 100a, what kind of apparatus may be sufficient, and apparatus control content may be what kind of content.

  Further, in the above-described embodiment, if the infant can execute the target action at the next time when the equipment control device 100, 100a performs the equipment control with the equipment control content determination process by the equipment control content determination process, one level is set. An example is shown in which device control is performed with low device control content. In addition, after the device control apparatus 100, 100a performs device control with a certain level of device control content, if the infant can execute the target action, the device control device 100, 100a performs device control with the same level of device control content multiple times (in advance) It is also possible to perform device control with a low level of device control content at the timing at which the infant can continuously execute the target action. In addition, after the evaluation unit 110 continuously evaluates that the infant has not performed the target action, the device control apparatuses 100 and 100a perform device control different from the previously determined device control content by the determination units 120 and 120a. The content may be newly determined.

  In addition, when the above-described device control apparatuses 100 and 100a determine the device control content, the device control device 100 and 100a may determine the device control content level in conjunction with the compliment behavior (behavior praise) of an infant guardian (such as a parent). Good. For example, when the infant can execute the target action, if there is a compliment action by the guardian, the level may be lowered by one relative to the case where there is no compliment action. Note that the device control devices 100 and 100a may determine whether or not the guardian is complimenting based on an input operation to the device control devices 100 and 100a by the guardian, or a voice input device (voice recognition system). The determination may be made based on whether or not the word to be given up is detected.

  In addition, another device may share a part of the functions of the device control devices 100 and 100a described in the above embodiment. The other device may be a computer installed remotely from the device control devices 100 and 100a, such as a server outside the house. In addition, the execution order of the device control content determination processing procedure (see FIGS. 3, 5, and 9) in the above-described device control apparatuses 100 and 100a is not necessarily limited to the above-described order. The execution order can be changed or a part thereof can be omitted without departing from the gist of the present invention. In addition, all or part of the device control content determination process described above may be realized by hardware of the device control devices 100 and 100a or other devices, or may be realized using software. Note that the processing by software is realized by a processor included in the device control device 100, 100a or another device executing a control program stored in the memory. Further, the control program may be recorded on a recording medium and distributed or distributed. For example, by installing the distributed control program in the apparatus and causing the processor of the apparatus to execute it, it is possible to cause the apparatus to perform all or part of the device control content determination process.

  In addition, embodiments realized by arbitrarily combining the constituent elements and functions shown in the above-described embodiments and modifications are also included in the scope of the present invention.

  Note that various general or specific aspects of the present invention include one or a plurality of combinations of an apparatus, a system, a method, an integrated circuit, a computer program, a computer-readable recording medium, and the like.

  The device control system according to one aspect of the present invention and the configuration, modification, and effects of the device control method and control program used in the device control system will be described below.

  (1) The device control system according to one aspect of the present invention is a device control system 10 or 10a that performs device control that affects a living organism (for example, a human infant), and sequentially obtains observations related to the behavior of the organism. The evaluation unit 110 that sequentially evaluates the behavior of the organism based on the data, the determination units 120 and 120a that determine the device control content under a certain condition based on the evaluation result of the evaluation unit 110, and the device control by the determination units 120 and 120a A control unit 140 that performs device control based on the device control content each time the content is determined, and the determination units 120 and 120a include the evaluation results of the evaluation unit 110 and the devices determined in the past by the determination units 120 and 120a. The device control content is newly determined according to the control content.

  With this configuration, it is possible to support the organism to acquire a specific action by influencing the organism through device control. Since device control is performed based on past device control content, for example, the level of device control content (such as the degree of influence on living organisms) can be gradually changed. As a result, if device control is performed so as to change appropriately, the possibility that the target action can be executed even if the organism leaves control of the device control may be increased.

  (2) For example, the evaluation by the evaluation unit 110 includes a distinction as to whether or not the organism has performed the predetermined target behavior, and the evaluation unit 110 has evaluated the determination units 120 and 120a that the organism has performed the target behavior. The first device control content is determined, and when the evaluation unit 110 evaluates that the organism has performed the target action after the determination of the first device control content, the second device is different from the first device control content. The control content may be determined.

  As a result, when the organism performs the target action as a result of device control that affects the organism, the device is controlled with the changed device control content, and thus the organism may be less likely to be controlled by the initial device control content.

  (3) For example, the determination units 120 and 120a determine the first device control content so as to influence the organism to increase the execution frequency of the target action, and influence the organism to increase the execution frequency of the target action. The second device control content may be determined so as to be smaller than the first device control content.

  As a result, the organism is less affected by the device control each time the target action is executed, so that the dependence on the device control can be gradually reduced.

  (4) For example, when the evaluation unit 110 evaluates that the organism has performed the target action after the determination of the second device control content, the determination units 120 and 120a do not determine the device control content. It is good.

  Thereby, even if it does not receive apparatus control finally, possibility that a living body will be able to perform target action can increase.

  (5) For example, the determination units 120 and 120a may not determine the device control content when the evaluation unit 110 evaluates that the organism has not performed the target action.

  As a result, the organism can increase the frequency of spontaneously executing the target action because a stimulus by device control is obtained only when the target action is executed.

  (6) For example, when the evaluation unit 110 continuously evaluates a predetermined number of times (a predetermined number of times) that the organism has not performed the target action, the determination unit 120 or 120a is the device control content determined last time. Different device control contents may be newly determined.

  Thereby, it is possible to prevent the device control that did not act effectively from being repeated, and it may be possible to promote the acquisition of the target action by the organism through effective device control.

  (7) For example, the determination units 120 and 120a may determine, as the second device control content, the device control content that consumes less energy than the first device control content.

  As a result, the degree of device control decreases as the number of times that the organism has been able to execute the target action increases. For this reason, the living thing can finally be able to execute the target action spontaneously without being greatly influenced by the device control.

  (8) For example, the determination units 120 and 120a determine, as the first device control content, the device control content that causes the display device that is one of the devices 300a to 300c to display the video for the first time, and the video is displayed on the display device. Is determined as the second device control content, and the control unit 140 sets the display device to realize the device control content determined by the determination units 120 and 120a. It is good also as controlling.

  As a result, when the organism can execute the target action, the video display is a stimulus, and the frequency at which the target action can be executed can be increased. In addition, as the number of times that the organism has been able to execute the target action increases, the display time of the video on the display device by device control becomes shorter. For this reason, the living thing can be able to spontaneously execute the target action even if the video is not finally displayed on the display device.

  (9) For example, the determination units 120 and 120a determine the device control content for which a plurality of devices are controlled as the first device control content, and the device control content for which the number of devices less than the first device control content is the control target. May be determined as the second device control content, and the control unit 140 may control the device so as to realize the device control content determined by the determination units 120 and 120a.

  Thus, since the plurality of devices are controlled when the organism can execute the target behavior for the first time, the frequency at which the organism can execute the target behavior can be increased by various outputs (that is, stimulation to the organism) by the plurality of devices. Further, as the number of times that the organism has been able to execute the target action increases, the number of devices controlled by device control decreases. In response to this, the creature can spontaneously execute the target action even if the number of devices to be controlled becomes smaller (for example, zero).

  (10) For example, the organism affected by the device control system 10a is a human, and the device control system 10a further includes a camera 200 that captures images of the organism and generates image data, and the determination unit 120a includes the first device. When the control unit 140 performs device control based on the control content, it is determined whether or not the organism has a predetermined expression using the image data generated by the camera 200, and when it is determined that the organism has a predetermined expression. When the evaluation unit 110 evaluates that the organism has performed the target action after the determination of the first device control content, the second device control content is determined, and when it is determined that the organism has not made a predetermined facial expression. When the evaluation unit 110 evaluates that the organism has performed the target action after the determination of the first device control content, the device control content is determined to be the same as the first device control content. It may be.

  Thereby, the detection result of the facial expression of a living organism (human) after device control can be fed back to the next device control, and device control can be performed effectively. For this reason, it can be promoted that the human increases the execution frequency of the target action.

  (11) For example, the determination units 120 and 120a may select one of a plurality of device control contents determined in advance so as to increase the frequency of spontaneously executing a target action according to an operant conditioning theory. The device control content may be determined by selecting the device control content.

  Thereby, the frequency which voluntarily performs target action on the living thing can be increased.

  (12) For example, the device control systems 10 and 10a include a camera 200 that generates image data as observation data by imaging, and the evaluation unit 110 takes actions of living organisms based on image data sequentially generated by the camera 200. Such an evaluation may be performed.

  Thereby, for example, it is possible to perform an evaluation related to the behavior of the organism by a relatively easy method such as comparison between an image related to image data and a reference image. For this reason, for example, it may be possible to suppress the cost and construct the device control systems 10 and 10a.

  (13) For example, the living organism affected by the device control systems 10 and 10a is a human, and the device control content determined by the determination units 120 and 120a outputs to the device that is the device control target an output that affects human perception. It may be the device control content to be performed.

  Accordingly, it can be promoted that a human increases the execution frequency of the target action.

  (14) A device control method according to an aspect of the present invention is a device control method for performing device control that affects a living organism, and first evaluation that evaluates the behavior of a living organism based on observation data relating to the behavior of a living organism. Determined in step (for example, step S11), a first determination step (for example, step S12) for determining the device control content under a certain condition based on the evaluation result in the first evaluation step, and the first determination step. A first control step for performing device control based on the device control content (for example, transmission of a control signal performed by the control unit 140 in order to realize the device control content determined by the determination unit 120 in step S12); A second evaluation step (e.g., step S14) for evaluating the behavior of the organism based on observation data relating to the behavior of the organism after the device control is performed in the step; A second determination step (for example, step S15) for determining the device control content under a certain condition according to the evaluation result in the price step and the device control content determined in the first determination step, and the second determination step. Second control step (for example, transmission of a control signal performed by the control unit 140 in order to realize the device control content determined by the determination unit 120 in step S15).

  Thereby, a living thing can be made to acquire a specific action by influencing a living thing by device control. And since device control based on the past device control content is performed, the level of device control content can be changed, for example. This can be useful for nurturing organisms so that the target behavior can be carried out spontaneously even if the control of the device is left.

  (15) For example, the device control method described above further includes a third evaluation step (e.g., step S <b> 17) for evaluating the behavior of the organism based on observation data relating to the behavior of the organism after the device control is performed in the second control step. ), A third determination step (for example, step S18) for determining the device control content under a certain condition according to the evaluation result in the third evaluation step and the device control content determined in the second determination step, And a third control step for performing device control based on the device control content determined in the determination step. The evaluation in the first evaluation step, the second evaluation step, and the third evaluation step is performed by the organism performing a predetermined target action. In the first determination step, the frequency of execution of the target behavior is increased when the first evaluation step evaluates that the organism has performed the target behavior. The first device control content that gives a sound is determined as the device control content, and the device control content is determined. In the second determination step, when the living thing is evaluated in the second evaluation step, the target action is evaluated. The device control content is determined using the second device control content that gives the organism the influence of increasing the execution frequency of the target action to be smaller than the first device control content, and the third determination step When the third evaluation step evaluates that the target action has been executed, the third device control content that gives the organism an effect of increasing the execution frequency of the target behavior smaller than the second device control content is controlled by the device control. The content may be determined as device control content.

  Thereby, it is promoted that the organism learns the target behavior by the stimulus by the device control. In addition, since an organism is less affected by device control each time a target action is executed, the dependence on device control can be gradually reduced.

  (16) A control program according to an aspect of the present invention is a control program for causing a device control device 100 or 100a including a microprocessor to execute device control processing for performing device control that affects a living thing. The control process includes a first evaluation step (e.g., step S11) that evaluates the behavior of the organism based on observation data related to the behavior of the organism, and the device control content under a certain condition based on the evaluation result in the first evaluation step. And a first control step (for example, device control determined by the determination unit 120 in step S12) that performs device control based on the device control content determined in the first determination step. After transmitting the control signal performed by the control unit 140 to realize the contents) and the device control in the first control step According to the second evaluation step (e.g., step S14) for evaluating the behavior of the organism based on the observation data related to the behavior of the organism, the evaluation result in the second evaluation step, and the device control content determined in the first determination step A second determination step (for example, step S15) for determining device control content under a certain condition, and a second control step (for example, step S15) for performing device control based on the device control content determined in the second determination step. For example, transmission of a control signal performed by the control unit 140 in order to realize the device control content determined by the determination unit 120).

  If this control program is installed in the device control devices 100 and 100a, which are computers equipped with a microprocessor, the device control devices 100 and 100a perform device control processing, and affect organisms by device control, thereby identifying the organism. Can learn behavior. And since the device control based on the past device control content is performed, the content of device control can be changed. This can be useful for nurturing organisms so that the target behavior can be carried out spontaneously even if the control of the device is left.

10, 10a Device control system 100, 100a Device control device 110 Evaluation unit 120, 120a Determination unit 140 Control unit 300a-300c Device

Claims (16)

A device control system for controlling devices that affect living organisms,
An evaluation unit that sequentially evaluates the behavior of the organism based on observation data relating to the behavior of the organism obtained sequentially,
A determination unit that determines device control content under a certain condition based on the evaluation result of the evaluation unit;
A control unit that performs device control based on the device control content every time device control content is determined by the determination unit,
The determination unit newly determines a device control content according to the evaluation result of the evaluation unit and the device control content determined by the determination unit in the past. The evaluation by the evaluation unit includes a distinction as to whether or not the organism has performed a predetermined target action,
The determination unit
When the evaluation unit evaluates that the organism has performed the target action, the first device control content is determined,
The second device control content different from the first device control content is determined when the evaluation unit evaluates that the organism has executed the target action after the determination of the first device control content. The device control system according to 1. The determination unit
Making the determination of the first device control content to affect the living organism to increase the frequency of execution of the target action,
The device control system according to claim 2, wherein the determination of the second device control content is performed such that an influence of increasing the execution frequency of the target action is given to the organism smaller than the first device control content. The determination unit does not determine the device control content when the evaluation unit evaluates that the organism has executed the target behavior after the determination of the second device control content. 3. The device control system according to 3. The device control system according to any one of claims 2 to 4, wherein the determination unit does not determine device control content when the evaluation unit evaluates that the organism has not performed the target action. The said determination part newly determines the apparatus control content different from the previously determined apparatus control content, when the said evaluation part evaluates continuously predetermined times that the said organism did not perform the said target action. The apparatus control system as described in any one of -5. The said determination part determines the apparatus control content in which the energy consumed by the apparatus of an apparatus control object is smaller than the said 1st apparatus control content as said 2nd apparatus control content. Equipment control system. The determination unit
A device control content for displaying a video on the display device for a first time is determined as the first device control content,
A device control content for causing the display device to display an image for a second time shorter than the first time is determined as the second device control content,
The device control system according to any one of claims 2 to 6, wherein the control unit controls the display device so as to realize the device control content determined by the determination unit. The determination unit
A device control content for which a plurality of devices are controlled is determined as the first device control content,
The device control content for which the device to be controlled is less than the first device control content is determined as the second device control content,
The device control system according to any one of claims 2 to 6, wherein the control unit controls the device so as to realize the device control content determined by the determination unit. The organism is a human,
The device control system further includes
Comprising a camera that images the organism and generates image data;
The determination unit
It is determined using the image data whether or not the organism has a predetermined facial expression when the control unit performs device control based on the first device control content,
When it is determined that the organism has a predetermined facial expression, the second device control content when the evaluation unit evaluates that the organism has executed the target action after the determination of the first device control content. Decide
When it is determined that the organism does not have a predetermined facial expression, the first device is evaluated when the evaluation unit evaluates that the organism has executed the target action after the determination of the first device control content. The device control content according to any one of claims 2 to 9, wherein the device control content is determined to be the same as the control content. The determination unit selects one device control content from among a plurality of device control details determined in advance so as to increase the frequency of voluntarily executing the target action on the organism according to an operant conditioning theory. The device control system according to claim 2, wherein the determination is performed. The device control system includes:
A camera that generates image data as the observation data by imaging;
The device control system according to any one of claims 1 to 11, wherein the evaluation unit performs the evaluation based on the image data sequentially generated by the camera. The organism is a human,
The device control system according to any one of claims 1 to 12, wherein the device control content determined by the determination unit is a device control content that causes a device to be controlled to perform an output that affects human perception. A device control method for controlling devices that affect living organisms,
A first evaluation step of evaluating the behavior of the organism based on observation data relating to the behavior of the organism;
A first determination step of determining the device control content under a certain condition based on the evaluation result in the first evaluation step;
A first control step for performing device control based on the device control content determined in the first determination step;
A second evaluation step of evaluating the behavior of the organism based on observation data relating to the behavior of the organism after device control is performed in the first control step;
A second determination step of determining device control content under a certain condition according to the evaluation result in the second evaluation step and the device control content determined in the first determination step;
A second control step of performing device control based on the device control content determined in the second determination step. The device control method further includes
A third evaluation step of evaluating the behavior of the organism based on observation data relating to the behavior of the organism after the device control is performed in the second control step;
A third determination step of determining the device control content under a certain condition according to the evaluation result in the third evaluation step and the device control content determined in the second determination step;
A third control step for performing device control based on the device control content determined in the third determination step,
The evaluation in the first evaluation step, the second evaluation step, and the third evaluation step includes a distinction as to whether or not the organism has performed a predetermined target action,
In the first determination step, a first device control that influences the organism to increase the frequency of execution of the target behavior when the organism is evaluated in the first evaluation step as having executed the target behavior. The content is determined as the device control content,
In the second determination step, when the organism has executed the target action and is evaluated in the second evaluation step, the influence of increasing the execution frequency of the target action on the organism is determined by the first device control content. The second device control content that is given smaller is set as the device control content, and the determination is performed.
In the third determination step, when the organism has executed the target action, and the third evaluation step evaluates the influence of the organism to increase the execution frequency of the target action, the second device control content The device control method according to claim 14, wherein the determination is performed by using, as the device control content, third device control content that is given smaller. A control program for causing a device control device including a microprocessor to execute device control processing for performing device control that affects a living organism,
The device control process
A first evaluation step of evaluating the behavior of the organism based on observation data relating to the behavior of the organism;
A first determination step of determining the device control content under a certain condition based on the evaluation result in the first evaluation step;
A first control step for performing device control based on the device control content determined in the first determination step;
A second evaluation step of evaluating the behavior of the organism based on observation data relating to the behavior of the organism after device control is performed in the first control step;
A second determination step of determining device control content under a certain condition according to the evaluation result in the second evaluation step and the device control content determined in the first determination step;
And a second control step for performing device control based on the device control content determined in the second determination step.

Images