JP2004278912A - Person response system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform the response processing in accordance with the frequency or the number of times of the change of motion when the response processing on the basis of the change of motion is performed by detecting the change of motion of a man. <P>SOLUTION: An indoor controller 2 adjusts a temperature of an air conditioner 1 as the response processing corresponding to the specific motion, by determining an execution timing of the response processing in accordance with the frequency or the number of times of the detection that the change of motion of the person is corresponding to the specific motion as a result of analysis for image of a person photographing a person who is indoor. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a person response control system and a program for performing a response process according to a person's motion.
[0002]
[Prior art]
Conventionally, as this kind of human response control system, for example, there is a system such as an electronic toy or an intelligent robot that performs a response process corresponding to the detection of a speech or motion from a human, such as an electronic toy or an intelligent robot.
In addition, a control device for an air conditioner that takes an image of a room with an air-conditioning facility by a camera, analyzes the captured image to determine the degree of arousal of a person, and controls the air-conditioning facility based on the determination result. Is known (see Patent Document 1).
[0003]
[Patent Document 1]
JP-A-10-259943
[0004]
[Problems to be solved by the invention]
However, in each of the above-described response control systems, each time a specific operation of a human is detected, a corresponding response process is performed. For example, when an operation similar to the specific operation is performed, or when the specific operation is erroneously performed. Is performed, that is, even when an unintended operation is performed, the detection is made sensitively, and there is a problem that an undesired response process is performed.
This is the same even when there are a plurality of persons indoors. If any one of the persons performs a predetermined operation, a corresponding response process is executed. , Undesired results.
[0005]
A first object of the present invention is to make it possible to execute a response process according to the frequency or the number of times of a change of a motion when detecting a change of a motion of a human and performing a response process according to the change of the motion. .
A second object of the present invention is to perform a response process in accordance with a ratio of a person who has performed a specific operation among a plurality of persons when performing a response process in accordance with the change in the human motion. To be able to do it.
A third object of the present invention is to make it possible to execute a response process according to a change in a plurality of persons who are indoors.
[0006]
[Means for Solving the Problems]
The invention according to claim 1 (first invention) is a person response control system that performs a response process in accordance with the motion of a person, and captures a person who is indoors and sequentially analyzes the person image to capture the person. Detecting means for detecting whether a change in the motion of a person corresponds to a specific action, and determining to determine the execution timing of a response process according to the detection frequency or the number of times of detection each time the specific action is detected by the detecting means Means and a response means for executing a response process corresponding to the specific operation when the execution timing is determined by the determination means.
Further, the present invention provides a computer with a program for realizing the main functions described in the first aspect of the present invention (the eighth aspect of the present invention).
[0007]
Therefore, according to the first and eighth aspects of the present invention, when analyzing a person image of a person who is indoors and detecting that a change in the motion of the person corresponds to a specific operation, the invention according to the frequency or the number of times is determined. Response processing is determined by executing the response processing corresponding to the specific action, so that the response processing can be performed according to the natural movement of the person, and the response processing can be performed for unintended movements. Instead, it is possible to respond only when the probability is high, and it is possible to realize response control according to the actual situation.
[0008]
The invention according to claim 2 (second invention) is a person response control system that performs a response process according to the motion of a person, and photographs a plurality of persons indoors and sequentially analyzes the plurality of person images. Detecting means for detecting whether the change in motion of each person corresponds to the specific action, and obtaining a ratio of persons who performed the specific action each time the specific action is detected by the detecting means. Response means for executing response processing corresponding to the specific operation.
Further, the present invention provides a computer with a program for realizing the main functions described in the second aspect of the present invention (the ninth aspect of the present invention).
[0009]
Therefore, according to the second and ninth aspects of the present invention, when a plurality of person images obtained by photographing a plurality of persons indoors are analyzed, when the motion change of each person corresponds to the specific operation, the specific operation is performed. Since the response processing corresponding to the specific operation is executed according to the ratio of the persons, even if any one of the plurality of persons indoors performs the specific operation, no response is made, and the entire person indoors is not responded. In consideration of the operation described above, it is possible to realize response control according to the actual situation.
[0010]
In the inventions according to the first and second aspects, if an adjustment process for adjusting the indoor environment is performed according to a change in the motion of a person (the invention according to the third aspect), for example, temperature adjustment, humidity adjustment, etc. Can be accurately and remotely controlled as necessary, so that it can be expected to be used not only for ordinary households but also as an automatic environment adjustment means in organizations such as companies and public facilities.
Further, in the invention according to claim 2, when executing the response processing corresponding to the specific operation, the response processing corresponding to the processing level corresponding to the ratio of the person who has performed the specific operation is performed. 4), stepwise control can be performed in accordance with the proportion of persons, and the situation can be made more realistic.
[0011]
The invention according to claim 5 (third invention) is a person response control system that performs a response process according to a person who is indoors, and a detection unit that detects a change in the entirety of a plurality of people indoors, A response unit that executes a response process according to a change in the entire person detected by the detection unit.
Further, the present invention provides a computer with a program for realizing the main functions shown in the invention described in claim 5 (the invention described in claim 10).
[0012]
Therefore, the invention according to claims 5 and 10 detects a change in a plurality of persons who are indoors and executes a response process in accordance with the change in the whole person. In addition, it is possible to respond to the entire person indoors, and it can be expected to be used as response control means not only for ordinary households but also for organizations such as companies and public facilities.
[0013]
If a change in the number of persons indoors is detected and a response process optimal for the current number of persons is executed according to the change in the number of persons (the invention according to claim 6), for example, volume adjustment of a speaker, temperature adjustment Etc. can be accurately controlled remotely according to the number of people.
In addition, if the total body temperature of all persons indoors is detected based on the distribution state of biological heat obtained by the infrared camera, the indoor temperature may be adjusted according to the total body temperature of all persons. In the described invention), when the indoor temperature is adjusted, it is possible to detect a change in the whole person indoors by a simple and reliable method, and the practical effect is high.
[0014]
BEST MODE FOR CARRYING OUT THE INVENTION
(1st Embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram showing the overall configuration of the person response control system according to this embodiment.
This person response control system is an indoor air-conditioning control system that automatically adjusts the temperature of an air conditioner according to the operation of a person in a room, and includes an air conditioner 1 installed in a general home and each of the air conditioners. 1 and an indoor controller 2 connected via short-range communication means (for example, infrared communication means) to the indoor controller 2 via short-range communication means (for example, weak wireless means). And a plurality of surveillance cameras 3.
[0015]
The air conditioner 1 has a cooling and heating function, and receives a temperature control remote control signal (infrared signal) transmitted and output from the indoor controller 2, and controls the temperature in accordance with the control content. It has become. The remote control signal (infrared signal) corresponds to a signal transmitted and output from a normal hand-held controller provided for remote operation.
The indoor controller 2 is a freely movable handy type or fixedly mounted installation type control device, and has a communication function of transmitting and outputting a remote control signal to the air conditioner 1. A communication function for performing short-range wireless communication with the monitoring camera 3 is provided.
[0016]
The surveillance camera 3 is a video camera and a still camera that constantly capture a color image of a person in order to monitor a change in the motion of the person in the room. Note that the video camera is provided for detecting a motion change of a person, and the still camera is provided for identifying a person for identifying a person. Also, in one room, two surveillance cameras 3 are installed to prevent a person from falling out of the photographable area and to photograph a person from the front-back direction or the left-right direction. Even if a person goes out of the photographable area of No. 3 or if there is a person in that area and it gets into an obstacle or a shadow of another person, the movement change of the person is set in another direction. It can be monitored by the monitoring camera 3.
[0017]
The images captured by each monitoring camera 3 are sequentially transmitted to the indoor controller 2. Here, the indoor controller 2 is configured to sequentially analyze the captured images from the surveillance camera 3 to detect whether the change in the motion of the person corresponds to the specific motion. Here, when there is only one person in the room, when the specific operation is performed, the indoor controller 2 transmits a remote control signal for temperature adjustment according to the frequency or the number of times the specific operation is performed. Output.
When there are a plurality of persons in the room, a remote control signal for temperature adjustment is transmitted and output according to the ratio of the number of persons who have performed the specific operation.
[0018]
FIG. 2 is a diagram for explaining the operation response table 20 provided on the indoor controller 2 side.
In the operation response table 20, information for performing a predetermined response process corresponding to a specific operation performed by a person in the room is set. For example, various types of specific operations in cold weather include: "The action of curling the back and rubbing both hands", "Breathing on the hand", and "‥‥" are also specific actions in hot weather, such as "wiping sweat on the forehead", "hand and “Fan with an object” and ‥‥, and “motion change pattern identification information” unique to these motion change patterns is set in the motion response table 20. Further, in this embodiment, response processing corresponding to various specific operations when the temperature is cold and response processing corresponding to various specific operations when the temperature is hot are set in the operation response table 20. Here, the response process corresponding to various specific operations when the temperature is cold is an adjustment process for increasing the indoor temperature by 1 ° C. The response process corresponding to various specific operations when the temperature is hot is an adjustment process for lowering the indoor temperature by 1 ° C. is there.
[0019]
FIG. 3 is a diagram for explaining the response timing determination table 21 provided on the indoor controller 2 side.
The response timing determination table 21 is a table for determining an execution timing for starting execution of a response process corresponding to a specific operation, and corresponds to various “operation change patterns” and their “pattern identification information”. In addition to storing a preset “reference count” and “reference frequency”, a configuration that stores “total actual count” and “actual count per unit time” updated each time an operation change is detected It has become.
[0020]
The “total actual number” is a cumulative value of how many times the specific operation has been performed since the person entered the room until the present time, and the “reference number” is the execution timing of the response processing corresponding to the “total actual number”. Is set as a reference value for determining, for example, “5 times”, “3 times”, and ‥‥ are set. The “actual number per unit time” is a cumulative value indicating how many times the specific operation has been performed per unit time, and the “reference frequency” is a response process corresponding to the “actual number per unit time”. This is a set value serving as a reference for determining the execution timing. For example, “3 times / 10 minutes”, “2 times / 5 minutes”, and ‥‥ are set. Here, in the case where the number of persons is one, the indoor controller 2 updates the “total actual number” or “the actual number per unit time” updated each time a specific operation by the person is detected with the corresponding “standard”. When the number of times matches the "reference frequency", the room temperature adjustment process is started. The “actual number per unit time” is cleared each time the elapse of the unit time is detected.
[0021]
FIG. 4 is a diagram for explaining the determination result table 22 provided on the indoor controller 2 side.
The determination result table 22 indicates whether or not a specific operation (wearing / unwearing operation) is performed for each person when a plurality of persons are present in the room, and a specific operation when the person is cold (wearing the outerwear). Operation) or a specific operation in hot weather (operation to take off the outerwear) is stored. For example, when the determination result is “0”, the specific operation is performed. Is not performed, and “+1” indicates that the specific operation in cold weather has been performed. Although not shown, "-1" indicates that the specific operation in hot weather has been performed. The indoor controller 2 refers to the contents of the determination result table 22 to determine the ratio of the number of persons who performed the specific operation when the temperature was cold or hot, and determined the temperature adjustment level according to the ratio of the number of persons to determine the room temperature. An adjustment process is performed.
[0022]
FIG. 5 is a block diagram showing basic components of the indoor controller 2.
The CPU 23 is a central processing unit that controls the overall operation of the indoor controller 2 according to the operating system and various application software in the storage device 24. The storage device 24 has a program storage area and a data storage area, and is configured by a magnetic, optical, semiconductor memory, or the like and a drive system thereof. The recording device 24 may have a structure in which a removable storage medium such as a CD-ROM or a DVD can be mounted in addition to a fixed memory such as a hard disk. The programs and data in the storage device 24 are loaded into a RAM (for example, a static RAM) 25 as necessary, or the data in the RAM 25 is saved in the storage device 24. The RAM 25 has a program execution area and a work area. Further, the CPU 23 has input / output peripheral devices such as an input device 26, a display device 27, an infrared communication device 28, and a weak wireless communication device 29 connected via a bus line. Control behavior.
[0023]
Next, an operation concept of the person response control system (indoor air-conditioning control system) in the first embodiment will be described with reference to flowcharts shown in FIGS. Here, the functions described in these flowcharts are stored in the form of readable program codes, and sequentially execute operations according to the program codes. Further, the operation according to the above-described program code transmitted via the transmission medium can be sequentially performed. The same applies to other embodiments described later, and an operation specific to this embodiment can be executed using a program / data externally supplied via a transmission medium in addition to a recording medium.
[0024]
FIG. 6 and FIG. 7 are flowcharts showing the overall operation of the indoor controller 2, and are started when the power to the air conditioner 1 is turned on.
First, the indoor controller 2 gives a shooting instruction to each surveillance camera 3 (still camera) (step A1), and then receives a shot image (still image) sent from the surveillance camera 3 in response thereto. Then, (Step A2), the photographed image is analyzed to check whether a person is photographed (whether there is a person in the room) or not (Step A3). The system enters a standby state until a person is detected while giving a photographing instruction to the monitoring camera 3. If at least one person is present in the room, the person and the number of persons are specified from the photographed image (step A4).
[0025]
As a result, if there is only one person in the room (YES in step A5), the person is specified as a monitoring target (step A6), and a shooting instruction is given to each monitoring camera 3 (video camera) ( Step A7). Upon receiving the captured image (moving image) sent from the monitoring camera 3 in response to this (step A8), the captured image is analyzed and it is checked whether or not the person to be monitored is in the captured area. (Step A9) If it is not captured, it instructs each surveillance camera 3 (video camera) to stop capturing a moving image (Step A11), but if the person to be monitored is captured, it analyzes the video. It is checked whether or not there is a change in the motion of the person (a relatively large change in motion) (step A10).
[0026]
If the person is still stopped or hardly moves, it is detected in step A10 that there is no change in operation, and the process returns to step A8 to monitor the change in operation while capturing a captured image (moving image). to continue. If a relatively large change in operation is detected (YES in step A10), it is checked whether the operation corresponds to any of various predetermined specific operation patterns (step A12). In this case, the size of the motion and the moving direction are comprehensively analyzed while sequentially focusing on specific parts such as the upper body and the arms to extract the feature of the motion change, and the characteristic pattern and the motion change in the response timing determination table 21 are extracted. This is performed by sequentially comparing patterns.
[0027]
Here, if none of the motion change patterns is applicable, the process returns to step A8 and continues to monitor the motion change. For example, as a specific operation in cold weather, an operation of "rounding his back and rubbing both hands" is performed. In the case where a specific action in hot weather is performed, such as “wipe sweat on the forehead” or the like, the operation corresponds to the operation change pattern in the response timing determination table 21. After performing the update process of adding “1” to “the total number of actual times” and “the actual number of times per unit time”, respectively, the “reference” set in the response timing determination table 21 corresponding to this operation change pattern is set. By reading the “number of times” and comparing the “reference number of times” with the “total number of actual times”, it is checked whether the “total number of actual times” is equal to or more than the “reference number of times” (step 14).
[0028]
If the “total actual number” is less than the “reference number”, the “reference frequency” corresponding to the specific operation is read from the response timing determination table 21, and the “reference frequency” and the “actual number per unit time” are read. Then, it is checked whether the “actual number per unit time” is equal to or more than the “reference frequency” (step A15).
As a result, when it is detected in step A14 that the “total actual number” is equal to or more than the “reference number” or in step A15 that the “actual number per unit time” is equal to or more than the “reference frequency”, A room temperature adjustment process corresponding to the operation pattern is selected from the operation response table 20 (step A16), and a remote control signal for temperature adjustment is transmitted and output by executing the selection process (step A17).
[0029]
On the other hand, when there are a plurality of persons in the room (NO in step A5), the process proceeds to step A18 in FIG. 7, and each person image is temporarily stored as an initial image. Further, after elapse of a predetermined time (step A19), a photographing instruction is given to the still camera of each monitoring camera 3, and the photographed image is received (step A20). Then, it is checked whether or not a person is present in the received image this time (step A21). If there is no person, the process returns to step A1 in FIG. After the identification (Step A22), the person image is temporarily stored for each person (Step A23).
[0030]
In this state, for each person, the initial image is compared with the current received image (step A24) to check whether there has been a change in clothes (step A25). That is, it is checked with respect to all the persons in the room whether they wear their outerwear as a cold operation or take off their outerwear as a hot operation (steps A24 to A28). As a result, if any one of the persons performs the corresponding action and the clothes change (YES in step A25), the direction of the change (whether the user wears or takes off his outerwear) is determined (step A26). In the case of wearing the clothes, the judgment result of "+1" is set in the judgment result table 22 corresponding to the person as a change in the plus direction, and in the case of taking off the jacket, the judgment result of the minus direction is changed. A determination result of “−1” as a change is set in the determination result table 22 corresponding to the person (step A27).
Hereinafter, after performing the above-described operation on all the persons, the determination result table 22 is referred to, and the ratio of “+1” or “−1” set in the plus / minus direction, that is, the number of persons in the room Then, the ratio of the person who put on the outerwear is determined or the ratio of the person who took off the outerwear is obtained (step A29).
[0031]
Here, in the case of the plus direction in which “+1” is set as the determination result (step A30), an adjustment value for increasing the temperature is determined according to the magnitude of the ratio (steps A31 to A34). . That is, as a result of comparing the calculated ratio in the plus direction with a predetermined reference value, it is determined whether the ratio is small, large, or medium (step A31). 1 ° C. ”(step A32). If the temperature is medium,“ 2 ° C. ”is determined as the temperature rise value (step A33). If the temperature is large,“ 3 ° C. ”is determined as the temperature rise value. (Step A34).
[0032]
Similarly, when the determination result is in the minus direction in which “−1” is set (step A35), an adjustment value for lowering the temperature is determined according to the magnitude of the ratio (steps A36 to A39). ). That is, as a result of comparing the calculated ratio in the negative direction with a predetermined reference value, it is determined whether the ratio is small, large, or medium (step A36). Is determined (step A37). If the value is medium, “2 ° C.” is determined (step A38). If the value is large, “3 ° C.” is determined (step A39).
[0033]
As described above, in the first embodiment, the indoor controller 2 analyzes the person image obtained by photographing the person in the room, and when it detects that the change in the motion of the person corresponds to the specific operation, Alternatively, the execution timing of the response process is determined according to the number of times, and the temperature adjustment of the air conditioner 1 is performed as the response process corresponding to the specific operation, so that the temperature adjustment can be performed in response to the natural operation of the person. However, it is possible to respond only to the case where the probability is high without responding to the unintended operation, and it is possible to realize the response control according to the actual situation.
[0034]
In addition, as a result of analyzing a plurality of person images obtained by photographing a plurality of persons in the room, the indoor controller 2 determines that a change in the motion of each person is a specific operation (wearing in a jacket as a cold operation or as a hot operation). (Whether he / she took off his jacket)), determines an adjustment value for temperature rise as a response process corresponding to the specific operation or an adjustment value for lowering the temperature in accordance with the proportion of persons who performed the specific operation. The temperature of the air conditioner 1 is adjusted by adjusting the temperature of the air conditioner 1. Therefore, even if any one of a plurality of persons in the room performs a specific operation, the person does not respond, and the operation of the entire person in the room is considered. A response can be made, and response control according to the actual situation can be realized. In this case, the room temperature can be adjusted stepwise according to the ratio.
[0035]
In the above-described first embodiment, as the specific operation at the time of cold, “an operation of rolling the back and rubbing both hands” and “exhaling at the hand” are exemplified, and as the specific operation at the time of hot, “ The example of the operation of wiping the sweat of the forehead and the function of `` fan with a hand or object '' are also exemplified. Other specific operations in cold weather include `` rubbing hands, '' `` rubbing arms, '' and `` wearing outerwear '' , "Pursue the neck", "Shake the lips", "Rub the ears", "Shrink the body", and the like. In addition, the specific motion when the temperature is hot may be “sit with the body spread”, “relax the tie”, or the like. Of course, a combination of these operations may be detected as a specific operation.
[0036]
In the first embodiment described above, the “total actual number” and “the actual number per unit time” corresponding to each specific operation are counted. The “actual number” may be a total value when any one of the individual specific operations described above is performed. For example, each time one of the following operations is performed among “rubbing hands”, “rubbing arms”, “wearing outerwear”, and “‥‥”, “total actual number of times”, “real time per unit time” The number of times may be updated.
[0037]
Further, in the first embodiment described above, when there are a plurality of persons in the room, whether to wear the outerwear or take off the outerwear is set as the determination result set in the determination result table 22. However, as a specific action in cold weather, judgment results such as "rounding your back and rubbing your hands" and "exhaling your hands" or a specific action in hot weather "wipe sweat on your forehead", "hand A determination result such as "Let's play with something" may be set.
In the above-described first embodiment, the case where the room temperature is adjusted is illustrated. In addition, for example, the degree of light (the degree of sweating) is focused on the forehead of a face image photographed for each person. May be determined by comparing the first captured image with the current captured image, and the indoor humidity may also be adjusted.
[0038]
On the other hand, a recording medium (for example, a CD-ROM, a floppy disk, a RAM card, or the like) in which a program code for causing each of the above-described units to be executed may be provided to the computer.
That is, a recording medium having a program code that can be read by a computer, a function of detecting whether a change in the motion of the person corresponds to a specific operation by photographing a person indoors and sequentially analyzing the image of the person. And a function of determining the execution timing of the response processing according to the detection frequency or the number of times of detection each time the specific operation is detected, and a response corresponding to the specific operation when the execution timing is determined. A computer-readable recording medium that records a program for realizing the function of executing a process may be provided. ,
[0039]
Further, a recording medium having a computer-readable program code, a plurality of persons indoors is photographed, and by sequentially analyzing the plurality of person images, whether the change in motion of each person corresponds to the specific operation A program for realizing a function of detecting a specific operation and a function of obtaining a ratio of persons who have performed a specific operation each time a specific operation is detected and executing a response process corresponding to the specific operation in accordance with the ratio is recorded. A computer-readable recording medium may be provided.
[0040]
(2nd Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to FIG. In the above-described first embodiment, the temperature adjustment processing is performed according to the frequency or the number of motion changes of the person in the room, or the temperature adjustment processing is performed according to the ratio of the person who has performed the specific operation. However, in the second embodiment, a response process according to a change in the whole person in the room is executed.
Here, in both embodiments, basically the same components are denoted by the same reference numerals, and the description thereof will be omitted. In addition, the following description focuses on the features of the second embodiment.
[0041]
In the second embodiment, the control target for adjusting the indoor environment is not limited to the air conditioner 1, and the volume of an audio device (not shown) can be automatically controlled. In the second embodiment, an infrared camera is used as the surveillance camera 3 to detect a change in the number of persons in the room based on the distribution state of the human body heat (human body heat). Thus, the sound volume of the sound device is automatically controlled, or the total body temperature of all the persons is detected, and the temperature of the air conditioner 1 is controlled in accordance with the total body temperature of all the persons.
[0042]
FIG. 8 is a flowchart showing the operation of the indoor controller 2 in the second embodiment.
First, the indoor controller 2 waits for a control start instruction transmitted when the power of the air conditioner 1 or the like is turned on (step B1). After giving the indoor photographing instruction to the camera 3 (step B2), in response to the instruction, the photographed image (thermal map) transmitted from the infrared camera is received (step B3), and this is temporarily stored as an initial image. (Step B4). Then, the thermal map is analyzed, and the number of persons in the room is counted based on the distribution state of the human body heat (step B5).
[0043]
In this state, after elapse of a predetermined time (step B6), an indoor photographing instruction is given to the surveillance camera (infrared camera) 3 again (step B7), and the photographed image is received (step B8). The number of persons in the room is counted by this image analysis (step B9). Then, the initial count value (number of people) is compared with the current count value (number of people) (step B10) to check whether or not the number of people has changed (step B11). Here, if there is a change in the number of persons, the volume of the sound device is automatically controlled (steps B12 to B16). That is, it is checked whether the number of persons has increased or decreased (step B12). If the number of persons has increased, the current setting value is changed to "loud volume" on the condition that the current setting value is not "loud volume" (step B13). (Step B14), and when the number of people has decreased, it is changed to "low volume" on condition that the current set value is not "low volume" (step B15). A volume adjustment signal is transmitted and output (step B16).
[0044]
Next, the distribution of the human body heat distributed over the entire image is analyzed while comparing the entirety of the initial image and the current received image, and the total amount of the human body heat (total body temperature of all persons) is quantified (step B17). ), It is checked whether or not the total body temperature has changed (step B18). That is, it is checked whether the amount of change has increased or decreased from a predetermined reference value (step B19), and if it has increased, an adjustment process for lowering the room temperature by 1 ° C. is executed (step B19). B20) If it has decreased, an adjustment process for increasing the room temperature by 1 ° C. is executed (step B21).
Thereafter, the process proceeds to step B22, where it is determined whether or not a control end instruction transmitted in response to turning off of the power of the air conditioner 1 or the like is received, and the process returns to step B6 to repeat the above operation until the end instruction is received. (Steps B6 to B22).
[0045]
As described above, in the second embodiment, the indoor controller 2 detects a change in a plurality of persons in the room and executes a response process according to the change in the whole person. It is possible to respond to the entire person in the room without targeting the user, and it can be expected to be used as a response control means in not only ordinary households but also organizations such as companies and public facilities. In this case, the speaker volume optimal for the current number of people can be adjusted according to the change in the number of persons in the room, and the room temperature can be adjusted according to the total body temperature of all the persons. Further, since the change of the person in the room is detected based on the distribution state of the human body heat obtained by the infrared camera, the change of the whole person in the room can be detected by a simple and reliable method.
[0046]
In the above-described second embodiment, the speaker volume is adjusted according to the change in the number of people. However, the room temperature adjustment may be adjusted according to the change in the number of people.
In the above-described second embodiment, the change in the number of persons and the change in the body temperature of all the persons are detected as changes in the entire person. However, gender changes and age group changes are detected, and a response appropriate to the gender and age group is detected. Control may be performed.
[0047]
Further, a recording medium (for example, a CD-ROM, a floppy disk, a RAM card, or the like) in which a program code for causing the computer to execute the above-described units may be provided.
That is, a recording medium having a program code readable by a computer, a function of detecting a change in a plurality of persons indoors and a function of executing a response process in accordance with the detected change in the whole person. A computer-readable recording medium on which a program for realizing the program is recorded may be provided.
[0048]
Furthermore, in each of the above-described embodiments, the case where the indoor environment of a general home is controlled is illustrated. However, the present invention is not limited to the general home, and may be a case where the indoor environment of an organization such as a company or a public facility is controlled. .
Furthermore, the present invention is not limited to the case of controlling an indoor environment, and can be applied to control of a response operation of an electronic toy, an intelligent robot, or the like.
[0049]
【The invention's effect】
According to the first invention (invention of claim 1), when the analysis of a person image of a person who is indoors detects that a change in the motion of the person corresponds to a specific operation, the detection is performed. Since the execution timing of the response process is determined according to the frequency or the number of detections and the response process corresponding to the specific operation is executed, the response process according to the natural motion of the person becomes possible, It is possible to respond only to the case where the probability is high without responding to the operation, and it is possible to realize response control according to the actual situation.
According to the second invention (invention of claim 2), as a result of analyzing a plurality of person images obtained by photographing a plurality of persons indoors, when the motion change of each person corresponds to the specific operation, the identification is performed. Since the response process corresponding to the specific operation is performed according to the ratio of the person who performed the operation, even if any one of the plurality of persons indoors performs the specific operation, the response process is not performed. The response can be made in consideration of the motion of the whole person in the room, and the response control according to the actual situation can be realized.
According to the third invention (invention of claim 5), a change in a plurality of persons who are indoors is detected, and a response process is performed according to the change in the whole person. It is possible to respond to the whole person in the room without targeting, and it can be expected to be used as a response control means not only in ordinary households but also in organizations such as companies and public facilities.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an overall configuration of a person response control system.
FIG. 2 is a diagram for explaining an operation response table 20 provided on the indoor controller 2 side.
FIG. 3 is a diagram for explaining a response timing determination table 21 provided on the indoor controller 2 side.
FIG. 4 is a diagram for explaining a determination result table 22 provided on the indoor controller 2 side.
FIG. 5 is a block diagram showing basic components of the indoor controller 2.
FIG. 6 is a flowchart showing the overall operation of the indoor controller 2 started to be executed in response to turning on the power to the air conditioner 1;
FIG. 7 is a flowchart showing the overall operation of the indoor controller 2 following FIG. 6;
FIG. 8 is a flowchart illustrating an operation of the indoor controller 2 according to the second embodiment.
[Explanation of symbols]
1 air conditioner
2 Indoor controller
3 surveillance cameras
20 Operation response table
21 Response timing decision table
22 Judgment result table
23 CPU23
24 storage devices
28 Infrared communication device
29 Weak wireless communication device

Claims (10)

A person response control system that performs a response process according to a motion of a person,
Detecting means for photographing a person in the room and sequentially analyzing the person image to detect whether a change in the motion of the person corresponds to a specific operation,
Determining means for determining the execution timing of the response process according to the detection frequency or the number of detections determined each time the specific operation is detected by the detection means;
A response unit that executes a response process corresponding to the specific operation when the execution timing is determined by the determination unit;
A person response control system comprising: A person response control system that performs a response process according to a motion of a person,
Detecting means for photographing a plurality of persons in the room and sequentially analyzing the plurality of person images to detect whether a change in the motion of each person corresponds to a specific operation,
A response unit that calculates a ratio of persons who have performed the specific operation each time the specific operation is detected by the detection unit, and executes a response process corresponding to the specific operation in accordance with the ratio;
A person response control system comprising: The response unit executes an adjustment process for adjusting an indoor environment according to a change in the motion of a person.
The person response control system according to claim 1 or 2, wherein the system is configured as follows. The response unit, when performing a response process corresponding to the specific operation, performs a response process corresponding to a processing level according to the ratio of the person who performed the specific operation,
3. The person response control system according to claim 2, wherein: A person response control system that performs response processing according to a person who is indoors,
Detecting means for detecting a change in a plurality of persons indoors;
A response unit that executes a response process according to a change in the entire person detected by the detection unit;
A person response control system comprising: The detecting means detects a change in the number of people indoors,
The response unit performs an optimal response process for the current number of people according to a change in the number of people indoors detected by the detection unit,
6. The person response control system according to claim 5, wherein: The detection means is an infrared camera that detects a person based on the distribution of bio-heat of a person indoors, and the total body temperature of all persons indoors based on the distribution of the bio-heat obtained by the infrared camera. Is detected,
The response unit adjusts the indoor temperature according to the total body temperature of all the persons detected by the detection unit,
6. The person response control system according to claim 5, wherein: Against the computer
A function of photographing a person who is indoors and detecting whether a change in the motion of the person corresponds to a specific operation by sequentially analyzing the image of the person,
A function of determining the execution timing of the response process according to the detection frequency or the number of detections determined each time the specific operation is detected,
A function of executing a response process corresponding to the specific operation when it is determined that the execution timing is reached,
The program to realize. Against the computer
A function of photographing a plurality of persons indoors and detecting whether a change in the motion of each person corresponds to a specific operation by sequentially analyzing the plurality of person images,
A function of obtaining a ratio of persons who have performed a specific operation each time a specific operation is detected, and executing a response process corresponding to the specific operation in accordance with the ratio;
The program to realize. Against the computer
A function to detect changes of multiple people indoors,
A function of executing a response process according to a change in the entire detected person,
The program to realize.

Images