WO2012011400A1

WO2012011400A1 - Output control device

Info

Publication number: WO2012011400A1
Application number: PCT/JP2011/065760
Authority: WO
Inventors: 本郷　仁志; 石井　洋平; 圭介淺利; 長輝楊
Original assignee: 三洋電機株式会社
Priority date: 2010-07-20
Filing date: 2011-07-11
Publication date: 2012-01-26
Also published as: JP2012042197A

Abstract

A CPU searches for one or two or more persons present in the interior space of a room (RM1) on the basis of an image of field output from a camera (12) for capturing the interior space of the room (RM1) and controls the output operations of air conditioners (D_1 to D_6) for generating outputs to the interior space of the room (RM1) on the basis of the positional relationships between the one or two or more persons found by the search processing and the air conditioners (D_1 to D_6). The CPU also reproduces the image of field output from the camera (12) on a monitor screen while controlling the air conditioners and multiplexes a graphic image showing the operation states of the air conditioners (D_1 to D_6) onto the image of field reproduced on the monitor screen.

Description

Output control device

The present invention relates to an output control device, and more particularly to an output control device that detects a specific object existing in space and controls the output of the device.

An example of this type of device is disclosed in Patent Document 1. According to this background art, the sensor unit measures at least the temperature of a person or the like in the detection area. The image processing unit extracts a feature amount by processing a thermal image having a detected temperature, which is an output from the sensor unit, as a pixel value. Based on the signal from the image processing unit, the image information detection unit outputs a human personal information signal, an environmental information signal, or the like equivalent to or more detailed than the output signal from the sensor unit using a neural network or a pattern recognition mechanism. . The operation of the air conditioner is controlled based on such a signal.

Japanese Patent Application Laid-Open No. 6-117836

However, in the background art, it is not easy to determine whether or not the operation of the air conditioner is accurately controlled, and there is a possibility that the load on the initial setting work and the maintenance work increases. That is, it can be understood from the change in the operation of the air conditioner in response to the detection result that the person has been detected and that the air conditioner operates in response to the detection result. However, experience and skill are required to correctly match the detected position of the person with the operating range of the air conditioner.

Therefore, a main object of the present invention is to provide an output control device capable of reducing the load applied to the initial setting work and / or the maintenance work.

The output control device according to the present invention comprises the following: search means for searching for one or more specific objects existing in the space based on the object scene image output from the camera that captures the space; Control means for controlling the output operation of the plurality of devices generating the output based on the positional relationship between one or more specific objects discovered by the search means and the plurality of devices; an object scene image output from the camera; Reproduction means for reproducing on the monitor screen in parallel with the control processing of the control means; and multiplexing means for multiplexing the state information indicating the operation states of the plurality of apparatuses onto the object scene image reproduced by the reproduction means.

Preferably, a selection unit that alternatively selects a plurality of modes including the trial operation mode, and an activation unit that activates the multiplexing unit corresponding to the trial operation mode are further provided.

Preferably, the camera has an imaging surface defined along the UV coordinate system, the space has a plane defined along the XY coordinate system, and the control means corresponds to the UV coordinate system and the XY coordinate system. Calculating means for calculating XY coordinates of a specific object with reference to a calibration parameter indicating the relationship and an image found by the searching means; and detecting means for detecting a positional relationship with reference to the XY coordinates calculated by the calculating means. Including.

More preferably, there is further provided a definition means for defining the multiple positions of the state information with reference to the calibration parameter.

Preferably, each of the plurality of devices corresponds to an air conditioning control device, and the state information has at least one of temperature, humidity, air volume, wind direction, and power consumption as parameters.

Preferably, the status information has a position and / or width that each output of the plurality of devices reaches as a parameter.

Preferably, transmission means for transmitting the object scene image and the state information to the mobile communication terminal is further provided, and the monitor screen corresponds to the monitor screen of the mobile communication terminal.

The output control device according to the present invention comprises the following: search means for searching for one or more specific objects existing in space based on the object scene image output from the camera capturing the space; output from the camera Reproduction means for reproducing the object scene image on the monitor screen in parallel with the search processing of the search means; directing different outputs to the space according to the positional relationship with one or more specific objects found by the search means Detecting means for detecting operating states of a plurality of generated devices; and multiplexing means for multiplexing state information indicating the operating states detected by the detecting means on the object scene image reproduced by the reproducing means.

According to the present invention, the plurality of devices generate outputs toward the space, the specific object existing in the space is searched based on the object scene image output from the camera capturing the space, and the outputs of the plurality of devices The operation is controlled based on the positional relationship between the specific object discovered by the search process and the plurality of devices. Thereby, adaptive output control in consideration of the position of the specific object is realized.

In addition, the object scene image output from the camera is reproduced on the monitor screen in parallel with the output control of the plurality of devices, and the state information indicating the operation state of the plurality of devices is multiplexed on the reproduced object scene image. . Whether or not the outputs of the plurality of devices are adaptively controlled can be determined based on the multiplexed state information. As a result, the load on the initial setting work and / or the maintenance work can be reduced.

According to the present invention, the object scene image output from the camera is reproduced on the monitor screen together with the state information indicating the operation states of the plurality of devices. Whether or not the outputs of a plurality of devices are adaptively controlled in consideration of the positional relationship with a specific object existing in space can be determined based on the multiplexed state information. As a result, the load on the initial setting work and / or the maintenance work can be reduced.

The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

(A) is a block diagram showing a basic configuration of one embodiment of the present invention, and (B) is a block diagram showing a basic configuration of another embodiment of the present invention. It is a block diagram which shows the structure of one Example of this invention. It is an illustration figure which shows an example of the installation state of the camera applied to the FIG. 2 Example. It is an illustration figure which shows an example of the camera image displayed on the monitor of FIG. 2 Example. It is an illustration figure which shows an example of the map image displayed on the monitor of FIG. 2 Example. It is an illustration figure which shows an example of a structure of the area register applied to the FIG. 2 Example. FIG. 3 is an illustrative view showing one example of a configuration of a representative point register applied to the embodiment in FIG. 2; It is an illustration figure which shows an example of a structure of the weighting amount register | resistor applied to the FIG. 2 Example. (A) is an illustration figure which shows an example of the allocation state of the divided area on a map image, (B) is an illustration figure which shows an example of the allocation state of the measurement area on a camera image. (A) is an illustrative view showing an example of a graphic image multiplexed on a map image, and (B) is an illustrative view showing an example of a graphic image multiplexed on a camera image. It is an illustration figure which shows an example of a camera image. (A) is an illustrative view showing an example of a graphic image drawn corresponding to the air volume “small”, and (B) is an illustrative view showing an example of a graphic image drawn corresponding to the air volume “medium”. FIG. 6C is an illustrative view showing an example of a graphic image drawn corresponding to the air volume “large”. (A) is an illustration figure which shows an example of the graphic image multiplexed on the camera image, (B) is an illustration figure which shows an example of the graphic image multiplexed on the camera image. It is a flowchart which shows a part of operation | movement of CPU applied to the FIG. 2 Example. It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. (A) is an illustrative view showing another example of a graphic image multiplexed on a map image, and (B) is an illustrative view showing another example of a graphic image multiplexed on a camera image. It is an illustration figure which shows an example of the object scene image and graphic image which are displayed on the monitor screen of another Example.

Referring to FIG. 1 (A), the output control device of one embodiment of the present invention is basically configured as follows. The search means 1a searches for one or more specific objects existing in the space based on the object scene image output from the camera 5a capturing the space. The control means 2a includes the one or two or more specific objects discovered by the search means 1a and the plurality of devices 6a, 6a,... That output the operations of the plurality of devices 6a, 6a,. Control based on the positional relationship. The reproduction unit 3a reproduces the object scene image output from the camera 5a on the monitor screen 7a in parallel with the control process of the control unit 2a. The multiplexing unit 4a multiplexes the state information indicating the operation states of the plurality of devices 6a, 6a,... On the object scene image reproduced by the reproduction unit 3a.

The plurality of devices 6a, 6a,... Generate an output toward the space, a specific object existing in the space is searched based on the object scene image output from the camera 5a capturing the space, and the plurality of devices 6a, 6a,. The output operation of 6a,... Is controlled based on the positional relationship between the specific object discovered by the search process and the plurality of devices 6a, 6a,. Thereby, adaptive output control in consideration of the position of the specific object is realized.

In addition, the object scene image output from the camera 5a is reproduced on the monitor screen 7a in parallel with the output control of the plurality of devices 6a, 6a,..., And state information indicating the operation state of the plurality of devices 6a, 6a,. Are multiplexed onto the reproduced scene image. It can be determined whether or not the outputs of the plurality of devices 6a, 6a,... Are adaptively controlled based on the multiplexed state information. As a result, the load on the initial setting work and / or the maintenance work can be reduced.

Referring to FIG. 1 (B), the output control device of another embodiment is basically configured as follows. The search means 1b searches for one or more specific objects existing in the space based on the object scene image output from the camera 5b that captures the space. The reproduction unit 2b reproduces the object scene image output from the camera 5b on the monitor screen 6b in parallel with the search process of the search unit 1b. The detection means 3b detects the operating state of the plurality of

devices

7b, 7b,... That generate different outputs toward the space depending on the positional relationship with one or more specific objects discovered by the search means 1b. The multiplexing unit 4b multiplexes the state information indicating the operation state detected by the detection unit 3b on the object scene image reproduced by the reproduction unit 2b.

The object scene image output from the camera 5b is reproduced on the monitor screen together with state information indicating the operation states of the plurality of

devices

7b, 7b,. It can be determined based on the multiplexed state information whether or not the outputs of the plurality of

devices

7b, 7b,... Are adaptively controlled in consideration of the positional relationship with a specific object existing in the space. As a result, the load on the initial setting work and / or the maintenance work can be reduced.

Referring to FIG. 2, the air conditioning control device 10 of this embodiment includes a camera 12 that repeatedly outputs image data representing an object scene (three-dimensional space) captured on the imaging surface. The image data output from the camera 12 is subjected to display processing by the image processing circuit 14. The processed image data is given to the monitor 16 and transmitted toward the mobile communication terminal 30 via the communication I / F 20. An image representing the object scene, that is, a camera image is displayed on each screen of the monitor 16 and the portable communication terminal 30.

Referring to FIG. 3, room RM1 is partitioned by floor surface FL1 and ceiling HV1 and four wall surfaces WL1 to WL4. The camera 12 is provided in the upper part of the center in the width direction of the wall surface WL1, and captures the internal space of the room RM1 from obliquely above. Therefore, the camera image is displayed on the monitor screen as shown in FIG. As shown in FIGS. 3 and 4, the internal space of the room RM1 is defined by the X, Y, and Z axes that are orthogonal to each other, and the imaging surface of the camera 12 is defined by the U and V axes that are orthogonal to each other.

The air conditioners D_1 to D_6 are installed at a predetermined distance on the ceiling HV1. Each of the air conditioners D_1 to D_6 outputs air having a specified temperature and humidity in a specified air volume and direction, and the temperature and humidity of the room RM1 are adjusted by the air thus output.

When the area setting mode is selected by operating the input device 18, the following processing is executed by the CPU 14p. In the area setting mode, the camera 12 is in a stopped state.

First, the map image shown in FIG. The map image corresponds to an image that schematically represents a bird's-eye view of the plane FL1. In the map image, marks M_1 to M_6 respectively representing air conditioners D_1 to D_6 are displayed corresponding to the positions of the air conditioners D_1 to D_6.

When the display of the map image is completed, the variable K is set to “1”. When the mark M_K is clicked by the mouse pointer provided in the input device 18, coordinates indicating the clicked position, that is, click coordinates are calculated. The calculated click coordinates are described in the area register 14r1 shown in FIG. 6 corresponding to the variable K, and the variable K is incremented thereafter. The click operation is accepted a total of six times corresponding to the marks M_1 to M_6, and thereby six click coordinates respectively corresponding to the marks M_1 to M_6 are set in the area register 14r1.

The map image is divided in the manner shown in FIG. 9A with the six click coordinates thus set as a reference. The boundary lines BL_1 to B_L3 are drawn on the map image so as to surround the marks M_1 to M_6. As a result, the divided areas MP_1 to MP_6 are allocated around the marks M_1 to M_6, and the internal space of the room RM1 is divided into a plurality of small spaces respectively corresponding to the divided areas MP_1 to MP_6. In the area register 14r1, a plurality of XY coordinates defining the divided area MP_K (K: 1 to 6) are described.

Subsequently, each of a plurality of XY coordinates that define the divided area MP_K is converted into UV coordinates according to Equation 1.

The calibration parameters P11 to P33 shown in Equation 1 correspond to a matrix for performing planar projective transformation between the XY coordinate system that defines the plane FL1 and the imaging plane of the camera 12, that is, the UV coordinate system that defines the camera image. Therefore, by applying the desired XY coordinates to Equation 1, the corresponding UV coordinates on the camera image are calculated. The plurality of UV coordinates thus converted are described in the area register 14r1 corresponding to the plurality of XY coordinates of the conversion source. The measurement area DT_K corresponding to the divided area MP_K is defined on the camera image in the manner shown in FIG. 9B.

Subsequently, the drawing position of the graphic image G_K indicating the operating status of the air conditioner D_K is defined on the map image. The graphic image G_K is represented by a plurality of circles drawn around the XY coordinates of the air conditioner D_K. Accordingly, the drawing position of the graphic image G_K is defined such that the graphic image G_K is drawn on the map image in the manner shown in FIG. A plurality of XY coordinates indicating the defined drawing position are described in the area register 14r1 corresponding to the variable K.

The described XY coordinates are then converted into UV coordinates according to Equation 1. Thus, the drawing position of the graphic image G_K is defined on the camera image, and the graphic image G_K is drawn on the camera image in the manner shown in FIG. A plurality of UV coordinates indicating the drawing position defined on the camera image are also described in the area register 14r1 corresponding to the variable K.

When the congestion degree measurement mode is selected by operating the input device 18, the camera 12 is activated, and the next processing is executed by the CPU 14p every time the measurement cycle arrives.

First, a person image is searched from a camera image by pattern matching or motion detection. When one or more person images are found, the variable L is set to each of “1” to “Lmax” (Lmax: total number of person images found), and one or more person images found are found. The representative point of the L-th person image is determined as “RP_L”. The determined XY coordinates of the representative point RP_L are described in the representative point register 14r2 shown in FIG.

When the persons H1 to H3 are present in the room RM1 as shown in FIG. 11, the representative point RP_1 is determined on the image representing the person H1, the representative point RP_2 is determined on the image representing the person H2, and the person H3 is selected. A representative point RP_3 is determined on the image to be represented. The XY coordinates of the representative points RP_1 to RP_3 are described in the representative point register 14r2 corresponding to L = 1 to 3.

Subsequently, the variable L is set to each of “1” to “Lmax”, the variable K is set to each of “1” to “6”, and the distance from the representative point RP_L to the air conditioner D_K is set to “DS_K”. ”As measured. The positional relationship between each of the persons corresponding to “Lmax” and the air conditioners D_1 to D_6 is clarified by the distances DS_1 to DS_6 thus measured.

The variable K is again set to each of “1” to “6”, and the weighting amount W_K corresponding to the divided area MP_K is calculated according to Equation 2. The calculated weighting amount W_K corresponds to the variable K in FIG. It is described in the weighting amount register 14r3 shown.
[Equation 2]
W_K = 1−f (D_K) / Σf (D_K)
However, f (D_K) = a_K * DS_K + b_K

In Equation 2, “a_K” and “b_K” are variables depending on the current output of the air conditioner D_K and the indoor environment. The function value f (D_K) is defined by the variables a_K and b_K and the distance DS_K. The weighting amount W_K is derived by subtracting from “1” the ratio of the function value f (D_K) to the sum of the function values f (D_1) to f (D_6) respectively corresponding to the air conditioners D_1 to D_6. The variables a_K and b_K are adjusted so that the sum of the weighting amounts W_1 to W_6 is “1.0”.

When the weighting amount is thus determined, the variable K is set to each of “1” to “6”, and the congestion degree CR_K is calculated. The degree of congestion CR_K corresponds to the sum of weighting amounts assigned to the divided areas MP_K. The outputs (= air volume) of the air conditioners D_1 to D_6 are controlled based on the congestion levels CR_1 to CR_6 thus calculated. Specifically, the air volume of the air conditioner corresponding to the divided area where the degree of congestion is high is increased, and the air volume of the air conditioner corresponding to the divided area where the degree of congestion is low is reduced.

Two modes, a test operation mode and a normal operation mode, are prepared as modes for operating the air conditioners D_1 to D_6. Here, in the test operation mode, after the installation of the air conditioning control device 10 is completed and the setting of the divided areas MP_1 to MP_6 is completed, the output operations of the air conditioning devices D_1 to D_6 are adaptively controlled under the congestion measurement task. This is a mode for checking whether or not. On the other hand, the normal operation mode is a mode selected in a normal use stage after the adaptive control of the air conditioners D_1 to D_6 is confirmed by the test operation mode. The trial operation mode and the normal operation mode are alternatively selected by operating the input device 18.

In the trial operation mode, the variable K is set to “1” to “6”, and the operating status (operating status: temperature, humidity, air volume, and wind direction) of the air conditioner D_K is detected. The graphic image G_K is multiplexed with the camera image in a drawing manner according to the detected operating situation. The drawing position is determined with reference to the description of the area register 14r1.

The drawing mode of the graphic image G_K changes in the manner shown in FIGS. 12A to 12C according to the air volume of the air conditioner D_K. The graphic image G_K is drawn in the manner shown in FIG. 12A corresponding to the air volume “small”, drawn in the manner shown in FIG. 12B corresponding to the air volume “medium”, and the air volume “large”. Is drawn in the manner shown in FIG. Further, the hue of the graphic image G_K changes from “blue” to “red” as the set temperature of the air conditioner D_K increases, and the saturation of the graphic image G_K increases as the set humidity of the air conditioner D_K increases. The shape of the graphic image G_K is distorted along the wind direction.

As shown in FIG. 13A, when the person H1 exists in the measurement area DT_4, the air volume of the air conditioner D_4 is set to “large”, and the air volumes of the air conditioners D_1, D_2, and D_5 are set to “medium”. The air volumes of the air conditioners D_3 and D_6 are set to “small”. The graphic images G_1 to G_6 are drawn in a manner showing such air volume setting.

As shown in FIG. 13B, when the person H1 moves to the measurement area DT_1, the air volume of the air conditioner D_1 is changed from "medium" to "large", and the air volume of the air conditioner D_4 is changed from "large" to "medium". Be changed. As a result, the drawing mode of the graphic images G_1 and G_4 also changes.

The camera images and graphic images G_1 to G_6 are also displayed on the screen of the mobile communication terminal 30. Therefore, by carrying the mobile communication terminal 30 and moving in the room RM1, the person H1 can easily confirm whether or not the output operations of the air conditioners D_1 to D_6 are adaptively controlled. Thereby, the efficiency of the initial setting work and the maintenance work can be improved.

Further, when the orientation of the camera 12 is deviated, the drawing positions of the graphic images G_1 to G_6 are also deviated. Therefore, the person H1 can recognize that the orientation of the camera 12 has shifted by moving through the space while viewing the graphic images G_1 to G_6.

The CPU 14p executes a plurality of tasks including a main task shown in FIG. 14, an area setting task shown in FIGS. 15 to 16, a congestion degree measuring task shown in FIGS. 17 to 19, and a display control task shown in FIG. Note that control programs corresponding to these tasks are stored in the recording medium 22.

Referring to FIG. 14, in step S1, it is determined whether or not the current operation mode is the area setting mode, and in step S5, it is determined whether or not the current operation mode is the congestion degree measurement mode.

If “YES” in the step S1, the area setting task is started in a step S3, and thereafter, the process proceeds to a step S15. If “YES” in the step S5, it is determined whether or not the divided areas MP_1 to MP_6 have been set in a step S7. If the determination result is YES, the congestion degree measurement task and the display control task are started in steps S9 and S11, and then the process proceeds to step S15. If the determination result is NO, the process directly proceeds to step S15. If both steps S1 and S5 are NO, another process is executed in step S13, and then the process proceeds to step S15.

In step S15, it is repeatedly determined whether or not a mode change operation has been performed. When the determination result is updated from NO to YES, the activated task is terminated in step S17, and thereafter, the process returns to step S1.

Referring to FIG. 15, a map image is displayed on monitor 16 in step S21, and variable K is set to “1” in step S23. In step S25, it is determined whether or not a click operation for designating an area has been performed. If the determination result is updated from NO to YES, click coordinates are calculated in step S27. The calculated coordinates are described in the area register 14r1 corresponding to the variable K. In step S29, it is determined whether or not the variable K has reached “6”. If the determination result is NO, the variable K is incremented in step S31 and then the process returns to step S25. Proceed to S33.

In step S33, the map image is divided with reference to the click coordinates. As a result, six divided areas MP_1 to MP_6 are allocated on the map image. In step S35, boundary lines that divide the divided images MP_1 to MP_6 are drawn on the map image.

In step S37, the variable K is set to “1”, and in step S39, a plurality of XY coordinates defining the divided area MP_K are calculated. The calculated XY coordinates are described in the area register 14r1 corresponding to the variable K. In step S41, each of the plurality of XY coordinates that define the divided area MP_K is converted into UV coordinates according to Equation 1. The converted UV coordinates are described in the area register 14r1 corresponding to the variable K, whereby the measurement area DT_K corresponding to the divided area MP_K is assigned to the camera image.

In step S43, the drawing position of the graphic image G_K is defined on the map image. A plurality of XY coordinates indicating the defined drawing position are described in the area register 14r1 corresponding to the variable K. In step S45, the XY coordinates indicating the drawing position defined in step S43 are converted into UV coordinates according to Equation 1. As a result, the drawing position of the graphic image G_K is defined on the camera image. A plurality of UV coordinates indicating the drawing position defined in this way are also described in the area register 14r1 corresponding to the variable K.

In step S47, it is determined whether or not the variable K has reached “6”. If the determination result is NO, the variable K is incremented in step S49 and the process returns to step S39. If the determination result is YES, the process is ended.

Referring to FIG. 17, in step S51, it is determined whether or not the measurement cycle has arrived. When the determination result is updated from NO to YES, the process proceeds to step S53, and a person image is searched from the camera image by pattern matching or motion detection. In step S55, it is determined whether one or more person images have been found. If the determination result is NO, the process returns to step S51, whereas if the determination result is YES, the process proceeds to step S57.

In step S57, the variable L is set to “1”. In step S59, the representative point of the Lth person image among the one or more found person images is determined as “RP_L”, and is determined in step S61. The XY coordinates of the representative point RP_L are calculated with reference to the above equation 1. The calculated XY coordinates are described in the representative point register 14r2 corresponding to the variable L. In step S63, it is determined whether or not the variable L has reached the maximum value Lmax (= total number of discovered human images). If the determination result is NO, the variable L is incremented in step S65, and the process returns to step S59. On the other hand, if a determination result is YES, it will progress to Step S67.

In step S67, the variable L is set to "1" again, in step S69, the variable K is set to "1", and in step S71, the distance from the representative point RP_L to the air conditioner D_K is measured as "DS_K". In step S73, it is determined whether or not the variable K has reached “6”. If the determination result is NO, the variable K is incremented in step S75 and the process returns to step S71. Proceed to S77. The positional relationship between the Lth person and the air conditioners D_1 to D_6 is clarified by the distances DS_1 to DS_6 thus measured.

In step S77, the variable K is set to “1” again. In step S79, the weighting amount W_K corresponding to the divided area MP_K is calculated according to Equation 2. The calculated weighting amount W_K is described in the weighting amount register 14r3 corresponding to the variable K.

In step S81, it is determined whether or not the variable K has reached “6”. If the determination result is NO, the variable K is incremented in step S83 and the process returns to step S79. Proceed to S85.

In step S85, it is determined whether or not the variable L has reached the maximum value Lmax. If the determination result is NO, the variable L is incremented in step S87 and the process returns to step S69. Proceed to step S89. In step S89, the variable K is set to “1”, and in step S91, the congestion level CR_K is calculated. The degree of congestion CR_K corresponds to the sum of weighting amounts assigned to the divided areas MP_K.

In step S93, it is determined whether or not the variable K has reached “6”. If the determination result is NO, the variable K is incremented in step S95 and the process returns to step S91. Proceed to S97. In step S97, the outputs of the air conditioners D1 to D6 are controlled with reference to the congestion levels CR_1 to CR_6 calculated in step S91. Specifically, the output of the air conditioner corresponding to the divided area with a high degree of congestion is strengthened, and the output of the air conditioner corresponding to the divided area with a low degree of congestion is weakened.

Referring to FIG. 20, the camera 12 is activated in step S101, and the display of the camera image is started in step S103. Image data representing the scene captured by the camera 12 is given to the monitor 16 and transmitted to the mobile communication terminal 30 via the communication I / F 20. As a result, the camera image is displayed on the screen of the monitor 16 and the mobile communication terminal.

In step S105, it is determined whether the current mode is the normal operation mode or the test operation mode. If the current mode is the normal operation mode, the display control task is terminated. If the current mode is the test operation mode, the process proceeds to step S107. In step S107, the variable K is set to “1”, and in step S109, the operating status (operating status: temperature, humidity, air volume, wind direction) of the air conditioner D_K is detected. In step S111, the graphic image G_K is multiplexed with the camera image corresponding to the measurement area DT_K. The drawing mode of the graphic image G_K corresponds to the detected operating status.

In step S113, it is determined whether or not the variable K has reached “6”. If the determination result is NO, the variable K is incremented in step S117 and then the process returns to step S109. If the determination result is YES, the variable K is set to “1” in step S115 and then the process returns to step S109.

As can be seen from the above description, the CPU 14p searches for one or more persons existing in the internal space of the room RM1 based on the object scene image output from the camera 12 capturing the internal space of the room RM1 (S53). ), Controlling the output operation of the air conditioners D_1 to D_6 that generate output toward the internal space of the room RM1 based on the positional relationship between the air conditioners D_1 to D_6 and one or more persons discovered by the search process (S57-S97). The CPU 14p also reproduces the object scene image output from the camera 12 on the monitor screen of the monitor 16 or the portable communication terminal 30 in parallel with the air conditioning control (S101 to S103), and shows the operating state of the air conditioning devices D_1 to D_6. The graphic images G_1 to G_6 are multiplexed on the object scene image reproduced on the monitor screen (S107 to S117).

The air conditioners D_1 to D_6 generate outputs toward the interior space of the room RM1, and a person existing in the interior space of the room RM1 searches based on the object scene image output from the camera 12 that captures the interior space of the room RM1. The output operations of the air conditioners D_1 to D_6 are controlled based on the positional relationship between the person discovered by the search process and the air conditioners D_1 to D_6. Thereby, adaptive output control in consideration of the position of the person is realized.

In addition, the object scene image output from the camera 12 is reproduced on the monitor screen in parallel with the output control of the air conditioners D_1 to D_6, and the graphic images G_1 to G_6 showing the operation states of the air conditioners D_1 to D_6 are reproduced. It is multiplexed on the object scene image. Whether the outputs of the air conditioners D_1 to D_6 are adaptively controlled can be determined based on the multiplexed graphic images G_1 to G_6. As a result, the load on the initial setting work and / or maintenance work can be reduced.

In this embodiment, the coordinates of the marks M_1 to M_6 are designated by clicking the mouse pointer. However, instead of this, the coordinate values of the marks M_1 to M_6 may be directly specified.

In this embodiment, it is assumed that the output of the air conditioner is adaptively controlled. However, instead of the output of the air conditioner or together with the output of the air conditioner, the output (that is, brightness) of the lighting device is adaptive. You may make it control to. In this case, the drawing mode of the graphic image changes differently according to the brightness of the lighting device.

Furthermore, in this embodiment, planar projective transformation with reference to Equation 1 is assumed, but perspective projective transformation may be performed instead.

Further, in this embodiment, an image schematically representing a state in which the floor surface FL1 is bird's-eye view is adopted as the map image. However, the map image may be generated by performing bird's-eye conversion with reference to Equation 1 described above on the camera image.

Furthermore, in this embodiment, “temperature”, “humidity”, “air volume”, and “wind direction” are assumed as the operating status of the air conditioner D_K detected in step S109 shown in FIG. However, “power consumption” may additionally be assumed with the power consumption of the air conditioner D_K as the operating status.

In this embodiment, the graphic image G_K is multiplexed on the monitor screen in the manner shown in FIGS. 13 (A) to 13 (B). However, numerical values (for example, “1 m” and “3 m”) indicating the spread of the wind output from the air conditioner D_K may be additionally displayed. In this case, the graphic image G_K is displayed as shown in FIG. A) to be displayed as shown in FIG.

Further, in this embodiment, the scene image captured by the camera 12 is displayed on the monitor screen from the viewpoint of the camera 12, and the shape and / or the graphic image G_K is adapted to match the displayed scene image. The size is adjusted (see FIG. 10B). However, the object scene image captured by the camera 12 may be displayed on the monitor screen in a state of being converted into a bird's-eye view image, and the shape and / or size of the graphic image G_K may be adjusted to match the bird's-eye view image. Good. In this case, the overhead image and the graphic image G_K are displayed on the monitor screen as shown in FIG.

Although the present invention has been described and illustrated in detail, it is clear that it has been used merely as an illustration and example and should not be construed as limiting, and the spirit and scope of the present invention are attached Limited only by the wording of the claims.

DESCRIPTION OF SYMBOLS 10 ... Air-conditioning control apparatus 12 ... Camera 14 ... Image processing circuit 14p ... CPU
16 ... monitor 18 ... input device

Claims

An output control device comprising:
Search means for searching for one or more specific objects existing in space based on an object scene image output from a camera capturing the space;
Control means for controlling output operations of a plurality of devices that generate output toward the space based on a positional relationship between one or more specific objects discovered by the search means and the plurality of devices;
Reproduction means for reproducing an object scene image output from the camera on a monitor screen in parallel with the control processing of the control means; and status information indicating operation states of the plurality of devices being reproduced by the reproduction means. Multiplexing means to multiplex to the scene image.
An output control device according to claim 1, further comprising:
Selection means for alternatively selecting a plurality of modes including a trial operation mode; and activation means for activating the multiplexing means in response to the trial operation mode.
An output control device according to claim 1, wherein the camera has an imaging surface defined along a UV coordinate system,
The space has a plane defined along the XY coordinate system;
The control means calculates a XY coordinate of the specific object with reference to a calibration parameter indicating a correspondence relationship between the UV coordinate system and the XY coordinate system and an image found by the search means; and Detection means for detecting the positional relationship with reference to XY coordinates calculated by the calculation means is included.
The output control device according to claim 3, further comprising a defining means for defining a multiplex position of the state information with reference to the calibration parameter.
The output control device according to claim 1, wherein each of the plurality of devices corresponds to an air conditioning control device, and the state information has at least one of temperature, humidity, air volume, wind direction, and power consumption as parameters.
The output control device according to claim 1, wherein the state information has, as a parameter, a position and / or a width that each output of the plurality of devices reaches.
The output control device according to claim 1, further comprising: transmission means for transmitting the object scene image and the state information to a mobile communication terminal, wherein the monitor screen corresponds to a monitor screen of the mobile communication terminal. .
An output control device comprising:
Search means for searching for one or more specific objects existing in space based on an object scene image output from a camera capturing the space;
Reproduction means for reproducing the object scene image output from the camera on a monitor screen in parallel with the search processing of the search means;
Detecting means for detecting operation states of a plurality of devices that generate different outputs toward the space according to a positional relationship with one or more specific objects discovered by the searching means; and detected by the detecting means Multiplexing means for multiplexing state information indicating the operating state on the object scene image reproduced by the reproducing means.