JP2015231128A - Adjusting terminal, adjusting method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an adjusting terminal, an adjusting method and a computer program that can improve efficiency of image sensor setting work.SOLUTION: An adjusting terminal in one embodiment generates an image by imaging a prescribed space, generates setting information that is necessary for the image sensor, which obtains information on the space from the image, to obtain the information on the space, and transmits the setting information to the image sensor. The adjusting terminal includes a communication unit and a generation unit. The communication unit communicates with the image sensor. The generation unit obtains the image from the image sensor and generates the setting information on the basis of the obtained image.

Description

  Embodiments described herein relate generally to an adjustment terminal, an adjustment method, and a computer program.

  Conventionally, space information is acquired using a sensor, and a device to be controlled is controlled based on the acquired space information. For example, if the device to be controlled is a lighting device, the information on the person such as the presence / absence of the person, the number of people present, the amount of activity of the person, and the information on the brightness of the space are converted into the space information. Can be used. For example, when it is detected that a person is absent based on information about a person, it is possible to control to turn off the illumination. In addition, for example, when it is detected that the brightness of the space is sufficiently secured by outside light or the like based on the information on the brightness of the space, it is possible to control to reduce the dimming rate of the illumination It is.

There is an image sensor as a sensor for acquiring information on this space. The image sensor acquires an image of a space, and acquires space information from the image. Since an image includes a lot of information, the image sensor can acquire various information as space information. Therefore, in a control system using an image sensor, device control based on various space information can be performed. Further, since the image sensor can take a wide detection range, there is an advantage that the number of installed sensors can be reduced.
However, when performing control using an image sensor, the user needs to set parameters necessary for the sensor to acquire spatial information in the sensor in advance. Therefore, when a large amount of image sensors are manually set, a lot of labor may be required.

JP 2011-249130 A

  The problem to be solved by the present invention is to provide an adjustment terminal, an adjustment method, and a computer program that can improve the efficiency of setting operation of an image sensor.

  The adjustment terminal according to the embodiment is necessary for the image sensor to acquire the space information with respect to the image sensor that captures a predetermined space and generates an image and acquires the space information from the image. An adjustment terminal that generates setting information and transmits the setting information to the image sensor, and includes a communication unit and a generation unit. The communication unit communicates with the image sensor. The generation unit acquires an image from the image sensor, and generates the setting information based on the acquired image.

The figure which shows the specific example of the layout of the office in which the image sensor was installed. 1 is a system configuration diagram showing a configuration of a control system 4 using an image sensor 1 of an embodiment. 2 is a functional block diagram showing a functional configuration of the image sensor 1. FIG. The functional block diagram which shows the function structure of the adjustment terminal 42. FIG. FIG. 3 is a diagram illustrating a first specific example of an image acquired by the image sensor 1. The figure which shows the 1st specific example of an illumination intensity estimation area. The figure which shows the 2nd specific example of the image acquired by the image sensor. The figure which shows the 2nd specific example of an illumination intensity estimation area. The figure which shows the 3rd specific example of the image acquired by the image sensor. The figure which shows the 3rd specific example of an illumination intensity estimation area. The figure which shows the specific example of the menu screen of an adjustment tool. The sequence diagram showing the preset of the illuminating device 2 using the image sensor 1 of embodiment, and the flow of operation | movement in operation.

  Hereinafter, an adjustment terminal, an adjustment method, and a computer program according to embodiments will be described with reference to the drawings.

FIG. 1 is a diagram showing a specific example of an office layout in which image sensors are installed.
In the office of FIG. 1, image sensors 1-1 and 1-2, lighting devices 2-1 and 2-2, and air conditioning devices 3-1 to 3-8 are installed on the ceiling. The image sensors 1-1 and 1-2 are sensor devices that acquire information (hereinafter referred to as “control information”) necessary for controlling a device to be controlled from a captured image. The devices to be controlled in FIG. 1 are lighting devices 2-1 and 2-2 and air conditioning devices 3-1 to 3-8.

  The image sensor 1-1 is a sensor device installed to control the lighting device 2-1 and the air conditioning devices 3-1 to 3-4. The image sensor 1-2 is a sensor device installed to control the lighting device 2-2 and the air conditioning devices 3-5 to 3-8. The operations of the lighting device 2-1 and the air conditioning devices 3-1 to 3-4 are controlled based on control information acquired from an image captured by the image sensor 1-1. The operations of the illumination device 2-2 and the air conditioning devices 3-5 to 3-8 are controlled based on control information acquired from an image captured by the image sensor 1-2.

FIG. 2 is a system configuration diagram illustrating a configuration of a control system 4 using the image sensor 1 of the embodiment.
The control system 4 includes image sensors 1-1 to 1-3, lighting devices 2-1 to 2-3, an external system 41, an adjustment terminal 42, a first network 43, a second network 44, a gateway device 45, and a HUB 46. Is provided.

  The image sensors 1-1 to 1-3 are sensor devices that capture an image near the installed position and acquire control information from the captured image. In FIG. 2, image sensors 1-1 to 1-3 are sensor devices for controlling the lighting devices 2-1 to 2-3, respectively. In FIG. 2, one illumination device is associated with one image sensor, but a plurality of illumination devices may be associated with one image sensor. The image sensors 1-1 to 1-3 are accommodated in the second network 44 by the HUB 46, and can communicate with the adjustment terminal 42 and the gateway device 45. The image sensors 1-1 to 1-3 can communicate with the external system 41 via the gateway device 45. The image sensors 1-1 to 1-3 transmit the acquired control information to the external system 41. In the following description, unless otherwise specified, the image sensors 1-1 to 1-3 are referred to as an image sensor 1.

  The lighting devices 2-1 to 2-3 are target lighting devices controlled by the control system 4. In the present embodiment, the case where the device to be controlled is a lighting device will be described, but the device to be controlled may be a device other than the lighting device. For example, the device to be controlled may be an air conditioner or an elevator device. In the following description, lighting devices 2-1 to 2-3 will be referred to as lighting devices 2 unless otherwise specified.

  The external system 41 is a set of devices and systems that control devices to be controlled. For example, the external system 41 includes a system such as a BEMS (Building Energy Management System) 411 (registered trademark, hereinafter the same), and devices such as a lighting control device 412 and an air conditioning control device 413. BEMS is a building management system for reducing energy consumption by managing the operation of equipment and facilities in a building. The external system 41 is connected to the first network 43 and can communicate with the image sensor 1 and the adjustment terminal 42 via the gateway device 45. The external system 41 controls the device to be controlled based on the control information transmitted from the image sensor 1.

  The adjustment terminal 42 is a terminal for performing pre-setting of the image sensor 1 before starting the operation of the image sensor 1. The adjustment terminal 42 generates setting information necessary for the image sensor 1 to acquire control information. As the adjustment terminal 42, an information device such as a PC (Personal Computer), a smartphone, or a tablet is used. The adjustment terminal 42 transmits the generated setting information to the image sensor 1.

  The first network 43 is a network that accommodates the external system 41. For example, the first network 43 is a network that communicates with a protocol defined by a standard such as BACnet (Building Automation and Control Networking protocol) or industrial Ethernet (registered trademark, hereinafter the same). BACAnet is a network standard for intelligent buildings, and is used for control of air-conditioning equipment and lighting equipment, access control, fire detection, and the like. Industrial Ethernet is an Ethernet standard mainly corresponding to FA (Factory Automation) systems in manufacturing sites such as factories.

The second network 44 is a network that accommodates the image sensor 1, the lighting device 2, and the adjustment terminal 42. The second network 44 is connected to the first network 43 by the gateway device 45. Note that the second network 44 may be integrated with the first network 43.
The gateway device 45 is a gateway device that relays communication between the first network 43 and the second network 44. The gateway device 45 converts a communication protocol between the first network 43 and the second network 44.
The HUB 46 is a network hub that accommodates the image sensor 1 in the second network 44.

FIG. 3 is a functional block diagram showing a functional configuration of the image sensor 1.
The image sensor 1 includes a CPU (Central Processing Unit), a memory, an auxiliary storage device, and the like connected by a bus, and executes a sensor control program. The image sensor 1 functions as a device including the communication control unit 11, the storage unit 12, the imaging unit 13, the environment information acquisition unit 14, the person information acquisition unit 15, and the setting unit 16 by executing the sensor control program.
Note that all or part of the functions of the image sensor 1 may be realized using hardware such as an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA). The sensor control program may be recorded on a computer-readable recording medium. The computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built in the computer system. The sensor control program may be transmitted via a telecommunication line.

The communication control unit 11 is configured using a communication interface such as a LAN (Local Area Network). The communication control unit 11 controls communication between the external system 41 and the adjustment terminal 42.
The storage unit 12 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 12 stores imaging information 121 and setting information 122. The imaging information 121 is recorded by the imaging unit 13. The setting information 122 is recorded by the setting unit 16. Details of the imaging information 121 and the setting information 122 will be described later.

  The imaging unit 13 is configured using a device having an imaging function such as a camera. The imaging unit 13 captures a space near the position where the device is installed, and acquires an image of the space. The imaging unit 13 stores information such as the acquired image and imaging parameters when the image is acquired in the storage unit 12 as imaging information 121. The imaging parameter is a parameter for controlling the imaging operation of the imaging unit 13. For example, the imaging parameters are parameters such as shutter speed, gain, iris, focal length and the like.

  The environment information acquisition unit 14 acquires environment information of the space imaged by the imaging unit 13 based on the imaging information 121. The environment information is one piece of control information, and is information necessary for controlling the device to be controlled. The environmental information is information representing the state of the environment surrounding the person in the target space. For example, the environment information is information representing illuminance representing the brightness of the space, the state of the blinds, the layout of the office, and the like. The environment information acquisition unit 14 outputs the acquired environment information to the communication control unit 11 and transmits it to the external system 41.

  The person information acquisition unit 15 acquires the person information of the space imaged by the imaging unit 13 based on the imaging information 121. The person information is one piece of control information and is information necessary for controlling the device to be controlled. The person information is information representing the state of a person existing in the target space. For example, the person information is information representing the presence / absence of a person, the number of persons, the amount of activity, the behavior, the behavior, the movement, the stay, the face direction, the position, the posture, the sex, the height, and the like. The person information acquisition unit 15 outputs the acquired person information to the communication control unit 11 and transmits it to the external system 41.

  The setting unit 16 acquires setting information from the adjustment terminal 42. The setting unit 16 stores the acquired setting information as setting information 122 in the storage unit 12. By saving the setting information 122, the pre-setting for the image sensor 1 is completed. After completion of the pre-setting, the image sensor 1 can operate as a sensor that acquires control information such as environment information and personal information from the imaging information 121 based on the setting information 122 set in the self-device.

  Next, details of the adjustment terminal 42 of the embodiment will be described. In the following description, a case will be described in which the adjustment terminal 42 performs presetting on the image sensor 1 used for controlling the brightness of the lighting device. In this case, the setting information of the image sensor 1 generated by the adjustment terminal 42 is an illuminance estimation parameter and illuminance estimation area information. In the following description, first, the contents of the illuminance estimation parameter and the illuminance estimation area information will be described. After the description, the configuration of the adjustment terminal 42 and the method by which the adjustment terminal 42 generates the setting information will be described.

First, illuminance estimation parameters and illuminance estimation area information will be described.
In controlling the brightness of the lighting device using the image sensor 1, the image sensor 1 estimates the brightness of the space from the acquired image. Then, the lighting control device 412 controls the dimming rate of the lighting device to be controlled based on the estimated brightness of the space. Specifically, the image sensor 1 estimates the illuminance of the space from the luminance of the image. For this reason, an illuminance estimation model that represents the relationship between the luminance of the image and the illuminance is used for estimating the illuminance.

  In general, even if the amount of light supplied to a space is the same, the brightness of the space varies depending on conditions such as the material, color, and arrangement of an object present in the space. Therefore, when the illuminance estimation model is used, it is necessary to reflect the feature of the target space in the illuminance estimation model. A parameter representing the feature of this space is called an illuminance estimation parameter. For example, the illuminance estimation parameter includes information on the reflectance in the target space. The reflectance is a value representing the degree to which an object reflects light. Therefore, the brightness of the space increases as the reflectance of the object existing in the space increases. A value obtained by combining the reflectance of an object existing in this space over the entire target space is called a spatial reflectance.

  The image sensor 1 applies the illuminance estimation parameter to the illuminance estimation model, and acquires illuminance information representing the brightness of the target space from the acquired image. At this time, the area of the image used by the image sensor 1 for acquiring illuminance information is referred to as an illuminance estimation area. By appropriately setting the illuminance estimation area, the accuracy of the illuminance information acquired by the image sensor 1 is improved. The adjustment terminal 42 includes an image of the target space acquired by the image sensor 1 and an actual illuminance value (hereinafter referred to as “reference illuminance information”) of the target space measured simultaneously with the acquisition of the image. Based on the above, the illuminance estimation parameter and the illuminance estimation area information are generated. The adjustment terminal 42 transmits these pieces of information as setting information to the image sensor 1.

FIG. 4 is a functional block diagram showing a functional configuration of the adjustment terminal 42.
The adjustment terminal 42 includes a CPU and a memory connected by a bus, and executes an adjustment program. The adjustment program is a program that generates setting information of the image sensor 1. The adjustment program provides the user of the adjustment terminal 42 with a user interface (hereinafter referred to as “adjustment tool”) for inputting an operation for generating setting information. The adjustment terminal 42 functions as a device including a storage unit 421, a communication control unit 422, an input unit 423, and a setting information generation unit 424 by executing the adjustment program.
All or some of the functions of the adjustment terminal 42 may be realized using hardware such as ASIC, PLD, or FPGA. The adjustment program may be recorded on a computer-readable recording medium. The computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built in the computer system. The adjustment program may be transmitted via a telecommunication line.

The storage unit 421 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 421 stores reference illuminance information in advance. The content of the reference illuminance information will be described later.
The communication control unit 422 is configured using a communication interface such as a LAN. The communication control unit 422 communicates with the image sensor 1 via the HUB 46.
The input unit 423 is configured using an input device such as a mouse, a keyboard, or a touch panel. The input unit 423 is an input device for a user to input an operation to the adjustment tool. The input unit 423 receives user input and outputs the input information to the setting information generation unit 424.

  The setting information generation unit 424 generates setting information to be set for the image sensor 1. The setting information generation unit 424 transmits the generated setting information to the image sensor 1. The setting information transmitted to the image sensor 1 is set in the image sensor 1 by the setting unit 16.

  The setting information generation unit 424 includes an illuminance estimation area generation unit 425 and an illuminance estimation parameter generation unit 426.

  The illuminance estimation area generation unit 425 generates illuminance estimation area information. The illuminance estimation area generation unit 425 acquires imaging information from the image sensor 1. The illuminance estimation area generation unit 425 generates illuminance estimation area information by performing image processing on the image of the target space included in the imaging information. The illuminance estimation area generation unit 425 outputs the generated illuminance estimation area information to the illuminance estimation parameter generation unit 426. A specific example of a method by which the illuminance estimation area generation unit 425 generates illuminance estimation area information will be described later.

  The illuminance estimation parameter generation unit 426 generates an illuminance estimation parameter for the target space. The illuminance estimation parameter generation unit 426 acquires imaging information from the image sensor 1. The illuminance estimation parameter generation unit 426 determines an illuminance estimation parameter based on the image of the target space included in the imaging information, the imaging parameter when the image is acquired, and the reference illuminance information. The reference illuminance information may be read from the storage unit 421 or may be input from the input unit 423, for example. The reference illuminance information may be read from a storage medium such as a flash memory or a CD-ROM, or may be input from a device other than the adjustment terminal 42 via a network. .

  The illuminance estimation parameter generation unit 426 may use the illuminance estimation area information output from the illuminance estimation area generation unit 425 to generate the illuminance estimation parameter. The illuminance estimation parameter generation unit 426 can generate an illuminance estimation parameter with higher accuracy by using an image of an area indicated by the illuminance estimation area information for generation of the illuminance estimation parameter. The illuminance estimation parameter generation unit 426 transmits the illuminance estimation parameter and the illuminance estimation area information to the image sensor 1 as setting information.

FIG. 5 is a diagram illustrating a first specific example of an image acquired by the image sensor 1.
FIG. 5 is a specific example of an image acquired when one lighting device is installed in one room. The image 5 is an image of a room imaged from the ceiling by the imaging unit 13 having a fisheye lens. Reference numeral 5-1 represents the outer periphery of the fisheye lens. Reference numeral 5-2 represents the outer periphery of the floor of the imaged room. Reference numeral 5-3 denotes a desk installed on the floor. Reference numeral 5-4 represents an illuminometer installed on the desk 5-3 for measuring the reference illuminance information.

FIG. 6 is a diagram illustrating a first specific example of the illuminance estimation area.
FIG. 6 shows an example of the illuminance estimation area set based on the position of the illuminometer that has acquired the reference illuminance information. Since the illuminance estimation model is designed based on the reference illuminance information, it is desirable that the illuminance estimation area corresponds to the position where the reference illuminance information is acquired. In the case of the example in FIG. 6, the illuminance estimation area generation unit 425 detects the illuminometer 5-4 from the image 5 in FIG. 5 by using an image processing technique such as template matching or shape recognition. Based on the detected position of the illuminometer 5-4, the illuminance estimation area 5-5 is determined.

  The position of the illuminance estimation area may be set to an arbitrary position based on the position of the illuminometer 5-4. For example, as shown in FIG. 6, the illuminance estimation area 5-5 may be set to an area centered on the position of the illuminometer 5-4 in the image 5. Further, for example, it may be set as a region whose end point is the position of the illuminometer 5-4. Further, the shape of the illuminance estimation area 5-5 may be set to a rectangle as shown in FIG. 6, or may be set to another shape.

  Further, the illuminance estimation area 5-5 may be set to a shape corresponding to the distortion of the lens. For example, the illuminance estimation area generation unit 425 detects the center position of the lens from the image on the outer periphery 5-1 of the lens by using an image processing technique such as circle detection or circular Hough transform. Then, the illuminance estimation area generation unit 425 sets the illuminance estimation area in a shape having a distortion corresponding to the detected distance from the center position of the lens. Since the illuminance estimation area has distortion according to the distance from the center position of the lens, the real space area corresponding to the illuminance estimation area can be set to a shape without distortion.

  Note that a preset value prepared in advance may be used for setting the size and shape of the illuminance estimation area, or a value input from the adjustment tool may be used.

FIG. 7 is a diagram illustrating a second specific example of an image acquired by the image sensor 1.
FIG. 7 is a specific example in a case where four lighting devices are installed in one room. Four lighting devices indicated by reference numerals 6-1 to 6-4 are installed at the four corners of the ceiling of the room captured in the image 6. The illuminance meters 6-6 to 6-9 installed on the desk 6-5 measure the reference illuminance information of the lighting devices 6-1 to 6-4, respectively.

FIG. 8 is a diagram illustrating a second specific example of the illuminance estimation area.
FIG. 8 shows an example in which a plurality of illuminance estimation areas are set in one image by the same method as in FIG. In the case of the example in FIG. 8, the illuminance estimation area generation unit 425 detects the illuminance meters 6-6 to 6-9 from the image 6. The illuminance estimation area generation unit 425 determines the illuminance estimation areas 6-10 to 6-13 based on the detected positions of the illuminance meters 6-6 to 6-9, respectively. For setting the size and shape of the illuminance estimation areas 6-10 to 6-13, a default value prepared in advance may be used as in the example of FIG. 6, or input from the adjustment tool. A value may be used. Thus, by setting a plurality of illuminance estimation areas according to the number of installed lighting devices, it is possible to control lighting devices more accurately.

FIG. 9 is a diagram illustrating a third specific example of an image acquired by the image sensor 1.
FIG. 9 is an image captured in a state where only the lighting device 7-2 is turned on among the four lighting devices (lighting devices 7-1 to 7-4 in FIG. 9) in the room shown in FIG. is there. Therefore, in the image 7, the brightness of the area indicated by reference numeral 7-6 is high.

FIG. 10 is a diagram illustrating a third specific example of the illuminance estimation area.
FIG. 10 illustrates an example of an illuminance estimation area set based on an image captured in a state where only the lighting device 7-2 is turned on. In the case of the example in FIG. 10, the illuminance estimation area generation unit 425 detects a region 7-6 from the image 7 by image processing. Based on the detected area 7-6, the illuminance estimation area 7-7 is determined. By acquiring images with different lighting states of lighting devices in this way, it is possible to set illuminance estimation areas corresponding to a plurality of lighting devices.

FIG. 11 is a diagram illustrating a specific example of the menu screen of the adjustment tool.
The menu screen 8 is a menu screen provided to the user by the adjustment tool. The user generates illuminance estimation area information by operating the adjustment tool using the menu screen 8. In the example of FIG. 11, the menu screen 8 displays a menu for generating an illuminance estimation area by the method shown in FIGS.
The image indicated by the input image 81 in FIG. 11 is, for example, an image input to generate illuminance estimation area information. The input menu 82 is an area for the user to input parameters for generating illuminance estimation area information. For example, the input menu 82-1 is an area for inputting the ceiling height of the room captured in the input image 81. By inputting the ceiling height, the illuminance estimation area generation unit 425 can convert the distance on the image into the distance in the real space.

  An input menu 82-2 in FIG. 11 is an area for inputting a range to be subjected to image processing on the input image 81, for example. The target range may be specified in any manner that can represent the range. For example, a range based on the center position of the lens may be input, or a range represented by coordinates may be input. In addition, the value indicating the input length, position, or the like may be a value in real space or a value on an image in the input image 81.

An input menu 82-3 in FIG. 11 is an area for inputting the size of the illuminance estimation area, for example.
The input menu 82 may be provided with menus other than the input menus 82-1 to 82-3. For example, a menu for inputting the shape of the illuminance estimation area may be provided. Further, the information input to the input menu 82 may be configured to be displayed in a corresponding area of the input image 81. Further, the value input to the input menu 82 may be configured to be input by selecting an area on the input image 81.

  The execution button 83 is an input button for inputting a process execution instruction based on the input image 81 and the parameters input from the input menu 82. For example, the execution button 83-1 is a button for inputting execution of processing for detecting the center position of the lens from the input image 81. In addition, for example, the execution button 83-2 is a button for inputting execution of processing for detecting an illuminometer from the input image 81. In addition, for example, the execution button 83-3 is a button for inputting execution of processing for detecting a region whose luminance is increased by illumination from the input image 81. For example, the execution button 83-4 is a button for inputting execution of a process for generating an illuminance estimation area based on the result of the process executed by pressing the execution buttons 83-1 to 83-3. . In addition, for example, the execution button 83-5 is a button for inputting execution of processing for saving the generated illuminance estimation area information in the storage unit 421 or the like. Note that the result of the processing executed by the execution buttons 83-1 to 83-4 may be displayed in a corresponding area of the input image 81.

  By using the adjustment tool as described above, the user of the adjustment terminal 42 can more easily generate setting information (illuminance estimation parameter and illuminance estimation area information) set in the image sensor 1.

FIG. 12 is a sequence diagram illustrating a flow of an operation in advance and operation of the lighting device 2 using the image sensor 1 of the embodiment.
First, the flow of processing in advance setting of the image sensor 1 will be described.
First, the user operates the image sensor 1 and the illuminance meter to simultaneously acquire an image of a space where the lighting device 2 to be controlled is installed and reference illuminance information of the space. The illuminometer acquires reference illuminance information according to the user's operation (step S101). The image sensor 1 captures the target space in accordance with a user operation, and acquires an image of the target space (step S102).

The user arranges the acquired reference illuminance information in such a manner that the adjustment terminal 42 can read it. For example, the user may record the reference illuminance information on a portable recording medium and read it by the adjustment terminal 42. For example, the user may arrange the reference illuminance information in an area where the adjustment terminal 42 is accessible via the network. The user executes the adjustment tool after arranging the reference illuminance information in the above-described manner.
By executing the adjustment tool, the adjustment terminal 42 acquires the reference illuminance information acquired in step S101 (step S103). At the same time, the adjustment terminal 42 acquires the image acquired in step S102 from the image sensor 1 (step S104).

The adjustment terminal 42 generates illuminance estimation area information based on the acquired image and the parameter input by the adjustment tool (step S105). And the adjustment terminal 42 produces | generates an illumination intensity estimation parameter based on the acquired image, reference | standard illumination intensity information, and the produced | generated illumination intensity estimation area information (step S106). The adjustment terminal 42 transmits the illuminance estimation parameter and the illuminance estimation area information as setting information to the image sensor 1 (step S107). The image sensor 1 receives the setting information and stores it in the storage unit 12 as setting information 122. By storing the setting information 122, the image sensor 1 sets the setting information in its own device (step S108).
Pre-setting for the image sensor 1 is completed by the processing in steps S101 to S108 described above.

Next, the flow of operation during operation of the image sensor 1 will be described.
First, the image sensor 1 captures the target space and acquires an image of the target space (step S201). The image sensor 1 estimates the illuminance of the target space based on the acquired image and the setting information 122 (illuminance estimation parameter and illuminance estimation area information), and acquires illuminance information (environment information) (step S202). . The image sensor 1 transmits the acquired illuminance information to the illumination control device 412 (step S203). The lighting control device 412 generates a control signal for controlling the lighting device 2 based on the received illuminance information (step S204). The lighting control device 412 transmits the generated control signal to the lighting device 2 (step S205). The lighting device 2 controls the operation of the device itself based on the received control signal (step S206).

  Specifically, in step S204, the illumination control device 412 compares the illuminance indicated by the received illuminance information with the target illuminance. When the illuminance indicated by the illuminance information is lower than the target illuminance, a control signal for reducing the dimming rate of the lighting device is generated. On the other hand, when the illuminance indicated by the illuminance information is higher than the target illuminance, a control signal for increasing the dimming rate of the lighting device is generated.

  The image sensor 1 according to the embodiment configured as described above acquires control information (environment information and person information) necessary for controlling a device to be controlled based on an image acquired by the device itself. The adjustment terminal 42 generates setting information necessary for the image sensor 1 to acquire control information based on the image acquired by the image sensor 1, and transmits the setting information to the image sensor 1. The image sensor 1 sets the setting information transmitted from the adjustment terminal 42 in its own device. Therefore, the user does not need to manually create and set the setting information, and the work efficiency of the pre-setting before starting the operation of the image sensor 1 can be improved.

Hereinafter, modifications of the embodiment will be described.
The setting unit 16 may have a function of applying the input imaging parameter to the imaging unit 13 when the imaging parameter is input from the outside.
The image sensor 1 may be configured to include either the environment information acquisition unit 14 or the person information acquisition unit 15.
The setting information generation unit 424 may be provided in the image sensor 1. In this case, the adjustment terminal 42 transmits reference illuminance information necessary for generating setting information to the image sensor 1.
Information transmitted and received between the image sensor 1 and the adjustment terminal 42 may include internal information of the image sensor 1 in addition to information such as the imaging information 121 and the setting information 122. The internal information is information for an operator who sets the image sensor 1 using the adjustment terminal 42 to confirm details of the operation of the image sensor 1. For example, the internal information is information such as the result of image processing and intermediate data generated during each processing. The format of the transmitted setting information 122, imaging parameters, and internal information may be text data or binary data. The format of the image or video to be transmitted may be RAW data, various image formats, or various video formats. Further, the data to be transmitted may be encrypted.

According to at least one embodiment described above, the adjustment terminal 42 of the embodiment includes the setting information generation unit 424 that generates the setting information of the image sensor 1 based on the image acquired by the image sensor 1, thereby The efficiency of the setting work of the sensor 1 can be improved.
In addition, by acquiring control information from an image, it is possible to acquire a wide variety of control information. Further, by acquiring control information from the image, it is possible to visualize the area detected by the image sensor 1, and the efficiency of the setting operation of the image sensor 1 can be improved.
In addition, since the image sensor 1 can acquire a wider range of information than other sensor devices, the number of installed sensor devices can be reduced.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1, 1-1 to 1-3 ... Image sensor, 11 ... Communication control part, 12 ... Memory | storage part, 121 ... Imaging information, 122 ... Setting information, 13 ... Imaging part, 14 ... Environment information acquisition part, 15 ... Person information Acquisition unit, 16 ... setting unit, 2, 2-1 to 2-3 ... lighting equipment, 3, 3-1 to 3-8 ... air conditioning equipment, 4 ... control system, 41 ... external system, 411 ... BEMS, 412 ... Illumination control device, 413 ... air conditioning control device, 42 ... adjustment terminal, 421 ... storage unit, 422 ... communication control unit, 423 ... input unit, 424 ... setting information generation unit, 425 ... illuminance estimation area generation unit, 426 ... illuminance estimation Parameter generating unit 43 ... first network 44 ... second network 45 ... gateway device 46 ... HUB 5 ... image 5-1 ... periphery of lens 5-2 ... outer perimeter of floor 5-3 ... desk, 5-4 ... illuminance meter, 5-5 ... light Estimated area, 6 ... image, 6-1 to 6-4 ... lighting equipment, 6-5 ... desk, 6-6 to 6-9 ... illuminance meter, 6-10 to 6-13 ... illuminance estimation area, 7 ... image 7-1 to 7-4, lighting equipment, 7-5, desk, 7-6, area in the image, 7-7, illuminance estimation area, 8 ... menu screen, 81, input image, 82, 82-1 ~ 82-3 ... input menu, 83, 83-1 to 83-5 ... execute button

Claims (9)

For an image sensor that captures a predetermined space and generates an image, and acquires space information from the image, the image sensor generates setting information necessary for acquiring the space information, and An adjustment terminal that transmits to an image sensor,
A communication unit communicating with the image sensor;
A generation unit that acquires an image from the image sensor and generates the setting information based on the acquired image;
A coordination terminal comprising: When the setting information includes information on spatial reflectance,
The generation unit generates information on the reflectance of the space based on the image and the illuminance value measured in the space simultaneously with the generation of the image.
The adjustment terminal according to claim 1. In the acquisition of the space information, when the setting information includes information representing a target area in the image used by the image sensor as a target for acquiring the space information,
The generation unit detects an illuminance meter that measures the illuminance value from the image, and determines the target region according to a position of the illuminance meter.
The adjustment terminal according to claim 2. The generating unit detects a center position of the lens from the image, and determines the target region according to the center position of the lens;
The adjustment terminal according to claim 3. The generation unit detects a region whose brightness is increased by a lighting device from the image, and determines the target region according to a position of the region.
The adjustment terminal according to claim 3 or 4. The generation unit determines the target area according to a distance between the image sensor and a subject.
The adjustment terminal according to any one of claims 3 to 5. When the image sensor acquires information about the person in the space as information on the space,
The generation unit determines, as the target region, a region in the image used by the image sensor as a target for acquiring information about the person.
The adjustment terminal as described in any one of Claim 3 to 6. For an image sensor that captures a predetermined space and generates an image, and acquires space information from the image, the image sensor generates setting information necessary for acquiring the space information, and An adjustment method of an adjustment terminal that transmits to an image sensor,
A communication step of communicating with the image sensor;
A generation step of acquiring an image from the image sensor and generating the setting information based on the acquired image;
An adjustment method comprising:   The computer program for functioning a computer as an adjustment terminal as described in any one of Claim 1 to 7.

Images