JP2019003854A - Imaging apparatus, controller, and lighting control system - Google Patents

Abstract

To provide an imaging apparatus capable of suppressing inappropriate dimming of lighting equipment.SOLUTION: An imaging apparatus 10 includes an imaging device 11 that captures an image of a space illuminated by light emitted from a lighting device 30, a detection processing unit 12 that generates a detection signal by performing first detection processing including signal processing on the image captured by the imaging device 11 during the normal operation of the lighting device 30, and a communication unit 13 that transmits the generated detection signal. While the lighting device 30 is operating for visible light communication, the detection processing unit 12 (a) generates a detection signal by performing second detection processing different from the first detection processing, or (b) stops the transmission of the detection signal by the communication unit 13.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a lighting control system that performs dimming control on a lighting fixture capable of performing a visible light communication operation based on an image captured by an imaging device.

  2. Description of the Related Art Conventionally, a technique for controlling a lighting fixture based on an image captured by a camera is known. Patent Document 1 discloses an LED illumination tube having a camera. On the other hand, lighting fixtures capable of visible light communication operation that blinks at a speed that cannot be recognized by human eyes are also known. An information terminal such as a smartphone provided with an imaging element can use blinking of a lighting fixture as a data signal.

JP 2010-238572 A

  In a lighting control system that dimmes a lighting fixture based on an image captured by an imaging device, the lighting fixture may perform a visible light communication operation. In this case, flickering due to visible light communication operation (flickering of the lighting fixture) or the like may occur in the captured image, and the lighting fixture may not be appropriately dimmed.

  The present invention provides an imaging device, a controller, and a lighting control system that can prevent a lighting fixture from being dimmed inappropriately.

  An imaging device according to an aspect of the present invention is an imaging device that transmits the detection signal to a controller that performs dimming control of a lighting fixture based on a detection signal, and the lighting fixture includes a first lighting operation, and The second illumination operation for emitting light for optical communication modulated at a higher modulation degree than the light emitted during the first illumination operation is selectively performed, and the imaging device is illuminated by the light emitted by the lighting fixture. An image sensor that captures an image of a space, and the detection signal is generated by performing a first detection process including a signal process on the image captured by the image sensor while the lighting device is performing the first illumination operation. A detection processing unit, and a communication unit that transmits the generated detection signal. When the lighting fixture is in the second lighting operation, the detection processing unit is (a) a second different from the first detection processing. Perform detection processing To generate more the detection signal, or to stop the transmission of the detection signal according to (b) the communication unit.

  A controller according to an aspect of the present invention is a controller that performs dimming control of a lighting fixture, and the lighting fixture modulates at a higher degree of modulation than a first lighting operation and light emitted during the first lighting operation. The controller selectively performs a second illumination operation that emits light for optical communication, and (a) a detection signal based on an image captured by the imaging device while the lighting fixture is in the first illumination operation. And (b) a control unit that stops the dimming control during the second lighting operation.

  An illumination control system according to an aspect of the present invention includes: a first illumination operation; and a second illumination operation that emits light for optical communication modulated at a higher modulation degree than light emitted during the first illumination operation. A light source selectively performed, an image sensor that captures an image of a space illuminated by light emitted from the light source, and signal processing on the image captured by the image sensor during the first illumination operation of the light source. A detection processing unit that generates a detection signal by performing a first detection process, and a control unit that performs dimming control of the light source based on the detection signal generated by the detection processing unit by the first detection process, While the light source is in the second illumination operation, the control unit (a) performs dimming control on the light source based on a detection signal generated by the detection processing unit by a second detection process different from the first detection process. Or ( ) Stops the dimming control of the light source.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device, controller, and illumination control system which can suppress that a lighting fixture will be dimmed improperly are implement | achieved.

FIG. 1 is a block diagram illustrating a functional configuration of a lighting control system according to an embodiment. FIG. 2 is a diagram schematically illustrating the brightness of the luminaire during normal operation and during visible light communication operation. FIG. 3 is another diagram schematically illustrating the brightness of the luminaire during normal operation and visible light communication operation. FIG. 4 is a sequence diagram of the operation of the lighting control system. FIG. 5 is a diagram for explaining signal processing for reducing the influence of a dark part generated in a frame. FIG. 6 is a schematic diagram for explaining the change of the frame rate. FIG. 7 is a sequence diagram of the operation of the lighting control system according to the second modification. FIG. 8 is a sequence diagram of the operation of the illumination control system according to the third modification. FIG. 9 is a sequence diagram of the operation of the illumination control system according to the fourth modification.

  Hereinafter, embodiments will be described with reference to the drawings. It should be noted that each of the embodiments described below shows a comprehensive or specific example. The numerical values, shapes, materials, constituent elements, arrangement positions and connecting forms of the constituent elements, steps, order of steps, and the like shown in the following embodiments are merely examples, and are not intended to limit the present invention. In addition, among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims indicating the highest concept are described as optional constituent elements.

  Each figure is a schematic diagram and is not necessarily shown strictly. Moreover, in each figure, the same code | symbol is attached | subjected to substantially the same structure, and the overlapping description may be abbreviate | omitted or simplified.

(Embodiment)
[Configuration of lighting control system]
Hereinafter, the structure of the illumination control system and lighting fixture which concern on embodiment is demonstrated, referring drawings. First, the illumination control system according to the embodiment will be described. FIG. 1 is a block diagram illustrating a functional configuration of a lighting control system according to an embodiment.

  As illustrated in FIG. 1, the illumination control system 100 according to the embodiment includes an imaging device 10, a controller 20, and a lighting fixture 30. The imaging device 10, the controller 20, and the lighting fixture 30 are connected by a communication line 40. The lighting control system 100 may include a plurality of lighting fixtures 30.

  In the lighting control system 100, the lighting fixture 30 is dimmed based on the image of the space illuminated by the light emitted by the lighting fixture 30. For example, the imaging device 10 captures an image of the space and transmits a detection signal indicating the brightness of the captured image. That is, the imaging device 10 is used as an illuminance sensor that detects brightness. Further, the imaging apparatus 10 may compare a background image prepared in advance with a captured video and transmit a detection signal indicating whether or not the captured video includes an object such as a human. That is, the imaging device 10 may be used as a sensor (human sensor) that detects an object such as a human.

  Such a detection signal is received by the controller 20, and the controller transmits a first instruction signal for instructing dimming to the lighting fixture 30 in accordance with the received detection signal. As a result, the lighting fixture 30 is dimmed according to the image. For example, the luminaire 30 is dimmed dark when the image brightness is too bright and brightly dimmed when the image brightness is too dark so that the brightness of the image indicated by the detection signal is constant. The luminaire 30 may be dimmed brightly when the detection signal indicates that an object such as a person is included in the video.

  Here, the lighting fixture 30 can perform visible light communication operation in addition to such normal operation. 2 and 3 are diagrams schematically illustrating the brightness of the lighting fixture 30 during normal operation and during visible light communication operation.

  As shown in FIGS. 2 and 3, the lighting fixture 30 emits light at a constant brightness indicated by the first instruction signal instructing dimming during normal operation. On the other hand, during the visible light communication operation, the lighting fixture 30 blinks at a speed that cannot be recognized by human eyes. An information terminal such as a smartphone provided with an imaging element can use the blinking of the lighting fixture 30 as a data signal. The normal operation and the visible light communication operation may be alternately performed as shown in FIG. 2, or the visible light communication operation may be continued from a certain point in time as shown in FIG.

  As described above, the lighting fixture 30 selectively performs a normal operation of illuminating the space and a visible light communication operation of outputting a data signal while illuminating the space. The normal operation is an example of a first illumination operation, and the visible light communication operation is an example of a second illumination operation that emits light for optical communication modulated with a higher modulation degree than the light emitted during the first illumination operation. It is. Note that the lighting device 30 blinks means that the lighting device 30 emits light brightly and repeats a dark light emission state or a light-off state. The blinking frequency is, for example, several kHz to several MHz. Blinking includes blinking. A high degree of modulation means, for example, that the difference in brightness between the brightest state and the darkest state of the luminaire is large.

  Here, when the lighting fixture 30 is dimmed based on an image captured by the imaging device 10 during the visible light communication operation, the lighting fixture 30 may not be dimmed in the same manner as during normal operation. is there. This is because the imaging device 10 recognizes the blinking of the lighting fixture 30 and flickers in the video imaged by the imaging device 10. When the image flickers by the imaging device 10, the lighting fixture 30 may be dimmed inappropriately (flickers) according to the flicker of the image. Further, when the imaging device 10 detects the presence or absence of an object in the video, since the false detection occurs due to the flickering of the video, the lighting fixture 30 may be dimmed inappropriately.

  Therefore, the imaging device 10 performs a second detection process different from the first detection process performed during the normal operation during the visible light communication operation. Thereby, the illumination control system 100 can suppress that the lighting fixture 30 is dimmed inappropriately. Hereinafter, each component of such an illumination control system will be described in detail with reference to FIG.

[Imaging device]
The imaging device 10 is a device that captures an image of a space illuminated by the lighting fixture 30 and detects the brightness of the space or the presence or absence of an object in the space based on the captured image. Specifically, the imaging device 10 transmits a detection signal indicating the brightness of the space or the presence or absence of an object in the space to the controller 20 that controls the lighting fixture 30. The imaging device 10 includes an imaging element 11, a detection processing unit 12, a communication unit 13, and a storage unit 14.

  The image sensor 11 captures an image of a space illuminated by light emitted from the lighting fixture 30. The image sensor 11 is, for example, a complementary metal-oxide-semiconductor (CMOS) image sensor. The image pickup device 11 may be another image pickup device such as a CCD (Charge Coupled Device) image sensor. The image sensor 11 is a rolling shutter type image sensor, but may be a global shutter type image sensor.

  The detection processing unit 12 performs detection processing using the video imaged by the image sensor 11 and generates a detection signal. Specifically, the detection processing unit 12 includes an imaging control unit 12a and a signal processing unit 12b.

  The imaging control unit 12 a controls the image sensor 11. The imaging control unit 12a controls the frame rate (shutter timing) of the image sensor 11, for example.

  The signal processing unit 12 b performs signal processing on the video imaged by the image sensor 11. For example, the signal processing unit 12b detects (calculates) the brightness of a frame included in an image captured by the image sensor 11.

  The signal processing unit 12b may calculate an average value of luminance values of a plurality of pixels constituting the frame as a value indicating the brightness of the frame, or may calculate a sum of luminance values of a plurality of pixels included in the frame. It may be calculated. In this case, the signal processing unit 12 b generates a detection signal indicating the brightness of the video (frame) and outputs the detection signal to the communication unit 13.

  Further, the signal processing unit 12b may detect the presence or absence of an object in the video imaged by the imaging device 11. Specifically, the signal processing unit 12b may use the image sensor 11 as a human sensor. The signal processing unit 12b compares a background image prepared in advance with a captured video (frame) and detects whether an object such as a person not included in the background image is included in the captured video. In this case, the signal processing unit 12 b generates a detection signal indicating the presence or absence of an object in the video (frame) and outputs the detection signal to the communication unit 13. As described above, the detection signal may be a signal based on the video imaged by the imaging device 10 (imaging device 11).

  The detection processing unit 12 is realized by, for example, a processor, a microcomputer, or a dedicated circuit. The detection processing unit 12 may be realized by a combination of two or more of a processor, a microcomputer, and a dedicated circuit.

  The communication unit 13 transmits a detection signal based on the control of the detection processing unit 12. The detection signal is transmitted to the controller 20 by wired communication via the communication line 40. In addition, the communication unit 13 receives a notification signal indicating the timing at which the visible light communication operation is performed from the lighting fixture 30 via the communication line 40. The communication unit 13 is specifically a communication module (communication circuit).

  The storage unit 14 is a storage device that stores a control program executed by the detection processing unit 12, a background image used when the detection processing unit 12 detects the presence or absence of an object, and the like. The storage unit 14 is realized by a semiconductor memory or the like.

[controller]
The controller 20 is a control device that controls the lighting fixture 30. For example, the controller 20 performs dimming control on the lighting fixture 30 based on the detection signal. Specifically, the controller 20 includes a communication unit 21, a control unit 22, an operation reception unit 23, and a storage unit 24.

  The communication unit 21 receives a detection signal from the imaging device 10 via the communication line 40. In addition, the communication unit 21 transmits a first instruction signal that instructs the lighting fixture 30 to perform dimming and a second instruction signal that instructs the lighting fixture 30 to perform a visible light communication operation based on the control of the control unit 22. Specifically, the communication unit 21 is a communication module (communication circuit).

  Based on the detection signal received by the communication unit 21, the control unit 22 generates a first instruction signal that instructs the lighting fixture 30 to perform dimming, and causes the communication unit 21 to transmit the generated first instruction signal. The first instruction signal is transmitted to the lighting fixture 30 by wired communication via the communication line 40. The first instruction signal includes an instruction value for the brightness to the luminaire 30. In this way, the control unit 22 performs dimming control of the lighting fixture 30 (light source 33) by transmitting the first instruction signal.

  In addition, the control unit 22 generates an instruction signal based on a user operation received by the operation reception unit 23 and causes the communication unit 21 to transmit the generated instruction signal. For example, the control unit 22 generates a second instruction signal instructing the visible light communication operation based on a user's operation instructing the visible light communication operation received by the operation receiving unit 23, and the generated second instruction signal is The data is transmitted to the communication unit 21. The second instruction signal is transmitted to the lighting fixture 30 by wired communication via the communication line 40.

  The control unit 22 is realized by, for example, a processor, a microcomputer, or a dedicated circuit. The control unit 22 may be realized by a combination of two or more of a processor, a microcomputer, and a dedicated circuit.

  The operation reception unit 23 is a user interface that receives user operations. The operation receiving unit 23 is, for example, a touch panel or a hardware key arranged on the main body of the controller 20. The operation receiving unit 23 may be a remote controller that is separate from the controller 20.

  The storage unit 24 is a storage device that stores a control program executed by the control unit 22. The storage unit 24 also stores correspondence information indicating a correspondence relationship between a value indicating the brightness of the frame indicated by the detection signal and an instruction value of the brightness instructed to the lighting fixture 30. The storage unit 24 is realized by a semiconductor memory or the like.

[lighting equipment]
The lighting fixture 30 is a lighting fixture for room lighting, for example, and emits white light. The lighting fixture 30 is a ceiling light, for example, but may be a spotlight or a downlight. The lighting fixture 30 includes a communication unit 31, a lighting control unit 32, a light source 33, and a storage unit 34.

  The communication unit 31 receives the first instruction signal and the second instruction signal from the controller 20 via the communication line 40. Further, the communication unit 31 transmits a notification signal for notifying the imaging device 10 of the timing when the visible light communication operation is performed based on the control of the illumination control unit 32. In other words, the notification signal is a signal indicating the timing at which the lighting fixture 30 performs the visible light communication operation. Specifically, the communication unit 31 is a communication module (communication circuit).

  The illumination control unit 32 adjusts the light source 33 based on the first instruction signal received by the communication unit 31. Specifically, the illumination control unit 32 reads the brightness instruction value included in the first instruction signal, and causes the light source 33 to emit light with the brightness indicated by the read instruction value.

  In addition, when the second instruction signal is received by the communication unit 31, the illumination control unit 32 generates a notification signal indicating the timing for performing the visible light communication operation, and causes the communication unit 31 to transmit the generated notification signal. The notification signal is transmitted to the imaging device 10 by wired communication via the communication line 40.

  Specifically, the illumination control unit 32 includes a constant current circuit for supplying a constant current to the light source 33, a circuit such as a modulation circuit for modulating the current supplied from the constant current circuit, and a control of a microcomputer or the like. This is realized by the element. The constant current circuit includes a filter circuit, a rectifier circuit, a smoothing capacitor, a boost converter circuit, a flyback converter circuit, and the like. The microcomputer controls the switching element for adjusting the amount of current to the light source 33 included in the modulation circuit to cause the light source 33 to emit light with the brightness indicated by the instruction value.

  The light source 33 is a light source in which an LED chip or an LED element is used as a light emitting element, and emits light using electric power supplied from the illumination control unit 32. The light source 33 selectively performs a normal operation and a visible light communication operation. The light source 33 emits white light, for example. The light emitted from the light source 33 may include invisible light such as infrared rays. The light source 33 is, for example, a COB (Chip On Board) type light emitting module in which an LED chip is directly disposed on a substrate, but an SMD type in which an SMD (Surface Mount Device) type LED element is disposed on the substrate. It may be a light emitting module.

  The storage unit 34 is a storage device that stores a control program executed by the illumination control unit 32. The storage unit 34 also stores a modulation signal for visible light communication used in light emission control for visible light communication. Specifically, the storage unit 34 is realized by a semiconductor memory or the like.

[Operation of lighting control system]
Next, the operation of the illumination control system 100 will be described. FIG. 4 is a sequence diagram of the operation of the lighting control system 100. In the following embodiment, the case where the imaging device 10 is mainly used as an illuminance sensor and the detection signal indicates the brightness of the frame will be described, but the same applies to the case where the detection signal indicates the presence or absence of an object in the video. It becomes the operation.

  First, the lighting fixture 30 starts a normal operation (S11). At this time, the detection processing unit 12 of the imaging device 10 performs the first detection process, and transmits the detection signal generated by the first detection process to the communication unit 13 (S12).

  As described above, in the first detection process, the imaging control unit 12a of the detection processing unit 12 controls the imaging device 11 to capture the image of the space illuminated by the lighting fixture 30, and the signal processing unit 12b captures the image. A value indicating the brightness of the frame included in the recorded video is calculated. In the first detection process, the detection processing unit 12 generates a detection signal including a value indicating the calculated brightness of the frame. The detection processing unit 12 transmits the generated detection signal to the communication unit 13.

  The communication unit 21 of the controller 20 receives the detection signal transmitted by the communication unit 13 (S13). The control unit 22 specifies an instruction value corresponding to a value indicating the brightness of the frame included in the received detection signal by referring to the correspondence information stored in the storage unit 24, and includes the specified instruction value. A first dimming signal is generated, which is a first instruction signal for instructing the lighting fixture 30 to perform dimming. Then, the control unit 22 causes the communication unit 21 to transmit the generated first dimming signal (S14).

  The communication unit 31 of the lighting fixture 30 receives the first instruction signal transmitted by the communication unit 21 (S15). The illumination control unit 32 causes the light source 33 to emit light with the brightness indicated by the instruction value included in the received first instruction signal. That is, the illumination control unit 32 adjusts the light source 33 (S16).

  As described above, in the normal operation, the brightness of the light emitted from the lighting fixture 30 is controlled based on the image of the space illuminated by the light emitted from the lighting fixture 30.

  Here, when the operation receiving unit 23 of the controller 20 receives a user's instruction for visible light communication operation (S17), the control unit 22 generates a second instruction signal for instructing visible light communication, and generates the generated second instruction. The signal is transmitted to the communication unit 21 (S18). Note that when the visible light communication operation is performed regardless of the user's operation, such as when the normal operation and the visible light communication operation are periodically performed alternately, step S17 is omitted.

  The communication part 31 of the lighting fixture 30 receives the 2nd instruction | indication signal transmitted by the communication part 21 (S19). When the second instruction signal is received by the communication unit 31, the illumination control unit 32 causes the communication unit 31 to transmit a notification signal indicating that the lighting fixture 30 will start the visible light communication operation from now on (S20). In other words, the lighting control unit 32 causes the communication unit 31 to transmit a notification signal indicating the timing at which the lighting fixture 30 performs the visible light communication operation.

  The communication unit 13 of the imaging device 10 receives the notification signal transmitted by the communication unit 31 (S21). When the notification signal is received by the communication unit 13, the detection processing unit 12 causes the communication unit 13 to transmit an ACK signal (S22).

  The communication unit 31 of the lighting fixture 30 receives the ACK signal transmitted by the communication unit 13 (S23). When the communication unit 31 receives the ACK signal, the illumination control unit 32 starts a visible light communication operation that causes the light source 33 to blink at high speed (S24).

  Here, after the detection processing unit 12 of the imaging device 10 receives the notification signal in step S21 (after transmitting the ACK signal in step S22), the detection processing unit 12 continues until the notification signal indicating the return to the normal operation is received. Performs a second detection process different from the first detection process, and transmits a detection signal (S25). Specifically, the second detection process is different from the first detection process in that it includes a signal process for reducing the influence of a dark part generated in the frame due to blinking of the light source 33. Details of the second detection process will be described later.

  The subsequent processing is the same as in the normal operation. The communication unit 21 of the controller 20 receives the detection signal transmitted by the communication unit 13 (S26). The control unit 22 specifies an instruction value corresponding to a value indicating the brightness of the frame included in the received detection signal by referring to the correspondence information stored in the storage unit 24, and includes the specified instruction value. A first dimming signal first instruction signal is generated. And the control part 22 transmits the produced | generated 1st light control signal to the communication part 21 (S27).

  The communication part 31 of the lighting fixture 30 receives the 1st instruction | indication signal transmitted by the communication part 21 (S28). The illumination control unit 32 causes the light source 33 to emit light with the brightness indicated by the instruction value included in the received first instruction signal. That is, the illumination control unit 32 adjusts the light source 33 (S29).

[Second detection process]
As described above, in the visible light communication operation, the detection processing unit 12 generates a detection signal by the second detection process. Specifically, the second detection process is different from the first detection process in that it includes a signal process for reducing the influence of a dark part generated in the frame due to the blinking of the light source 33. FIG. 5 is a diagram for explaining signal processing for reducing the influence of a dark part generated in a frame. FIG. 5 shows a schematic state in which each of the frames 50a to 50d is configured by a total of 16 pixels in 4 rows and 4 columns.

  As such signal processing, the signal processing unit 12b of the detection processing unit 12 performs averaging processing using a plurality of frames constituting the video imaged by the imaging device 11. For example, when calculating a value indicating the brightness of the frame 50a, an averaged frame in which the luminance values of the corresponding pixels are averaged is generated using the frame 50a and a plurality of frames immediately before the frame 50a. The value indicating the brightness of the averaged frame is calculated as the value indicating the brightness of the frame 50a ((a) in FIG. 5). The value indicating the brightness of the averaged frame may be an average value of luminance values of a plurality of pixels constituting the averaged frame, or may be a sum of luminance values of a plurality of pixels included in the averaged frame. Also good.

  According to such an averaging process, the dark part included in the frame 50a is corrected by the averaging process. For this reason, the illumination control system 100 can suppress the lighting fixture 30 being dimmed inappropriately (for example, flickering).

  Note that a case where signal processing is performed after a plurality of frames are temporarily stored in the storage unit 14 (after being buffered) is conceivable. In such a case, the signal processing unit 12b generates an averaged frame in which luminance values of corresponding pixels are averaged using the frame 50a and a plurality of frames immediately after the frame 50a, and the generated averaged frame May be calculated as a value indicating the brightness of the frame 50a. The signal processing unit 12b generates an averaged frame in which luminance values of corresponding pixels are averaged using the frame 50a, one or more frames immediately before the frame 50a, and one or more frames immediately after the frame 50a. The value indicating the brightness of the generated averaged frame may be calculated as the value indicating the brightness of the frame 50a.

  In addition, the signal processing unit 12b may perform pixel correction processing on a frame included in the video imaged by the imaging device 11 as signal processing for reducing the influence of a dark portion generated in the frame. Specifically, the signal processing unit 12b may correct the luminance value of the pixel included in the frame 50a with the luminance value of the corresponding pixel in the other frames 50b to 50d. For example, the signal processing unit 12b performs correction to replace the luminance value of the pixel 51a included in the frame 50a with the luminance value of the corresponding pixel 51b of the frame 50b immediately before the frame 50a, and indicates the brightness of the corrected frame 50a. The value is calculated ((b) in FIG. 5). Note that the pixel 51a to be replaced is a pixel whose luminance value has decreased due to the influence of the visible light communication operation. For example, the signal processing unit 12b specifies the pixel 51a to be replaced based on whether or not the luminance value is lower than a predetermined value. As a pixel used for replacement, for example, a pixel having a luminance value equal to or higher than a predetermined value may be used. In FIG. 5B, the luminance value is replaced only for one pixel 51a, but the luminance values of a plurality of pixels included in the frame 50a may be replaced.

  According to such pixel correction processing, dark pixels included in the frame 50a are corrected. For this reason, the illumination control system 100 can suppress the lighting fixture 30 being dimmed inappropriately.

  Note that a case where signal processing is performed after a plurality of frames are temporarily stored in the storage unit 14 (after being buffered) is conceivable. In such a case, the signal processing unit 12b performs correction to replace the luminance value of the pixel 51a included in the frame 50a with the luminance value of the corresponding pixel in the frame immediately after the frame 50a, and adjusts the brightness of the corrected frame 50a. The indicated value may be calculated. The pixel correction process for the frame 50a may be performed using a frame other than the frame 50a.

  The imaging control unit 12a of the detection processing unit 12 may change the frame rate (shutter timing) of the image sensor 11 in the second detection process. FIG. 6 is a schematic diagram for explaining the change of the frame rate.

  As illustrated in FIG. 6, for example, the imaging control unit 12 a increases the frame rate during the visible light communication operation compared to the normal operation. Specifically, for example, during the visible light communication operation, the imaging control unit 12a increases the frame rate of 30 fps to 100 fps during normal operation. In other words, the image sensor 11 captures an image at a first frame rate (for example, 30 fps) based on the control of the detection processing unit 12 in the first detection process, and controls the detection processing unit 12 in the second detection process. The video is shot at a second frame rate (for example, 100 fps) that is different from the first frame rate.

  Thus, the number of usable frames can be increased in the averaging process and the pixel correction process. In FIG. 6, from when the ACK signal for the notification signal indicating that the visible light communication operation is started is transmitted until the ACK signal for the notification signal indicating that the visible light communication operation is ended is transmitted. The period is illustrated as a period during which the frame rate is increased.

[Modification 1]
The lighting control system 100 may include a plurality of lighting fixtures 30 for one controller 20 and one imaging device 10. In such a case, the controller 20 performs dimming control on the plurality of lighting fixtures 30 based on one detection signal. In addition, the controller 20 causes the plurality of lighting fixtures 30 to perform visible light communication operation simultaneously.

  At this time, the notification signal may be transmitted by only one lighting fixture 30 among the plurality of lighting fixtures 30. In other words, the communication unit 13 of the imaging device 10 may receive a notification signal indicating that the one lighting fixture 30 is performing a visible light communication operation from only one lighting fixture 30 among the plurality of lighting fixtures 30. Good.

  When each of the plurality of lighting fixtures 30 transmits a notification signal, communication congestion on the communication line 40 occurs, and a collision of the plurality of notification signals may occur on the communication line 40. If the notification signal is transmitted by only one lighting fixture 30 among the plurality of lighting fixtures 30, communication congestion on the communication line 40 is suppressed.

[Modification 2]
In the above-described embodiment, the communication unit 13 of the imaging device 10 receives the notification signal indicating the timing at which the lighting fixture 30 performs the visible light communication operation from the lighting fixture 30. However, the communication unit 13 may receive a notification signal indicating the timing at which the lighting fixture 30 performs the visible light communication operation from the controller 20. FIG. 7 is a sequence diagram of the operation of the illumination control system 100 according to the second modification. In the following description of FIG. 7, the description is focused on steps S <b> 31 to S <b> 34 that are different from the sequence diagram shown in FIG. 4.

  In the operation according to the modified example 2 shown in FIG. 7, when the operation reception unit 23 of the controller 20 receives an instruction of the visible light communication operation of the user (S17), the control unit 22 causes the lighting fixture 30 to perform the visible light communication operation. A notification signal indicating the timing to perform is transmitted to the communication unit 21 (S31). Note that when the visible light communication operation is performed regardless of the user's operation, such as when the normal operation and the visible light communication operation are periodically performed alternately, step S17 is omitted.

  The communication unit 13 of the imaging device 10 receives the notification signal transmitted by the communication unit 21 (S32). When the notification signal is received by the communication unit 13, the detection processing unit 12 causes the communication unit 13 to transmit an ACK signal (S33).

  The communication unit 21 of the controller 20 receives the ACK signal transmitted by the communication unit 13 (S34). When the communication unit 21 receives the ACK signal, the control unit 22 generates a second instruction signal instructing visible light communication, and transmits the generated second instruction signal to the communication unit 21 (S18).

  The communication part 31 of the lighting fixture 30 receives the 2nd instruction | indication signal transmitted by the communication part 21 (S19). When the second instruction signal is received by the communication unit 31, the illumination control unit 32 starts a visible light communication operation (S24).

  Even in the operation according to Modification 2 as described above, the imaging apparatus 10 can perform the second detection process different from the first detection process while the lighting fixture 30 is in the visible light communication operation. For this reason, the illumination control system 100 can suppress the lighting fixture 30 being dimmed inappropriately.

  In addition, the process of step S31-step S34 may be performed after step S18, step S19, and step S24.

  Further, it is not essential that the notification signal is transmitted to the imaging device 10. For example, the detection processing unit 12 may determine whether or not the lighting fixture 30 is in a visible light communication operation by performing image processing on a frame included in a video imaged by the imaging device 11. However, if a notification signal is transmitted from the controller 20 or the lighting fixture 30, the image processing is not necessary, so that the signal processing amount and power consumption of the detection processing unit 12 can be reduced.

[Modification 3]
The detection processing unit 12 of the imaging device 10 may stop the detection process (detection signal transmission) during the visible light communication operation. That is, in the lighting control system 100, the light control function of the light source 33 may be stopped while the lighting fixture 30 is in the visible light communication operation. FIG. 8 is a sequence diagram of the operation of the illumination control system 100 according to the third modification. In the following description of FIG. 8, the description will be focused on differences from the sequence diagram shown in FIG. 4.

  In the operation according to the modified example 3 shown in FIG. 8, the detection processing unit 12 of the imaging device 10 causes the communication unit 13 to transmit an ACK signal (S22), and then stops the detection process (S41). At this time, the lighting fixture 30 is in a visible light communication operation. The detection process is stopped, for example, until the operation of the lighting fixture 30 is switched from the visible light communication operation to the normal operation (for example, until a notification signal indicating that the operation returns to the normal operation is received).

  The detection processing unit 12 may stop the detection process by stopping the imaging of the video by the image sensor 11 or may continue the imaging of the video by the imaging element 11 and stop the generation of the detection signal. May be stopped. Further, the detection processing unit 12 may continue the generation of the detection signal and stop the detection process by causing the communication unit 13 to stop transmitting the detection signal. The detection processing unit 12 may stop at least transmission of the detection signal by the communication unit 13.

  As described above, when the transmission of the detection signal is stopped while the lighting fixture 30 is in the visible light communication operation, the control unit 22 of the controller 20 stops the dimming control of the light source 33 based on the detection signal. Therefore, the lighting control system 100 can suppress the lighting fixture 30 from being dimmed inappropriately.

[Modification 4]
In the operation according to Modification 3, the dimming control of the lighting fixture 30 is stopped when the imaging device 10 stops the transmission of the detection signal while the lighting fixture 30 is in the visible light communication operation. However, the dimming control may be stopped when the controller 20 handles the detection signal as an invalid signal while the lighting fixture 30 is in the visible light communication operation. FIG. 9 is a sequence diagram of the operation of the illumination control system 100 according to the fourth modification. In the following description of FIG. 9, the description is focused on differences from the sequence diagram shown in FIG. 4.

  In the operation according to the modified example 4 shown in FIG. 9, when the operation receiving unit 23 of the controller 20 receives an instruction for the visible light communication operation of the user (S <b> 17), the control unit 22 performs the second instruction for instructing the visible light communication. A signal is generated, and the generated second instruction signal is transmitted to the communication unit 21 (S18). When the second instruction signal is received by the communication unit 31 of the lighting fixture 30 (S19), the illumination control unit 32 starts a visible light communication operation (S24).

  Here, the control part 22 of the controller 20 stops the light control of the lighting fixture 30 after transmitting the 2nd instruction | indication signal to the communication part 21 (S51). Specifically, the control unit 22 stops the transmission of the first instruction signal by the communication unit 21. The stop of the dimming control is continued until, for example, a user instruction to cancel the visible light communication operation (a user instruction to shift to a normal operation) is received by the operation reception unit 23.

  Therefore, even if the detection signal generated by the detection processing unit 12 of the imaging device 10 through the first detection process is transmitted (S52), the control unit 22 does not perform dimming control of the lighting fixture 30. That is, the control unit 22 (controller 20) handles the detection signal as an invalid signal.

  At this time, the control unit 22 may stop the dimming control by stopping reception of the detection signal by the communication unit 21, or may continue reception of the detection signal by the communication unit 21 to generate the first instruction signal. The dimming control may be stopped by stopping. The control unit 22 may continue the generation of the first instruction signal and stop the dimming control by causing the communication unit 13 to stop transmitting the first instruction signal. The control part 22 should just stop the transmission of the 1st instruction | indication signal by the communication part 21 at least.

  In this way, if the dimming control of the lighting fixture 30 by the control unit 22 is stopped while the lighting fixture 30 is in the visible light communication operation, the lighting control system 100 causes the lighting fixture 30 to be dimmed inappropriately. This can be suppressed.

[Effects]
As described above, the imaging device 10 is an imaging device that transmits a detection signal to the controller 20 that performs dimming control of the lighting fixture 30 based on the detection signal. The luminaire 30 selectively performs a normal operation and a visible light communication operation that emits light for optical communication modulated with a higher degree of modulation than the light emitted during the normal operation. The normal operation is an example of the first illumination operation, and the visible light communication operation is an example of the second illumination operation.

  The imaging device 10 includes a first imaging device 11 that captures an image of a space illuminated by light emitted by the lighting fixture 30, and a signal processing for a video shot by the imaging device 11 while the lighting fixture 30 is in normal operation. A detection processing unit 12 that generates a detection signal by performing detection processing, and a communication unit 13 that transmits the generated detection signal are provided. While the lighting fixture 30 is in the visible light communication operation, the detection processing unit 12 generates a detection signal by performing (a) a second detection process different from the first detection process, or (b) detection by the communication unit 13. Stop signal transmission.

  Thereby, the imaging device 10 can suppress that the lighting fixture 30 is dimmed inappropriately.

  The communication unit 13 may further receive a notification signal indicating the timing at which the lighting fixture 30 performs the visible light communication operation from the controller 20.

  Thereby, the imaging device 10 (detection processing unit 12) can recognize the timing at which the lighting fixture 30 performs the visible light communication operation without performing image processing on the frame. Therefore, the signal processing amount and power consumption of the detection processing unit 12 can be reduced.

  Further, the communication unit 13 may further receive a notification signal indicating the timing at which the lighting fixture 30 performs the visible light communication operation from the lighting fixture 30.

  Thereby, the imaging device 10 (detection processing unit 12) can recognize the timing at which the lighting fixture 30 performs the visible light communication operation without performing image processing on the frame. Therefore, the signal processing amount and power consumption of the detection processing unit 12 can be reduced.

  Further, the controller 20 performs dimming control of the plurality of lighting fixtures 30 based on the detection signal, and the communication unit 13 determines that the one lighting fixture 30 is visible light from only one lighting fixture 30 among the plurality of lighting fixtures 30. You may receive the notification signal which shows the timing which performs communication operation.

  Thereby, the congestion of the communication in the communication line 40 is suppressed rather than the case where each of the some lighting fixture 30 transmits a notification signal. In addition, collision of a plurality of notification signals is suppressed.

  In addition, during the visible light communication operation of the luminaire 30, the detection processing unit 12 generates a detection signal by performing a second detection process, and in the second detection process, configures an image captured by the image sensor 11. An averaging process using a plurality of frames may be performed.

  If the dark part included in the frame is corrected by such an averaging process, the imaging apparatus 10 can suppress the lighting fixture 30 from being dimmed inappropriately.

  In addition, during the visible light communication operation of the lighting fixture 30, the detection processing unit 12 generates a detection signal by performing the second detection process, and the second detection process includes the detection signal in the video imaged by the imaging device 11. Pixel correction processing for a frame to be processed may be performed.

  Thereby, if the dark pixel contained in a flame | frame is correct | amended by the correction process of a pixel, the imaging device 10 can suppress that the lighting fixture 30 is dimmed improperly.

  In addition, during the visible light communication operation of the lighting fixture 30, the detection processing unit 12 generates a detection signal by performing the second detection process, and the imaging element 11 is used for each of the first detection process and the second detection process. Frame rate control may be included. In the first detection process, the image sensor 11 may capture a video at the first frame rate, and in the second detection process, the image sensor 11 may capture a video at a second frame rate different from the first frame rate. .

  Thereby, the detection processing unit 12 can increase the number of usable frames in the averaging process and the pixel correction process.

  The controller 20 is a controller that performs dimming control of the lighting fixture 30. The luminaire 30 selectively performs a normal operation and a visible light communication operation that emits light for optical communication modulated with a higher degree of modulation than the light emitted during the normal operation. The controller 20 (a) performs dimming control of the luminaire 30 based on a detection signal based on the video imaged by the imaging device 10 while the luminaire 30 is in normal operation, and (b) the luminaire 30 is visible light. During the communication operation, a control unit 22 that stops the dimming control is provided.

  Thereby, the controller 20 can suppress that the lighting fixture 30 is dimmed improperly.

  In addition, the illumination control system 100 includes a light source 33 that selectively performs a normal operation and a visible light communication operation that emits light for optical communication modulated with a higher degree of modulation than light emitted during the normal operation, and a light source The image sensor 11 that captures an image of the space illuminated by the light emitted by the light source 33, and a detection signal by performing a first detection process including signal processing on the image captured by the image sensor 11 while the light source 33 is in normal operation. And a control unit 22 that performs dimming control of the light source 33 based on the detection signal generated by the detection processing unit 12 through the first detection process. During the visible light communication operation of the light source 33, the control unit 22 (a) performs dimming control of the light source 33 based on the detection signal generated by the detection processing unit 12 by the second detection process different from the first detection process, or (B) Dimming control of the light source 33 is stopped.

  Thereby, the illumination control system 100 can suppress that the lighting fixture 30 is dimmed inappropriately.

(Other embodiments)
Although the embodiment has been described above, the present invention is not limited to such an embodiment.

  For example, the communication method between apparatuses described in the above embodiment is not particularly limited. In the above embodiment, wired communication is performed between devices via a communication line, but wireless communication may be performed between devices.

  Moreover, in the said embodiment, another process part may perform the process which a specific process part performs. Further, the order of the plurality of processes may be changed, and the plurality of processes may be executed in parallel. Moreover, the distribution of the components included in the illumination control system to a plurality of devices is an example. For example, another device may include a component included in one device. For example, the controller may be realized as an apparatus integrated with the imaging apparatus, or may be realized as an apparatus integrated with the lighting fixture. The lighting control system may be realized as a single device. The lighting control system may be realized as a client server system.

  In the above-described embodiment, the components such as the control unit may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

  The components such as the control unit may be a circuit (or an integrated circuit). These circuits may constitute one circuit as a whole, or may be separate circuits. Each of these circuits may be a general-purpose circuit or a dedicated circuit.

  The general or specific aspect of the present invention may be realized by a recording medium such as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable CD-ROM. Further, the present invention may be realized by any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium. For example, the present invention may be realized as a lighting control method. In addition, the present invention may be realized as a program for causing a computer to execute the lighting control method, or may be realized as a non-temporary recording medium on which the program is recorded.

  In addition, it is realized by variously conceiving various modifications conceived by those skilled in the art for each embodiment, or by arbitrarily combining the components and functions in each embodiment without departing from the spirit of the present invention. This form is also included in the present invention.

DESCRIPTION OF SYMBOLS 10 Imaging device 11 Image sensor 12 Detection process part 13 Communication part 20 Controller 22 Control part 30 Lighting fixture 33 Light source 50a, 50b, 50c, 50d Frame 51a, 51b Pixel 100 Illumination control system

Claims (9)

An imaging device that transmits the detection signal to a controller that performs dimming control of the lighting fixture based on the detection signal,
The lighting apparatus selectively performs a first lighting operation and a second lighting operation that emits light for optical communication modulated with a higher modulation degree than the light emitted during the first lighting operation,
The imaging device
An image sensor that captures an image of a space illuminated by light emitted by the lighting fixture;
A detection processing unit that generates the detection signal by performing a first detection process including a signal process on an image captured by the imaging device during the first lighting operation of the lighting fixture;
A communication unit that transmits the generated detection signal,
While the lighting device is in the second lighting operation, the detection processing unit generates the detection signal by performing (a) a second detection process different from the first detection process, or (b) the communication. An imaging apparatus that stops transmission of the detection signal by the unit. The imaging device according to claim 1, wherein the communication unit further receives a notification signal indicating a timing at which the lighting fixture performs the second lighting operation from the controller. The imaging device according to claim 1, wherein the communication unit further receives a notification signal indicating the timing at which the lighting fixture performs the second lighting operation from the lighting fixture. The controller performs dimming control of the plurality of lighting fixtures based on the detection signal,
The imaging device according to claim 1, wherein the communication unit receives a notification signal indicating a timing at which the one lighting fixture performs the second lighting operation from only one lighting fixture among the plurality of lighting fixtures. During the second lighting operation of the lighting fixture, the detection processing unit generates the detection signal by performing the second detection processing,
The imaging device according to any one of claims 1 to 4, wherein in the second detection process, an averaging process using a plurality of frames constituting an image photographed by the imaging element is performed. During the second lighting operation of the lighting fixture, the detection processing unit generates the detection signal by performing the second detection processing,
5. The imaging device according to claim 1, wherein in the second detection processing, pixel correction processing is performed on a frame included in an image captured by the imaging device. During the second lighting operation of the lighting fixture, the detection processing unit generates the detection signal by performing the second detection processing,
Each of the first detection process and the second detection process includes control of a frame rate of the image sensor,
In the first detection process, the imaging device captures an image at a first frame rate,
The imaging apparatus according to claim 5 or 6, wherein, in the second detection process, the imaging element captures an image at a second frame rate different from the first frame rate. A controller for dimming control of a lighting fixture,
The luminaire selectively performs a first illumination operation and a second illumination operation that emits light for optical communication modulated with a higher modulation degree than the light emitted during the first illumination operation,
The controller (a) performs dimming control on the lighting fixture based on a detection signal based on an image taken by the imaging device while the lighting fixture is in the first lighting operation, and (b) the lighting fixture is A controller comprising a control unit that stops the dimming control during the second illumination operation. A light source that selectively performs a first illumination operation and a second illumination operation that emits light for optical communication modulated at a higher modulation degree than the light emitted during the first illumination operation;
An image sensor that captures an image of a space illuminated by light emitted by the light source;
A detection processing unit that generates a detection signal by performing a first detection process including a signal process on a video image captured by the image sensor while the light source is in the first illumination operation;
A control unit that performs dimming control of the light source based on the detection signal generated by the detection processing unit by the first detection processing;
While the light source is in the second illumination operation, the control unit (a) performs dimming control on the light source based on a detection signal generated by the detection processing unit by a second detection process different from the first detection process. Or (b) an illumination control system that stops dimming control of the light source.

Images