JP2019176408A - Video monitoring device - Google Patents

Abstract

To make it possible to simply register the position of a signal light and readily allow the signal light to be remotely monitored even if the existing signal light is used.SOLUTION: A video monitoring device 2 includes: a video reception unit 21 for receiving video capturing a signal light that informs a state change of a lighting section by lighting of the lighting section from a photographing device; a mode switching unit 22 for switching to a registration mode for registering the position of the lighting section in the video; and a signal light information registration unit 23 for registering the lighting position lighting in the video as positional information on the lighting section with a signal light information storage unit 24 in the case of the registration mode.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for monitoring a signal lamp and a manufacturing facility connected to the signal lamp, and more particularly to a technique for registering a lighting position of the signal lamp in an image.

  In factories, signal lights are used for quality control of factories (Non-Patent Document 1). The signal lamp is physically and electrically connected to a manufacturing facility that operates in a manufacturing facility facility of a factory, and lights up in response to an abnormal signal output when the manufacturing facility is abnormal.

  However, signal lights are based on the premise that “monitors will be resident in the manufacturing equipment facility and directly monitor the lighting / non-lighting of the signal lights”, so quality control is performed in large-scale factories with hundreds of manufacturing facilities. In order to do this, it was necessary to secure a certain number of supervisors, and it was difficult to increase the production facilities.

  Therefore, as a facility management system using signal lights, a method of collectively monitoring a plurality of signal lights and manufacturing facilities is expected. For example, when a signal lamp is photographed by a photographing device and transmitted to a video monitoring device, the position of the signal light in the video is manually registered in the video monitoring device, and lighting is detected in the video from the photographing device. The signal lamp corresponding to the lighting position is identified from the position information, and the fact that the identified signal lamp is abnormal is notified. Thereby, even a small number of supervisors can collectively monitor a plurality of signal lights and manufacturing facilities.

PATLITE, “Improvement examples: FA site”, [online], [Search on March 15, 2018], <URL: http://www.patlite.co.jp/adoption_case/index_fa.html>

  However, since the position of the signal lamp in the video is manually registered, it takes time to newly register the position of the signal lamp when the number of the signal lamp and the manufacturing equipment is enormous or when the signal lamp and the manufacturing equipment are added. There was a problem.

  The present invention has been made in view of the above, and it is an object of the present invention to easily register the position of a signal lamp even when an existing signal lamp is used, and to easily monitor the signal lamp remotely.

  In order to solve the above problems, an image monitoring apparatus according to claim 1 includes: a receiving unit that receives an image of a signal lamp that notifies a change in state of a lighting unit by lighting of the lighting unit; A switching unit that switches to a registration mode for registering the position of the lighting unit, and a registration unit that registers, in the registration mode, a lighting position that is lit in the video in the storage unit as position information of the lighting unit, It is characterized by providing.

  The video monitoring device according to claim 2 is the video monitoring device according to claim 1, wherein the video is a plurality of videos in which the signal light is shot from different angles by a plurality of shooting devices, and the registration unit Is characterized by associating a plurality of lighting positions corresponding to the plurality of lighting with the same lighting section when the lighting patterns of the plurality of lighting detected from the plurality of images are the same.

  The video monitoring device according to claim 3 is the video monitoring device according to claim 1 or 2, wherein the registration unit is configured such that a maximum value of luminance included in a lighting area lit in the video is equal to or lower than a luminance upper limit value of the signal lamp. Only the region from the position corresponding to the maximum value of the luminance until the luminance becomes the threshold value or less in the external direction is registered as the position information of the lighting unit.

  According to the present invention, even when an existing signal lamp is used, the position of the signal lamp can be easily registered, and the signal lamp can be easily monitored remotely.

It is a figure which shows the structure of the monitoring system which concerns on 1st Embodiment. It is a figure which shows the example of the image | video which concerns on 1st Embodiment. It is a figure which shows the processing flow of the video monitoring apparatus which concerns on 1st Embodiment. It is a figure which shows the example of the signal light information which concerns on 1st Embodiment. It is a figure which shows another example of the signal light information which concerns on 1st Embodiment. It is a figure which shows the structure of the monitoring system which concerns on 2nd Embodiment. It is a figure which shows the example of the image | video which concerns on 2nd Embodiment. It is a figure which shows the processing flow of the video monitoring apparatus which concerns on 2nd Embodiment. It is a figure which shows the example of the signal light information which concerns on 2nd Embodiment. It is a figure which shows the processing flow of the video monitoring apparatus which concerns on 3rd Embodiment.

  Hereinafter, an embodiment for carrying out the present invention will be described with reference to the drawings.

<First Embodiment>
FIG. 1 is a diagram illustrating a configuration of a monitoring system 100 according to the first embodiment. The monitoring system 100 detects lighting / non-lighting of a signal lamp physically and electrically connected to a manufacturing facility operating in a manufacturing facility facility of a factory, and detects a change in state of the manufacturing facility connected to the signal lamp and the signal lamp. It is a monitoring system.

  As shown in FIG. 1, the monitoring system 100 includes a single photographing device 1 and a video monitoring device 2. The imaging device 1 and the video monitoring device 2 are connected via a wired or wireless communication network 3.

  The photographing apparatus 1 is a camera that is fixedly installed at a predetermined position in a manufacturing facility facility. The photographing device 1 has a function of photographing the signal lamp and the manufacturing facility connected to the manufacturing facility and transmitting the photographed video to the video monitoring device 2.

  Here, the signal lamp will be described. A signal light is composed of one or more lighting parts (blue, yellow, red, colorless, etc.), and lighting of one or more lighting parts itself and the state of the manufacturing equipment (normal, stopped, abnormal, etc.) It is to inform. For example, it is possible to grasp that the lighting unit itself and the manufacturing facility of the lighting unit are in a normal state by lighting the blue lighting unit. In addition, it is possible to grasp that each lighting unit itself and the manufacturing equipment are currently stopped and in an abnormal state by lighting each of the yellow and red lighting units.

  As shown in FIG. 1, the video monitoring device 2 includes a video reception unit 21, a mode switching unit 22, a signal light information registration unit 23, a signal light information storage unit 24, and a signal light monitoring unit 25. Is done.

  The video reception unit 21 has a function of receiving a signal lamp and a video captured by a manufacturing facility connected to the signal lamp from the imaging apparatus 1.

  The mode switching unit 22 has a function of switching the mode of the video monitoring device 2. For example, the registration mode for registering the position of the lighting part of the signal lamp in the video according to the mode selection by the supervisor, or the monitoring for monitoring the signal lamp and the manufacturing equipment using the video and the position information of the lighting part. Switch to mode.

  The signal light information registration unit 23 operates in the registration mode, has a function of autonomously detecting lighting in the video, and automatically registering the lighting position that has been lit as the position information of the lighting unit. Specifically, the brightness or luminance at each coordinate position in the image received from the image capturing device 1 is measured, and lighting in the image is detected based on whether the measured brightness or luminance value exceeds a threshold value. It has a function. The signal light information registration unit 23 has a function of specifying the lighting position in the video. The signal light information registration unit 23 has a function of registering the specified lighting position in the signal light information storage unit 24 as the position information of the lighting unit.

  The signal lamp information storage unit 24 has a function of storing, as signal lamp information, position information where the lighting part of the signal lamp is located in the video. The signal lamp information storage unit 24 has a function of associating position information where the lighting part of the signal lamp is located in the video with state information indicating a state of the lighting unit or a manufacturing facility connected to the lighting unit by lighting of the lighting unit. .

  The signal lamp monitoring unit 25 operates in the monitoring mode and repeatedly performs the process of detecting lighting in the video. When lighting is detected in the video, the lighting position is specified and stored in the signal lamp information storage unit 24. A function for detecting the current state of the lighting unit or the manufacturing equipment connected to the lighting unit from the status information of the lighting unit corresponding to the lighting position using the signal lamp information is provided.

  Next, the processing operation of the monitoring system 100 will be described.

  First, the processing operation of the photographing apparatus 1 will be described. The imaging device 1 captures the signal lamp and the manufacturing facility connected to the manufacturing facility, and transmits the captured image to the video monitoring device 2. For example, as illustrated in FIG. 2, the imaging device 1 captures a signal lamp 4 including three lighting units 4 a to 4 c and transmits the signal lamp 4 to the video monitoring device 2.

  Next, the processing operation of the video monitoring device 2 will be described. FIG. 3 is a diagram illustrating a flowchart of processing operations performed by the video monitoring apparatus 2.

Step S101;
First, the video reception unit 21 receives a video from which the signal lamp is captured from the imaging device 1.

Step S102;
Next, when the supervisor selects the registration mode, the mode switching unit 22 switches the mode of the video monitoring device 2 to the registration mode.

Steps S103 and S104;
Next, when the worker turns on the lighting unit 4a, the signal lamp information registration unit 23 is activated by switching to the registration mode, and when lighting is detected in the video, the lighting coordinates in the detected video are displayed. The position (x ₁ , y ₁ ) is specified.

Step S105;
Thereafter, the signal lamp information registration unit 23 registers the specified lighting coordinate position (x ₁ , y ₁ ) in the signal lamp information storage unit 24 as position information of the lighting unit 4a.

Thereafter, each time the worker changes the lighting unit to light it, the signal light information registration unit 23 repeats the processes of steps S103 to S105. As a result, the signal light information shown in FIG. 4 is registered in the signal light information storage unit 24. In the lighting unit ID, the identifiers of the lighting units 4a to 4c assigned by the signal light information registration unit 23 are registered. Coordinate positions (x ₁ , y ₁ ) to (x ₃ , y ₃ ) corresponding to the lighting units 4a to 4c in the video are registered in the lighting position. When a plurality of signal lamps 4 are included in the video, the lighting position of the lighting unit is registered for each signal lamp 4.

  Thereafter, when the registration mode is switched to the monitoring mode, the signal lamp monitoring unit 25 is activated, and when the signal lamp is lit based on the abnormal signal from the manufacturing facility, the signal lamp monitoring unit 25 detects lighting from the video and determines the lighting position. Specifically, the current state of the lighting unit or the manufacturing facility is detected using the signal lamp information in the signal lamp information storage unit 24, displayed on a monitor, or converted into signal data and transmitted to another monitoring device.

(Modification 1)
The signal lamp information registration unit 23 can register the reason why the lighting part of the signal lamp is lit (the state of the signal lamp and the manufacturing equipment connected to the signal lamp (normal / stop / abnormal), etc.) together with the signal lamp information. In this case, the video monitoring apparatus 2 holds in advance lighting reason information that defines the lighting pattern of the lighting unit and the lighting reason of the lighting unit used in the registration mode. For example, information that “three times lighting in the registration mode indicates an abnormal state” is held.

  When the worker repeatedly turns on the lighting unit 4a “1 second lighting → 0.5 second off → 1 second lighting → 0.5 second lighting → 1 second lighting → 3 second off”, the signal light information registration unit 23 Since lighting of 3 times is detected, it is specified from the lighting reason information that the lighting of the lighting unit 4a indicates an abnormal state, and is further registered in the signal lamp information. In addition, when the lighting is stopped twice and the lighting is normal once, when the worker turns on the lighting part 4b twice, the lighting of the lighting part 4b is specified to indicate the stopped state. When it is turned on once, it is specified that the lighting of the lighting unit 4c indicates a normal state, and is registered in the signal lamp information. Thereby, the signal light information is as shown in FIG.

  In this case, the signal lamp monitoring unit 25 can identify the lighting position from the video using the signal lamp information of FIG. 5 and can also grasp the state of the lighting part at the lighting position (≈the state of the manufacturing equipment connected to the lighting part). .

  As described above, according to the first embodiment, the signal lamp information registration unit 23 registers the lighting position lit in the video as the position information of the lighting unit in the signal lamp information storage unit 24. Therefore, when an existing signal lamp is used Even so, it is possible to easily register the position of the signal lamp, and to easily monitor the signal lamp remotely.

<Second Embodiment>
In the first embodiment, the case where one photographing apparatus 1 is used has been described. On the other hand, since the photographing apparatus 1 is fixedly installed at a predetermined position, it can only photograph from a predetermined angle. Therefore, in order to ensure that the blind spot area of the signal lamp can be photographed, the signal lamp may be photographed from a plurality of angles using a plurality of photographing apparatuses 1.

  However, when the same signal lamp is photographed by a plurality of imaging devices 1, the same signal lamp is double registered. Therefore, in the second embodiment, a method will be described in which the same signal lamp is not double registered even when a plurality of photographing apparatuses 1 are used.

  FIG. 6 is a diagram illustrating a configuration of the monitoring system 100 according to the second embodiment. The monitoring system 100 includes a plurality of photographing devices 1a to 1n and a video monitoring device 2.

  The plurality of photographing apparatuses 1a to 1n are fixedly installed at different places in the manufacturing facility facility. In the present embodiment, the plurality of imaging devices 1a to 1n respectively capture the same signal lamp from different angles, and transmit the captured images to the video monitoring device 2, respectively.

  Similar to the first embodiment, the video monitoring device 2 includes a video reception unit 21, a mode switching unit 22, a signal lamp information registration unit 23, a signal lamp information storage unit 24, and a signal lamp monitoring unit 25. Composed.

  The video receiving unit 21 has a function of receiving a plurality of videos taken by the same signal lamp at different angles from the plurality of imaging devices 1a to 1n, respectively.

  The signal light information registration unit 23 has a function of associating a plurality of lighting positions corresponding to a plurality of lightings with the same lighting unit when the lighting patterns of the plurality of lightings detected from the plurality of images are the same.

  The mode switching unit 22, the signal lamp information storage unit 24, and the signal lamp monitoring unit 25 have the same functions as those described in the first embodiment.

  Next, the processing operation of the monitoring system 100 will be described.

  First, processing operations of the plurality of imaging devices 1a to 1n will be described. The plurality of photographing devices 1a to 1n respectively photograph the same signal lamp from different angles, and transmit the photographed images to the video monitoring device 2, respectively. For example, as shown in FIG. 7, the two photographing devices 1 a and 1 n simultaneously photograph one signal lamp 4 composed of three lighting units 4 a to 4 c and transmit it to the video monitoring device 2.

  Next, the processing operation of the video monitoring device 2 will be described. FIG. 8 is a diagram illustrating a flowchart of processing operations performed by the video monitoring apparatus 2.

Step S201;
First, the video receiving unit 21 receives videos taken with signal lights from the plurality of imaging devices 1a to 1n, respectively. In the received plurality of images, the same signal lamp is taken from different angles.

Step S202;
Next, when the supervisor selects the registration mode, the mode switching unit 22 switches the mode of the video monitoring device 2 to the registration mode.

Steps S203 and S204;
Next, when the lighting section 4a is turned on three times by turning on the lighting section 4a with "1 second lighting → 0.5 second lighting off → 1 second lighting → 0.5 second lighting → 1 second lighting → 3 seconds off”, the signal lamp information registration is performed. The unit 23 detects lighting in each of a plurality of videos, specifies the lighting coordinate positions (x ₁₁ , y ₁₁ ), (x ₂₁ , y ₂₁ ) in each detected video, The lighting pattern of the lighting part 4a in each image is specified.

Step S205;
Next, the signal lamp information registration unit 23 compares the plurality of identified lighting patterns and determines whether or not the plurality of lighting patterns are the same. When the plurality of lighting patterns are the same, the process proceeds to step S206, and when the plurality of lighting patterns are not the same, the process proceeds to step S207.

Step S206;
When the plurality of lighting patterns are the same as each other, the signal light information registration unit 23 sets the plurality of coordinate positions (x ₁₁ , y ₁₁ ) and (x ₂₁ , y ₂₁ ) corresponding to the specified plurality of lightings to the same lighting unit. 4a is registered in the signal light information.

Step S207;
On the other hand, in step S203, the worker turns on the lighting unit 4a three times, and at the same time turns on the lighting unit 4b twice by “lighting on for 1 second → lighting off for 0.5 seconds → lighting on for 1 second → lighting off for 3 seconds”. The signal lamp information registration unit 23 does not have the same lighting pattern of the three lightings out of the two lighting patterns specified from the video #a and the lighting pattern of the two lightings out of the two lighting patterns specified from the video #n. Therefore, the two coordinate positions (x ₁₁ , y ₁₁ ) and (x ₂₂ , y ₂₂ ) respectively corresponding to the three times and two times of lighting are registered separately without being associated with the same lighting part.

  As a result, the signal light information is as shown in FIG.

(Modification 1)
In 2nd Embodiment, the case where the lighting pattern of the lighting part used at the time of registration mode was changed for every lighting part was demonstrated so that the same signal lamp might not be double-registered. On the other hand, since it takes time to change the lighting pattern, the lighting pattern of the lighting unit used in the registration mode may be set to the same common pattern, and the plurality of lighting units may be turned on in different time zones. For example, after the lighting part 4a is turned on once and turned off, the lighting part 4b is turned on once. The lighting patterns of the two lighting parts 4a and 4b are the same once, but the lighting timings are different, so the positions of the two lighting parts 4a and 4b are registered separately.

  As described above, according to the second embodiment, when the lighting patterns of the plurality of lightings detected from the plurality of images by the signal light information registration unit 23 are the same, the plurality of lighting positions corresponding to the plurality of lightings are the same. It is possible to prevent double registration of the same signal lamp.

<Third Embodiment>
In the first embodiment and the second embodiment, it is assumed that a light source other than a signal light is not included in the video imaged by the imaging device 1. On the other hand, depending on the time of day, sunlight or the like may be included in the video from the window of the manufacturing facility, and may be erroneously registered as a signal light. Thus, in the third embodiment, a tolerance technique for preventing erroneous registration of light sources other than signal lights will be described.

  Specifically, an allowable luminance range that is permitted as the luminance of the signal lamp in the video is defined and registered in advance, and the luminance of the lighting area detected from the video (the luminance of each pixel, the luminance of the maximum point (the maximum luminance value) The position information is registered only when the average value of all pixel luminances is within the allowable luminance range. In addition, the position information is registered by regarding the area from the maximum luminance point included in the lighting area to a predetermined condition in the external direction as the lighting area of the lighting unit. The predetermined condition is a pixel position at which the rate of change in luminance rapidly decreases, for example, a pixel position having 80% of the luminance at the maximum point.

  Therefore, in this embodiment, the signal light information registration unit 23 of the video monitoring device 2 is an area where the maximum luminance value included in the lighting area lit in the video is equal to or lower than the upper limit value of the luminance allowable range, Only a region from the position corresponding to the maximum value to the external direction until the luminance falls below the threshold value is registered as the position information of the lighting unit.

  FIG. 10 is a diagram illustrating a flowchart of processing operations performed by the video monitoring apparatus 2.

Steps S301 and S302;
First, in the registration mode, the signal light information registration unit 23 measures the maximum luminance value of the lighting region for the lighting region detected from the video, and determines whether or not the measured maximum luminance value is included in the allowable luminance range. judge. If the maximum luminance value is included in the allowable luminance range, the process proceeds to step S303. If the maximum luminance value is not included in the allowable luminance range, the process ends. For example, if the allowable luminance range of a signal lamp is defined as 5,000 to 1,000 cd / m ² , sunlight or reflected light of sunlight can be reliably excluded.

Step S303;
When the maximum luminance value is included in the allowable luminance range, the signal light information registration unit 23 determines the pixel region from the pixel position corresponding to the maximum luminance value to the pixel position having 80% of the maximum luminance value in the external direction. Identify and extract.

Step S304;
Thereafter, the signal lamp information registration unit 23 registers the extracted pixel area in the signal lamp information storage unit 24 as the position information of the lighting unit.

  As described above, according to the third embodiment, the signal lamp information registration unit 23 is an area in which the maximum luminance value included in the lighting area lit in the video is equal to or lower than the luminance upper limit value of the signal lamp, and the maximum luminance. Since only the area from the position corresponding to the value to the external direction where the luminance falls below the threshold value is registered as the position information of the lighting unit, it is possible to prevent erroneous registration of a light source other than the signal lamp.

  Finally, the video monitoring apparatus 2 described in each embodiment can be realized by a computer. It is also possible to create a program for causing a computer to function as the video monitoring apparatus 2 and a storage medium for the program.

DESCRIPTION OF SYMBOLS 100 ... Surveillance system 1, 1a, 1n ... Imaging device 2 ... Video monitoring device 21 ... Video receiving part 22 ... Mode switching part 23 ... Signal light information registration part 24 ... Signal light information storage part 25 ... Signal light monitoring part 3 ... Communication network 4 ... Signal lamps 4a-4c ... lighting part

In order to solve the above problems, an image monitoring apparatus according to claim 1 includes: a receiving unit that receives an image of a signal lamp that notifies a change in state of a lighting unit by lighting of the lighting unit; A switching unit that switches to a registration mode for registering the position of the lighting unit, and a registration unit that registers, in the registration mode, a lighting position that is lit in the video in the storage unit as position information of the lighting unit, The video is a plurality of videos obtained by shooting the signal light from different angles by a plurality of imaging devices, and the registration unit has a plurality of lighting patterns detected from the plurality of videos, respectively. In the same case, a plurality of lighting positions corresponding to the plurality of lightings are associated with the same lighting part .

The video monitoring device according to claim 2 registers a receiving unit that receives from the imaging device a video in which a signal lamp that indicates a change in the state of the lighting unit by lighting of the lighting unit is received, and a position of the lighting unit in the video A switching unit that switches to a registration mode for registering, and a registration unit that registers, in the registration mode, a lighting position that is lit in the video in a storage unit as position information of the lighting unit, and the registration unit includes: The maximum luminance value included in the lighting area lit in the video is an area that is less than or equal to the luminance upper limit value of the signal lamp, and the luminance from the position corresponding to the maximum luminance value to the external direction until the luminance becomes the threshold value or less. Only the region is registered as the position information of the lighting unit.

Claims (3)

A receiving unit that receives an image of a signal lamp that is informed of a change in the state of the lighting unit by lighting the lighting unit;
A switching unit for switching to a registration mode for registering the position of the lighting unit in the video;
In the case of the registration mode, a registration unit that registers a lighting position lit in the video as a position information of the lighting unit in a storage unit;
A video surveillance apparatus comprising: The video is a plurality of videos in which the signal light was shot from different angles by a plurality of shooting devices,
The registration unit
2. The video according to claim 1, wherein when a plurality of lighting patterns detected from the plurality of videos are the same as each other, a plurality of lighting positions corresponding to the plurality of lighting are associated with the same lighting unit. Monitoring device. The registration unit
The maximum luminance value included in the lighting area lit in the video is an area that is less than or equal to the luminance upper limit value of the signal lamp, and the luminance from the position corresponding to the maximum luminance value to the external direction until the luminance becomes the threshold value or less. The video monitoring apparatus according to claim 1, wherein only the area is registered as position information of the lighting unit.

Images