JP6226859B2 - Work monitoring system - Google Patents

Description

  The present invention relates to a work monitoring system that monitors a worker with a monitoring camera.

  In a conventional work monitoring system, a monitor monitors a video of a monitoring camera installed in a work area with a monitoring display. In addition, a monitoring system using face authentication is widely used as a method for identifying an operator who does not rely on visual observation.

  For example, in the intruder monitoring system presented in Patent Document 1, a specific action pattern that proceeds to a suspicious person intrusion prohibited area set in an area is stored in the action pattern storage unit, and the person tracked by the image analysis means is stored. When the action matches a specific action pattern and the face information of the person is not registered, the person is determined to be a suspicious person.

  On the other hand, as a recent image processing method, a technique called augmented reality (AR) in which information is superimposed on an image obtained by imaging a real space and presented to a user has attracted attention. Patent Document 2 presents a method for presenting information in an easy-to-understand manner as an image processing method using the AR technology in an image in which there are many targets to which information is to be added.

JP 2010-2111514 A JP 2012-58838 A

  With a conventional general monitoring method in which a monitor visually monitors the video of a monitoring camera, it is difficult to monitor the behavior of all workers without overlooking. Depending on the size of the work area, there may be a case where a plurality of surveillance cameras and monitors are installed, and it is necessary for the supervisor to grasp the actions of all the workers reflected in them, and there is a problem that the burden is heavy. However, in order to automate monitoring, system complexity and cost increase are inevitable.

  In Patent Document 1, the determination of a suspicious person is automated, but a suspicious person is determined only when it matches a pre-stored action pattern. Less than In addition, there is no prior example in which the AR technique as described in Patent Document 2 is used to improve the efficiency of monitoring work.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to obtain a work monitoring system capable of improving the efficiency of monitoring work and reducing the burden on the supervisor.

  A work monitoring system according to the present invention includes a monitoring camera installed in a work area, a face authentication processing device that performs face authentication of an operator, a monitoring video processing device that displays an image acquired from the monitoring camera on a monitoring display, and A work information database in which worker information including a worker name, work content, and work area is registered, and the face authentication processing device includes a face information database in which the worker face information and the worker ID are stored, The face authentication unit that performs face authentication of the worker and acquires the worker ID of the worker from the face information database, and the monitoring video processing apparatus acquires the video captured by the monitoring camera and displays the video on the monitoring display. A video acquisition unit, an input unit for selecting a worker or a message on the monitor display screen, and the face authentication unit requesting face authentication of the worker selected by the input unit The worker information acquisition unit that acquires the worker ID of the worker, collates the acquired worker ID with the work information database and acquires the worker information of the worker, and the worker information acquired by the worker information acquisition unit Is generated, and an output image generation unit that displays the information window on the screen of the monitoring display is provided.

  According to the work monitoring system of the present invention, the supervisor can select a worker from the real-time video on the monitoring display and check the worker information of the worker in the information window. Work is streamlined and the burden on the observer is reduced.

It is the schematic which shows the work monitoring system which concerns on Embodiment 1 of this invention. It is a block diagram which shows the structure of the work monitoring system which concerns on Embodiment 1 of this invention. It is a figure which shows the screen of the monitor display of the work monitoring system which concerns on Embodiment 1 of this invention. It is a figure which shows the flow of the monitoring operation | work in the operation | work monitoring system which concerns on Embodiment 1 of this invention. It is a figure which shows the screen of the monitor display of the work monitoring system which concerns on Embodiment 2 of this invention. It is the schematic which shows the work monitoring system which concerns on Embodiment 3 of this invention. It is a figure which shows the flow of the monitoring operation | work in the operation | work monitoring system which concerns on Embodiment 3 of this invention. It is the schematic which shows the work monitoring system which concerns on Embodiment 5 of this invention.

Embodiment 1 FIG.
Hereinafter, a work monitoring system according to Embodiment 1 of the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram showing a work monitoring system according to the first embodiment, and FIG. 2 is a block diagram showing a configuration of the work monitoring system according to the first embodiment. FIG. 3 shows an example of a monitor display screen of the work monitoring system according to the first embodiment. In each figure, the same and corresponding parts are denoted by the same reference numerals.

  As shown in FIG. 1, a work monitoring system 100 according to the first embodiment includes a monitoring camera 1 installed in a work area 6 and a monitoring video processing device that displays a video acquired from the monitoring camera 1 on a monitoring display 5. 2. A face authentication processing device 3 for performing face authentication of the worker and a work information database 4 in which worker information is registered are provided. The monitor 8 monitors the video of the work area 6 captured by the monitoring camera 1 on the monitoring display 5.

  As shown in FIG. 2, the monitoring video processing device 2 includes a video acquisition unit 21, an operator information acquisition unit 22, an output image generation unit 23, and an input unit 24. Further, the face authentication processing device 3 includes a face authentication unit 31 and a face information database 32. The face authentication unit 31 performs face authentication of the worker and acquires the worker ID of the worker from the face information database 32. The face information database 32 stores worker face information and worker ID necessary for face authentication.

  The video acquisition unit 21 of the monitoring video processing device 2 acquires the video captured by the monitoring camera 1 and displays the video on the monitoring display 5. The worker information acquisition unit 22 requests the face authentication unit 31 to perform face authentication of the worker selected by the monitor 8 on the screen of the monitoring display 5 and acquires the worker ID of the worker. Further, the worker ID of the worker is obtained by collating the worker ID with the work information database 4.

  Note that the worker information stored in the work information database 4 includes at least the name of the worker, the work content, and the work area. Furthermore, other information, for example, the age of the worker, qualifications owned, work history, work schedule, etc. may be included. The name, age, etc. of the worker are unique invariant information, and the work content, work area, work schedule, etc. are rewritable variable information. The rewriting of worker information will be described later in a fourth embodiment.

  The output image generation unit 23 uses AR technology that superimposes and presents worker information on a real-time video obtained by photographing the work area 6 that is a real space, and the worker information acquisition unit 22 An information window 52 that presents the acquired worker information is generated and displayed on the screen of the monitoring display 5. The information window 52 is displayed so as to overlap or be close to the image of the worker selected by the supervisor 8.

  The input unit 24 is a mouse or a keyboard, and is used when the supervisor 8 selects a worker or a message on the screen of the monitor display 5 or rewrites the worker information presented in the information window 52. .

  In the screen example of the monitoring display 5 shown in FIG. 3, images of workers 7 a and 7 b working in the work area 6 are displayed. When the monitor 8 clicks the face of the worker 7b on the screen of the monitoring display 5 with the mouse cursor 51, an information window 52 is displayed so as to overlap the image of the worker 7b, and the name is set as the worker information of the worker 7b. , Work content and work location are presented. When the worker 7a is selected, an information window 52 that presents worker information related to the worker 7a is displayed so as to overlap the image of the worker 7a.

  A monitoring work flow in the work monitoring system 100 according to the first embodiment will be described with reference to the flowchart of FIG. In step 1 (S1) of FIG. 4, the surveillance camera 1 captures the workers 7a and 7b in the work area 6, and in step 2 (S2), the video acquisition unit 21 acquires the video captured in S1, This is displayed on the monitor display 5.

  Subsequently, in step 3 (S3), when the supervisor 8 clicks on the face of the worker 7b with the mouse cursor 51 in order to confirm the worker information of the worker 7b, the worker information acquisition unit 22 performs S3. The face authentication processing device 3 is requested to authenticate the clicked face image. Subsequently, in step 4 (S4), the face authentication unit 31 acquires the image of the face of the worker 7b clicked in S3, executes face authentication, and obtains the worker ID of the worker 7b from the face information database 32. Extract. Subsequently, in step 5 (S5), the worker information acquisition unit 22 acquires the worker ID of the worker 7b from the face authentication processing device 3.

  Further, in step 6 (S6), the worker information acquisition unit 22 collates the worker ID acquired in S5 with the work information database 4, and acquires the worker information of the worker 7b. Subsequently, in step 7 (S7), the output image generation unit 23 generates an information window 52 on the screen of the monitoring display 5, and presents the worker information of the worker 7b acquired from the worker information acquisition unit 22. . In step 8 (S8), the supervisor 8 confirms the name, work content, and work area of the clicked worker 7b in the information window 52.

  As described above, according to the work monitoring system 100 according to the first embodiment, the supervisor 8 selects a worker from the real-time video on the monitoring display 5 and displays the worker information of the worker in the information window. It is possible to confirm at 52, the efficiency of the monitoring work is improved, and the burden on the supervisor 8 is reduced.

Embodiment 2. FIG.
The work monitoring system 100 according to Embodiment 2 of the present invention includes a warning message display unit (not shown) that displays a warning message 53 in the information window 52 on the screen of the monitoring display 5. Since other configurations are the same as those in the first embodiment, detailed description thereof is omitted with reference to FIGS. 1 and 2.

  The warning message display unit captures the work area of the worker information registered in the work information database 4 and the surveillance camera 1 for the worker selected by the monitor 8 on the screen of the monitor display 5 using the input unit 4. It is determined whether or not the work area 6 being matched matches, and if they do not match, a warning message 53 is displayed in the information window 52.

  FIG. 5 shows an example of the screen of the monitoring display 5 of the work monitoring system 100 according to the second embodiment. In the example shown in FIG. 5, the work area A of the worker information presented in the information window 52 is different from the actual work area 6 captured by the monitoring camera 1, so that a warning message 53 is displayed in the information window 52. It is displayed. In FIG. 5, the word “warning” is displayed as the warning message 53, but a sentence such as “work area does not match” or an item indicating the warning content may be displayed.

  According to the second embodiment, in addition to the same effects as those of the first embodiment, the work area registered in the worker information and the surveillance camera 1 are photographing the worker selected by the supervisor 8. Since the warning message 53 is displayed in the information window 52 when the work areas 6 do not match, the supervisor 8 can immediately confirm the suspicious behavior of the worker.

Embodiment 3 FIG.
FIG. 6 is a schematic diagram showing a work monitoring system according to Embodiment 3 of the present invention. The work monitoring system 100 according to the third embodiment has a message notification unit (not shown) for notifying a worker working in the work area 6 by voice in addition to the same functions as those of the second embodiment. I have. Since the other configuration is the same as that of the first embodiment, FIG. 2 is used and detailed description is omitted.

  The message notification unit includes a voice generation unit that generates a voice of the message and a notification unit that transmits the voice generated by the voice generation unit to the worker. In FIG. 6, a speaker 9 is installed in the work area 6 as a notification means. The notification means may be headphones worn by the worker.

  The work monitoring system 100 according to the third embodiment includes a warning message display unit similar to that of the second embodiment. When the work area registered in the work information database 4 does not match the work area 6 photographed by the monitoring camera 1 for the worker selected by the monitor 8 on the screen of the monitor display 5, the information window A warning message 53 is displayed at 52. Further, in the third embodiment, when the monitor 8 selects (clicks) the warning message 53 displayed on the information window 52 with the input unit 4, the message notification unit broadcasts the warning message on the speaker 9, and Notify workers.

  A monitoring work flow in the work monitoring system 100 according to the third embodiment will be described with reference to the flowchart of FIG. Note that S1 to S8 in FIG. 7 are the same as those in the flowchart in FIG. 4 described in the first embodiment, and thus description thereof is omitted. In step 9 (S9) of FIG. 7, the warning message display unit determines whether or not the work area 6 of the actual video captured by the surveillance camera 1 matches the worker area of the worker information.

  In S9, if they match (YES), the process ends. If they do not match (NO), the process proceeds to step 10 (S10), and the warning message display unit displays a warning message 53 in the information window 52. Subsequently, in step 11 (S11), when the supervisor 8 clicks the warning message 53 with the mouse cursor 51, the message notification unit generates a message voice and broadcasts it through the speaker 9 in step 12 (S12). Warn workers.

  According to the third embodiment, in addition to the same effects as those of the first and second embodiments, a warning message can be immediately notified to a suspicious worker, and the supervisor 8 It is possible to save the trouble of warning the supervisor, and the burden on the supervisor 8 is reduced.

Embodiment 4 FIG.
Since the configuration of the work monitoring system according to the fourth embodiment of the present invention is the same as that of the third embodiment, FIG. 6 is used and detailed description is omitted. In the third embodiment, the example in which the message notification unit notifies the worker working in the work area 6 of the warning message has been described. However, the message notification unit also has other uses. In the fourth embodiment, other uses of the message notification unit will be described.

  At least a part of the worker information presented in the information window 52 of the monitoring display 5 can be rewritten by the input unit 24. The monitor 8 changes the variable information in the worker information presented in the information window 52, that is, the work area and the work content, using the mouse or keyboard that is the input unit 24 when a sudden schedule change occurs. can do. For example, the work content of the worker 7b can be changed from carrying the member A to carrying the member B, or the work area can be changed from the area A to the area B.

  When the worker information presented in the information window 52 is rewritten, the message notification unit notifies the worker of the change of the worker information. The worker who receives the notification engages in the changed work. The changed worker information is registered and managed in the work information database 4.

  According to the fourth embodiment, in addition to the same effects as those of the first to third embodiments, it is possible to save the supervisor 8 from notifying the worker of changes in work content and the like. The burden of 8 is reduced.

Embodiment 5. FIG.
FIG. 8 is a schematic diagram showing a work monitoring system according to Embodiment 5 of the present invention. The work monitoring system 100 according to the fifth embodiment uses a tablet terminal 10 that can be carried by a monitor 8 as a monitoring display. Since the other configuration is the same as that of the first embodiment, FIG. 2 is used and detailed description is omitted.

  The monitoring video processing device 2 of the work monitoring system 100 according to the fifth embodiment includes a wireless device 11 for communicating with a tablet terminal 10 that is a monitoring display. The video acquired by the video acquisition unit 21 and the worker information presented in the information window 52 generated by the output image generation unit 23 are transmitted to the tablet terminal 10 via the wireless device 11.

  According to the fifth embodiment, in addition to the same effects as those of the first embodiment, the monitor 8 can check the monitor video regardless of the location by using the tablet terminal 10, and the convenience of the monitoring work is improved. To do. It should be noted that the present invention can be freely combined with each other within the scope of the invention, and each embodiment can be appropriately modified or omitted.

  The present invention can be used as a work monitoring system that monitors a worker with a monitoring camera.

DESCRIPTION OF SYMBOLS 1 Surveillance camera, 2 Surveillance video processing apparatus, 3 Face authentication processing apparatus, 4 Work information database, 5 Surveillance display, 6 Work area, 7a, 7b Worker, 8 Monitor, 9 Speaker, 10 Tablet terminal, 11 Wireless apparatus , 21 Video acquisition unit, 22 Worker information acquisition unit, 23 Output image generation unit, 24 input unit, 31 Face authentication unit, 32 Face information database, 51 Mouse cursor,
52 information window, 53 warning message, 100 work monitoring system.

Claims (6)

A surveillance camera installed in the work area, a face authentication processing device for performing face recognition of the worker, a monitoring video processing device for displaying a video acquired from the monitoring camera on a monitoring display, the name of the worker, and the work content And a work information database in which worker information including a work area is registered,
The face authentication processing device includes a face information database storing a worker's face information and a worker ID, and a face authentication unit that performs face authentication of the worker and acquires the worker ID of the worker from the face information database. Have
The monitoring video processing apparatus includes a video acquisition unit that acquires a video captured by the monitoring camera and displays the video on the monitoring display, an input unit that selects an operator or a message on a screen of the monitoring display, and the input The face authentication unit is requested to perform face authentication of the worker selected by the section, the worker ID of the worker is acquired, and the worker ID of the worker is checked against the work information database. An operator information acquisition unit that acquires information, and an output image generation unit that generates an information window that presents the worker information acquired by the worker information acquisition unit and displays the information window on a screen of the monitoring display A work monitoring system comprising:   For the worker selected by the input unit, a warning message is displayed in the information window when the work area of the worker information registered in the work information database does not match the work area captured by the monitoring camera. The work monitoring system according to claim 1, wherein:   The work monitoring system according to claim 2, further comprising a message notification unit that notifies a worker who works in the work area by voice.   4. The work monitoring system according to claim 3, wherein when the warning message displayed in the information window is selected by the input unit, the message notification unit notifies the worker of the warning message.   At least a part of the worker information presented in the information window can be rewritten by the input unit, and when the worker information presented in the information window is rewritten, the message notification unit displays the worker information. The work monitoring system according to claim 3, wherein a change in the worker information is notified to. The work monitoring system according to any one of claims 1 to 5, wherein a tablet terminal is used as the monitoring display.

Images