JP2020102817A - Monitor target identification apparatus, monitor target identification system, and monitor target identification method - Google Patents

Abstract

To provide a monitor target identification apparatus, a monitor target identification system, and a monitor target identification method for allowing individual identification of a target included in a monitor image.SOLUTION: A monitor information management server 10 as a monitor target identification apparatus stores transmitter management data in which identification information of a transmitter 40 is associated with target identification information being information identifiably indicating a monitor target holding a transmitter 40. Also, the monitor information management server 10 specifies a position of a shooting target included in a monitor image, and specifies a position of the transmitter 40 which has transmitted the identification information received by a receiver 30 on the basis of a radio wave condition from the transmitter 40 detected by the receiver 30. Further, the monitor information management server 10 performs the individual identification of the monitor target included in the monitor image by specifying correspondence between the shooting target and the monitor target held by the transmitter 40 on the basis of the transmitter management data, a specified position of the shooting target, and a specified position of the transmitter 40.SELECTED DRAWING: Figure 1

Description

The present invention relates to a monitoring target identification device, a monitoring target identification system, and a monitoring target identification method used for monitoring a target by video.

A system is known in which a network camera, which is a photographing terminal connected to a network such as the Internet, is used to monitor a target. The photographing terminal photographs the target area to be monitored, and the photographed data is transmitted to the display terminal via the server connected to the network. Then, the display terminal displays a video based on the received shooting data. Thereby, the user can confirm the state of the target area using the display terminal.

Further, a system using various sensors such as an infrared sensor in addition to the photographing terminal has been proposed. In such systems, sensors detect changes in the entry and exit of people, equipment abnormalities, etc., and the user can check the state of the target area when these changes are detected by the image taken by the imaging terminal. Can be performed (see, for example, Patent Document 1).

JP, 2005-208878, A

By the way, among the various situations requiring monitoring as described above, there are situations where it is desired to monitor the position and movement of a predetermined person or article. For example, in a factory or a construction site, there is a demand to monitor who is among a plurality of workers and at which place. On the other hand, it is a heavy burden for the user who confirms the image to distinguish the person or the article included in the image by relying only on the image from the photographing terminal described above. On the other hand, if the infrared sensor is used like the system described in Patent Document 1, it is possible to detect the position and movement of a person, but it is difficult to detect the position and movement of an article having the same temperature as the surroundings. In addition, individual identification of a person or an article cannot be performed by an infrared sensor.

It is an object of the present invention to provide a monitoring target identification device, a monitoring target identification system, and a monitoring target identification method that enable individual identification of a target included in a monitoring video.

A monitoring target identification device that solves the above-described problems is provided by a capturing terminal that captures an image of a monitoring area and outputs it as a monitoring image, and a first communication device that is held by a monitoring target that is located within an imaging range of the capturing terminal. A monitoring target identification device that is connected to a second communication device that receives information by short-range wireless communication, the identification information of the first communication device, and the monitoring target that holds the first communication device. A storage unit that stores management data associated with target identification information that is information that enables identification, a monitoring video processing unit that specifies a position of a shooting target included in the monitoring video, and the second communication device. A communication device specifying unit that specifies the position of the first communication device that has transmitted the identification information received by the second communication device based on the state of the radio wave from the first communication device detected by the second communication device; And holding the photographing target and the first communication device based on the position of the photographing target specified by the monitoring video processing unit and the position of the first communication device specified by the communication device specifying unit. An individual identification unit that identifies the monitoring target included in the monitoring video by identifying the correspondence with the monitoring target.

A surveillance target identification system for solving the above-mentioned problems includes a photographing terminal for photographing the inside of a surveillance region and outputting it as a surveillance image, a first communication device held by the surveillance target, and a photographing terminal located within the photographing range of the photographing terminal. A monitoring target identification system, comprising: a second communication device that receives its identification information from a first communication device by short-range wireless communication; and a monitoring target identification device connected to the photographing terminal and the second communication device. Then, the monitoring target identification device is associated with management data in which identification information of the first communication device and target identification information that is information that enables identification of the monitoring target holding the first communication device are associated with each other. A storage unit for storing the above, a monitor image processing unit for specifying a position of a shooting target included in the monitor image, and a position of the first communication device that has transmitted the identification information received by the second communication device, A communication device specifying unit that specifies the second communication device based on the state of the radio wave from the first communication device, the management data, the position of the imaging target specified by the monitoring image processing unit, and the communication Based on the position of the first communication device specified by the device specifying unit, by specifying the correspondence between the imaging target and the monitoring target holding the first communication device, the monitoring included in the monitoring video And an individual identification unit for performing individual identification of the target.

A monitoring target identification method for solving the above-described problem is provided that a photographing terminal captures an image of a monitoring area and outputs a monitoring image, which is the image, to a monitoring target identification device, and a first communication device held by the monitoring target. Transmits the identification information of the first communication device, and the second communication device receives the identification information from the first communication device located within the photographing range of the photographing terminal by wireless communication at a short distance. Then, outputting the identification information and information indicating the state of the radio wave from the first communication device detected by the second communication device to the monitoring target identification device, and the monitoring target identification device, The position of the shooting target included in the monitoring video is specified, and the monitoring target identification device determines the position of the first communication device that has transmitted the identification information received by the second communication device, Specifying based on the information shown, the monitoring target identification device, the identification information of the first communication device, and the target identification information that is information indicating the monitoring target holding the first communication device in an identifiable manner. On the basis of the data associated with each other, the identified position of the imaging target, and the identified position of the first communication device, the correspondence between the imaging target and the monitoring target holding the first communication device. The identification of the monitoring target included in the monitoring video is performed by specifying.

According to the above configuration, by the cooperation of the specification of the position of the shooting target included in the monitoring video and the specification of the position of the monitoring target based on the specification of the position of the first communication device using the state of the radio wave from the first communication device. It is possible to identify the individual monitoring target included in the monitoring video. Therefore, even if it is difficult to identify the monitoring target included in the monitoring video only by the monitoring video, the monitoring target can be identified.

In the above configuration, the first communication device may be a transmitter that spontaneously emits a radio wave, and the second communication device may be a receiver that receives the radio wave.
According to the above configuration, as compared with the case where the first communication device is activated by receiving the radio wave from the second communication device, the distance and the direction in which the communication between the first communication device and the second communication device is possible. The constraints are small. Therefore, the versatility of the monitoring target identification system is enhanced.

In the monitoring target identification device, the monitoring target identification device is connected to a display device, and the target identification information of the monitoring target in which the correspondence between the monitoring video and the shooting target is specified is included in the monitoring video. A display data generation unit that generates display data of an image that includes information that is associated with the position of the shooting target, and an output unit that outputs the display data to the display device may be provided.

According to the above configuration, the user of the display device can easily understand the individual identification of the monitoring target included in the monitoring video by looking at the image displayed on the display device.
In the above-mentioned monitoring target identification device, when the monitoring target image processing unit specifies a position, and the shooting target includes a target whose correspondence with the monitoring target cannot be specified by the individual identification unit, an external notification is sent. You can go.

According to the above configuration, an external monitor or the like understands that an object that does not hold the first communication device, that is, an object that is not supposed to exist in the monitoring area is invading the monitoring area. be able to.

In the monitoring target identification device, the monitoring target identification device is connected to a display device, and the correspondence between the monitoring target and the monitoring target is specified by the individual identification unit in the imaging targets whose positions are specified by the monitoring image processing unit. When an unconfirmed target that is a target that cannot be performed is included, a display data generation unit that generates display data of an image including the monitoring video and information indicating the position of the unconfirmed target in the monitoring video, and the display data An output unit for outputting to the display device may be provided.

According to the above configuration, the user of the display device visually recognizes that an object not supposed to exist in the monitoring area is invading the monitoring area by looking at the image displayed on the display device. I can figure it out. Therefore, it is easy to properly deal with such an intrusion of the target.

In the monitoring target identification device, artificial intelligence may be used for the process of specifying the shooting target by the monitoring video processing unit.
According to the above configuration, it is possible to more accurately specify the shooting target included in the surveillance video.

In the monitoring target identification device, the state of the radio wave may include the intensity and direction of the radio wave detected by the second communication device.
According to the above configuration, the distance and the direction of the first communication device with respect to the second communication device can be calculated, so that the position of the first communication device can be accurately specified.

According to the present invention, it is possible to enable individual identification of a target included in a surveillance video.

The figure which shows the whole structure of a monitoring target identification system about one Embodiment of a monitoring target identification system. The figure which shows each structure of the monitoring information management server of one embodiment, a registration terminal, and a monitoring terminal. The figure which shows an example of the transmitter management data of one embodiment. 3 is a sequence chart showing a procedure of registering transmitter management data in the surveillance video display system according to the embodiment. The sequence chart which shows the procedure of individual identification of the surveillance subject in the surveillance video display system of one embodiment. The figure which shows typically the position of the transmitter specified in the surveillance video display system of one embodiment. The figure which shows an example of arrangement|positioning of the transmitter in the surveillance video display system of one Embodiment. The figure which shows an example of arrangement|positioning of the transmitter in the surveillance video display system of one Embodiment. The figure which shows typically the position of the imaging|photography target pinpointed in the surveillance video display system of one Embodiment. 3 is a sequence chart showing a procedure for displaying an integrated image in the surveillance video display system according to the embodiment. The figure which shows an example of the integrated image in the surveillance video display system of one Embodiment. The figure which shows an example of the integrated image in the surveillance video display system of one Embodiment.

An embodiment of a monitoring target identification device, a monitoring target identification system, and a monitoring target identification method will be described with reference to FIGS.
[Configuration of monitoring target identification system]
The overall configuration of the monitoring target identification system will be described with reference to FIG.

As illustrated in FIG. 1, the monitoring target identification system includes a monitoring information management server 10, which is an example of a monitoring target identification device, a photographing terminal 20, a receiver 30, a transmitter 40, a registration terminal 50, and a monitoring terminal 60. .. The transmitter 40 is an example of a first communication device, and the receiver 30 is an example of a second communication device. The number of each of the photographing terminal 20, the receiver 30, the transmitter 40, the registration terminal 50, and the monitoring terminal 60 may be 1 or more.

The monitoring information management server 10, the photographing terminal 20, the receiver 30, the registration terminal 50, and the monitoring terminal 60 are connected to a network, and the monitoring information management server 10 mutually exchanges data with each of these devices via the network. Send and receive. The network used for communication of each device may include a plurality of independent networks, or may be one common network. These networks may be general-purpose communication lines such as the Internet, or may be dedicated communication lines for communication of each device.

The photographing terminal 20 has a moving image photographing function and a function of transmitting data to the monitoring information management server 10 via a network. The photographing terminal 20 is embodied as a network camera. The photographing terminal 20 stores a photographing terminal ID which is identification information of the photographing terminal 20. The photographing terminal ID is information unique to each photographing terminal 20, and is stored in the photographing terminal 20 in advance.

The photographing terminal 20 sequentially transmits the moving image data generated by photographing, together with the photographing terminal ID stored in the photographing terminal 20, to the monitoring information management server 10 in real time.

The receiver 30 has a function of receiving data from the transmitter 40 by wireless communication at a short distance and a function of transmitting data to the monitoring information management server 10 via a network. As the communication standard of the wireless communication, Bluetooth (registered trademark) is used, and particularly BLE (Bluetooth Low Energy) is preferably used. Each of the receiver 30 and the transmitter 40 compatible with Bluetooth has a built-in battery, and the transmitter 40 spontaneously emits a radio wave, and the receiver 30 receives the radio wave.

Specifically, the receiver 30 receives the transmitter ID, which is the identification information of the transmitter 40, from the transmitter 40. Within the range with the receiver 30 as a reference, the range in which the radio wave emitted from the transmitter 40 reaches the receiver 30 is the reception range of the receiver 30. The receiver 30 receives a transmitter ID transmitted from the transmitter 40 located within the reception range of the receiver 30 at a predetermined interval by using the radio wave emitted by the transmitter 40 as a carrier wave.

The receiver 30 also stores a receiver ID that is identification information of the receiver 30. The receiver ID is information unique to each receiver 30, and is stored in the receiver 30 in advance.
Upon receiving the transmitter ID from the transmitter 40, the receiver 30 transmits the transmitter ID to the monitoring information management server 10 together with the receiver ID stored in the receiver 30. At this time, the receiver 30 receives the radio wave intensity information indicating the intensity of the radio wave from the transmitter 40 detected at the time of receiving the transmitter ID, and the radio wave direction information indicating the direction in which the radio wave has propagated, as monitoring information. It is also transmitted to the management server 10.

The imaging terminal 20 and the receiver 30 are installed in a monitoring area, which is an area where monitoring is performed. The monitoring area is an area in which a worker performs various kinds of work in, for example, a factory, a construction site, a medical site, or the like, and is a region in which it is desired to monitor the behavior of a monitoring target of such an operator.

The monitoring area may include a plurality of partitioned rooms, may be a single continuous space without divisions, or may include a plurality of spaces separated from each other. The monitoring area may be indoors or outdoors.

The receiver 30 is installed so that its reception range extends within the monitoring area. When the monitoring target identification system includes a plurality of receivers 30, the plurality of receivers 30 have different reception ranges of the respective receivers 30 in the monitoring area, and the reception ranges of the receivers 30 are combined. It is installed so that the range extends over the entire surveillance area. Note that a part of the reception range of each receiver 30 may overlap a part of the reception range of another receiver 30.

The shooting range of the shooting terminal 20 is the shooting range, and the shooting terminal 20 is installed so that the shooting range extends within the monitoring area. When the surveillance target identification system includes a plurality of photographing terminals 20, the photographing ranges of the photographing terminals 20 are different from each other in the monitoring area, and the photographing ranges of the photographing terminals 20 are combined. It is installed so that the range extends over the entire surveillance area. A part of the shooting range of each shooting terminal 20 may overlap with a part of the shooting range of another shooting terminal 20.

Each of the image capturing ranges of the image capturing terminals 20 overlaps the receiving range of one or more receivers 30. Hereinafter, as an example, a case will be described in which the shooting range of one shooting terminal 20 and the reception range of one receiver 30 overlap. That is, one photographing terminal 20 and one receiver 30 are associated with each other.

Specifically, for example, as shown in FIG. 1, a monitoring area is composed of two partitioned areas, an area RA and an area RB, and an imaging terminal 20 having an imaging terminal ID C01 is provided in the area RA. The shooting terminal 20 having the shooting terminal ID C02 is installed in the area RB. That is, the area RA is imaged by the imaging terminal 20 of C01, and the area RB is imaged by the imaging terminal 20 of C02. The receiver 30 having the receiver ID BR01 is installed in the area RA, and the receiver 30 having the receiver ID BR02 is installed in the area RB. The reception range of the receiver 30 of BR01 substantially overlaps the entire area RA, that is, substantially the entire imaging range of the imaging terminal 20 of C01. The reception range of the receiver 30 of BR02 substantially overlaps the entire region RB, that is, the reception range of the photographing terminal 20 of C02 substantially overlaps. In this way, the photographing terminal 20 and the receiver 30 are associated with each other by the overlapping of the photographing range and the receiving range.

The transmitter 40 has a function of transmitting data by wireless communication corresponding to the receiver 30. Specifically, the transmitter 40 continuously emits a radio wave serving as a carrier wave of data, and transmits a transmitter ID as the data at predetermined intervals. The transmitter ID functions as a signal for notifying the vicinity of the transmitter 40 of the existence of the transmitter 40 itself. The transmitter ID is information unique to each transmitter 40 and is stored in the transmitter 40 in advance.

The transmitter 40 is carried by a monitoring target, that is, an operator who works in the monitoring area. One transmitter 40 is assigned to each monitoring target.
The registration terminal 50 is a terminal used for associating the monitoring target with the transmitter 40, and has a function of receiving data by wireless communication corresponding to the transmitter 40, and stores data between the monitoring information management server 10 and the network. It has a function of transmitting and receiving. For example, the registration terminal 50 is embodied in a personal computer, a tablet terminal, or a smartphone.

The monitoring terminal 60 is an example of a display device. The monitoring terminal 60 is a terminal used to confirm a monitoring video that is a moving image captured by the imaging terminal 20 in the monitoring area, and has a function of transmitting and receiving data to and from the monitoring information management server 10 through a network, and the monitoring information. It has a function of displaying an image based on the data received from the management server 10. The monitoring terminal 60 is embodied in, for example, a personal computer, a tablet terminal, or a smartphone.

The monitoring information management server 10 is a server that performs individual identification of the monitoring target included in the monitoring video based on the information received from the photographing terminal 20 and the receiver 30. Moreover, the monitoring information management server 10 transmits the display data generated in response to the request from the monitoring terminal 60 to the monitoring terminal 60. The display data is data for displaying the integrated image, which is an image including the monitoring video, on the monitoring terminal 60.

[Detailed configuration of each device]
The detailed configurations of the monitoring information management server 10, the registration terminal 50, and the monitoring terminal 60 will be described with reference to FIG.

The monitoring information management server 10 includes a communication unit 11, a storage unit 12, and a control unit 13.
The communication unit 11 executes a connection process between the monitoring information management server 10 and each of the above-described devices via a network, and transmits and receives data between the monitoring information management server 10 and each of the devices. The communication unit 11 functions as a receiving unit that receives information from the photographing terminal 20 and the receiver 30, and an output unit that outputs display data to the monitoring terminal 60.

The storage unit 12 has a configuration including a non-volatile memory such as a hard disk drive, and stores programs and data necessary for the processing executed by the control unit 13. As part of such data, the storage unit 12 stores receiver management data 12a, transmitter management data 12b, monitoring video data 12c, and detection data 12d.

The receiver management data 12a includes data for managing the correspondence between the receiver 30 and the shooting terminal 20 in which the reception range and the shooting range overlap. For example, in the receiver management data 12a, the receiver ID and the photographing terminal ID are associated with each other. Further, the receiver management data 12a indicates the position in the space where the receiver 30 and the photographing terminal 20 are located with respect to the receiver 30 and the photographing terminal 20 which are associated with each other, for example, using a three-dimensional orthogonal coordinate system. Contains data for management.

The transmitter management data 12b is data for managing the association between the transmitter 40 and the monitoring target that holds the transmitter 40. The transmitter management data 12b includes a transmitter ID and information about the monitoring target. It is associated with certain target information.

The monitoring video data 12c is data for managing moving image data showing the monitoring video captured by the imaging terminal 20 in association with the imaging terminal ID of the imaging terminal 20 that has captured the monitoring video. The moving image data includes time information indicating the time when the surveillance video was captured.

The detection data 12d is acquired by the monitoring information management server 10 from the receiver 30 while the monitoring video is being captured by the imaging terminal 20, and is acquired by the monitoring information management server 10 by analyzing the information and the monitoring video. Contains information. Specifically, the detection data 12d includes a transmitter ID received by the receiver 30, a period during which the transmitter ID is continuously received, an identification result of a monitoring target included in the monitoring video, and the like.

The control unit 13 has a configuration including a CPU and a volatile memory such as a RAM, and controls communication by the communication unit 11 and reads information from the storage unit 12 based on programs and data stored in the storage unit 12. Controls each unit included in the monitoring information management server 10, such as writing, writing, and various arithmetic processes. The control unit 13 includes a management data registration unit 13a, a monitor video processing unit 13b, a receiver information processing unit 13c, and a display data generation unit 13d.

The management data registration unit 13a associates the transmitter ID received by the monitoring information management server 10 from the registration terminal 50 with the target information, and causes the storage unit 12 to store the transmitter management data 12b. Further, the management data registration unit 13a generates the receiver management data 12a and stores it in the storage unit 12. The input of the receiver ID and the photographing terminal ID required for generating the receiver management data 12a may be performed through any computer terminal connected to the monitoring information management server 10 via the network.

The receiver management data 12a is constructed before the photographing of the surveillance area by the photographing terminal 20 is started, and the transmitter management data 12b is constructed before the surveillance target enters the surveillance area.
The monitoring video processing unit 13b analyzes the monitoring video received by the monitoring information management server 10 from the shooting terminal 20, identifies the type of the shooting target included in the monitoring video, and specifies the position of the shooting target. For such identification, it is preferable to use artificial intelligence (AI). Specifically, for example, an object detection (Real Time Object Detection) technique such as YOLO is used. The type of the imaging target is, for example, a classification such as a person or a predetermined article, and the type of the imaging target to be identified may be set in advance by an artificial intelligence program. When the monitoring target is a person, the monitoring video processing unit 13b detects at least a shooting target that is a person among the targets included in the monitoring video.

Further, the monitoring video processing unit 13b stores the moving image data indicating the monitoring video in the storage unit 12 as the monitoring video data 12c in association with the shooting terminal ID.
The receiver information processing unit 13c functions as a communication device identification unit and an individual identification unit. Specifically, the receiver information processing unit 13c uses the radio wave intensity information and the radio wave direction information received by the monitoring information management server 10 from the receiver 30, and corresponds to the transmitter ID received by the receiver 30. Identify 40 positions. Further, the receiver information processing unit 13c compares the result of specifying the position of the transmitter 40, the detection result of the shooting target by the monitoring video processing unit 13b, and the transmitter management data 12b, and the monitoring included in the monitoring video. Perform individual identification of the target.

Further, the receiver information processing unit 13c stores the information received from the receiver 30 and the result of individual identification of the monitoring target in the storage unit 12 as the detection data 12d. The monitoring video data 12c and the detection data 12d are sequentially constructed while the shooting terminal 20 is shooting the monitoring area.

The display data generation unit 13d generates display data using each data stored in the storage unit 12 in response to a request from the monitoring terminal 60. The display data is transmitted to the monitoring terminal 60 via the communication unit 11.

In the control unit 13, each of the management data registration unit 13a, the monitor video processing unit 13b, the receiver information processing unit 13c, and the display data generation unit 13d has a plurality of CPUs, various memories such as RAMs, and the like. Hardware and software that causes them to be embodied separately, or may be embodied by software that imparts a plurality of functions to one common hardware. Such software is stored in the storage unit 12 as a monitoring information management program.

The registration terminal 50 includes a communication unit 51 that controls communication, an operation unit 52 that receives user operations, a display unit 53 that displays images, and a storage unit 54 that stores programs and data. The control unit 55 is provided which performs processing based on the programs and data stored in the storage unit 54. The storage unit 54 has a configuration including a non-volatile memory, and the control unit 55 has a configuration including a volatile memory such as a CPU and a RAM.

The communication unit 51 connects the registration terminal 50 and the monitoring information management server 10 via a network, and performs a function of transmitting and receiving data between these devices and a wireless communication at a short distance corresponding to the transmitter 40. It has a function of connecting the registration terminal 50 and the transmitter 40 by using it and transmitting and receiving data between these devices.

The communication unit 51 receives the transmitter ID from the transmitter 40 by the wireless communication. Further, the target information is input to the registration terminal 50 through the operation on the operation unit 52, and the control unit 55 causes the communication unit 51 to transmit the transmitter ID and the target information to the monitoring information management server 10.

The monitoring terminal 60 includes a communication unit 61 that controls communication, an operation unit 62 that receives a user operation, a display unit 63 that displays an image, a storage unit 64 that stores programs and data, and controls and calculations of these units. A control unit 65 that performs processing based on a program or data stored in the storage unit 64 is provided. The storage unit 64 has a configuration including a non-volatile memory, and the control unit 65 has a configuration including a volatile memory such as a CPU and a RAM.

The communication unit 61 has a function of connecting the monitoring terminal 60 and the monitoring information management server 10 via a network and transmitting and receiving data between these devices. The communication unit 61 also receives display data from the monitoring information management server 10, and the control unit 65 causes the display unit 63 to display an image using the display data.

Each function of the control unit 55 of the registration terminal 50 and the control unit 65 of the monitoring terminal 60 depends on various hardware such as a plurality of CPUs and memories such as RAMs, and software that causes them to function. It may be embodied separately, or may be embodied by software that provides a plurality of functions to one common hardware. Such software may be application software installed in each terminal or application software provided as a web application from the monitoring information management server 10.

Further, the function of the registration terminal 50 and the function of the monitoring terminal 60 may be realized by one computer terminal. That is, the registration terminal 50 and the monitoring terminal 60 may be the same terminal.

[Composition of transmitter management data]
The data structure of the transmitter management data 12b stored in the monitoring information management server 10 will be described with reference to FIG.

As shown in FIG. 3, the transmitter management data 12b includes a transmitter ID and target information, and the transmitter ID and target information are associated with each other. The target information includes target identification information that is information that allows the monitoring target to be identified. The target identification information is, for example, a target ID that is identification information assigned to each worker who is a monitoring target, a name of a monitoring target, a nickname, and the like. The target information may further include information indicating the attribute of the monitoring target in addition to the target identification information. The information indicating the attribute of the monitoring target includes, for example, the group to which the monitoring target belongs, the post or role of the monitoring target, and the like.

The target information associated with the transmitter ID in the transmitter management data 12b is information about the monitoring target to which the transmitter 40 having the transmitter ID is assigned and which holds the transmitter 40. is there. For example, in the example illustrated in FIG. 3, the transmitter ID of BC01 is associated with the target ID of P01 and the name of the monitoring target “Ichiro Akiba” as the target identification information in the target information. This indicates that the target ID assigned to the monitoring target that holds the transmitter 40 having the transmitter ID BC01 is P01, and the name of the monitoring target is “Ichiro Akiba”.

The target identification information differs for each transmitter ID. On the other hand, the information indicating the attribute of the monitoring target may be commonly set for a plurality of transmitter IDs.
[Operation of the monitoring target identification system]
The operation of the monitoring target identification system, that is, the procedure of the monitoring target identification method will be described with reference to FIGS. The operation of the monitoring target identification system includes a process of registering the transmitter management data 12b, a process of individual identification of the monitoring target, and a process of displaying an integrated image. The receiver management data 12a is constructed at an appropriate timing before the shooting terminal 20 starts shooting the monitoring area.

First, the process of registering the transmitter management data 12b will be described with reference to FIG. The process of registering the transmitter management data 12b is, in other words, the process of registering the monitoring target, and for example, before the worker starts the work in the factory or the like, the registration terminal 50 and the monitoring information management server 10 are It is done in collaboration. The process shown in FIG. 4 is performed for each worker to be monitored. In the process of each step shown in FIG. 4, for example, a screen for registering a monitoring target is displayed on the registration terminal 50 based on a predetermined operation, and the operator or the registration manager performs an operation according to the instruction on the screen. It is carried out by doing.

As shown in FIG. 4, the target information is input to the registration terminal 50 through the operation of the registration terminal 50 (step S10). That is, the name of the worker to be monitored is input to the registration terminal 50. The target information input to the registration terminal 50 may be a part of the target information associated with the transmitter ID in the transmitter management data 12b. For example, the target ID is not input to the registration terminal 50. It may be assigned by the management data registration unit 13a of the monitoring information management server 10 when the transmitter management data 12b is registered.

Then, based on the fact that the transmitter 40 assigned to the worker to be monitored is brought close to the registration terminal 50, the registration terminal 50 acquires the transmitter ID of the transmitter 40 through wireless communication at a short distance. Yes (step S11).

The order of inputting the target information and acquiring the transmitter ID is not limited to the above order, and the target information may be input to the registration terminal 50 after the registration terminal 50 acquires the transmitter ID.
Upon acquiring the target information and the transmitter ID, the registration terminal 50 transmits the target information and the transmitter ID to the monitoring information management server 10 via the network (step S12). Upon receiving the target information and the transmitter ID, the management data registration unit 13a of the monitoring information management server 10 stores the target information and the transmitter ID in the storage unit 12 as transmitter management data 12b in association with each other. At this time, the management data registration unit 13a assigns the target ID to each set of the target information and the transmitter ID, includes the target ID in the target information, and generates the transmitter management data 12b.

This completes the registration of the monitoring target, that is, the registration of the transmitter management data 12b. The transmitter 40 used for registration is delivered to the worker who is the monitoring target, that is, the monitoring target corresponding to the target information input to the registration terminal 50, and is carried by the monitoring target.

Next, a process of identifying an individual to be monitored will be described with reference to FIGS.
As shown in FIG. 5, when the photographing terminal 20 starts photographing the monitoring area (step S20), the moving image data of the monitoring video generated by the photographing together with the photographing terminal ID of the photographing terminal 20 is used to monitor information through the network. It transmits to the management server 10 (step S21).

Further, when the receiver 30 receives the transmitter ID from the transmitter 40 located within the reception range (step S22), the transmitter ID, the radio wave intensity information, and the radio wave direction information together with the receiver ID of the receiver 30 are received. , To the monitoring information management server 10 (step S23). The transmission of the information including the transmitter ID from the receiver 30 to the monitoring information management server 10 can be performed, for example, at a predetermined interval with respect to all transmitter IDs received by the receiver 30 at that time. And the radio wave intensity information and the radio wave direction information are transmitted to the monitoring information management server 10.

When the video data of the monitoring video is received, the monitoring video processing unit 13b of the monitoring information management server 10 analyzes the monitoring video and detects a shooting target included in the monitoring video for each type of shooting target (step S24). .. As a result, the type and position of the shooting target are specified in the surveillance video. Specifically, the position of the photographing target, which is a person, is specified in the surveillance video.

Upon receiving the information from the receiver 30, the receiver information processing unit 13c of the monitoring information management server 10 uses the radio wave intensity information and the radio wave direction information to identify the transmitter 40 corresponding to the transmitter ID received by the receiver 30. The position is specified (step S25).

Subsequently, the receiver information processing unit 13c, for the photographing terminal 20 and the receiver 30 that are associated with each other, the detection result of the photographing target in step S24, and the result of specifying the position of the transmitter 40 in step S25. Individual identification of the monitoring target included in the monitoring video is performed using the transmitter management data 12b (step S26).

The monitoring information management server 10 stores various data received from the imaging terminal 20 and the receiver 30 and data such as the individual identification result of the monitoring target obtained by analyzing such data in the storage unit 12 (step S27).

The order of the process of step S24 and the process of step S25 is not particularly limited. The processes of steps S24 to S27 are repeatedly performed while the monitoring information management server 10 continues to receive information such as moving image data from the photographing terminal 20 and the receiver 30.

Further, when the monitoring target identification system includes a plurality of photographing terminals 20, the processing of the above steps S21 and S24 is performed for each photographing terminal 20, and when the monitoring target identification system includes a plurality of receivers 30, the above steps are performed. The processes of S23 and S25 are performed for each receiver 30. Then, regarding the photographing terminal 20 and the receiver 30 that are associated with each other, that is, the photographing terminal 20 and the receiver 30 in which the photographing range and the receiving range overlap, the photographing in step S24 for the monitoring video photographed by the photographing terminal 20. The individual identification of the monitoring target in step S26 is performed using the detection result of the target and the result of specifying the position of the transmitter 40 in step S25 corresponding to the transmitter ID received by the receiver 30. The association between the imaging terminal 20 and the receiver 30 is specified based on the receiver management data 12a.

With reference to FIGS. 6 to 9, the process of detecting the photographing target in step S24 and the process of specifying the position of the transmitter 40 in step S25 described in the flow of FIG. 5 and the individual identification of the monitoring target in step S26 are performed. The details of the processing will be described.

In the process of specifying the position of the transmitter 40, when the receiver 30 receives the transmitter ID, the radio wave intensity information and the radio wave direction information of the radio wave from the transmitter 40 carrying the transmitter ID are used. Then, as shown in FIG. 6, the position of the transmitter 40 based on the position of the receiver 30 is specified. Specifically, the distance L from the receiver 30 to the transmitter 40 is calculated by using the radio field intensity information. Further, by using the radio wave direction information, the direction in which the transmitter 40 is located with respect to the receiver 30 is calculated in the three-dimensional rectangular coordinate system centered on the receiver 30. For example, when the x-axis direction and the y-axis direction of the three-dimensional Cartesian coordinate system are set in the horizontal direction in the monitoring area and the z-axis direction is set in the vertical direction in the monitoring area, reception is performed. The direction in which the transmitter 40 is located with respect to the receiver 30 is obtained based on the calculation of the azimuth angle θ1 in the horizontal direction and the elevation angle θ2 in the vertical direction of the transmitter 40 with respect to the receiver 30. As a result, the position of the transmitter 40 with respect to the receiver 30 is specified.

In FIG. 6, the elevation/depression angle θ2 is shown as the elevation angle for easy understanding, but the receiver 30 is preferably installed above the monitoring area such as a ceiling. In this case, The elevation angle θ2 is the depression angle.

When the receiver 30 receives the transmitter IDs of the plurality of transmitters 40, the position of the transmitter 40 corresponding to the transmitter ID is identified using the radio wave intensity information and the radio wave direction information for each transmitter ID. Is done. As shown in FIG. 7, even when a plurality of transmitters 40 exist in the same direction with respect to the receiver 30, a difference in distance between the receiver 30 and each transmitter 40 may occur due to a difference in radio field intensity information. Since it is detected, each transmitter 40 can be identified. Further, as shown in FIG. 8, even when a plurality of transmitters 40 are present at the same distance from the receiver 30, due to the difference in the radio wave direction information, the direction in which each transmitter 40 is located with respect to the receiver 30 is different. Since the difference is detected, each transmitter 40 can be identified. Thus, by using the radio wave intensity information and the radio wave direction information, the position of the transmitter 40 with respect to the receiver 30 can be accurately specified.

On the other hand, by analyzing the surveillance video, the shooting target included in the surveillance video is detected for each type, and thereby the position of the shooting target in the surveillance video is specified. Based on this, as shown in FIG. 9, the position of the imaging target Ob based on the imaging terminal 20 is calculated. When the monitoring video includes a plurality of shooting targets Ob, the position of each shooting target Ob is specified.

For example, a three-dimensional Cartesian coordinate system centered on the imaging terminal 20 is set in advance, and the position coordinates of a fixed object such as a wall or a pillar in the monitoring area are determined thereby. When the imaging target Ob is detected, the positional relationship of the imaging target Ob with respect to the fixed object is further obtained by image analysis to obtain the position coordinates of the imaging target Ob.

In the process of individual identification of the monitoring target, the position of the transmitter 40 with respect to the receiver 30 and the position of the target Ob with respect to the photographing terminal 20 are collated, so that the target Ob and the transmitter 40 are compared. The correspondence with is identified. At this time, the imaging target Ob of the same type as the monitoring target holding the transmitter 40 is selected as the specific target. Specifically, when the monitoring target is a person, the imaging target Ob that is determined to be a person is a target whose correspondence with the transmitter 40 is specified.

For example, the axial direction of the three-dimensional Cartesian coordinate system with the receiver 30 as a reference and the axial direction of the three-dimensional Cartesian coordinate system with the photographing terminal 20 as the center are matched, and the position of the transmitter 40 and the object Ob to be photographed. When the positions are close to each other, it is determined that the transmitter 40 and the imaging target Ob correspond to each other. The position of the imaging target Ob may be specified as a point or an area. When the position of the imaging target Ob is specified as a point, for example, when the imaging target Ob is a person, the position of the position determined to be approximately the center of the head or body of the object may be set as the position of the imaging target Ob. However, a rectangular parallelepiped, a sphere, or an ellipsoid surrounding the entire object to be imaged Ob may be set and the center of gravity thereof may be set as the position of the object to be imaged Ob. The position of the imaging target Ob may be determined based on the distribution. When the position of the imaging target Ob is specified as the area, for example, a solid such as a rectangular parallelepiped, a sphere, or an ellipsoid that surrounds the entire imaging target Ob is set, and the area where the solid is located is the position of the imaging target Ob. Alternatively, a range based on the distribution of the points where the outer shape or the characteristic part of the imaging target Ob is extracted and located there may be the position of the imaging target Ob.

When the position of the photographing target Ob is specified as a point, for example, when the position of the transmitter 40 is included in a predetermined range from the position of the photographing target Ob, the transmitter 40 and the photographing target Ob correspond to each other. Then it is determined. When the position of the imaging target Ob is specified as the area, it is determined that the transmitter 40 and the imaging target Ob correspond to each other when the position of the transmitter 40 is included in the area. Further, the position of the transmitter 40 may be specified as a point or a region.

The position of the imaging target Ob does not necessarily have to be defined as three-dimensional coordinates, and may be defined by part of the distance and direction of the imaging target Ob with respect to the imaging terminal 20. For example, in the monitoring area, if the receiver 30 and the photographing terminal 20 are arranged on the same vertical axis, the axial direction of the coordinate system with the receiver 30 as the reference and the photographing terminal 20 as the reference. It is physically aligned with the axial direction of the coordinate system. When the photographing terminal 20 is installed in the upper part of the monitoring area and the monitoring target is a person located on the ground, the photographing terminal 20 in the horizontal direction can be obtained without obtaining the elevation angle of the photographing target Ob with respect to the photographing terminal 20 in the vertical direction. If the azimuth angle of the object Ob to be photographed is known, it is possible to compare it with the position of the transmitter 40.

As described above, the position of the shooting target Ob with respect to the shooting terminal 20 is not limited to the above-described example, and can be compared with the position of the transmitter 40 according to the placement of the shooting terminal 20 and the expected placement of the monitoring target. It may be specified as follows.

The photographing target Ob and the transmitter 40 corresponding to each other are that the transmitter 40 emits a radio wave from the position of the photographing target Ob, in other words, the photographing target Ob holds the transmitter 40. Indicates that

Furthermore, the target information associated with the transmitter ID is specified by referring to the transmitter management data 12b. As a result, the correspondence between the shooting target Ob and the target identification information is specified via the transmitter ID, and as a result, the target identification information corresponding to the shooting target Ob, that is, the individual who is the monitoring target corresponding to the shooting target Ob is identified. Specified. With the above, individual identification of the monitoring target included in the monitoring video is completed. The target information associated with the transmitter ID may be specified before the correspondence between the imaging target Ob and the transmitter 40 is specified.

In addition, in the surveillance video, in the same type as the surveillance target, that is, in the photography target Ob detected as a person, the photography target Ob whose correspondence with the transmitter 40 cannot be specified, in other words, the transmission existing at the position of the photography target Ob. There may be a case where there is a shooting target Ob that cannot be confirmed by the machine 40. In this case, it is preferable that the position of the imaging target Ob and information indicating that the corresponding transmitter 40 could not be confirmed are included in the detection data 12d and stored in the storage unit 12.

Next, the process of displaying the integrated image will be described with reference to FIG. The process of displaying the integrated image is performed by the cooperation of the monitoring terminal 60 and the monitoring information management server 10.
As shown in FIG. 10, an integrated image is requested from the monitoring terminal 60 to the monitoring information management server 10 through the operation of the monitoring terminal 60 (step S30). When the monitoring target identification system includes a plurality of photographing terminals 20, the monitoring terminal 60 specifies the area within the monitoring area as to which of the photographing terminals 20 requests the integrated image based on the monitoring video imaged. May be determined by

When receiving the request from the monitoring terminal 60, the display data generation unit 13d of the monitoring information management server 10 generates display data using each data stored in the storage unit 12 (step S31). The integrated image is an image showing the monitoring video together with the individual identification result of the monitoring target, and the display data is data for displaying the integrated image on the monitoring terminal 60.

The monitoring information management server 10 transmits the generated display data to the monitoring terminal 60 (step S32), and the monitoring terminal 60 displays the integrated image on the display unit using the received display data (step S33). Thereby, the monitoring person who is the user of the monitoring terminal 60 can confirm the state of the monitoring target in the monitoring area while individually identifying the monitoring target.

The structure of the integrated image will be described with reference to FIG. As shown in FIG. 11, the integrated image IM includes the monitoring video Ia captured by the imaging terminal 20, and the identification information Ib indicating the position of the monitoring target included in the monitoring video and the target identification information corresponding to the monitoring target. .. The identification information Ib indicates the position of the imaging target Ob in the monitoring video for the imaging target Ob and the target identification information that are identified as corresponding to each other as a result of the above-described individual identification processing of the monitoring target, and the position The target identification information is shown in association with.

The display data generation unit 13d generates display data for displaying the integrated image IM so that the identification information Ib is displayed on the same screen as the monitor image Ia. Such display data may be, for example, data for displaying the identification information Ib overlaid on the surveillance image Ia by combining a plurality of layers, or the surveillance image Ia and at least a part of the identification information Ib may be combined into one. The data may be displayed in different areas on the screen.

In the example shown in FIG. 11, the position of the monitoring target is identifiable by the display surrounding the imaging target Ob included in the monitoring image Ia, and the target identification information that is the name of the monitoring target is displayed near the display. To be done. Thereby, the monitor who views the integrated image IM on the monitor terminal 60 confirms the state of the monitoring target while individually identifying which of the monitoring targets each of the shooting targets Ob included in the monitoring video is. be able to.

Further, when there is a shooting target Ob whose correspondence with the transmitter 40 cannot be confirmed among the shooting targets Ob detected as a person in the monitoring video, as shown in FIG. It is preferable that the position of the target Ob and the non-identification information Ic indicating that the corresponding identification information corresponding to the imaging target Ob cannot be specified are included. The display data generation unit 13d generates display data for displaying the integrated image IM so that the non-identification information Ic is displayed on the same screen as the monitor image Ia.

The existence of the photographing target Ob whose correspondence with the transmitter 40 cannot be confirmed means that the photographing target Ob does not hold the transmitter 40, and the photographing target Ob is like an outsider. , It is highly possible that the person is not supposed to exist in the surveillance area. By including the non-identification information Ic in the integrated image IM, the surveillance person can easily recognize the existence of such an imaging target Ob, and thus a person who should not be present in the surveillance area enters the surveillance area. Can be detected and dealt with early.

If there is an object to be photographed Ob whose correspondence with the transmitter 40 cannot be confirmed in the surveillance video, the surveillance information management server 10 may cause the surveillance terminal 60 to issue a warning by voice or text, e-mail or the like. Notification may be given to the monitoring person. As described above, the display of the non-identification information Ic in the integrated image IM, the warning, and the notification notify the outside that there is the imaging target Ob whose correspondence with the transmitter 40 cannot be confirmed.

As described above, according to the present embodiment, the surveillance included in the surveillance video is performed by the cooperation of the location of the shooting target in the surveillance video and the location of the surveillance target based on the location of the transmitter 40. Individual identification of the target becomes possible. In other words, by making the transmitter 40 correspond to the shooting target whose position is specified in the monitoring video based on the position specified by the state of the radio wave, the shooting target and the monitoring target holding the transmitter 40 can be associated with each other. Can be specified.

Then, together with the monitoring video, the individual identification result of the monitoring target is displayed on the monitoring terminal 60 as an integrated image. Therefore, even if it is difficult to identify the individual monitoring target included in the monitoring video only by the monitoring video, the individual identification of the monitoring target is possible, and the monitoring target can be accurately monitored.

In particular, at a work site such as a factory, a construction site, or a medical site, clothes of workers and worn items such as helmets are often similar to each other. Since it is a heavy burden for the monitor to distinguish the person included in the video only by relying on the video captured at the work site, the burden on the monitor is greatly reduced by using the monitoring target identification system of the present embodiment. be able to. In addition, for example, if face recognition technology is used, it is possible to identify a person to be monitored only by monitoring video. There are large restrictions on the conditions required for shooting the surveillance video, such as the direction. In addition, when the monitoring target is wearing a common wearing item such as a hat or a mask, which is necessary for work, the accuracy of identification must be reduced. On the other hand, according to the present embodiment, the individual identification of the monitoring target is possible without being restricted by the shooting conditions and the mounted article of the monitoring target, and thus the utility is high.

Further, in the above description, the case where the monitoring target holding the transmitter 40 is a person has been exemplified, but the product is made a monitoring target by attaching the transmitter 40 to an article, and the type corresponding to the article in the monitoring image is displayed. The individual identification of the article is also possible by detecting the imaging target Ob. That is, the type of the monitoring target is not limited as long as the transmitter 40 can be held and can be detected in the monitoring video. When the monitoring target is an item, the target identification information included in the integrated image may be any information that can identify the monitoring target, such as the target ID and the name of the item. In the present embodiment, in order to specify the position of the monitoring target by exchanging information between the transmitter 40 and the receiver 30 using wireless communication in a short distance, a case where the infrared sensor is used to detect the monitoring target, Differently, not only a person but also an article can be a monitoring target.

In particular, by using BLE for wireless communication in a short distance, the receiver 30 receives the radio waves of the transmitter 40 within a range of a maximum radius of 20 m to 30 m around the receiver 30. It is possible to set the reception range to a desired range within this range. For example, another example of a short-range wireless communication system is a passive RFID system using the HF band or the UHF band. In such a system, the receiver detects an RFID tag as a transmitter. The possible range, that is, the communication distance between the receiver and the RFID tag is about 1 m at the maximum in the HF band and about 10 m at the maximum in the UHF band. In comparison with this, by using BLE, the degree of freedom in setting the reception range of the receiver 30 is increased, and it is possible to secure a wide reception range. Also, the number of receivers 30 required for the system can be reduced.

Further, in the RFID system, the receiver and the RFID tag need to face each other in order for the receiver to detect the RFID tag. Therefore, there are restrictions on the orientation of the receiver and the RFID tag for detection. large. On the other hand, if the configuration is such that BLE is used, the constraint imposed by the orientation of the receiver 30 and the transmitter 40 for detection is reduced, and the load required to set the arrangement position of the receiver 30 is increased. Also, it is possible to prevent the work efficiency of the worker to be monitored from being lowered due to the detection. Furthermore, in recent years, the number of terminals such as smartphones and tablet terminals that support BLE is increasing, so that the degree of freedom in selecting a terminal that can be used as the registration terminal 50 can be increased. Therefore, the use of BLE enhances the versatility of the monitoring target identification system.

[Other modes for displaying integrated image]
When requesting the integrated image from the monitoring terminal 60 to the monitoring information management server 10, a display condition that is a condition for generating the integrated image may be designated. The display data generation unit 13d of the monitoring information management server 10 generates display data according to the display conditions.

Specifically, the display conditions include designation of a viewing mode of the monitoring video and conditions for extracting the monitoring video. The viewing mode is either a live mode or an archive mode. The live mode is a mode in which the monitoring images captured by the image capturing terminal 20 are sequentially displayed on the monitoring terminal 60, that is, the supervisor views the monitoring images captured by the image capturing terminal 20 in real time. ..

The archive mode is a mode in which the surveillance terminal 60 displays the surveillance video captured by the photography terminal 20 in the past and stored in the surveillance information management server 10, and the surveillance video captured by the surveillance terminal 20 in the past by the observer. Is the mode to see. By using the archive mode, the monitor person can accurately confirm the place and the target to be confirmed in the past monitor area and monitor target. Therefore, the convenience of the observer is enhanced, and the past monitoring video can be effectively used as a record of the monitoring target in the past monitoring area.

The condition for extracting the surveillance video includes at least one of information designating an area in the surveillance area and information designating a monitoring target. The area in the monitoring area is specified, for example, by specifying the photographing terminal ID and the receiver ID, and the monitoring target is specified, for example, by specifying the target ID, the target identification information, and the transmitter ID. When the archive mode is designated, the condition for extracting the surveillance video also includes time designation information that designates the time when the surveillance video was shot.

When the live mode is designated as the display condition, the display data generation unit 13d generates the display data by using the moving image data sequentially received from the photographing terminal 20. When the archive mode is designated as the display condition, the display data generation unit 13d takes a picture during the period designated by the time designation information in the moving image data stored in the storage unit 12 as the monitoring video data 12c. Display data is generated using the generated moving image data.

Further, when the area within the surveillance area is designated as the display condition, the display data generation unit 13d extracts the surveillance video of the designated area as the surveillance video used for generating the integrated image, Display data of the integrated image is generated using the individual identification result of the monitoring target. When the receiver ID is designated as the designation of the area within the monitoring area, the photographing terminal 20 that has photographed the surveillance video of the designated area corresponds to the receiver ID and the photographing terminal ID in the receiver management data 12a. It can be specified by referring to the attachment. With such a configuration, a specific area in the monitoring area can be designated, and the monitoring image Ia obtained by shooting the area can be displayed on the monitoring terminal 60 together with the identification information Ib. It can be easily confirmed.

In addition, when the monitoring target is specified as the display condition, the display data generation unit 13d extracts the monitoring video including the specified monitoring target as the monitoring video used for generating the integrated image, and monitors the monitoring video. Display data of the integrated image is generated using the individual identification result of the monitoring target. The photographing terminal 20 that has photographed the monitoring video including the designated monitoring target associates the target ID and the target identification information in the transmitter management data 12b with the transmitter ID, and transmits the call received by the receiver 30 in the detection data 12d. It can be specified by referring to the record of the machine ID and the correspondence between the receiver ID and the photographing terminal ID in the receiver management data 12a. The display data is configured such that when the designated monitoring targets move in different shooting ranges of the shooting terminals 20, the monitoring videos shot by the shooting terminals 20 are displayed in a connected manner. According to such a configuration, a specific monitoring target can be designated, and the monitoring video Ia obtained by shooting the monitoring target can be displayed on the monitoring terminal 60 together with the identification information Ib. Therefore, the monitoring person can easily check the monitoring target to be confirmed. Can be confirmed.

Further, when the area within the monitoring area and the monitoring target are specified as the display conditions, the monitoring video including the specified area and the specified monitoring target is the monitoring video used for generating the integrated image. Is extracted as.

As described above, according to this embodiment, the following effects can be obtained.
(1) Included in the monitoring video in cooperation with the specification of the position of the shooting target included in the monitoring video and the specification of the position of the monitoring target based on the position of the transmitter 40 using the state of the radio wave from the transmitter 40. It is possible to identify the individual monitored target.

(2) The integrated image IM displayed on the monitoring terminal 60 identifies the monitoring video Ia and the target identification information of the monitoring target whose correspondence with the shooting target is identified in association with the position of the shooting target in the monitoring video. And information Ib. With such a configuration, the observer can easily grasp the individual identification of the monitoring target included in the monitoring video by looking at the integrated image.

(3) When the shooting target whose position is specified in the monitoring video includes an unconfirmed target that is a shooting target whose correspondence with the monitoring target cannot be specified, notification to the outside is performed. With such a configuration, an observer or the like can understand that an object that is not supposed to exist in the monitoring area has entered the monitoring area.

(4) If the integrated image IM includes the non-identification information Ic indicating the position of the unconfirmed target in the monitor video as the notification to the outside, the monitor is assumed to be present in the monitor area. It is possible to visually understand that a target that has not entered has entered the surveillance area. Therefore, it is easy to properly deal with such an intrusion of the target.

(5) Artificial intelligence is used for the process of specifying the type and position of the shooting target in the surveillance video. According to this mode, it is possible to more accurately specify the shooting target included in the surveillance video.

(6) The state of the radio wave used to identify the position of the transmitter 40 includes the intensity and direction of the radio wave of the transmitter 40 detected by the receiver 30. With such a configuration, the distance and the direction of the transmitter 40 with respect to the receiver 30 can be calculated, and thus the position of the transmitter 40 can be accurately specified.

[Modification]
The above embodiment can be modified and implemented as follows.
In the above embodiment, an example in which one image capturing terminal 20 and one receiver 30 are associated with each other has been described, but one image capturing terminal 20 may be associated with a plurality of receivers 30. The plurality of photographing terminals 20 and one receiver 30 may be associated with each other. In other words, one photographing terminal 20 may photograph the receiving range of one receiver 30 or may photograph the receiving ranges of a plurality of receivers 30. Further, the reception range of one receiver 30 may be photographed by a plurality of photographing terminals 20. In short, by linking the position of the shooting target in the monitoring video with the position of the monitoring target based on the position of the transmitter 40, the shooting target and the monitoring target can be associated with each other. It suffices that the photographing terminal 20 and the receiver 30 are arranged and that data for position calculation in the monitoring information management server 10 is set.

The integrated image may include a plurality of surveillance videos Ia and identification information Ib for each surveillance video Ia. For example, when a plurality of areas and a plurality of monitoring targets are designated as display conditions, or when a plurality of image capturing terminals 20 are associated with one receiver 30, a plurality of monitoring videos are extracted and monitored. Display data of an integrated image including a plurality of monitoring videos is generated using the individual identification result of the monitoring target for each video.

In the above embodiment, an example in which the monitoring target identification device is a server has been described, but the monitoring target identification device may be a computer terminal that is connected to the imaging terminal 20 and the receiver 30 in a wired or wireless manner to exchange information. Good.

The integrated image displayed on the monitoring terminal 60 includes, in addition to the monitoring video and the target identification information, information indicating the attributes of the monitoring target associated with the transmitter ID together with the target identification information, and the target identification information. Information about the receiver 30 that receives the corresponding transmitter ID and information about the photographing terminal 20 that has photographed the surveillance video may be included. That is, the display data generation unit 13d of the monitoring information management server 10 may generate the display data so that these pieces of information are displayed in one screen.

In the above embodiment, the transmitter 40 that spontaneously emits a radio wave is used as the first communication device, and the receiver 30 that receives the radio wave is used as the second communication device. Not limited to this, the second communication device may be configured to be able to receive the identification information of the first communication device by wireless communication at a short distance, and the wireless communication is performed by the first communication device depending on the radio wave state. Any wireless communication can be used as long as the position can be specified. For example, the first communication device is activated by receiving a radio wave from the second communication device, reflects the identification information of the first communication device to the second communication device, and as a result, the second communication device causes the first communication device to receive the identification information. May be received. The first communication device is held as a monitoring target, and the second communication device is installed in the monitoring area.

Specifically, the wireless communication used for exchanging information between the first communication device and the second communication device is not limited to BLE, and for example, the HF band or UHF band used in the RFID system is used. The contactless communication may be performed. In this case, a communication medium such as an IC tag used in the RFID system is used as the first communication device, and a communication device such as a reader/writer device used in the RFID system is used as the second communication device. .. Then, the communication device receives the response including the identification information from the communication medium by the command communication using the radio wave emitted from the communication device. The position of the communication medium can be specified from the strength and direction of the radio wave when the communication device receives the response from the communication medium. In addition, multiple communication devices are installed in the monitoring area, and the position of the communication medium is specified from the state of the radio waves during communication between each communication device and the communication medium, thereby realizing highly accurate positioning of the position of the communication medium. You can also do it.

Ia...monitoring video, Ib...identification information, Ic...non-identification information, IM...integrated image, Ob...shooting target, 10...monitoring information management server, 11...communication section, 12...storage section, 12a...receiver management data, 12b...transmitter management data, 12c...monitoring video data, 12d...detection data, 13...control section, 13a...management data registration section, 13b...monitoring video processing section, 13c...receiver information processing section, 13d...display data generation Part, 20... Imaging terminal, 30... Receiver, 40... Transmitter, 50... Registration terminal, 60... Monitoring terminal.

Claims (9)

The identification information is received by short-distance wireless communication from a photographing terminal that photographs the inside of the monitoring area and outputs it as a monitoring image, and a first communication device that is held by a monitoring target that is located within the photographing range of the photographing terminal. A monitoring target identification device connected to the second communication device,
A storage unit that stores management data in which identification information of the first communication device and target identification information that is information that enables identification of the monitoring target that holds the first communication device are associated with each other,
A surveillance video processing unit that identifies the position of the shooting target included in the surveillance video;
A communication device specifying unit that specifies the position of the first communication device that has transmitted the identification information received by the second communication device, based on the state of the radio wave from the first communication device detected by the second communication device. When,
Based on the management data, the position of the shooting target specified by the surveillance video processing unit, and the position of the first communication device specified by the communication device specifying unit, the shooting target and the first communication device are determined. By specifying the correspondence with the monitoring target to be held, an individual identification unit that performs individual identification of the monitoring target included in the monitoring video,
A monitoring target identification device including. The monitoring target identification device according to claim 1, wherein the first communication device is a transmitter that spontaneously emits a radio wave, and the second communication device is a receiver that receives the radio wave. The monitoring target identification device is connected to a display device,
Display data of an image including the monitoring video and information indicating the target identification information of the monitoring target whose correspondence with the shooting target is identified in association with the position of the shooting target in the monitoring video is generated. A display data generation unit,
An output unit for outputting the display data to the display device,
The monitoring target identification device according to claim 1, further comprising: The outside is notified when the surveillance video processing unit includes a target whose position cannot be specified by the individual identification unit among the shooting targets whose position is specified by the individual identification unit. The monitoring target identification device described. The monitoring target identification device is connected to a display device,
The monitoring video and the monitoring video when the monitoring video processing unit includes an unidentified target that is a target for which the correspondence with the monitoring target cannot be identified by the individual identification unit among the imaging targets whose positions are specified. A display data generation unit that generates display data of an image including information indicating the position of the unconfirmed target in
An output unit for outputting the display data to the display device,
The monitoring target identification device according to claim 1, further comprising: The monitoring target identification device according to any one of claims 1 to 5, wherein artificial intelligence is used for the process of specifying the shooting target by the monitoring video processing unit. The monitoring target identification device according to claim 1, wherein the state of the radio wave includes the intensity and direction of the radio wave detected by the second communication device. A shooting terminal that shoots the inside of the surveillance area and outputs it as surveillance video,
A first communication device held as a monitoring target,
A second communication device that receives the identification information from the first communication device located within the shooting range of the shooting terminal by wireless communication at a short distance;
A monitoring target identification system comprising a monitoring target identification device connected to the photographing terminal and the second communication device,
The monitoring target identification device,
A storage unit that stores management data in which identification information of the first communication device and target identification information that is information that enables identification of the monitoring target that holds the first communication device are associated with each other,
A surveillance video processing unit that identifies the position of the shooting target included in the surveillance video;
A communication device specifying unit that specifies the position of the first communication device that has transmitted the identification information received by the second communication device, based on the state of the radio wave from the first communication device detected by the second communication device. When,
Based on the management data, the position of the shooting target specified by the surveillance video processing unit, and the position of the first communication device specified by the communication device specifying unit, the shooting target and the first communication device are determined. A monitoring target identification system comprising: an individual identification unit that performs individual identification of the monitoring target included in the monitoring video by identifying the correspondence with the retained monitoring target. The photographing terminal photographs the inside of the monitoring area and outputs a monitoring image, which is the image, to the monitoring target identification device,
A first communication device held by a monitoring target transmits identification information of the first communication device;
The second communication device receives the identification information from the first communication device located within the photographing range of the photographing terminal by wireless communication at a short distance, and the identification information and the second communication device detect the identification information. Outputting information indicating the state of radio waves from the first communication device to the monitoring target identification device;
The monitoring target identification device specifies a position of a shooting target included in the monitoring video,
The monitoring target identification device identifies the position of the first communication device that has transmitted the identification information received by the second communication device, based on information indicating the state of the radio wave;
The monitoring target identification device specifies data in which identification information of the first communication device is associated with target identification information that is information that allows the monitoring target holding the first communication device to be identified. Included in the monitoring video by specifying the correspondence between the shooting target and the monitoring target holding the first communication device based on the position of the shooting target and the position of the specified first communication device. Performing individual identification of the monitoring target,
Target identification method including.

Images