JP2020167662A - Information processing device, information processing system, method, and program - Google Patents

Abstract

To provide a technique for detecting contact between persons who are originally inappropriate to be in contact with each other in a predetermined region, and outputting the detection.SOLUTION: A system for monitoring persons in a predetermined region acquires, with respect to plural persons existing in the predetermined region, positional information of the persons and information indicating destinations of the persons in the predetermined region. Then, using the positional information, the system identifies contact between the persons. Furthermore, using the information indicating the destination of each person identified to have been in contact, the system determines whether the contact is inappropriate and outputs a result of the determination.SELECTED DRAWING: Figure 5

Description

The present invention relates to information processing devices, information processing systems, methods and programs.

A system has been proposed in which a visitor who visits a research facility or a company determines whether or not he / she has visited a planned destination (Patent Document 1).

Further, a technique for estimating the possibility of contact between two people from a surveillance image has been proposed (Patent Document 2).

Japanese Patent No. 5343660 Japanese Unexamined Patent Publication No. 2014-155159

However, a technique for monitoring the unauthorized contact between people with different destinations and exchanging information has not been proposed so far.

An object of the present invention is to provide a technique for detecting and outputting the contact of a person who should not be in contact with the predetermined region.

The present invention is an information processing device in a system for monitoring a person in a predetermined area, and is information indicating the position information of the person and the destination of the person in the predetermined area for a plurality of persons existing in the predetermined area. Using the acquisition means for acquiring the above, the specific means for identifying the contact between the persons using the position information, and the information indicating the destination of each of the persons identified as having contacted by the specific means. It is characterized by having a determination means for determining whether the contact is an illegal contact and an output means for outputting the determination result by the determination means.

According to the present invention, it is possible to provide a technique for detecting and outputting the contact of a person who should not be in contact with the predetermined region.

The figure which shows the structural example of the monitoring system 10 corresponding to the embodiment of an invention. The figure which shows an example of the examinee information database 310 in the database apparatus 300 corresponding to the embodiment of the invention. The figure which shows an example of the monitored area to which the embodiment of an invention is applied. A flowchart showing an example of processing executed by the network camera 100 in the monitoring system 10 corresponding to the embodiment of the present invention, and a diagram showing an example of a data structure of detected person information. FIG. 5 is a flowchart showing an example of processing executed by the information processing apparatus 200 in the monitoring system 10 corresponding to the embodiment of the invention. FIG. 5 is a flowchart showing an example of a person contact time calculation process executed by the information processing device 200 in the monitoring system 10 corresponding to the embodiment of the present invention. FIG. 5 is a flowchart showing an example of a process for displaying information of a person who has illegally contacted the information display device 500, which is executed by the information processing device 200 in the monitoring system 10 according to the embodiment of the invention. The figure which shows an example of the screen displayed on the information display device 500 corresponding to the embodiment of the invention. The figure which shows an example of the visitor information database 320 in the database apparatus 300 corresponding to the embodiment of an invention.

Hereinafter, embodiments of the invention will be described with reference to the accompanying drawings. The configuration shown in the following embodiments is only an example, and the present invention is not limited to the illustrated configuration.

(Example 1)
FIG. 1 is a diagram showing a configuration example of a monitoring system 10 (information processing system) corresponding to an embodiment of the invention. In the present invention, as an example, an example in which the test site is monitored by the monitoring system 10 will be described. The monitoring system 10 is configured by interconnecting a network camera 100, an information processing device 200, a database device 300, a reception terminal 400, and an information display device 500 by a LAN 600 which is a network line. The components of the monitoring system 10 shown in FIG. 1 are merely examples, and components other than these may be further added. Hereinafter, each component will be described.

First, the network camera 100 can be configured to include an image sensor unit 101, a development processing unit 102, a coding unit 103, a person detection processing unit 104, and a LAN interface (I / F) unit 105. The image sensor unit 101 includes an image sensor such as CMOS that photoelectrically converts an optical image formed on an image pickup surface and outputs an analog image signal, and an A / D converter that converts an analog image signal into a digital image signal. Consists of including. The development processing unit 102 executes a predetermined development process on the digital image signal output from the image pickup sensor unit 101. The developing process can include, for example, debayer processing, white balance processing, gradation conversion processing, edge enhancement correction processing, scratch correction, noise removal, scaling processing, color conversion to the YCbCr format, and the like.

The coding unit 103 compresses and encodes the digital image signal output by the developing processing unit 102 to generate image data for distribution to be provided to the information processing device 200. The generated image data includes identification information (camera ID) of the network camera 100, installation location information (position information), shooting time information, and the like. The coding unit 103 also sets the frame rate when generating image data. Here, the image compression method for distribution is, for example, H.I. 264, H. It can be based on standards such as 265, MPEG or JPEG. Further, image data in any format including mp4 and avi formats may be generated.

The person detection processing unit 104 analyzes the digital image output from the development processing unit 102 to detect information about the person included in the digital image. The person information to be detected includes, for example, image data such as a face, upper body, lower body, whole body, and rear view. The image data may be image data obtained by extracting a region including a person from the captured image. When the region is extracted, the coordinate information in the captured image of the region is attached to the image data. Further, the person information may not be the image data itself, but may be a feature amount obtained from the image based on a predetermined calculation, or may include both the image data and the feature amount. When the person information includes image data, the image data is subjected to compression coding processing in the same manner as performed by the coding unit 103, and for example, in the case of a still image, JPEG image data is included. The detected person information and its coordinate information in the captured image are provided to the information processing device 200 together with the camera ID, position information, shooting time information, and the like of the network camera 100 that captured the person. The information generated here will be referred to as "detected person information".

Here, the person detection processing unit 104 may be provided by an external device, for example, an information processing device 200, in addition to the configuration provided by the network camera 100. In that case, the information processing apparatus 200 may execute a part or all of the functions executed by the person detection processing unit 104, and the network camera 100 may execute the remaining functions.

The LAN I / F unit 105 is a communication interface for transmitting the image data output from the coding unit 103 and the detected person information generated by the person detection processing unit 104 to the information processing device 200 via the LAN 600. .. The LAN I / F unit 105 coordinates the exchange of data with a communication partner by using, for example, a network file system such as NFS or CIFS, or a network communication protocol such as UDP or TCP.

Next, the configuration of the information processing device 200 will be described. The information processing device 200 includes a LAN interface (I / F) unit 201, a decoding unit 202, an authentication unit 203, a database management unit 204, a determination unit 205, and a notification unit (output unit) 206, and is connected to each other by a system bus 207. Can be configured to be.

The LAN I / F unit 201 communicates with the network camera 100, the information display device 500, and the like via the LAN 600.

The decoding unit 202 decompresses and decodes the image data included in the detected person information acquired from the network camera 100 via the LAN 600, and restores the digital image signal. The decoded digital image signal is output to the authentication unit 203. Here, in the embodiment in which the information processing device 200 has the person detection processing unit 104, the person detection processing unit 104 can be provided so as to be connected to the system bus 207. The person detection processing unit 104 detects information about a person from the image data decoded by the decoding unit 202, and provides the detected person information to the authentication unit 203.

The authentication unit 203 performs an authentication process for identifying the captured person based on the detected person information generated by the person detection processing unit 104 and the reception image 314 registered in the examinee information database 310 described later. .. The details of this authentication process will be described later.

The database management unit 204 manages the registration information of the database held in the database device 300. For example, the registration information of the examinee information database 310 is updated, the registration information is extracted from the database, and the registration information is provided to each processing unit as needed.

The determination unit 205 performs a process for determining an unauthorized contact of a person in a predetermined area based on the registration information of each database of the database device 300. In the present invention, "contact" is not limited to physical contact between persons, but also includes that the difference in position coordinates between persons is within a predetermined threshold value (within a predetermined range). Further, in the present invention, "illegal" means contact between persons who should not be in contact with each other.

The notification unit 206 notifies (outputs) information about a person who has made an unauthorized contact with the information display device 500 based on the determination results of the authentication unit 203 and the determination unit 205. Details of the notification information will be described later with reference to FIGS. 7 and 8.

The database device 300 is a database in which information referred to when the information processing device 200 executes the process corresponding to the present embodiment is registered, and may include an examinee information database 310 and the like. Although the database device 300 is configured to be connected to the information processing device 200, it may have a network interface and be connected to the LAN 600. In that case, the communication between the information processing device 200 and the database device 300 is performed via the LANI / F unit 201.

The examinee information database 310 is a database in which information for each examinee who visits the facility to be monitored by the monitoring system 10 is registered. Details of this database will be described later with reference to FIG.

The reception terminal 400 is a terminal device used by an examinee who has come to a facility to be monitored by the monitoring system 10 to perform reception. The examinee specifies the examination number according to the instruction from the reception terminal 400, and the reception terminal 400 takes a picture of the examinee to confirm his / her identity, and the photographed image data (also called an image captured image data or simply an image or a reception image). ) Is generated.

If the examination number is specified and the photo is taken correctly, the reception procedure required for the examinee to enter the facility is completed.

When the reception procedure is completed, the reception terminal 400 transmits the examinee information together with the captured image data to the information processing device 200. The examinee information can include, for example, a pre-registered name of the person, an examination venue, and an examination start / end time, which are specified based on the examination number. The examination venue is information that can identify the destination of the examinee (information indicating the destination). In the present embodiment, the information is the examination venue, but as another embodiment, the information may include information such as admission authority and affiliation set for each person.

The information display device 500 is a device that displays information transmitted from the information processing device 200, and can be realized by, for example, a personal computer (PC), a tablet terminal, a smartphone terminal, or the like. The information display device 500 may be connected to the LAN 600 by either wired or wireless. The radio can follow, for example, the wireless LAN standard of IEEE 802.11.

In the present embodiment described below, the information display device 500 is used as a personal computer as a display device for a security guard who guards the inside of the facility where the monitoring system 10 is installed to confirm the notification from the information processing device 200. To do.

In the monitoring system 10 configuration shown in FIG. 1, the number of network cameras 100 can be any number of one or more, and the number is not limited. The information processing device 200, the database device 300, and the information display device 500 may be realized not only by a single device but also by a plurality of devices working together to realize each function.

Next, the data structure of the database in the database device 300 will be described with reference to FIG.

In the examinee information database 310, examinee information that has been accepted by the reception terminal 400 is registered. Specifically, each information of ID 311, examination number 312, name 313, reception image 314, reception date and time 315, examination venue 316, examination time information 317, approaching person information 318, and unauthorized contact flag 319 is registered.

Identification information that makes it possible to uniquely identify each examinee in the database is registered in ID311. An examination number issued in advance from an external device to the examinee is registered in the examination number 312. This examination number is set when the examinee correctly inputs it into the reception terminal 400. In the name 313, the name registered in advance so as to be referred to from the examination number 312 is registered.

In the reception image 314, the photographed image data of the examinee photographed by the reception terminal 400 at the time of reception is registered. This image may be, for example, only one face photograph, or may be registered as a plurality of images including a plurality of face photographs whose shooting angles are changed, a photograph of the whole body, and the like.

As for the reception date and time 315, the time when the examinee completes the reception process on the reception terminal 400 is automatically registered. Information registered in advance for reference from the examination number 312 is registered in the examination venue 316 and the examination time information 317.

In the approaching person information 318, information on a person who has approached each person is registered in the monitoring area in the test site. Therefore, there is no registration information at the time of reception. The details of the approaching person information 318 will be described later with reference to Table 1 and the like. The illicit contact flag 319 is usually set to 0, but when an illicit contact with another person is detected, it is set to 1. Details of the setting of the unauthorized contact flag will be described later with reference to FIG.

Next, an example of the monitoring area to which the monitoring system of the present embodiment is applied will be described with reference to FIG. Area 1 is located at the entrance of the facility and is an area not subject to monitoring by the monitoring system 10 of the present embodiment. Area 2 is a monitored area (predetermined area) of the monitoring system 10 of the present embodiment that only the examinee can enter.

Areas 3 indicating the examination rooms A to F are examination venues, respectively, and are areas (rooms) in which a predetermined examinee can enter only at a predetermined time.

In addition, a monitoring room 6 for monitoring areas 2 and 3 which are monitoring target areas and area 1 which does not directly affect the present embodiment is installed. The installation position of the monitoring room 6 depends on the actual implementation mode and does not particularly affect the implementation of the invention itself.

When the examinee arrives at the venue, he / she goes to the reception 4 installed in the area 1. A reception terminal 400 is installed at the reception 4, and when an examination number issued in advance from an external device is input to the examinee, the name, examination venue, and examination registered in advance based on the examination number are entered. The time information is displayed on a display device (not shown) on the reception terminal 400.

After the examinee confirms that the information displayed on the display device is correct, the examinee is photographed by the camera (not shown) of the reception terminal 400, and the reception is completed.

After that, the examinee enters the examination venue, that is, the monitoring areas 2 and 3, but this facility has a structure that can be entered only from the entrance / exit 5. The entrance / exit 5 is provided with a common gate so that only examinees who have completed the reception can pass through.

One or a plurality of network cameras 100 are installed in the monitoring area 2, and the behavior of the examinee in the area can be monitored. The network camera 100 images the state of the examinees in the monitoring area 2, and the information processing device 200 can detect the contact between the examinees based on the captured images.

When it is detected that the examinees have made unauthorized contact with each other in the monitoring area 2, the information of the person concerned is notified to the guard through the information display device 500 in the monitoring room 6.

Next, the details of the operation in the monitoring system 10 of the present embodiment will be described. FIG. 4 is a flowchart showing an example of processing executed by the network camera 100 in the monitoring system 10 corresponding to the embodiment of the invention.

First, in S401, the network camera 100 takes an image of a predetermined space or region to be imaged at its installation position by the image sensor unit 101, and outputs a digital image signal to the development processing unit 102. After performing a predetermined development process, the development processing unit 102 outputs the digital image signal of the processing result to the coding unit 103 and the person detection processing unit 104. The coding unit 103 compresses and encodes the input digital image signal to generate image data, and transmits the image data to the information processing device 200 via the LAN I / F unit 105.

In the following S402, the person detection processing unit 104 performs person detection based on the digital image signal of the processing target (hereinafter, simply referred to as the processing target image). Here, a case will be described in which the person detection processing unit 104 detects a person by detecting the face of the person. A known method can be used as the face detection method. If a person's face is detected, the process proceeds to S403. On the other hand, if the face of the person is not detected, the process returns to S401.

In S403, the person detection processing unit 104 transmits information about the detected person (detected person information) to the information processing device 200 via the LAN I / F unit 105. An example of the data structure of the detected person information at this time is shown in FIG. 4 (B).

The detected person information 410 includes ID 411 which is identification information for identifying the information, camera ID 412 for identifying the network camera 100 which detected the image, position information 413 of the network camera 100, and time information indicating the time when the image was captured. 414 is included. It also includes the detected face image, a predetermined feature amount extracted from the face image, and person information 415 indicating coordinate information indicating the position of the face of the person in the image. When the person information 415 includes image data, it may be compressed and encoded as a still image in a format such as JPEG. When a plurality of people are detected in one captured image, the detected person information 410 may be generated for each person, or one information may be generated collectively for the plurality of people. Good. At that time, coordinate information for specifying the position shown in the image for each person is included.

After that, the process returns to S401 and the process is repeated. By the above processing, the network camera 100 can transmit the image data of the region to be imaged to the information processing device 200. At the same time, the image data in the area to be imaged (within a predetermined area) is subjected to a person detection process, and when a person is detected, the detected person information 410 regarding the person is transmitted to the information processing device 200. Can be done.

In the embodiment in which the person detection processing unit 104 is included in the information processing device 200, the processes of S402 and S403 are not executed on the network camera 100 side, but are executed by the information processing device 200. Specifically, the person detection processing unit 104 executes the person detection process corresponding to S402 on the image data decoded by the decoding unit 202, and when the person is detected, the detected person information is sent to the authentication unit 203. provide.

Next, a process executed by the information processing apparatus 200 based on the detected person information 410 received from the network camera 100 will be described with reference to FIG. FIG. 5 is a flowchart showing an example of an unauthorized contact detection process executed by the information processing device 200 in the monitoring system 10 corresponding to the embodiment of the invention.

In the following description, the case where the person detection process is performed by the network camera 100 will be described, but the person detection process may be performed on the information processing apparatus 200 side. In that case, the detected person information 410 may be read as being provided by the person detection processing unit 104 provided in the information processing apparatus 200.

First, in S501, the information processing device 200 acquires the captured image and the detected person information 410 from the network camera 100.

In S502, the authentication unit 203 executes the person authentication process. Specifically, the person information 415 included in the acquired detected person information 410 and each examinee information in the examinee information database 310 are compared and processed to identify the most similar examinee information. For example, when the person information 415 includes a face image, the face image information (reception image 314) most similar to the face image is specified from the examinee information database 310.

In S502, characteristic information such as clothes, belongings, and accessories of a person obtained from an image can be used as an auxiliary. Here, since the method of image comparison processing for identifying a person is not a feature of the present invention and any known method can be adopted, further detailed description thereof will be omitted.

In S503, the determination unit 205 compares the position information 413, the time information 414, and the coordinate information included in the person information 415 included in the plurality of detected person information 410, respectively. As a result of the comparison, if the difference between them is within a predetermined threshold value, it is determined that the persons are at the same position at the same time. Then, the determination unit 205 acquires the examinee information of all the persons (that is, all the persons who have made contact) determined to be at the same position at the same time from the examinee information database 310 held by the database device 300. ..

S503 is an example of the acquisition means in the present invention for acquiring the position information of the person and the information indicating the destination of the person in the predetermined area for a plurality of persons existing in the predetermined area.

In S504, the determination unit 205 determines whether or not there are a plurality of persons at the same position at the same time from the information acquired in S503. If a plurality of persons are at the same position at the same time, the process proceeds to S505. On the other hand, if it is determined that there are no plurality of persons at the same position at the same time, the process returns to S501 and proceeds to the acquisition of the next captured image and detected person information.

S504 is an example of the specific means for identifying the contact between the persons by using the position information in the present invention.

In S505, the determination unit 205 calculates the contact time between a plurality of persons. Then, the database device 300 is controlled, and the result is recorded in the approaching person information 318 and the unauthorized contact flag 319 regarding the corresponding person in the examinee information database 310 held by the database device 300.

Details of the contact time calculation and the database update process in S505 will be described later with reference to FIG.

In S506, the determination unit 205 determines the presence or absence of unauthorized contact. If there is a person for whom the unauthorized contact flag 319 has been set by the process of S505, the determination unit proceeds to the process of S507. If there is no person for which the unauthorized contact flag 319 is set, the process returns to S501 and proceeds to the acquisition of the next captured image and detected person information.

S506 and S603, S604, and S606 described later determine whether or not the contact is an illegal contact by using the information indicating the destination of each of the persons identified as having contacted by the specific means in the present invention. This is an example of the determination means.

In S507, the determination unit 205 notifies the notification unit 206 of the information that there has been an unauthorized contact so that the subsequent processing can be executed, and then returns to S501 to perform the processing for the next captured image.

S507 is an example of the output means for outputting the determination result by the determination means in the present invention.

Next, the contact time calculation process and the examinee information database update process will be described with reference to FIG.

FIG. 6 is a flowchart showing an example of the contact time calculation process and the examinee information database update process in S505.

First, in S601, the determination unit 205 selects one person (hereinafter, also referred to as a target person) to be processed in FIG. 6 from the examinees included in the examinee information database 310.

In S602, the determination unit 205 refers to the approaching person information 318 of the data corresponding to the person selected in S601 in the examinee information database 310 held by the database device 300.

Here, Table 1 shows an example of approaching person information 318. Each time a certain person A is authenticated in S502 and the process of S503 is executed, the approach information of which person is approached is recorded.

That is, when the determination unit 205 executes the process of S503, the person A and the person estimated to be at the same position at the same time are recorded in the approach information as the person approaching the person A.

One vertical column of squares under "Authentication timing of person A" in Table 1 indicates one authentication. Then, in Table 1, it is shown that the person A is authenticated a total of 5 times, of which the person B approaches the person A 4 times, the person C once, and the person D 2 times.

In S603, the determination unit 205 identifies whether the test site 316 (destination) of the target person and another person who is close to the target person matches.

S603 is a process performed to prevent the unauthorized contact flag 319 from being set in S606 described later for a person whose test site 316 of another person who is close to the target person matches. This is because, as long as the examination venues 316 match, it is inevitable that the person will come into contact with the target person, and since the examination will be taken at the same timing, the risk of leakage of the examination questions will be extremely low even if they do. ..

In S604, the determination unit 205 calculates an integrated value of the time considered to have been approaching from the approach information of the target person and another person who is approaching at that time based on the approaching person information 318, and obtains the estimated contact time. To do. The calculated value of the estimated contact time may be recorded in the approaching person information 318 of the database as shown in Table 1.

In S605, the determination unit 205 determines whether or not the calculated estimated contact time is longer than the predetermined threshold value (or more than the predetermined time) with respect to the target person and each of the other persons who are approaching at that time. If the calculated estimated contact time is longer than the predetermined threshold value, the process proceeds to S606, and if not, the process proceeds to S607.

In S606, the determination unit 205 sets a flag indicating unauthorized contact with a person whose estimated contact time with the target person is longer than a predetermined threshold value. Specifically, the unauthorized contact flag 319 corresponding to the target person in the examinee information database 310 is set to 1. However, the determination unit 205 sets the unauthorized contact flag 319 for a person whose estimated contact time with the target person is longer than a predetermined threshold value but whose test site 316 (destination, destination) matches the target person. Is not set to 1.

As another embodiment, even if the target person and the test site 316 match, the unauthorized contact flag 319 may be set to 1 when the persons with different test start times come into contact with each other. By doing so, it is possible to prevent an examinee who has completed the examination from leaking the contents of the examination to the next examinee.

In S607, the determination unit 205 determines whether or not the processing up to S606 has been performed on all the authenticated persons, and if all the persons have been processed, the processing proceeds to S608, otherwise returns to S601 and next. Proceed to the processing for the person.

In S608, the determination unit 205 collates the approaching person information 318 of all the persons to be processed here, and generates the unauthorized contact information indicating the combination of persons whose estimated contact time exceeds a predetermined threshold value and can be determined to be unauthorized contact. .. In this process, it is not essential to generate unauthorized contact information.

In S609, the determination unit 205 updates the approaching person information 318 in the examinee information database 310 corresponding to the person targeted in S601 based on the processing results of S602 to S606. At this point, the approaching person information 318 corresponding to the person who has approached is updated, and the information without the approaching person is added to the approaching person information 318 corresponding to the person who did not have the approaching person.

In the present embodiment, the processes of S604 and S605 in the determination unit 205 are not indispensable processes, and the process of S606 may be executed when there is a person who has contacted regardless of the contact time. However, by executing the processes of S604 and S605, it is possible to reduce the possibility of being determined to be in contact when a plurality of persons simply pass each other.

Further, in the present embodiment, the information processing apparatus 200 executes the processes shown in FIGS. 5 and 6, but as another embodiment, a part or all of the processes shown in FIGS. 5 and 6 is performed by the network camera 100. May be executed.

Next, a process for displaying information about a person who has made an unauthorized contact on the information display device 500 will be described based on the above processing result. FIG. 7 is a flowchart showing an example of processing executed by the information processing apparatus 200 in the monitoring system 10 corresponding to the embodiment of the invention.

The process shown in FIG. 7 may be started according to a request from the information display device 500, or may be started at a predetermined timing (for example, every minute). Alternatively, in S507, the determination unit 205 may start at the timing when the notification unit 206 is notified of the information that there has been an unauthorized contact.

First, in S701, the notification unit 206 of the information processing device 200 identifies a person whose unauthorized contact flag 319 is set to 1 in the examinee information database 310. Further, since the guard can identify the person by confirming the ID 311, the examination number 312, the name 313, etc., the notification unit 206 can refer to the person in the examinee information database via the database management unit 204. Get this information from 310.

In S702, the notification unit 206 acquires the feature amount calculated from the reception image 314 or the reception image 314 of the person from the examinee information database 310 via the database management unit 204 for the person specified by the process of S701. .. The feature amount may be calculated at the timing when the reception image 314 is taken and stored in the examinee information database 310, or may be calculated from the reception image 314 each time as necessary.

In S703, the notification unit 206 searches for a person for whom the unauthorized contact flag is set from the captured image data received from the network cameras 100 installed in the monitoring areas 2 and 3. Here, for example, since the detected person information 410 is transmitted from the network camera 100, the person information 415 included in the detected person information 410 is compared with the feature amount acquired in S702. As a result, it is possible to identify the captured image data and the position of the person for whom the unauthorized contact flag is set.

In S704, the notification unit 206 converts the information in the examinee information database 310 into information that can be superimposed and displayed at the position specified in S703 of the captured image data of the monitoring areas 2 and 3. The information in the examinee information database 310 is the ID 311 of the person whose unauthorized contact flag 319 is set to 1, the name 313, the examination number 312, and the like.

When the person image 801 is superimposed on the sketch of the facility to be the test site on the display screen of FIG. 8 to be described later, in S704, the notification unit 206 superimposes the information in the examinee information database 310 on the sketch. Convert to possible information.

In S705, the notification unit 206 transmits the above-mentioned superimposable information to the information display device 500 together with the captured image data specified in S703. In the information display device 500 that has received this information, the information display device 500 can identify the information about the person (examinee) for which the unauthorized contact flag is set in the captured image data transmitted from the notification unit 206 of the information processing device 200. It can be superimposed and displayed on the screen.

The mode in which the information processing apparatus 200 executes the processing shown in FIG. 7 has been described above, but the present invention is not limited to this, and each processing shown in FIG. 7 may be performed by the network camera 100.

FIG. 8 is a diagram showing an example of a screen display transmitted from the notification unit 206 of the information processing device 200 to the information display device 500 and displayed on the information display device 500 in S705.

FIG. 8A is an example of a normal screen in which no examinee has made an unauthorized contact.

On the screen 800, the information of the persons in the monitoring areas 2 and 3 is superimposed and displayed on the sketch of the facility serving as the test site. The superimposition position of the person information is determined based on the detected person information 410.

The person image 801 may be an icon representing a person, or may be a reception image 314 acquired at the time of reception. Since the examinees in each of the test rooms A to F in the monitoring area 3 are monitored in the test room, the display method may be different from that of the monitoring area 2 in order to show that the monitoring status is different. Good. For example, the color of the icon is lightened as shown in the person image 802.

The person information display 803 displays information about the person in the monitoring areas 2 and 3. The person information display 803 displays at least one of ID 311, examination number 312, name 313, reception image 314, reception date and time 315, examination venue 316, and examination time information 317 in the examinee information database 310. In addition, a method may be used in which a small amount of information such as an ID is usually displayed, and detailed information is additionally displayed by performing a default operation such as clicking an icon.

FIG. 8B is an example of a screen transmitted from the notification unit 206 of the information processing device 200 to the information display device 500 and displayed on the information display device 500 in S705, in which an examinee who has made an unauthorized contact is detected. This is an example of the screen when

When a person with ID 001 and a person with ID 011 who have different destinations (destination) contact each other illegally, the security guard who is monitoring the screen is alerted by the highlighting 804. Here, the display surrounding the position of the person who made unauthorized contact is given as an example, but the method of calling the guards' attention is not limited to this. For example, any method may be applied such as changing the color and shape of the person image 801, displaying character information in an area on the screen (not shown), and warning by sound using a speaker (not shown).

Next, in S705, another embodiment of the screen display transmitted from the notification unit 206 of the information processing device 200 to the information display device 500 and displayed on the information display device 500 will be described.

In FIGS. 8 (A) and 8 (B), it is assumed that the information on the position of the person who made an unauthorized contact is superimposed on the sketch. On the other hand, in the present embodiment, the person (unauthorized contact flag) is set at the position of the person who has the unauthorized contact flag set specified in S703 of the captured image data transmitted from the notification unit 206 of the information processing apparatus 200. Information about the examinee) is superimposed and displayed on the screen. The information about the person for which the unauthorized contact flag is set is the same information as the information displayed on the person information display 803.

By displaying the captured image data, it becomes easier for the guard to grasp the actual situation of the site than when displaying the sketch. Then, the guard can determine whether the contact was really fraudulent and take appropriate measures against the person who made the fraudulent contact.

As another embodiment, only the information about the person may be displayed on the screen without superimposing the information about the person on the position of the person for which the unauthorized contact flag 319 is set. In that case, in addition to the information displayed on the person information display 803, it is preferable to display the reception image 314 of the person (examinee) for whom the unauthorized contact flag is set. By also displaying the reception image 314, the guard can confirm the face of the person for whom the unauthorized contact flag is set, so that it is possible to obtain the effect of making it easier to find the person from the test site 316.

In the above-described embodiment, the case where the person is specified based on the image captured by the network camera 100 is described, but the person may not be specified only by the image. For example, by lending a beacon transmitter at the reception at reception 4 and receiving a beacon signal transmitted from the beacon transmitter, the position coordinates of each person are detected, and whether the position coordinates of a plurality of people overlap. The unauthorized contact may be identified by. However, when a beacon transmitter is used, its position coordinates may deviate slightly, so that it is possible to detect unauthorized contact more accurately by using captured image data.

According to the above embodiment, it is possible to detect and notify the contact between the examinees who should not be in contact with each other at the examination venue or the like. Thereby, in the monitoring area, for example, it is possible to provide a mechanism for the examinees to come into contact with each other to exchange information, specifically, to prevent the leakage of examination questions.

(Example 2)
In Example 1, the detection of unauthorized contact between test takers at the test site was described. Normally, the examinee at the test site does not have a companion, but in this embodiment, a method of detecting contact with another group due to a companion who visits the facility will be described. The description of the contents common to those of the first embodiment will be omitted.

In this embodiment, we consider the case of monitoring a person who comes to visit an inpatient in a hospital that requires high security for explanation.

A visitor who arrives at the hospital inputs a visit destination, a visit time, and his / her name at the reception terminal 400 installed at the reception 4, and takes a picture of himself / herself according to the instructions of the reception terminal 400. Further, for example, the companion information can be input by specifying the ID of the companion who has completed the reception first. Note that these operations may be performed by, for example, a method in which the hospital staff operates the reception terminal 400 at the reception 4.

FIG. 9 is an example of the visitor information database 320 acquired at the reception and stored in the database device 300. In the visitor information database 320, ID 321, the visit destination 322 represented by the name of the inpatient, and the visitor name 323 are registered as the visitor information that has been accepted by the reception terminal 400. In addition, the reception image 324, the reception date and time 325, the visitation time 326, and the companion ID 327 acquired by taking a picture with the reception terminal 400 described above are registered, and the approaching person information 328 for holding the monitoring information for each visitor is registered. And also possesses the unauthorized contact flag 329. Of these, since the companion ID 327 is unique to this embodiment, the companion ID 327 will be described below, and the description of other items will be omitted.

According to the visitor information database 320 shown in FIG. 9, three people with IDs 0001, 0002, and 0004 visit the same destination as companions. With reference to the reception date and time 325, it is probable that the two persons, ID0001 and ID0002, were waiting for the reception operation of ID0004 in the state where the reception was completed first. As the work of registering a companion at the time of reception, ID0004 obtains the IDs of the two persons who received the reception in advance and inputs them at the reception terminal 400. As a result, the companion information is added to the companion IDs corresponding to IDs 0001, 0002, and 0004 in the visitor information database. As an additional operation of companion information, if security is more important, an unrelated person can be impersonated as a companion by taking a group photo when all the companions accept at the same time or when operating the final receptionist. The risk can be reduced.

The subsequent unauthorized contact detection process is the same as that of the first embodiment, but before the process of setting the unauthorized contact flag in S606, a process of referring to the companion ID is added, and if the companions are companions, it is estimated to be the target person. The unauthorized contact flag is not set even for a person whose contact time is longer than a predetermined threshold. As a result, it is possible to prevent the companion from being mistakenly detected as an unauthorized contact.

In this embodiment, a method of preventing false detection of unauthorized contact is shown by giving information of a companion to the system at the time of reception. In addition to this, it is also possible to have a mechanism that can set conditions to be excluded from contact detection according to the structure and situation of the facility to be monitored. For example, if you exclude visitors who have the same destination at a predetermined date and time, you can stop unnecessary detection and notification when many participants go to an event held in a certain corner of the facility. it can.

According to the above embodiment, in a facility such as a hospital where strict security management is required, it is possible to detect and notify contact between originally unrelated visitors. As a result, it is possible to provide a mechanism for suppressing unnecessary troubles between visitors as well as passing illegal information and goods in the facility.

(Other embodiments)
Although the embodiments have been described in detail above, the present invention can be implemented as, for example, a system, an apparatus, a method, a program, a recording medium (storage medium), or the like. Specifically, it may be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, an imaging device, a Web application, etc.), or it may be applied to a device composed of one device. Good.

The present invention can also be realized by the following processing. A program that realizes one or more functions of the above-described embodiment is supplied to the system or device via a network or a storage medium. Then, one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

10 Surveillance system 100 Network camera 200 Information processing device 300 Database device 400 Reception terminal 500 Information display device 600 LAN

Claims (11)

An information processing device in a system that monitors a person in a predetermined area.
An acquisition means for acquiring position information of the person and information indicating the destination of the person in the predetermined area for a plurality of persons existing in the predetermined area.
A specific means for identifying contact between the persons using the position information, and
A determination means for determining whether or not the contact is an illegal contact by using the information indicating the destination of each person identified as having contacted by the specific means.
An information processing device having an output means for outputting a determination result by the determination means. The information processing apparatus according to claim 1, wherein the determination means determines that the contact is illegal when the destinations of the persons identified as having contacted by the specific means are different. The information processing apparatus according to claim 1 or 2, wherein the specific means identifies the person as having contacted the person when the difference in the position information between the persons is within a predetermined range. The specific means is characterized in that when the difference in position information between the persons is within a predetermined range and the time within the predetermined range is equal to or longer than a predetermined time, the contact is specified. The information processing device according to claim 3. The output means according to any one of claims 1 to 4, wherein the output means outputs a screen capable of identifying the person determined to be an unauthorized contact by using the information relating to the person. Information processing equipment. The determination means is any one of claims 1 to 5, wherein when the persons identified as having contacted by the specific means are in a companion relationship, it is determined that the contact is not illegal. The information processing device described in. The information processing device according to any one of claims 1 to 6, wherein the acquisition means acquires the position information of the person from the image data captured by the imaging device. The information processing according to any one of claims 1 to 7, wherein the predetermined area indicates a predetermined facility, and the information indicating the destination is information indicating a room of the predetermined facility. apparatus. A control method for an information processing device in a system that monitors a person within a predetermined area.
An acquisition step of acquiring the position information of the person and the information indicating the destination of the person in the predetermined area for a plurality of persons existing in the predetermined area.
A specific step of identifying contact between the persons using the position information, and
A determination step of determining whether the contact is an illegal contact by using the information of the destination of each person identified as having contacted in the specific step.
A control method for an information processing device, which comprises an output step for outputting a determination result in the determination step. A system that monitors people within a predetermined area.
An acquisition means for acquiring position information of the person and information indicating the destination of the person in the predetermined area for a plurality of persons existing in the predetermined area.
A specific means for identifying contact between the persons using the position information, and
A determination means for determining whether or not the contact is an illegal contact by using the information indicating the destination of each person identified as having contacted by the specific means.
An information processing system characterized by having an output means for outputting a determination result by the determination means. A program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 8.

Images