JP7446806B2 - Information processing device, method and program - Google Patents

Description

The present invention relates to an information processing device , method, and program.

A system has been proposed that determines whether a visitor to a research facility or company has visited a scheduled destination (Patent Document 1).

Furthermore, a technique has been proposed for inferring whether there is a possibility that two people have come into contact with each other from surveillance video (Patent Document 2).

Patent No. 5343660 Japanese Patent Application Publication No. 2014-155159

However, no technology has been proposed to date to monitor unauthorized contact and exchange of information between people with different destinations.

An object of the present invention is to provide a technology for detecting and outputting a contact of a person who should not originally be in contact in a predetermined area.

The present invention provides an information processing device for monitoring people within a predetermined area, and the information processing apparatus includes, for each of a plurality of people existing in the predetermined area, information indicating the position of the person , and information on the position of the person in the predetermined area. an acquisition means for acquiring information indicating a destination ; a determination means for determining whether contact has occurred between persons having different destinations using the information acquired by the acquisition means ; , an output means for outputting information that allows identification of the occurrence of the contact when it is determined that the contact has occurred .
The present invention also provides an information processing device for monitoring people within a predetermined area, which includes, for each of a plurality of people existing in the predetermined area, information indicating the position of the person, and information indicating the position of the person in the predetermined area. An acquisition means for acquiring information indicating a destination of a person, and a plurality of persons whose information indicating the destination acquired by the acquisition means are different from each other, the difference in information indicating the position between the plurality of persons is determined as a threshold value. The present invention is characterized by having an output means for outputting predetermined information in the following cases.

According to the present invention, it is possible to provide a technique for detecting and outputting a contact of a person who should not originally be in contact in a predetermined area.

1 is a diagram showing a configuration example of a monitoring system 10 according to an embodiment of the invention. FIG. 3 is a diagram showing an example of a database 310 of examinee information in a database device 300 according to an embodiment of the invention. 1 is a diagram illustrating an example of a monitoring target area to which an embodiment of the invention is applicable; FIG. 2 is a flowchart illustrating an example of a process executed by a network camera 100 in a monitoring system 10 and a diagram illustrating an example of a data structure of detected person information, according to an embodiment of the invention. FIG. 1 is a flowchart illustrating an example of a process executed by an information processing device 200 in a monitoring system 10, according to an embodiment of the invention. 2 is a flowchart illustrating an example of a human contact time calculation process executed by the information processing device 200 in the monitoring system 10, according to an embodiment of the invention. 2 is a flowchart illustrating an example of a process for displaying information on a person who has made unauthorized contact on an information display device 500, which is executed by an information processing device 200 in a monitoring system 10, according to an embodiment of the invention. FIG. 5 is a diagram showing an example of a screen displayed on an information display device 500 according to an embodiment of the invention. FIG. 3 is a diagram showing an example of a visitor information database 320 in a database device 300 according to an embodiment of the invention.

Embodiments of the invention will be described below with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the illustrated configurations.

(Example 1)
FIG. 1 is a diagram showing a configuration example of a monitoring system 10 (information processing system) according to an embodiment of the invention. In the present invention, an example will be described in which a test venue is monitored by the monitoring system 10. The monitoring system 10 is configured such that a network camera 100, an information processing device 200, a database device 300, a reception terminal 400, and an information display device 500 are interconnected by a LAN 600, which is a network line. The components of the monitoring system 10 shown in FIG. 1 are merely examples, and components other than these may be further added. Each component will be explained below.

First, the network camera 100 can be configured to include an image sensor section 101, a development processing section 102, an encoding section 103, a person detection processing section 104, and a LAN interface (I/F) section 105. The image sensor unit 101 includes an image sensor, such as a CMOS, that photoelectrically converts a light image formed on an imaging surface and outputs an analog image signal, and an A/D converter that converts the analog image signal into a digital image signal. It consists of: The development processing unit 102 performs predetermined development processing on the digital image signal output from the image sensor unit 101. The development processing can include, for example, processing such as debayering processing, white balance processing, gradation conversion processing, edge emphasis correction processing, scratch correction, noise removal, scaling processing, and color conversion to YCbCr format.

The encoding unit 103 compresses and encodes the digital image signal output by the development processing unit 102 to generate image data for distribution to be provided to the information processing device 200. The generated image data includes identification information (camera ID) of the network camera 100, information on the installation location (position information), shooting time information, and the like. The encoding unit 103 also sets the frame rate when generating image data. Here, the image compression method for distribution is, for example, H. 264, H. It may be based on standards such as H.265, MPEG or JPEG. Furthermore, image data in any format including mp4, avi format, etc. may be generated.

A person detection processing unit 104 analyzes the digital image output from the development processing unit 102 and detects information regarding a person included in the digital image. The person information to be detected includes, for example, image data of a face, upper body, lower body, whole body, rear view, and the like. The image data may be image data obtained by extracting a region including a person from a captured image. When extracting a region, coordinate information of the region in the captured image is attached to the image data. Further, the person information may not be the image data itself, but may be a feature amount obtained from the image based on a predetermined calculation, or may include both the image data and the feature amount. When the personal information includes image data, the image data is subjected to compression encoding processing in the same way as in the encoding unit 103, and for example, in the case of a still image, JPEG image data is included. The detected person information and its coordinate information within the captured image are provided to the information processing device 200 along with the camera ID, position information, shooting time information, etc. of the network camera 100 that shot the person. The information generated here will be referred to as "detected person information."

Here, in addition to the configuration included in the network camera 100, the person detection processing unit 104 may be included in an external device, for example, the information processing device 200. In that case, the information processing device 200 may execute some or all of the functions executed by the person detection processing unit 104, and the remaining functions may be executed by the network camera 100.

The LAN I/F unit 105 is a communication interface for transmitting image data output from the encoding unit 103 and detected person information generated by the person detection processing unit 104 to the information processing device 200 via the LAN 600. . The LAN I/F unit 105 uses, for example, a network file system such as NFS or CIFS, or a network communication protocol such as UDP or TCP to coordinate data exchange with a communication partner.

Next, the configuration of the information processing device 200 will be explained. The information processing device 200 includes a LAN interface (I/F) unit 201, a decryption unit 202, an authentication unit 203, a database management unit 204, a determination unit 205, and a notification unit (output unit) 206, which are connected to each other by a system bus 207. It can be configured so that

The LAN I/F section 201 communicates with the network camera 100, the information display device 500, etc. via the LAN 600.

The decoding unit 202 decompresses and decodes image data included in the detected person information acquired from the network camera 100 via the LAN 600 to restore a digital image signal. The decoded digital image signal is output to the authentication section 203. Here, in an embodiment in which the information processing apparatus 200 includes the person detection processing section 104, the person detection processing section 104 can be provided to be connected to the system bus 207. The person detection processing unit 104 detects information regarding a person from the image data decoded by the decoding unit 202 and provides the detected person information to the authentication unit 203.

The authentication unit 203 performs authentication processing to identify the imaged person based on the detected person information generated by the person detection processing unit 104 and the reception image 314 registered in the examinee information database 310, which will be described later. . Details of this authentication process will be described later.

The database management unit 204 manages database registration information held in the database device 300. For example, the registration information in the examinee information database 310 is updated, the registration information is extracted from the database, and the information is provided to each processing unit as necessary.

The determination unit 205 performs processing for determining unauthorized contact by a person within a predetermined area based on registered information in each database of the database device 300. Note that, in the present invention, "contact" is not limited to physical contact between persons, but also includes the fact that the difference in position coordinates between persons is within a predetermined threshold (within a predetermined range). Furthermore, in the present invention, "unauthorized" means contact between persons who should not originally contact each other.

The notification unit 206 notifies (outputs) information regarding the person who has made unauthorized contact to the information display device 500 based on the determination results of the authentication unit 203 and the determination unit 205. Details of the notification information will be described later with reference to FIGS. 7 and 8.

The database device 300 is a database in which information to be referred to when the information processing device 200 executes processing according to the present embodiment is registered, and can include a test taker information database 310 and the like. Although the database device 300 is configured to be connected to the information processing device 200, it may also be provided with a network interface and connected to the LAN 600. In that case, communication between the information processing device 200 and the database device 300 is performed via the LAN I/F unit 201.

The test taker information database 310 is a database in which information about each test taker who visited a facility to be monitored by the monitoring system 10 is registered. Details of this database will be described later with reference to FIG. 2.

The reception terminal 400 is a terminal device used by test takers who have visited a facility monitored by the monitoring system 10 to register. The examinee specifies the examinee number according to instructions from the reception terminal 400, and the reception terminal 400 takes a photograph of the examinee for identity verification and sends photographed image data (also referred to as photographed image data or simply an image or reception image). ) is generated.

Once the examinee number has been specified and the photograph taken correctly, the reception procedures necessary for the examinee to enter the facility will be completed.

When the reception procedure is completed, the reception terminal 400 transmits the examinee information along with the captured image data to the information processing device 200. The examinee information may include, for example, the name of the person registered in advance, identified based on the examinee number, the examination venue, and the examination start and end times. The test venue is information that can identify the examinee's destination (information indicating the destination). In this embodiment, the information is the exam venue, but in other embodiments, the information may include information such as entry authority and affiliation set for each person.

The information display device 500 is a device that displays information transmitted from the information processing device 200, and can be realized by, for example, a personal computer (PC), a tablet terminal, a smartphone terminal, or the like. The information display device 500 may be connected to the LAN 600 either by wire or wirelessly. The wireless communication may conform to the IEEE802.11 wireless LAN standard, for example.

In the embodiment described below, the information display device 500 is used as a personal computer as a display device for checking notifications from the information processing device 200 by a security guard guarding the facility where the monitoring system 10 is installed. do.

In the configuration of the monitoring system 10 shown in FIG. 1, the number of network cameras 100 can be any number greater than or equal to one, and the number is not limited. The information processing device 200, the database device 300, and the information display device 500 may not only be realized by a single device, but also a plurality of devices may cooperate to realize each function.

Next, with reference to FIG. 2, the data structure of the database in the database device 300 will be described.

In the examinee information database 310, examinee information that has been accepted at the reception terminal 400 is registered. Specifically, the following information is registered: ID 311, examinee number 312, name 313, reception image 314, reception date and time 315, exam venue 316, exam time information 317, approaching person information 318, and unauthorized contact flag 319.

Identification information that allows each examinee to be uniquely identified within the database is registered in the ID 311. In the examinee number 312, an examinee number previously issued to the examinee from an external device is registered. This examinee number is set by the examinee correctly inputting it into the reception terminal 400. In the name 313, the name registered in advance so that it can be referenced from the examinee number 312 is registered.

In the reception image 314, photographed image data of the examinee photographed by the reception terminal 400 at the time of reception is registered. This image may be, for example, only one face photograph, or a plurality of images including a plurality of face photographs taken at different photographing angles, a photograph taken of the whole body, etc. may be registered.

In the reception date and time 315, the time when the examinee completed the reception process at the reception terminal 400 is automatically registered. As the test venue 316 and test time information 317, information that has been registered in advance so that it can be referenced from the examinee number 312 is registered.

In the approaching person information 318, information about people who have approached each person in the monitoring area within the test venue is registered. Therefore, there is no registration information at the time of reception. Details of the approaching person information 318 will be explained later using Table 1 and the like. The unauthorized contact flag 319 is normally set to 0, but is set to 1 when an unauthorized contact with another person is detected. Details of setting the unauthorized contact flag will be described later with reference to FIG.

Next, an example of a monitoring area to which the monitoring system of this embodiment is applied will be described with reference to FIG. 3. Area 1 is located at the entrance of the facility, and is an area that is not monitored by the monitoring system 10 of this embodiment. Area 2 is a monitoring target area (predetermined area) of the monitoring system 10 of this embodiment that only examinees can enter.

Area 3 indicating examination rooms A to F is each a test venue, and is an area (room) that predetermined test takers can enter only at predetermined times.

Furthermore, a monitoring room 6 is installed to monitor areas 2 and 3 which are the monitoring target areas, and area 1 which is not directly affected in this embodiment. The installation position of the monitoring room 6 depends on the actual mode of implementation and does not particularly affect the implementation of the invention itself.

When examinees arrive at the venue, they head to Reception 4 located in Area 1. A reception terminal 400 is installed at the reception desk 4, and when the examinee enters the examinee number previously issued from an external device, the name, test center, and test registered in advance are displayed based on the examinee number. Time information is displayed on a display device (not shown) on reception terminal 400.

After the examinee confirms that the information displayed on the display device is correct, a photograph of the examinee is taken using a camera (not shown) included in the reception terminal 400, and the reception is completed.

Thereafter, the examinees enter the examination hall, that is, the monitoring areas 2 and 3, but this facility is structured so that they can only enter through the entrance/exit gate 5. Entrance/exit entrance 5 is equipped with a cross-gate so that only test takers who have completed registration can pass through.

One or more network cameras 100 are installed in the monitoring area 2, and the actions of test takers within the area can be monitored. The network camera 100 images the examinees in the monitoring area 2, and the information processing device 200 can detect contact between the examinees based on the captured image.

If it is detected that test takers have come into contact with each other in the monitoring area 2, the security guard is notified of the person's information through the information display device 500 in the monitoring room 6.

Next, details of the operation in the monitoring system 10 of this embodiment will be explained. FIG. 4 is a flowchart illustrating an example of processing executed by the network camera 100 in the monitoring system 10 according to the embodiment of the invention.

First, in S<b>401 , the network camera 100 captures an image of a predetermined space or area to be imaged at its installation position using the image sensor unit 101 and outputs a digital image signal to the development processing unit 102 . After performing predetermined development processing, the development processing section 102 outputs a digital image signal as a result of the processing to the encoding section 103 and the person detection processing section 104. The encoding unit 103 compresses and encodes the input digital image signal to generate image data, and transmits the image data to the information processing device 200 via the LAN I/F unit 105.

In subsequent S402, the person detection processing unit 104 performs person detection based on the digital image signal to be processed (hereinafter simply referred to as the image to be processed). Here, a case will be described in which the person detection processing unit 104 performs person detection by detecting the person's face. A known method can be used to detect the face. Further, if a person's face is detected, the process advances to S403. On the other hand, if no human face is detected, the process returns to S401.

In S403, the person detection processing unit 104 transmits information about the detected person (detected person information) to the information processing apparatus 200 via the LAN I/F unit 105. An example of the data structure of the detected person information at this time is shown in FIG. 4(B).

The detected person information 410 includes an ID 411 that is identification information for identifying the information, a camera ID 412 for identifying the network camera 100 that detected the image, position information 413 of the network camera 100, and time information indicating the time when the image was captured. 414 included. It also includes person information 415 indicating the detected face image or a predetermined feature amount extracted from the face image, and coordinate information indicating the position of the person's face in the image. When the person information 415 includes image data, it may be compressed and encoded as a still image in a format such as JPEG. When multiple people are detected in one captured image, the detected person information 410 may be generated for each person, or one piece of information may be generated for multiple people at once. good. At that time, coordinate information for specifying the position of each person in the image is included.

After that, the process returns to S401 and repeats the process. Through the above processing, the network camera 100 can transmit image data of the area to be imaged to the information processing device 200. At the same time, a person detection process is performed on the image data of the imaging target area (within a predetermined area), and when a person is detected, the detected person information 410 regarding the person is transmitted to the information processing device 200. Can be done.

In an embodiment in which the person detection processing unit 104 is included in the information processing apparatus 200, the processes of S402 and S403 are not executed on the network camera 100 side but are executed on the information processing apparatus 200. Specifically, the person detection processing unit 104 executes the person detection process corresponding to S402 on the image data decoded by the decoding unit 202, and when a person is detected, sends the detected person information to the authentication unit 203. provide.

Next, a process executed by the information processing apparatus 200 based on the detected person information 410 received from the network camera 100 will be described with reference to FIG. FIG. 5 is a flowchart illustrating an example of an unauthorized contact detection process executed by the information processing device 200 in the monitoring system 10 according to the embodiment of the invention.

In the following description, a case will be described where the person detection process is performed by the network camera 100, but the person detection process may also be performed by the information processing device 200 side. In that case, the detected person information 410 may be read as information provided by the person detection processing unit 104 provided in the information processing device 200.

First, in S501, the information processing apparatus 200 acquires a captured image and detected person information 410 from the network camera 100.

In S502, the authentication unit 203 executes person authentication processing. Specifically, the person information 415 included in the acquired detected person information 410 and each examinee information in the examinee information database 310 are compared and the most similar examinee information is identified. For example, if the person information 415 includes a facial image, facial image information (reception image 314) most similar to the facial image is identified from the examinee information database 310.

In S502, characteristic information about the person's clothes, belongings, accessories, etc. obtained from the image can also be used supplementarily. Here, the method of image comparison processing for identifying a person itself is not a feature of the present invention, and any known method can be adopted, so further detailed explanation will be omitted.

In S503, the determination unit 205 compares the position information 413, time information 414, and coordinate information included in the person information 415 included in the plurality of pieces of detected person information 410, respectively. As a result of the comparison, if the respective differences are within a predetermined threshold, it is determined that those people are at the same time and location. Then, the determination unit 205 acquires the examinee information of all the persons determined to be in the same location at the same time (that is, all the persons with whom contact has occurred) from the examinee information database 310 held by the database device 300. .

S503 is an example of an acquisition unit according to the present invention that acquires position information of a plurality of people existing in the predetermined area and information indicating the destination of the people in the predetermined area.

In S504, the determination unit 205 determines whether there are multiple people at the same time and location based on the information acquired in S503. If multiple people are at the same time and location, the process advances to S505. On the other hand, if it is determined that there are no multiple people in the same position at the same time, the process returns to S501 and proceeds to obtain the next captured image and detected person information.

S504 is an example of a specifying means for specifying contact between the persons using the position information in the present invention.

In S505, the determination unit 205 calculates contact time between a plurality of people. Then, the database device 300 is controlled to record the results in the approaching person information 318 and unauthorized contact flag 319 regarding the corresponding person in the examinee information database 310 held by the database device 300.

Details of the contact time calculation and database update processing in S505 will be described later with reference to FIG.

In S506, the determination unit 205 determines whether there is any unauthorized contact. If the determination unit determines that there is a person for whom the unauthorized contact flag 319 has been set in the process of S505, the process proceeds to S507. If there is no person for whom the unauthorized contact flag 319 has been set, the process returns to S501 and proceeds to obtain the next captured image and detected person information.

In S506 and S603, S604, and S606 described later, in the present invention, it is determined whether the contact is an unauthorized contact using information indicating the destination of each person identified by the identifying means as having contacted. This is an example of a determination means.

In S507, the determination unit 205 notifies the notification unit 206 of the information that there has been an unauthorized contact in order to enable subsequent processing, and then returns to S501 to perform processing on the next captured image.

S507 is an example of an output means for outputting the determination result by the determination means in the present invention.

Next, the contact time calculation process and examinee information database update process will be described using FIG. 6.

FIG. 6 is a flowchart illustrating an example of the contact time calculation process and examinee information database update process in S505.

First, in S601, the determination unit 205 selects one person (hereinafter also referred to as a target person) to be subjected to the process of FIG. 6 from among the examinees included in the examinee information database 310.

In S602, the determination unit 205 refers to the approaching person information 318 of the data corresponding to the person selected in S601 in the examinee information database 310 held by the database device 300.

Here, Table 1 shows an example of the approaching person information 318. Each time a certain person A is authenticated in S502 and the process of S503 is executed, approach information about which person the person A approached is recorded.

That is, when the determination unit 205 executes the process of S503, a person who is estimated to be at the same time and at the same location as the person A is recorded in the approach information as a person who approached the person A.

In Table 1, one vertical column under "Authentication timing of person A" indicates one authentication. Table 1 shows that authentication was performed for person A a total of five times, and among these, person B approached person A four times, person C approached person A once, and person D approached person A twice.

In S603, the determination unit 205 determines whether the test venue 316 (destination) of the target person and another person who is close to the target person match.

S603 is a process performed to prevent an unauthorized contact flag 319 from being set in S606, which will be described later, for a person whose test venue 316 matches that of the target person and another person who is approaching. This is because, as long as the test locations 316 match, it is inevitable that the person will come into contact with the target person, and since they will take the test at the same time, even if they do come into contact, the risk of the test questions being leaked is extremely low. .

In S604, the determination unit 205 calculates the integrated value of the time during which the target person and another person who is approaching at that time is considered to have been close based on the approach information 318, and calculates the estimated contact time. do. The calculated value of this estimated contact time may be recorded in the approaching person information 318 of the database as shown in Table 1.

In S605, the determination unit 205 determines whether the calculated estimated contact time is longer than a predetermined threshold (or longer than a predetermined time) for the target person and each other person approaching at the time. If the calculated estimated contact time is longer than a predetermined threshold, the process advances to S606; otherwise, the process advances to S607.

In S606, the determination unit 205 sets a flag indicating unauthorized contact for a person whose estimated contact time with the target person is longer than a predetermined threshold. Specifically, the unauthorized contact flag 319 corresponding to the target person in the examinee information database 310 is set to 1. However, even if the estimated contact time with the target person is longer than a predetermined threshold, the determination unit 205 flags the unauthorized contact flag 319 for a person whose test venue 316 (destination, destination) matches the target person. Do not set to 1.

As another embodiment, even if the target person and the test venue 316 are the same, if the test start times are different, the unauthorized contact flag 319 may be set to 1. By doing so, it is possible to prevent test takers who have completed the test from disclosing the test contents to the next test taker.

In S607, the determination unit 205 determines whether the processes up to S606 have been performed on all authenticated persons. If the processes have been performed on all the authenticated persons, the process proceeds to S608; otherwise, the process returns to S601 and the next step is performed. Proceed to processing for the person.

In S608, the determination unit 205 collates the approaching person information 318 of all the persons processed here, and generates unauthorized contact information indicating a combination of persons whose estimated contact time exceeds a predetermined threshold and can be determined to be an unauthorized contact. . Note that in this process, generation of unauthorized contact information is not essential.

In S609, the determination unit 205 updates the approaching person information 318 in the examinee information database 310 corresponding to the person targeted in S601, based on the processing results of S602 to S606. At this point, the approaching person information 318 corresponding to the person who has approached is updated, and the approaching person information 318 corresponding to the person with no approaching person is updated by adding information that there is no approaching person.

Note that in the present embodiment, the processes in S604 and S605 in the determination unit 205 are not essential processes, and the process in S606 may be executed when there is a person in contact, regardless of the contact time. However, by executing the processes of S604 and S605, it is possible to reduce the possibility that contact will be determined in a case where two or more people simply pass each other.

Further, in this embodiment, the information processing apparatus 200 executes the processing shown in FIGS. 5 and 6, but as another embodiment, some or all of the processing shown in FIGS. may be executed.

Next, a process for displaying information on the person who has made unauthorized contact on the information display device 500 will be described based on the above processing results. FIG. 7 is a flowchart illustrating an example of processing executed by the information processing device 200 in the monitoring system 10 according to the embodiment of the invention.

The process shown in FIG. 7 may be started according to a request from the information display device 500, or may be started at a predetermined timing (for example, every minute). Alternatively, in S507, the determination unit 205 may start the process at the timing when it notifies the notification unit 206 of information that there has been an unauthorized contact.

First, in S701, the notification unit 206 of the information processing device 200 identifies a person whose unauthorized contact flag 319 is set to 1 in the examinee information database 310. Furthermore, by checking the ID 311, examinee number 312, name 313, etc., the security guard can identify the person in question, so the notification unit 206 sends information about the person to the examinee information database via the database management unit 204. These information are acquired from 310.

In S702, the notification unit 206 acquires the reception image 314 of the person identified by the process in S701 or the feature amount calculated from the reception image 314 from the examinee information database 310 via the database management unit 204. . The feature amount may be calculated at the timing when the reception image 314 is photographed and stored in the examinee information database 310, or may be calculated from the reception image 314 each time as necessary.

In S703, the notification unit 206 searches for a person for whom an unauthorized contact flag has been set from the captured image data received from the network cameras 100 installed in the monitoring areas 2 and 3. Here, for example, since the detected person information 410 is transmitted from the network camera 100, the person information 415 included in the detected person information 410 is compared with the feature amount acquired in S702. This makes it possible to specify the captured image data and position of the person for whom the unauthorized contact flag has been set.

In S704, the notification unit 206 converts the information in the examinee information database 310 into information that can be displayed in a superimposed manner at the position specified in S703 of the captured image data of the monitoring areas 2 and 3. The information in the examinee information database 310 includes the ID 311, name 313, examinee number 312, etc. of the person whose unauthorized contact flag 319 is set to 1.

Note that in the case of superimposing the person image 801 on the floor plan of the facility that will be the test venue on the display screen of FIG. Convert it into possible information.

In S705, the notification unit 206 transmits the above-mentioned superimposable information to the information display device 500 together with the captured image data specified in S703. The information display device 500 that has received this information can identify the person (examiner) for whom the unauthorized contact flag has been set in the captured image data transmitted from the notification unit 206 of the information processing device 200. It can be displayed on the screen in a superimposed manner.

Although the processing shown in FIG. 7 is executed by the information processing apparatus 200, the present invention is not limited to this, and the processing shown in FIG. 7 may be performed by the network camera 100.

FIG. 8 is a diagram illustrating an example of a screen display that is transmitted from the notification unit 206 of the information processing device 200 to the information display device 500 and displayed on the information display device 500 in S705.

FIG. 8(A) is an example of a normal screen in which no test taker has been contacted fraudulently.

On the screen 800, information about people in the monitoring areas 2 and 3 is displayed superimposed on a floor plan of a facility serving as a test venue. The superimposition position of the person's information is determined based on the detected person information 410.

The person image 801 may be an icon representing a person, or may be the reception image 314 acquired at the time of reception. For test takers in each examination room A to F, which is monitoring area 3, the examination room will be monitored, so the display method may be different from monitoring area 2 to indicate that the monitoring situation is different. good. For example, as shown in the person image 802, the color of the icon may be made lighter.

The person information display 803 displays information regarding people in the monitoring areas 2 and 3. The person information display 803 displays at least one of the ID 311, examinee number 312, name 313, reception image 314, reception date and time 315, exam venue 316, and exam time information 317 in the examinee information database 310. Alternatively, a method may be adopted in which normally only a small amount of information, such as an ID, is displayed, and detailed information is additionally displayed by performing a predetermined operation such as clicking on an icon.

FIG. 8B is an example of a screen that is transmitted from the notification unit 206 of the information processing device 200 to the information display device 500 and displayed on the information display device 500 in S705, in which a test taker who has made unauthorized contact is detected. This is an example of the screen when

If a person with an ID of 001 and a person with an ID of 011, who have different destinations, come into unauthorized contact, a highlighted display 804 alerts the security guard monitoring the screen. Here, a display surrounding the location of the person who has made unauthorized contact is given as an example, but the method of alerting the security guard is not limited to this. For example, any method may be applied, such as changing the color and shape of the person image 801, displaying text information in an area on the screen (not shown), or issuing a sound warning using a speaker (not shown).

Next, another embodiment of the screen display that is transmitted from the notification unit 206 of the information processing device 200 to the information display device 500 and displayed on the information display device 500 in S705 will be described.

In FIGS. 8(A) and 8(B), information on the location of the person who made unauthorized contact is superimposed on the sketch. On the other hand, in this embodiment, the person for whom the unauthorized contact flag is set is located at the position of the person for whom the unauthorized contact flag is set, which is identified in S703 of the captured image data transmitted from the notification unit 206 of the information processing device 200. information about the examinee) is superimposed and displayed on the screen. Note that the information regarding the person for whom the unauthorized contact flag has been set is the same information as the information displayed on the person information display 803.

By displaying captured image data, security guards can more easily grasp the actual situation at the scene than when displaying a floor plan. Then, the security guard will be able to judge whether or not it was really an unauthorized contact and take appropriate action against the person who made the unauthorized contact.

In addition, as another embodiment, only the information regarding the person may be displayed on the screen without superimposing the information regarding the person at the position of the person to whom the unauthorized contact flag 319 has been set. In that case, in addition to the information displayed on the person information display 803, it is preferable to also display the reception image 314 of the person (examiner) for whom the unauthorized contact flag has been set. By displaying the reception image 314 as well, the security guard can confirm the face of the person for whom the unauthorized contact flag has been set, thereby making it easier to search for the person from the test venue 316.

In addition, although the above-mentioned embodiment described the case where a person is identified based on the image imaged with the network camera 100, the person's identification does not have to rely only on an image. For example, by lending a beacon transmitter at the time of reception at reception 4 and receiving the beacon signal transmitted from the beacon transmitter, the position coordinates of each person can be detected, and whether the position coordinates of multiple people overlap? Unauthorized contact may be identified by However, when using a beacon transmitter, its position coordinates may be slightly shifted, so it is possible to detect unauthorized contact more accurately by using captured image data.

According to the embodiments described above, it is possible to detect and notify contact between examinees who should not originally come into contact with each other at a test venue or the like. Thereby, in the monitoring area, for example, it is possible to provide a mechanism for test takers to come into contact with each other and exchange information, and specifically to prevent leakage of test questions.

(Example 2)
In Example 1, detection of unauthorized contact between test takers at the test venue was explained. Normally, test takers do not have any companions at the test venue, but in this example, a person visiting a facility has a companion and a method for detecting contact with other groups will be described. Note that explanations of contents common to Example 1 will be omitted.

For purposes of explanation, this embodiment deals with a case in which a person visiting an inpatient at a hospital requiring high security is monitored.

A visitor who arrives at the hospital enters the place to visit, visiting time, and his/her name on a reception terminal 400 installed at the reception desk 4, and takes a photograph of the visitor according to instructions from the reception terminal 400. Further, for example, accompanying person information can be input by specifying the ID of the accompanying person who has completed the reception process first. Note that these operations may be performed by, for example, hospital staff operating the reception terminal 400 at the reception desk 4.

FIG. 9 is an example of the visitor information database 320 acquired at the reception and stored in the database device 300. In the visitor information database 320, an ID 321, a destination 322 represented by the name of an inpatient, and a visitor name 323 are registered as visitor information that has been accepted at the reception terminal 400. In addition, a reception image 324 obtained by taking a photo using the reception terminal 400, reception date and time 325, visiting time 326, and companion ID 327 are registered, and approaching person information 328 is used to maintain monitoring information for each visitor. and an unauthorized contact flag 329. Among these, the companion ID 327 is unique to this embodiment, and therefore, the companion ID 327 will be explained below, and the explanation of other items will be omitted.

According to the visitor information database 320 shown in FIG. 9, three people with IDs 0001, 0002, and 0004 are supposed to visit the same destination as companions. Referring to the reception date and time 325, it is considered that the two persons ID0001 and ID0002 had already completed the reception and were waiting for the reception operation of ID0004. For ID0004, the IDs of the two people who accepted the reception earlier are obtained in advance as part of the process of registering companions at the time of reception, and are input at the reception terminal 400. As a result, companion information is added to the companion IDs corresponding to ID0001, 0002, and 0004 in the visitor information database, respectively. To add companion information, if you place even greater emphasis on security, you can have all companions register at the same time, or you can have an unrelated person impersonate your companion by taking a group photo when the final receptionist operates. Risk can be reduced.

The subsequent unauthorized contact detection process is the same as in Example 1, but before the unauthorized contact flag setting process in S606, a process that refers to the companion ID is added, and if the companions are together, it is assumed that the person is the target person. Even if the contact time is longer than a predetermined threshold, an unauthorized contact flag is not set. This makes it possible to avoid erroneously detecting unauthorized contact with a companion.

In this embodiment, a method for preventing false detection of unauthorized contact by providing information about companions to the system at the time of reception is shown. In addition to this, it is also possible to have a mechanism that allows conditions to be excluded from contact detection depending on the structure and situation of the facility being monitored. For example, if you exclude visitors who have the same destination on a given date and time, you can stop unnecessary detection and notifications when many participants go to an event held in a certain corner of the facility. can.

According to the embodiments described above, in facilities such as hospitals that require strict security management, contact between unrelated visitors can be detected and notified. This makes it possible to provide a mechanism to prevent unauthorized exchange of information and goods within the facility, as well as to prevent unnecessary trouble between visitors.

(Other embodiments)
Although the embodiments have been described in detail above, the present invention can be implemented as, for example, a system, an apparatus, a method, a program, or a recording medium (storage medium). Specifically, it may be applied to a system consisting of multiple devices (for example, a host computer, an interface device, an imaging device, a web application, etc.), or it may be applied to a device consisting of a single device. good.

Further, the present invention can also be realized by the following processing. A program that implements one or more of the functions of the embodiments described above is supplied to a system or device via a network or a storage medium. This is a process in which one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

10 Monitoring system 100 Network camera 200 Information processing device 300 Database device 400 Reception terminal 500 Information display device 600 LAN

Claims (11)

An information processing device for monitoring people within a predetermined area,
acquisition means for acquiring, for each of the plurality of persons present in the predetermined area, information indicating the position of the person and information indicating the destination of the person in the predetermined area;
a determining means for determining whether contact has occurred between persons having different destinations, using the information acquired by the acquiring means;
and output means for outputting information that allows identification of the occurrence of the contact when the determination means determines that the contact has occurred. The information processing apparatus according to claim 1, wherein the determining means determines that contact has occurred when a difference in information indicating positions between the persons is within a predetermined range. The determining means determines that contact has occurred when a difference in information indicating positions between the persons is within a predetermined range and the time within the predetermined range is longer than a predetermined time. The information processing device according to claim 2, characterized in that: The information processing apparatus according to any one of claims 1 to 3, wherein the output means outputs a screen on which the contacted person can be identified using information related to the person. 5. The information processing apparatus according to claim 1 , wherein the acquisition means acquires information indicating the position of the person from image data captured by an imaging device. 6. The predetermined area indicates a predetermined facility, and the information indicating the destination is information indicating a room in the predetermined facility. Information processing device. 2. The output means is characterized in that, when contact occurs between persons having the same destination, the output means does not output the information that can identify that contact has occurred between persons having different destinations. 7. The information processing device according to any one of items 1 to 6. An information processing device for monitoring people within a predetermined area,
acquisition means for acquiring, for each of the plurality of persons present in the predetermined area, information indicating the position of the person and information indicating the destination of the person in the predetermined area;
an output means for outputting predetermined information when a difference in information indicating a position between the plurality of persons whose information indicating the destination acquired by the acquisition means differs is equal to or less than a threshold; An information processing device comprising: A method of controlling an information processing device for monitoring a person within a predetermined area, the method comprising:
an acquisition step of acquiring, for each of the plurality of persons present in the predetermined area, information indicating the position of the person and information indicating the destination of the person in the predetermined area;
a determination step of determining whether contact has occurred between persons having different destinations, using the information acquired in the acquisition step;
A method for controlling an information processing apparatus, comprising: an outputting step of outputting information that allows identification of the occurrence of the contact when it is determined in the determination step that the contact has occurred. A method of controlling an information processing device for monitoring a person within a predetermined area, the method comprising:
an acquisition step of acquiring, for each of the plurality of persons existing in the predetermined area, information indicating the position of the person and information indicating the destination of the person in the predetermined area;
an output step of outputting predetermined information when a difference in information indicating a position between the plurality of persons whose information indicating the destination obtained in the obtaining step is different from each other is equal to or less than a threshold; A method for controlling an information processing device, comprising: A program for functioning as an information processing apparatus according to any one of claims 1 to 8.

Images