JPWO2019188928A1 - Monitoring device and control device - Google Patents

Abstract

Monitor the entry of people into the restricted area with a simple configuration. The monitoring device includes an imaging device that captures an image of a space including at least a part of a preset restricted area in the facility. The monitoring device moves the person based on (i) a person detection unit (11) that detects the image of the person represented in the image and (ii) a change in the position of the image of the person with the progress of time in the image. The movement route acquisition unit that acquires the movement route information indicating the route, and (iii) the entrance attribute determination that determines whether or not the above-mentioned person has the regular entrance authority to the restricted area according to the movement route information. Further equipped with a part.

Description

The following disclosure relates to a monitoring device that monitors the movement of a person.
This application claims priority to Japanese Patent Application No. 2018-063040 filed in Japan on March 28, 2018, the contents of which are incorporated herein by reference.

Various techniques have been proposed for monitoring the movement of people. For example, Patent Document 1 discloses a technique for notifying the user that he / she is moving on an erroneous route when he / she detects that the user is moving on a route different from the planned route. ing. Patent Document 2 discloses a technique for detecting the movement of a person (planned passenger) from a check-in counter in an airport to a boarding gate by using an RFID (Radio Frequency Identification) tag. ..

International Publication WO2012 / 093618A1 Japanese Patent Publication No. 2005-173710

One aspect of the present disclosure is to monitor the entry of a person into a preset restricted area in a facility with a simple configuration.

In order to solve the above problems, the monitoring device according to one aspect of the present disclosure is a monitoring device that monitors the entry of a person into a restricted area set in advance in the facility, and is at least one of the restricted areas. Based on the image pickup device that captures the image of the space including the part, the person detection unit that detects the image of the person represented in the image, and the position change of the image of the person with the progress of time in the image. The movement route acquisition unit that acquires the movement route information indicating the movement route of the person, and the movement route information, determine whether or not the person has the regular entrance authority to the restricted area. It is equipped with an entrance attribute judgment unit.

In order to solve the above problem, the control device according to one aspect of the present disclosure is a control device that controls a monitoring device that monitors the entry of a person into a restricted area set in advance in the facility. The monitoring device is provided with an imaging device that captures an image of a space including at least a part of the restricted area, and the control device includes a person detection unit that detects an image of a person represented in the image. Based on the position change of the image of the person with the progress of time in the video, the movement route acquisition unit that acquires the movement route information indicating the movement route of the person, and the person according to the movement route information It is equipped with an admission attribute determination unit that determines whether or not the user has the proper admission authority to the restricted area.

According to the monitoring device according to one aspect of the present disclosure, the entry of a person into the restricted area can be monitored by a simple configuration. Further, the same effect can be obtained by the control device according to one aspect of the present disclosure.

It is a functional block diagram which shows the structure of the main part of the monitoring apparatus of Embodiment 1. FIG. It is a figure which shows the outline of the facility to which the monitoring device of FIG. 1 is applied. It is a figure for demonstrating the process of the monitoring apparatus of FIG. It is a figure which shows an example of the output video in the monitoring apparatus of FIG. It is a functional block diagram which shows the structure of the main part of the monitoring apparatus of Embodiment 2. It is a figure for demonstrating the process of the monitoring apparatus 2 of FIG. It is a functional block diagram which shows the structure of the main part of the monitoring apparatus of Embodiment 3. It is a figure for demonstrating the process of the monitoring apparatus 3. It is a figure which shows the outline of the monitoring apparatus 4 of Embodiment 4.

[Embodiment 1]
Hereinafter, the monitoring device 1 of the first embodiment will be described. For convenience of explanation, the members having the same functions as the members described in the first embodiment are designated by the same reference numerals in the following embodiments, and the description thereof will not be repeated.

(Outline of facilities to which monitoring device 1 is applied)
FIG. 1 is a functional block diagram showing a configuration of a main part of the monitoring device 1. The monitoring device 1 monitors the entry of a person into a restricted area (example: restricted area A2 described below) set in advance in the facility. The monitoring device according to one aspect of the present disclosure may be referred to as a monitoring system.

The monitoring device 1 includes a control device 10, an imaging device 80, and a notification device 81. The control device 10 comprehensively controls each part of the monitoring device 1. The control device 10 includes a person detection unit 11, a movement route acquisition unit 12, and an entrance attribute determination unit 13. An example of the operation of the monitoring device 1 will be described later.

FIG. 2 is a diagram showing an outline of a facility to which the monitoring device 1 is applied. The space inside the facility is divided into an area where people are not restricted (hereinafter, unrestricted area A1) and an area where people are restricted (hereinafter, restricted area A2). In the first embodiment, the case where the facility is an airport is illustrated. The restricted area A2 is, for example, the departure lobby of an airport. The entire restricted area A2 is imaged by the image pickup apparatus 80. The non-restricted area A1 is a space excluding the restricted area A2 in the entire space in the facility.

The facilities according to one aspect of the present disclosure are not limited to airports. The facility may be any facility in which admission from the unrestricted area A1 to the restricted area A2 is restricted by the gate G (admission restriction unit) described below. Another example of the facility may be, for example, a concert venue or a stadium.

A gate G is provided at the boundary between the unrestricted area A1 and the restricted area A2. As an example, Gate G is a security gate provided at a security checkpoint in an airport. In the first embodiment, for the sake of simplicity, it is assumed that the gate G is the only entrance for regular entry from the unrestricted area A1 into the restricted area A2. At the security checkpoint, among the persons in the unrestricted area A1, the person (passenger) who holds the boarding ticket for the airplane is allowed to pass through the gate G by the airport staff. At the security checkpoint, the baggage inspection of passengers passing through Gate G is carried out by airport staff.

As described above, the regular entrance route from the unrestricted area A1 to the restricted area A2 is set as a route passing through the gate G. Therefore, only a person who has the proper admission authority to enter the restricted area A2 (the person who owns the boarding ticket of the airplane) passes through the gate G and enters the restricted area A2 from the unrestricted area A1. it can.

Hereinafter, a person who has the proper admission authority to the restricted area A2 will be referred to as an admission qualified person. A person eligible for admission can also be expressed as a person who is officially permitted to enter the restricted area A2. In FIG. 2, a person eligible for admission is represented as a person MA. Further, the movement route of the person MA in the restricted area A2 is represented as TRA. The movement path may be referred to as a locus. As described above, the person MA passes through the gate G and enters the restricted area A2 from the unrestricted area A1. Therefore, the starting point of the TRA ideally coincides with the position of the gate G.

However, it is not always the case that only qualified persons can enter the restricted area A2. Hereinafter, a person who does not have the proper admission authority to the restricted area A2 will be referred to as an admission ineligible person. A person who is not eligible for admission can also be expressed as a person who is not officially permitted to enter the restricted area A2 (unlicensed visitor). In FIG. 2, a person who is not eligible for admission is represented as a person MB. Further, the movement route of the person MB in the restricted area A2 is represented as TRB.

As an example, an admission ineligible person is a person who accidentally enters the restricted area A2 even though he / she does not have the proper admission authority to the restricted area A2. For example, consider a case where a staircase ST is provided in the restricted area A2. It is assumed that the staircase ST is sufficiently separated from the gate G. It is assumed by the airport manager that the stairs ST will be used as a one-way route (eg downstairs) to get out of the restricted area A2 to the outside of the restricted area A2 (eg baggage claim). ing. Therefore, in the vicinity of the stairs ST, a sign indicating that entry into the restricted area A2 from the outside of the restricted area A2 is prohibited is posted.

However, there is a possibility that a person who overlooks this sign (eg, the person MB in FIG. 2) climbs the stairs ST and enters the restricted area A2 from the outside of the restricted area A2. That is, the person MB reverses the above-mentioned one-way route and invades the restricted area A2. In this case, the starting point of TRB is the position of the stairs ST. That is, the starting point of the TRB does not coincide with the position of the gate G.

As another example, an admission ineligible person is a person who has illegally entered the restricted area A2 even though he / she does not have the proper admission authority to the restricted area A2. For example, security guards are deployed in the airport to prevent erroneous entry or unauthorized entry into the restricted area A2. However, it is conceivable that an unqualified person may illegally enter the restricted area A2 by climbing the stairs ST, for example, by passing through the surveillance of the guards.

If an ineligible person enters the restricted area A2, it is suspected that items that have not undergone baggage inspection may be brought in by the ineligible person. Therefore, if it is found that a person who is not eligible for admission has entered the restricted area A2, it is necessary to carry out a baggage inspection for each person in the restricted area A2 from the viewpoint of security. In other words, it is necessary to perform the baggage inspection again even for an admission-qualified person who has already undergone the baggage inspection.

In order to avoid the above troubles, it is preferable to more reliably prevent an unqualified person from entering the restricted area A2. The inventors of the present application (hereinafter referred to as the inventors) have newly conceived the monitoring device 1 as a specific configuration for preventing an unqualified person from entering the restricted area A2.

(Example of operation of monitoring device 1)
FIG. 3 is a diagram for explaining the processing of the monitoring device 1. As an example, the imaging device 80 is a known surveillance camera. The image pickup apparatus 80 images at least a part of the restricted area A2. More specifically, the image pickup apparatus 80 captures an image (moving image) of a space including at least a part of the restricted area A2.

In the first embodiment, for the sake of simplicity, the imaging device 80 shall constantly image the entire restricted area A2. Therefore, the image pickup apparatus 80 can constantly image a person passing through the gate G and the stairs ST. Hereinafter, the image captured by the image pickup apparatus 80 is also referred to as an input image. FIG. 3 schematically shows an input image. In the input video, an image of one or more persons existing in the restricted area A2 is expressed.

In the example of FIG. 3, the input video includes images of a plurality of people (example: 5 people). Hereinafter, it is assumed that four of the five persons are eligible for admission (person MA) and one is an unqualified person for admission (person MB). In order to distinguish each qualified person for admission, the four person MAs are referred to as persons MA1 to MA4, respectively. Further, the movement paths (TRA) of the persons MA1 to MA4 are referred to as TRA1 to TRA4, respectively. As described above, the respective start points of TRA1 to TRA4 ideally coincide with the position of the gate G.

The person detection unit 11 acquires an input image from the image pickup device 80. The person detection unit 11 detects the image of each person represented in the input video by analyzing the input video. In the example of FIG. 3, the person detection unit 11 detects images of five people (persons MA1 to MA4 and person MB) represented in the input video.

As a method for causing the person detection unit 11 to detect an image of each person, a known moving object detection algorithm, a humanoid shape / pattern detection algorithm, or a gait detection algorithm may be used. Alternatively, the person detection unit 11 can detect an image of each person by using a classifier (discriminator) generated by machine learning (eg, deep learning).

According to the person detection unit 11, each person in the input video can be distinguished without using face authentication (a personal identification method having a high calculation cost). That is, the person detection unit 11 can distinguish each person in the input video with a relatively low calculation cost.

The movement route acquisition unit 12 acquires information (movement route information) indicating the movement route of each person based on the position change of the image of the person with the progress of time in the input video. For example, in each frame constituting the input video, the position of an arbitrary point is indicated by two-dimensional coordinates (xy coordinates). The movement route acquisition unit 12 tracks (tracks) an image of a certain person (eg, person MA1) between adjacent frames of the input video by using a known method. Then, the movement route acquisition unit 12 acquires the coordinates of a point (representative point of the person MA1) indicating the position of the image of the person MA1 in one frame of the input video.

The movement route acquisition unit 12 acquires the position of the representative point of the image of the person MA1 in each frame (that is, each time) of the input video. The movement route acquisition unit 12 acquires data indicating the position of the representative point of the image of the person MA1 at each time as the movement route information of the person MA1. The movement route information of the person MA1 indicates the transition of the position of the representative point of the image of the person MA1 with the passage of time. Therefore, the movement route information of the person MA1 indicates TRA1. Similarly, the movement route acquisition unit 12 acquires the movement route information of each of the person MA2 to MA4 and the person MB.

The admission attribute determination unit 13 determines whether or not each person is an admission qualified person according to the movement route of each person. Specifically, the admission attribute determination unit 13 generates admission attribute information indicating whether or not each person is an admission qualified person according to the movement route information of each person. Then, the entrance attribute determination unit 13 sets the generated entrance attribute information in association with each person. Hereinafter, the admission attribute information indicating that a certain person is an admission qualified person is referred to as the first admission attribute information. On the other hand, the admission attribute information indicating that a certain person is not an admission qualified person (a person who is not admitted qualified) is referred to as a second admission attribute information.

As an example, the entrance attribute determination unit 13 refers to the movement route information of a certain person, and determines whether or not it is indicated that the certain person has passed through the gate G and entered the restricted area A2. For example, in the admission attribute determination unit 13, in the above-mentioned two-dimensional coordinates, the start point of the movement path indicated by the start point of the movement path (hereinafter, the start point of the movement path) indicates the position of the gate G (hereinafter, the regular entrance point). To determine if it matches.

When the movement route start point coincides with the regular entrance point, the entrance attribute determination unit 13 may determine that the person corresponding to the movement route is an admission qualified person. In this case, it can be said that the movement route information indicating the movement route indicates that the person has passed through the gate G and entered the restricted area A2.

For example, the entrance attribute determination unit 13 refers to the movement route information of the person MA1. As shown in FIG. 3, the movement path start point of TRA1 coincides with the regular entrance point. Therefore, the admission attribute determination unit 13 determines that the person MA1 is an admission qualified person. That is, the admission attribute determination unit 13 sets the first admission attribute information in association with the person MA1.

However, in the input video, the moment when the person MA1 passes through the gate G is not always captured. Based on this point, even if the start point of the movement route of the TRA1 does not match the regular entrance point, the person MA1 may be determined to be an admission qualified person.

As an example, the entrance attribute determination unit 13 determines that the distance (hereinafter, d) between the movement path start point of TRA1 and the normal entrance point (hereinafter, d) is equal to or less than a predetermined distance threshold (hereinafter, dth) in the above-mentioned two-dimensional coordinates. It may be determined that the person MA1 is an admission qualified person. That is, the admission attribute determination unit 13 may determine that the person MA1 is an admission qualified person when d ≦ dth.

Even when d is a sufficiently small non-zero value, the movement route information indicating TRA1 is a person, as in the case of d = 0 (that is, when the movement route start point of TRA1 matches the regular entrance point). This is because it can be said that it indicates that MA1 has passed through the gate G and entered the restricted area A2. The dth may be set sufficiently smaller than the distance between the normal entry point and the point indicating the position of the stairs ST (hereinafter, ineligible entry point) in the above-mentioned two-dimensional coordinates.

Similarly, the admission attribute determination unit 13 refers to the movement route information of the persons MA2 to MA4, respectively. As shown in FIG. 3, the start points of the respective movement routes of TRA2 to TRA4 also coincide with the regular entrance points. Therefore, the admission attribute determination unit 13 determines that the persons MA2 to MA4 are eligible for admission, as in the case of the person MA1. That is, the entrance attribute determination unit 13 sets the first entrance attribute information in association with each of the persons MA2 to MA4.

On the other hand, when d> dth in the above-mentioned two-dimensional coordinates, the admission attribute determination unit 13 may determine that the person corresponding to the movement route is an admission ineligible person. In this case, it can be said that the movement route information indicates that the person has entered the restricted area A2 without passing through the gate G.

As an example, the entrance attribute determination unit 13 refers to the movement route information of the person MB. As shown in FIG. 3, the TRB travel path start point coincides with the ineligible entry point. That is, the starting point of the TRB movement route is sufficiently separated from the regular entrance point. In this case, since d> dth, the admission attribute determination unit 13 determines that the person MB is an admission ineligible person. That is, the entrance attribute determination unit 13 sets the second entrance attribute information in association with the person MB.

The notification device 81 notifies various information (example: predetermined information). As an example, the notification device 81 is notified that a person determined to be ineligible for admission by the admission attribute determination unit 13 (that is, a person for which the second admission attribute information is set) has entered the restricted area A2. be able to. In the case of the example of FIG. 3, the entrance attribute determination unit 13 gives a command to the notification device 81 to notify the notification device 81 that the person MB is an unqualified person for admission.

In the first embodiment, the notification device 81 includes a display device capable of displaying an image. In this case, the notification device 81 can visually notify that the person MB is an unqualified person for admission. In the following example, a case where the control device 10 (example: entrance attribute determination unit 13) is provided with a function (function as an image processing unit) for processing an input image is illustrated. However, a video processing unit may be provided in the notification device 81 (display device).

As an example, the entrance attribute determination unit 13 generates an output video (hereinafter, first output video) by processing the input video based on the second entrance attribute information. Then, the entrance attribute determination unit 13 supplies the output video to the notification device 81, and causes the notification device 81 to display the output video. By displaying the first output video, the notification device 81 visually notifies that the person MB is an unqualified person for admission.

FIG. 4 is a diagram showing an example of the first output video. The entrance attribute determination unit 13 may generate the first output video by adding a mark (object) (MARK1 in FIG. 4) surrounding the image of the person MB to the input video. A user (eg, an airport employee) who sees the first output video displayed on the notification device 81 can visually recognize that the person MB with MARK1 is an admission ineligible person.

Further, the entrance attribute determination unit 13 may generate the first output video by adding a message (MES1 in FIG. 4) to the input video. In the example of FIG. 4, MES1 is the character "an unauthorized visitor exists". MES1 may be any one that suggests that the person MB is a person who is not eligible for admission. The MES1 is preferably arranged in the vicinity of the image of the person MB.

The admission attribute determination unit 13 may aurally notify the notification device 81 that the person MB is an unqualified person for admission. For example, the notification device 81 may include a speaker. In this case, the entrance attribute determination unit 13 may make the speaker speak the above-mentioned message MES1 as voice by supplying the second entrance attribute information to the notification device 81. Alternatively, the entrance attribute determination unit 13 may output the alarm sound to the speaker by supplying the second entrance attribute information to the notification device 81.

Further, the notification device 81 may include a communication device capable of communicating with a communication terminal carried by the airport staff. In this case, the entrance attribute determination unit 13 may cause the communication device to transmit the above-mentioned message MES1 to the communication terminal of the airport staff by supplying the second entrance attribute information to the notification device 81.

(effect)
According to the monitoring device 1, it is possible to determine whether or not each person is a qualified person for admission according to the movement route of each person who has entered the restricted area A2. Therefore, it is possible to prevent an unqualified person from entering the restricted area A2 without introducing an additional device such as an RFID tag. That is, it is possible to monitor the entry of a person into the restricted area A2 with a simple configuration.

In particular, since the monitoring device 1 can make a determination according to the movement route of each person, for example, a person who has invaded the restricted area A2 by reversing the above-mentioned one-way route (person who is not eligible for admission). , Can be identified effectively.

Further, in the monitoring device 1, when it is determined that the person MB (person who is not eligible for admission) has invaded (entered) the restricted area, the notification device 81 can be notified to that effect. Therefore, when it is found that the person MB has invaded the restricted area A2, the airport staff can promptly take measures for ensuring safety (eg, the airport staff calls out to the person MB). ..

Further, since the image of the person MB is included in the input video and the output video, it is easy for the airport staff to identify the appearance of the person MB. Further, the airport staff can be made to recognize the approximate position of the person MB in the restricted area A2. The same applies to the person MA1 (person who stays for a long time or a person who is recommended to leave) described in the following embodiments 2 and 3.

[Embodiment 2]
FIG. 5 is a functional block diagram showing a configuration of a main part of the monitoring device 2 of the second embodiment. The monitoring device 2 further includes a timer 82. The timer 82 measures the current time (current time) (hereinafter referred to as "now"). The timer 82 can supply the current time information indicating the current time to the control device (hereinafter, control device 20) of the monitoring device 2. The movement route acquisition unit of the control device 20 is referred to as a movement route acquisition unit 22. Unlike the control device 10, the control device 20 further includes a stay determination unit 24. The timer 82 may be realized by the timer function in the control device 20.

The movement route acquisition unit 22 acquires entrance time information indicating the time (entrance time) (hereinafter referred to as tin) when each qualified person has passed through the gate G and entered the restricted area A2. The admission time can also be expressed as the time when a qualified person is allowed to enter the restricted area A2.

As an example, the movement route information of a person is recorded as a data series indicating the position of a representative point of the image of the person at each time. The movement route acquisition unit 22 acquires the initial time (the earliest time among each time included in the data series) in the data series indicating the movement route information of the person eligible for admission as the admission time. The admission time information indicates the admission time. The movement route acquisition unit 22 supplies the entrance time information to the stay determination unit 24. The stay determination unit 24 may also have a function of acquiring admission time information.

The stay determination unit 24 determines the stay state of each person in the restricted area A2. Specifically, the stay determination unit 24 determines whether or not each person is a person who stays for a long time (described later). The stay determination unit 24 acquires the current time information from the timer 82 and the entrance time information from the movement route acquisition unit 22. Based on the current time information and the admission time information, the stay determination unit 24 determines the time (stay time) during which the admission qualified person (the person for which the first admission attribute information is set) stays in the restricted area A2 (hereinafter, Ts) is calculated.

As an example, the stay determination unit 24 calculates the staying time of an admission-qualified person with Ts = tnow-tin. The calculation of Ts by the stay determination unit 24 may be executed after the entrance attribute determination unit 13 determines the person eligible for admission. Then, the stay determination unit 24 determines whether or not the stay time is longer than the predetermined first time (hereinafter, Tth1). That is, the stay determination unit 24 determines whether or not Ts> Tth1.

FIG. 6 is a diagram for explaining the processing of the monitoring device 2. FIG. 6 also shows an example of the output video (second output video) according to the second embodiment. In the example of FIG. 6, Tth1 is set as 2 hours. In FIG. 6, it is assumed that only the person MA1 among the four persons eligible for admission (persons MA1 to MA4) stays in the restricted area A2 for a longer time than Tth1.

Hereinafter, among the persons eligible for admission, a person who stays in the restricted area A2 for a longer time than Tth1 is also referred to as a person who stays for a long time. In FIG. 6, for convenience, only the person MA1 (person who stays for a long time) among the persons MA1 to MA4 is coded. Further, in FIG. 6, since the person who is not eligible for admission (person MB) is not related, the illustration is omitted. This point also applies to the subsequent drawings. In the following description, unless otherwise stated, "person" shall mean "eligible person for admission."

The stay determination unit 24 determines whether or not each person is a long-stay person by comparing the magnitude of Ts and Tth1. Specifically, the stay determination unit 24 generates stay time attribute information indicating whether or not each person is a long-stay person according to the result of magnitude comparison between Ts and Tth1. Then, the stay determination unit 24 sets the generated stay time attribute information in association with each person. Hereinafter, the staying time attribute information indicating that a certain person is a long-staying person will be referred to as the first staying time attribute information. On the other hand, the attribute information indicating that a certain person is not a long-staying person (a non-long-staying person) is referred to as a second staying time attribute information.

When Ts> Tth1, the stay determination unit 24 determines that the person with the stay time Ts is the person who stays for a long time. In the example of FIG. 6, the stay determination unit 24 determines that the person MA1 is a person who stays for a long time. That is, the stay determination unit 24 sets the first stay time attribute information in association with the person MA1.

On the other hand, when Ts ≦ Tth1, the stay determination unit 24 determines that the person with the stay time Ts is a non-long-term stay person. In the example of FIG. 6, the stay determination unit 24 determines that the persons MA2 to MA4 are non-long-term stay persons. That is, the stay determination unit 24 sets the second stay time attribute information in association with each of the persons MA2 to MA4.

In the second embodiment, the notification device 81 can be notified that the person staying for a long time exists in the restricted area A2. That is, it is possible to notify the notification device 81 that the person eligible for admission stays in the restricted area A2 for a longer time than Ts1.

In the case of the example of FIG. 6, the stay determination unit 24 gives a command to the notification device 81 to notify the notification device 81 that the person MA1 is a person staying for a long time. As an example, the stay determination unit 24 generates an output video (hereinafter referred to as a second output video) by processing the input video based on the first stay time attribute information. The stay determination unit 24 supplies the second output video to the notification device 81, and causes the notification device 81 to display the second output video. By displaying the second output video, the notification device 81 visually notifies that the person MA1 is a person staying for a long time.

For example, the stay determination unit 24 may generate the second output video by adding a mark (MARK2 in FIG. 6) surrounding the image of the person MA1 to the input video. The user who sees the second output video displayed on the notification device 81 can visually recognize that the person MA1 with MARK2 is a person who stays for a long time. MARK2 is preferably a mark having a different appearance from MARK1.

Further, the stay determination unit 24 may generate the second output video by adding the message MES2 to the input video. In the example of FIG. 6, the message MES2 is the character "staying for more than 2 hours from the admission time". The message MES2 may be any one suggesting that the person MA1 is a person who stays for a long time. The message MES2 is preferably arranged in the vicinity of the image of the person MA1.

Generally, an admission-eligible person staying in restricted area A2 (eg, the departure lobby of an airport) is considered to be waiting to board the scheduled flight. Therefore, it is considered unnatural for a person eligible for admission to stay in the restricted area A2 for an unnecessarily long time. In such a case, for example, it is presumed that the person who stays for a long time is an admission-qualified person who is in a state of being unable to move due to poor physical condition. Alternatively, it is presumed that the person who stays for a long time is an admission-qualified person who intentionally stays in the restricted area A2 for a long time in an attempt to attempt some kind of crime.

From the above, it can be said that among the four people eligible for admission, the person MA1 (person who stays for a long time) is a person who needs more attention than the people MA2 to MA4 (person who stays for a long time). Based on this point, the monitoring device 2 is configured so that the person MA1 can be identified by the stay determination unit 24. Further, according to the monitoring device 2, the notification device 81 can be notified that the person MA1 exists in the restricted area A2.

Therefore, when it is found that the person MA1 exists in the restricted area A2, the airport staff is promptly taken measures for ensuring safety (eg, the airport staff actively monitors the person MA1). be able to.

[Embodiment 3]
FIG. 7 is a functional block diagram showing a configuration of a main part of the monitoring device 3 of the third embodiment. The control device of the monitoring device 3 is referred to as a control device 30. The control device 30 has a configuration in which (i) a scheduled exit time acquisition unit 35 is added to the control device 20, and (ii) a stay determination unit 24 is replaced with an exit recommendation determination unit 36.

The scheduled exit time acquisition unit 35 acquires scheduled exit time information indicating the scheduled exit time (scheduled exit time) (hereinafter, tout) of the person eligible for admission from the restricted area A2. For example, consider a case where a boarding ticket owned by a person eligible for admission is read at the entrance gate G together with a baggage inspection. It is assumed that various information related to the boarding flight is recorded in advance on the boarding ticket, for example, by a two-dimensional bar code. In particular, it is assumed that the boarding ticket contains information (scheduled departure time information) indicating the scheduled departure time of the boarding flight.

At the entrance gate G, various information recorded on the boarding ticket is read by a barcode reader (not shown) owned by the airport staff. The scheduled departure time acquisition unit 35 acquires the scheduled departure time information read by the barcode reader via the communication network (not shown) in the airport. Then, the scheduled exit time acquisition unit 35 sets the scheduled exit time information (scheduled exit time) based on the scheduled departure time information (scheduled departure time).

In the third embodiment, the scheduled exit time acquisition unit 35 sets the scheduled departure time as a time equal to the scheduled exit time. However, the scheduled exit time acquisition unit 35 may set a time prior to the scheduled departure time by a predetermined time (example: 15 minutes) as the scheduled exit time. In this case, the margin for the scheduled departure time can be considered. The scheduled exit time acquisition unit 35 supplies the scheduled exit time information to the exit recommendation determination unit 36. The exit recommendation determination unit 36 may also have the function of the scheduled exit time acquisition unit 35.

The exit recommendation determination unit 36 determines the exit recommendation state of each person in the restricted area A2. Specifically, the exit recommendation determination unit 36 determines whether or not each person is an exit recommended person (described later). The exit recommendation determination unit 36 acquires the current time information from the timer 82 and the scheduled exit time information from the scheduled exit time acquisition unit 35. The stay determination unit 24 calculates the remaining time (hereinafter, Tr) that a qualified person can stay in the restricted area A2 based on the current time information and the scheduled exit time information.

As an example, the exit recommendation determination unit 36 calculates the remaining time of an admission-eligible person with Tr = tout-tonow. The calculation of Tr by the exit recommendation determination unit 36 may be executed after the entrance attribute determination unit 13 determines the person eligible for entry. Then, the exit recommendation determination unit 36 determines whether or not the remaining time is shorter than the predetermined second time (hereinafter, Tth2). That is, the stay determination unit 24 determines whether or not Tr <Tth2.

FIG. 8 is a diagram for explaining the processing of the monitoring device 3. FIG. 8 also shows an example of the output video (third output video) according to the third embodiment. In the example of FIG. 8, Tth2 is set to 20 minutes. In FIG. 8, it is assumed that only the person MA1 among the four persons eligible for admission (persons MA1 to MA4) is staying in the restricted area A2 with the remaining time shorter than Tth2. Hereinafter, among the persons eligible for admission, those who are staying in the restricted area A2 with the remaining time shorter than Tth2 are also referred to as the recommended exit persons. In FIG. 8, for convenience, only the person MA1 (recommended person to leave) is assigned a reference among the persons MA1 to MA4.

The exit recommendation determination unit 36 determines whether or not each person is an exit recommendation person by comparing the magnitude of Tr and Tth2. Specifically, the exit recommendation determination unit 36 generates remaining time attribute information indicating whether or not each person is an exit recommended person, according to the result of magnitude comparison between Tr and Tth2. Then, the exit recommendation determination unit 36 sets the generated remaining time attribute information in association with each person. Hereinafter, the remaining time attribute information indicating that a certain person is a recommended person to leave is referred to as the first remaining time attribute information. On the other hand, the attribute information indicating that a certain person is not a recommended person to leave (a non-long-term recommended person to leave) is referred to as a second remaining time attribute information.

When Tr <Tth2, the exit recommendation determination unit 36 determines that the person with the remaining time Tr is the exit recommendation person. In the example of FIG. 8, the exit recommendation determination unit 36 determines that the person MA1 is the exit recommendation person. That is, the exit recommendation determination unit 36 sets the first remaining time attribute information in association with the person MA1.

On the other hand, when Tr ≧ Tth2, the exit recommendation determination unit 36 determines that the person with the remaining time Tr is the non-exit recommendation person. In the example of FIG. 8, the exit recommendation determination unit 36 determines that the persons MA2 to MA4 are non-exit recommended persons. That is, the exit recommendation determination unit 36 sets the second remaining time attribute information in association with each of the persons MA2 to MA4.

In the third embodiment, the notification device 81 can be notified that the exit recommended person (that is, the person for which the first remaining time attribute information is set) exists in the restricted area A2. That is, it is possible to notify the notification device 81 that the person eligible for admission is staying in the restricted area A2 with the remaining time Tr shorter than Tth2.

In the case of the example of FIG. 8, the exit recommendation determination unit 36 gives a command to the notification device 81 to notify the notification device 81 that the person MA1 is the exit recommendation person. As an example, the exit recommendation determination unit 36 generates an output video (hereinafter, a third output video) by processing the input video based on the first remaining time attribute information. The exit recommendation determination unit 36 supplies the output video to the notification device 81, and causes the notification device 81 to display the third output video. The notification device 81 visually notifies that the person MA1 is the recommended person to leave by displaying the third output video.

For example, the exit recommendation determination unit 36 may generate the third output video by adding a mark (MARK 3 in FIG. 8) surrounding the image of the person MA to the input video. The user who sees the third output video displayed on the notification device 81 can visually recognize that the person MA1 with MARK3 is the recommended person to leave. MARK3 is preferably a mark having a different appearance from MARK1 and MARK2.

Further, the exit recommendation determination unit 36 may generate a third output video by adding a message (MES3 in FIG. 8) to the input video. In the example of FIG. 8, MES3 is the character "less than 20 minutes remaining until the departure of the scheduled flight". The message MES3 may be any one suggesting that the person MA1 is a recommended person to leave. The message MES3 is preferably arranged in the vicinity of the image of the person MA1.

Generally, an admission-eligible person staying in the restricted area A2 (eg, the departure lobby of the airport) will board the scheduled flight with some margin for the scheduled departure time (exit from the restricted area A2). )it is conceivable that. Therefore, it is considered unnatural that a person eligible for admission stays in the restricted area A2 even though the remaining time is shorter than Tth2.

In such a case, for example, it is possible that the above-mentioned person eligible for admission (that is, the person recommended to leave) has forgotten to board the scheduled flight. Alternatively, it is possible that the person who recommends leaving the aircraft intends to board the scheduled flight, but cannot find the correct boarding gate and is lost in the restricted area A2.

Generally, at airports, announcements are made to alert non-passengers. However, the announcement is for all prospective passengers. In addition to the announcement, an announcement may be made to notify other information. Therefore, it can be said that the announcement does not necessarily have a strong appeal to individual prospective boarders.

From the above, it can be said that among the four eligible persons for admission, the person MA1 (recommended person to leave) is a person who needs more attention than the persons MA2 to MA4 (person recommended to leave). Based on this point, the monitoring device 3 is configured so that the person MA1 can be identified by the exit recommendation determination unit 36. Further, according to the monitoring device 3, the notification device 81 can be notified that the person MA1 exists in the restricted area A2.

Therefore, when it is found that the person MA1 exists in the restricted area A2, the airport staff is to promptly board the person MA1 on the scheduled flight (to leave the person MA1 from the restricted area A2). You can take measures. For example, the airport staff can speak to the person MA1 and guide the person MA1 to the correct boarding gate. Therefore, it is possible to prevent the prospective boarder from being late for the scheduled flight. As a result, it is possible to prevent the occurrence of various troubles (eg, delay in departure of the scheduled flight, economic loss of the late boarding passenger) associated with the missed flight.

[Modification example]
It is possible that the scheduled departure time of the aircraft will be changed from the time previously recorded on the boarding ticket. For example, due to bad weather or other circumstances, the scheduled departure time of the aircraft may be delayed compared to the time recorded in advance on the boarding ticket.

Therefore, the scheduled departure time acquisition unit 35 may acquire the scheduled departure time information from, for example, a server (not shown) in the airport. The server can update the scheduled departure time information based on the latest flight schedule. In this case, the monitoring device 3 can determine whether or not there is a recommended person to leave, reflecting the change in the scheduled departure time.

Alternatively, internet sites may provide data showing the latest flight schedules for each aircraft. In this case, the scheduled departure time acquisition unit 35 may acquire the scheduled departure time information from the Internet site.

[Embodiment 4]
FIG. 9 is a diagram showing an outline of the monitoring device 4 of the fourth embodiment. Unlike the monitoring device 1, the monitoring device 4 includes a plurality of (example: two) imaging devices. The two imaging devices included in the monitoring device 4 are referred to as imaging devices 80a and 80b. In the fourth embodiment, the image pickup devices 80a and 80b play a role as one image pickup unit as a whole.

The restricted area of the fourth embodiment is referred to as a restricted area A3. A structure 900 is provided in the restricted area A3. In this respect, the restricted area A3 is different from the restricted area A2, and the structure 900 is, for example, a pillar or a wall. When the restricted area A3 is imaged by the image pickup device 80 (one image pickup device) of the first embodiment, the structure 900 may cause a blind spot of the image pickup device 80.

For example, in the example of FIG. 9, the person MA2 is moving behind the structure 900. Therefore, when the restricted area A3 is imaged by one imaging device 80, the person MA2 cannot be imaged during the period when the person MA2 passes behind the structure 900. Therefore, the movement route information indicating TRA2 cannot be properly acquired.

Therefore, in the monitoring device 4, the restricted area A3 is imaged by the two imaging devices 80a and 80b. The image pickup devices 80a and 80b are arranged so as to supplement each other's blind spots. For example, when the imaging device 80a is arranged so as to perform imaging from the front side of the structure 900, the imaging device 80b is arranged so as to perform imaging from the back side (opposite side to the front side) of the structure 900. Has been done. In other words, at least a part of the space imaged by each of the two imaging devices 80a and 80b is different from each other.

Hereinafter, the image captured by the imaging device 80a will be referred to as a first sub-input image, and the image captured by the imaging device 80b will be referred to as a second sub-input image. Both the first sub-input video and the second sub-input video are images in which at least a part of the restricted area A3 is captured. It is preferable that both the first sub-input video and the second sub-input video are at least images in which the gate G is constantly captured.

In the fourth embodiment, an image in which the first sub-input image and the second sub-input image are combined (example: an image in which the first sub-input image and the second sub-input image are overlapped) is used as the input image. To. As an example, in the monitoring device 4, the control device 10 combines the first sub-input video and the second sub-input video to generate an input video. Then, the control device 10 performs the same processing as in the first embodiment on the generated input video.

In this way, the monitoring device 4 may combine a plurality of sub-input images captured by the plurality of imaging devices to generate one input image as a whole. As a result, the movement route information of each person can be appropriately acquired even in the restricted area A3 in which the structure 900 is provided. Therefore, each person can be monitored more reliably.

[Example of realization by software]
The control blocks (particularly control devices 10 to 30) of the monitoring devices 1 to 4 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software. ..

In the latter case, the monitoring devices 1 to 4 include a computer that executes a program instruction, which is software that realizes each function. The computer includes, for example, at least one processor (control device) and at least one computer-readable recording medium that stores the program. Then, in the computer, the processor reads the program from the recording medium and executes it, thereby achieving the object of one aspect of the present disclosure. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, in addition to a "non-temporary tangible medium" such as a ROM (Read Only Memory), a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, a RAM (Random Access Memory) for expanding the above program may be further provided. Further, the program may be supplied to the computer via an arbitrary transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. It should be noted that one aspect of the present disclosure can also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.

[Additional notes]
One aspect of the present disclosure is not limited to each of the above-described embodiments, and various modifications can be made within the scope of the claims, and the technical means disclosed in each of the different embodiments can be appropriately combined. Such embodiments are also included in the technical scope of one aspect of the present disclosure. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment.

Claims (7)

A monitoring device that monitors the entry of people into a restricted area set in advance in the facility.
An imaging device that captures images of a space that includes at least a part of the restricted area,
A person detection unit that detects the image of the person represented in the above image,
A movement route acquisition unit that acquires movement route information indicating the movement route of the person based on the position change of the image of the person with the progress of time in the video.
A monitoring device including an admission attribute determination unit that determines whether or not the person has a regular admission authority to enter the restricted area according to the movement route information. The regular entry route to the restricted area is set as a route that passes through the entrance restriction section provided in the facility.
The above admission attribute judgment unit
If the movement route information indicates that the person has passed through the restricted area and entered the restricted area, the person has the proper admission authority to the restricted area. Judging that it is
If the movement route information indicates that the person has entered the restricted area without passing through the restricted area, the person has the proper admission authority to the restricted area. The monitoring device according to claim 1, wherein it is determined that the person does not have the monitoring device. Further equipped with a notification device for notifying predetermined information,
2. The admission attribute determination unit is characterized in that when a person who does not have the proper admission authority to enter the restricted area enters the restricted area, the notification device notifies the fact. The monitoring device described in. A timer that keeps the current time
Further equipped with a stay determination unit for determining the stay state of the person in the restricted area,
The above stay judgment department
Acquire admission time information indicating the time when the person passed through the admission restriction section and entered the restricted area.
Obtain the current time information indicating the current time from the timer and obtain it.
Based on the entrance time information and the current time information, the time during which the person stays in the restricted area is calculated.
The third aspect of the present invention is characterized in that, when the person stays in the restricted area for a longer time than the predetermined first time, the stay determination unit notifies the notification device to that effect. The monitoring device described. A timer that keeps the current time
A scheduled exit time acquisition unit that acquires scheduled exit time information indicating the scheduled time when a person who has regular entry authority into the restricted area is scheduled to leave the restricted area.
Further provided with an exit recommendation determination unit for determining the exit recommendation state of the person in the restricted area.
The above exit recommendation judgment unit
Obtain the above scheduled exit time information from the above scheduled exit time acquisition unit,
Obtain the current time information indicating the current time from the timer and obtain it.
Based on the scheduled exit time information and the current time information, the remaining time that the person who has the proper admission authority to the restricted area can stay in the restricted area is calculated.
When the person who has the proper admission authority to enter the restricted area stays in the restricted area with the remaining time shorter than the predetermined second time, the exit recommendation determination unit determines. The monitoring device according to claim 3 or 4, wherein the notification device is notified to that effect. The at least one imaging device is a plurality of imaging devices.
The monitoring device according to any one of claims 1 to 5, wherein at least a part of the space imaged by each of the plurality of image pickup devices is different from each other. A control device that controls a monitoring device that monitors the entry of people into a restricted area set in advance in the facility.
The monitoring device is provided with an imaging device that captures an image of a space including at least a part of the restricted area.
The above control device
A person detection unit that detects the image of the person represented in the above image,
A movement route acquisition unit that acquires movement route information indicating the movement route of the person based on the position change of the image of the person with the progress of time in the video.
A control device including an admission attribute determination unit that determines whether or not the person has a regular admission authority to enter the restricted area according to the movement route information.

Images