JP2020160573A - Monitoring system, monitoring method, and monitoring program - Google Patents

Abstract

To provide a monitoring system, monitoring method, and monitoring program capable of issuing warning concerning a person who is not permitted to go out while suppressing unnecessary warning.SOLUTION: A monitoring system X includes: an imaging section W for imaging a passing person who passes a predetermined place; a storage section 4 for storing features of a notification object person and a warning unnecessity condition being the condition not to perform notification by warning; an authentication section 85 for collating features of a passing person imaged by the imaging section W with features of a notification object person stored in the storage section 4 and authenticating whether the passing person is a notification object person; and a control section 8 for controlling notification that a passing person is a notification object person. When the authentication section 85 authenticates that a passing person is a notification object person, the control section 8 performs control not to perform notification by warning in a case where a warning unnecessity condition is satisfied.SELECTED DRAWING: Figure 3

Description

The present invention relates to a monitoring system, a monitoring method, and a monitoring program that can image a passing person passing through a predetermined place and notify the passing person if the passing person is a registered person in advance.

Conventionally, there is a monitoring system that captures a face image or the like of a passing person passing through a predetermined place with a camera and notifies the photographed person if it is authenticated as a pre-registered person (notification target person). This surveillance system is used for security, crime prevention, security, shoplifting prevention, customer recognition, and so on. In the authentication, the characteristics of the person are extracted from the face image of the passing person, and the characteristics of the extracted person are compared with the characteristics of the person to be notified registered in advance. Then, the monitoring system authenticates whether or not the characteristics of the extracted person match the characteristics of the notified target person registered in advance (for example, whether or not the similarity is equal to or higher than a predetermined value). Examples of the person to be notified include a person requiring attention such as a shoplifter in a store or a wanderer in a long-term care facility. When it is judged that the characteristics are consistent and it is authenticated that there is a notification target person, the notification system identifies the information related to the characteristics of the authenticated notification target person and notifies the monitoring system monitor etc. of the specified information etc. (Warning, notification, etc.). As a result, the observer or the like can confirm that the pre-registered notification target person has passed the predetermined place.

Here, it is common, but not limited to, to notify when the characteristics of the imaged person match the characteristics of the notification target person registered in advance. For example, in the monitoring system described in Patent Document 1, the characteristics of a facility staff member, a facility user who can go out alone, a facility user's family, and other persons who are permitted to go out are registered in advance. And the person who is not registered is the person to be notified. This monitoring system captures a passing person passing through a predetermined place (face recognition area at the exit of the facility) with a camera, and if this passing person is authenticated as an authorized person to go out, a warning (notification) is issued. Not performed. Further, in Patent Document 1, when the staff of the facility who is the person who is permitted to go out and the person to be notified are shown at almost the same time, the monitoring system determines that the staff of the facility will go out with the person to be notified. , An embodiment in which no warning is given is also disclosed. The monitoring system described in Patent Document 1 checks all persons who go out of the facility without leaking them by not giving an exceptional warning only to pre-registered outing permitting persons while setting all persons as notification targets to be alerted. It is a technology to do.

Japanese Unexamined Patent Publication No. 2012-252569

However, in the monitoring system described in Patent Document 1, in principle, all persons whose characteristics as an outing permitter are not registered are warned, so it is expected that unnecessary warnings will increase. For example, even a family member of a facility user or a trader entering or leaving a facility will issue a warning if the image is projected on a camera unless it is registered in advance. On the other hand, in order to suppress unnecessary warnings, it is necessary to register all the characteristics of the facility user's family, the entry / exit trader, etc., and this work is not troublesome.

Therefore, there is a demand for a monitoring system, a monitoring method, and a monitoring program that can warn a person who is not permitted to go out while suppressing unnecessary warnings.

The characteristic configuration of the monitoring system according to the present invention is the above-mentioned monitoring system that images a passing person passing through a predetermined place and can notify the passing person if the passing person is a registered notification target person, and passes through the predetermined place. An imaging unit that captures a passing person, a storage unit that stores the characteristics of the notification target person, and a storage unit that stores a warning-unnecessary condition that is a condition for not notifying by a warning, and characteristics of the passing person imaged by the imaging unit. An authentication unit that collates with the characteristics of the notification target person stored in the storage unit and authenticates whether or not the passing person is the notification target person, and the passing person is the notification target person. The control unit includes a control unit that controls the notification of the above, and the control unit satisfies the warning unnecessary condition when the passing person is authenticated as the notification target person by the authentication unit. The point is to control so that notification by warning is not performed.

A feature of the monitoring method according to the present invention is that a passing person passing through a predetermined place is imaged, and the passing person passing through the predetermined place is imaged in a monitoring method that can be notified by a pre-registered notification target person. The imaging step, the storage step for storing the characteristics of the notification target person and the warning unnecessary condition which is a condition for not performing notification by a warning, and the characteristics of the passing person and the characteristics of the notification target person are collated. The control step includes an authentication step for certifying whether or not the passing person is the notification target person, and a control step for controlling notification that the passing person is the notification target person. The point is that when the passing person is authenticated as the notification target person by the step, if the warning unnecessary condition is satisfied, the notification by the warning is not performed.

The feature configuration of the monitoring program according to the present invention is a monitoring program for causing a computer to perform a process of imaging a passing person passing through a predetermined place and controlling a form that can be notified by a pre-registered notification target person. , Whether or not the passing person is the notification target person by collating the input process for inputting the characteristics of the passing person passing through the predetermined place with the characteristics of the passing person and the characteristics of the notification target person. Authentication process for authenticating, determination process for determining whether or not the warning-unnecessary condition, which is a condition for not notifying by warning, is satisfied, and control processing for controlling notification that the passing person is the notification target person. When the passing person is authenticated as the notification target person by the authentication processing, the control process does not execute the notification by the warning when the warning unnecessary condition is satisfied. It is in the point of controlling to.

In this configuration or this method, if it is authenticated that the person is the notification target person, the notification can be performed, so that the notification target person can be notified without omission. At this time, even if it is authenticated that the person is the notification target person, the warning is not executed if the warning unnecessary condition such that the passing person is a person who is permitted to go out is satisfied. That is, when notifying that the person is the notification target person, only the person requiring attention is warned, and unnecessary warning is not given to other people. As a result, it is possible to prevent the inconvenience that the observer or the like feels annoyed because the warning is always executed if the person is the notification target person. In this way, we were able to provide a monitoring system, monitoring method, and monitoring program that can warn people who are not allowed to go out while suppressing unnecessary warnings.

Another characteristic configuration is that the control unit is different from the warning when the passing person is authenticated as the notification target person by the authentication unit and the warning unnecessary condition is satisfied. The point is to control so that it is notified by.

In this configuration, when the authentication unit authenticates the person to be notified, the notification is performed in a manner different from the warning if the warning unnecessary condition is satisfied. As a result, for example, when the passing person is a person requiring attention such as a wandering person, a warning is given to alert the observer, etc., and when the passing person is a person who is permitted to go out, a warning is given. It is possible to make the observer or the like know that he / she has gone out by different notifications.

Another feature configuration is that the control unit does not give the warning when the passing person is authenticated as the notification target person by the authentication unit and the warning unnecessary condition is satisfied. The point is to control so as to notify the reason.

As in this configuration, if the warning unnecessary condition is satisfied, the reason why the warning was not given can be notified, so that the observer or the like can easily grasp what kind of person the notification target person is. ..

Another feature configuration is that there are a plurality of the warning-free conditions, and the control unit controls so as to notify in different modes according to the warning-free conditions.

As in this configuration, for example, when there are multiple warning-free conditions such as a person who is permitted to go out or a person to be notified who has an attendant, the notification mode can be changed according to each warning-free condition, so that the observer, etc. Can easily grasp the attributes of the person to be notified (such as a person who is permitted to go out) who did not execute the warning.

Another feature configuration is that when the storage unit is authenticated by the authentication unit that the passing person is the notification target person and the warning unnecessary condition is satisfied, the notification target person The point is to store historical information.

By storing the history information of the notification target person whose storage unit did not execute the warning as in this configuration, for example, the observer or the like can freely view the outing status of the notification target person. As a result, it becomes possible to grasp the current state of the notification target person who did not execute the warning, and it is possible to improve convenience.

Another feature configuration further includes a display unit for displaying the history information and a reception unit for receiving a request for notification of the history information, and the control unit notifies the history information via the reception unit. The point is that when the request is received, the history information is displayed on the display unit.

If the history information is displayed by the operation of the reception unit of the observer or the like as in this configuration, the observer or the like can obtain the necessary information when necessary, which is highly convenient.

Another feature configuration is that the predetermined place is a place where the entry / exit of the notification target person to the facility can be confirmed, and the control unit obtains the history information of the notification target person in a state of going out and not returning. The point is to display it on the display unit.

If the display unit displays the history information of the state in which the person who has gone out and has not returned, as in this configuration, the observer or the like can easily grasp the person who has not returned.

Another feature configuration is that the predetermined place is a place where the entry / exit of the notification target person to the facility can be confirmed, and the storage unit stores the outing permission period of the notification target person as the warning unnecessary condition. At the point.

As in this configuration, if the permission period for going out is set as a condition that does not require a warning, no warning will be given if the permission person goes out while observing the permission period, so there is no misunderstanding to the observer, etc. ..

Another feature configuration is that the outing permission period includes an outing time when the notification target person leaves the facility and a return time when the notification target person returns to the facility, and the control unit controls the facility. The point is to control the notification target person to perform the notification by the warning when he / she has not returned to the facility even after the return time has elapsed.

In this configuration, even a person who is permitted to go out warns if he / she has not returned to the facility after the return time has elapsed. Therefore, the observer or the like can easily grasp the person who is permitted to go out after the period of permission to go out, and can promptly take necessary measures.

In another feature configuration, the storage unit stores the characteristics of an attendant who is permitted to go out with the notification target person, and the warning unnecessary condition is a plurality of images taken by the imaging unit. The point is that the passing person is authenticated by the authentication unit as being the notification target person and the attendant. Further, the storage unit may store the notification target person and the attendant in association with each other.

In this configuration, no warning is given when an attendant (for example, an attendant) goes out with the person to be notified. As a result, unnecessary warnings can be suppressed.

The other feature configuration further includes a notification unit that notifies the attendant of predetermined information, and the control unit receives the predetermined information via the notification unit when the warning unnecessary condition is satisfied. The point is to control the information so as to notify the attendant.

As in this configuration, if the attendant (for example, an attendant) is notified of predetermined information (for example, the information of the person to be notified accompanied by the attendant), the attendant will be accompanied by the information about the person to be notified. You can let yourself know. As a result, the attendant can take out the person to be notified with peace of mind.

Another characteristic configuration is that the control unit is authenticated by the authentication unit as the notification target person who is not permitted to go out to the plurality of passing persons imaged by the imaging unit. If is included, the point is to control so as to notify by the warning.

In this configuration, even when the attendant goes out with the notification target person, a warning is given when the notification target person who is not permitted to go out appears on the imaging unit almost at the same time. As a result, when the person who is permitted to go out and the person requiring attention go out together, a warning can be given to alert the observer or the like.

Another feature configuration further includes another imaging unit that images the passing person passing through a place other than the predetermined place among the places where the person to be notified can confirm the entry and exit to the facility, and the control unit includes the control unit. The point is that when the passing person imaged by the other imaging unit is authenticated by the authentication unit as the notification target person, the notification is performed by the warning.

In this configuration, a warning is given when going out from a place other than the exit that can be used by a person who is permitted to go out (for example, a staff-only entrance). As a result, it is possible to reliably grasp the person to be notified who illegally escapes from the hospital.

It is a conceptual diagram which shows the monitoring system when the person to be notified goes out. It is a conceptual diagram which shows the monitoring system when a person to be notified goes out with an attendant. It is a block diagram of a monitoring system. It is a figure which shows an example of the notification by a display part. It is a figure which shows an example which displayed the history information on the display part. It is a figure which shows an example of notifying a mobile terminal. This is the control flow of the monitoring system. This is the control flow of the monitoring system.

Hereinafter, embodiments of a monitoring system, a monitoring method, and a monitoring program according to the present invention will be described with reference to the drawings. In the present embodiment, as an example of the monitoring system, the monitoring system X used in the hospital as a facility will be described. However, the present invention is not limited to the following embodiments, and various modifications can be made without departing from the gist thereof.

As shown in FIGS. 1 and 2, the monitoring system X in the present embodiment captures a plurality of (four in the present embodiment) cameras W (imaging) passing through a predetermined entrance / exit (an example of a predetermined location) in a hospital. Video data including a passing person is transmitted to the management server S, and the observer or the like (operator) confirms the notification target person P based on the information displayed on the management server S. It can be done. Here, in the example of FIG. 1, the entrance / exit of the hospital is shared at one place, and a plurality of cameras W are installed on the exit side and image the inside of the facility (Camera1), and are installed on the exit side and outside the facility. One to image the inside of the facility (Camera2), one installed on the entrance side to image the inside of the facility (Camera3), and one installed on the entrance side to image the outside of the facility (Camera4). In addition, the passing persons are all persons passing through the entrance / exit of the hospital, and include inpatients, outpatients, hospital staff, entry / exit traders, patients' families, and the like. The notification target person P in the present embodiment is an inpatient corresponding to the registered face data (an example of the characteristics of the notification target person) registered in advance.

When the face image of the passing person (an example of the characteristics of the passing person) and the feature amount of the face (an example of the characteristics of the passing person) are consistent with the registered face data, the monitoring system X notifies the passing person to the notification target person P. Authenticate as. Here, the "registered face data" is a face image and a feature amount of the face registered in advance as the notification target person P. Here, the "feature amount" is data including feature information such as the contour, color and surface shape of the face.

When the monitoring system X in the present embodiment is authenticated as the notification target person P, the monitoring system X can notify that the passing person is the notification target person P. At this time, the warning is notified only when the warning unnecessary condition is not satisfied. On the other hand, even if the person is authenticated as the notification target person P, the notification by the warning is not performed if the warning unnecessary condition is satisfied. Hereinafter, the details of the monitoring system X according to the present embodiment will be described.

As shown in FIG. 3, the monitoring system X includes a camera W, a management server S, a notification device A, and a mobile terminal K (an example of a notification unit). The management server S is connected to the camera W and the notification device A via a wired or wireless network, and is connected to the mobile terminal K via a wireless LAN or an Internet line.

The camera W that captures a passing person is a visible light camera that incorporates an image sensor such as a CCD or CMOS. The camera W is installed at a hospital entrance / exit or the like with a predetermined angle of view, and captures a passing person to acquire moving image data. The moving image data also includes the shooting date and time and the attribute information (ID, etc.) of the shooting camera W.

The notification device A has a speaker Aa and a notification lamp Ab provided in a monitoring room or the like in which the management server S is arranged (see also FIGS. 1 to 2). The operation of the notification device A is controlled by the notification control unit 81 of the control unit 8 described later.

The mobile terminal K is composed of a smartphone, a tablet, or the like carried by hospital staff (see also FIG. 2). The operation of the mobile terminal K is controlled by the notification control unit 83 of the control unit 8 described later.

As shown in FIG. 3, the management server S is composed of a computer having a CPU and a memory as its core, and includes a communication unit 1, a reception unit 2, a display unit 3, a storage unit 4, and a control unit 8. There is.

The communication unit 1 is an interface for receiving moving image data including a passing person captured by the camera W via a network composed of a wired LAN, a wireless LAN, or the like. Further, the communication unit 1 is an interface for transmitting instruction information to the notification device A via a network composed of a wired LAN, a wireless LAN, or the like. Further, the communication unit 1 is a Web interface for transmitting and receiving various signals to and from the mobile terminal K via a wireless LAN or an Internet line.

The reception unit 2 is composed of a mouse, a keyboard, a touch panel, and the like, and receives operations by a monitor and the like on the screen displayed on the display unit 3. For example, a predetermined operation is executed by moving the pointer to a predetermined position on the display screen by operating the mouse and clicking the mouse at that position.

The operation of the display unit 3 is controlled by the display control unit 82 of the control unit 8 described later. The display unit 3 is composed of a computer display, displays moving image data in real time, and also displays a face image of the notification target person P when the passing person captured by the camera W is the notification target person P. Display a thumbnail indicating. A thumbnail is a compressed image encoded and compressed by a known compression method for displaying a list of facial images. The attribute information of the camera W, the shooting date and time, and the like are linked to this thumbnail.

As an example of the display unit 3, as shown in FIG. 4, there is a device that displays moving image data captured by a plurality of cameras W in real time in a frame (live viewer) on the upper left side of the screen. In addition, when the passing person detected from the moving image data in the frame (alert monitor / notification monitor) on the upper right side of the screen is authenticated, the display unit 3 has already registered the passing person in the storage unit 4. Information (face image and moving image data), reason for notification, camera W ID, imaging date and time, etc. are displayed in a list. Further, the display unit 3 includes a list display application of the history information of the notification target person P (see FIG. 5) and a registration face data registration application of the notification target person P in the frame in the middle right of the screen (application activation). A list of icons for various applications including is displayed. Here, the history information of the notification target person P includes a face image of the notification target person P, a discharge time (an example of an outing time), a return time (an example of a return time), and the like. The time of going out is the time of departure from the facility, and the time of return is the time of returning to the facility.

The storage unit 4 is composed of hardware such as RAM and HDD, and is associated with registered face data, camera W attribute information, imaging date and time, moving image data, face images, facial features, various programs, and the like. Is remembered. The registered face data includes the registered face data (an example of the characteristics of the attendant) of the attendant H (the out-of-home nursing staff who is a hospital staff) in addition to the registered face data of the notification target person P. The storage unit 4 stores all the moving image data for a short period (for example, 2 weeks) as a short-term storage mode, and further, as a long-term storage mode, stores the moving image data excluding the data in which the passing person is not imaged for a long period (for example). For example, it is stored for a period (a period obtained by subtracting 2 weeks from 2 months). The moving image data stored in the storage unit 4 may be encoded and compressed in a known compression format.

Further, the storage unit 4 stores a warning unnecessary condition in which the notification is not performed by a warning and the history information of the notification target person P. The warning-free conditions include the attributes of the notification target person P who does not notify by warning (going out permitted person, etc.), various conditions associated with the notification target person P (going out permission period, number of times of going out, etc.), and the environment at the time of imaging (attachment). Intervals, etc. when appearing with person H) are included. The history information of the notification target person P includes the face image of the notification target person P, the discharge time (time of departure from the hospital) and the return time (time of returning to the hospital) of the notification target person P who went out, and the notification target person. The attributes of P (such as those who are allowed to go out) are included. The details of the warning unnecessary condition and the history information of the notification target person P will be described later.

The control unit 8 includes a detection unit 84, an authentication unit 85, a registration unit 86, a notification control unit 81, a display control unit 82, and a notification control unit 83. These functional units are executed by a control circuit such as a CPU based on a program temporarily read from the storage unit 4 into the memory.

The detection unit 84 executes a process of detecting the face area of the passing person included in the moving image data. For example, the face area is detected by sequentially expanding a plurality of still image data included in the moving image data on the memory and performing template matching or the like using a template corresponding to the face area of the passing person. At this time, when a plurality of still image data are continuous and the same person is included in the continuous plurality of still image data, it is specified as one continuous section. Also, if the passing person on the video data disappears in the middle and is reflected in the video data again, it is specified as a separate section in principle, but if it is within a predetermined time (for example, within 1 second), one section It may be specified as.

The authentication unit 85 executes a process of determining whether or not a passing person corresponding to the registered face data is displayed on the moving image data. The authentication unit 85 extracts facial features from the face area detected by the detection unit 84, collates the facial features with the registered facial features included in the registered face data, and determines the degree of similarity. Authenticate the passing person based on. For example, matching is performed by template matching or the like that compares the facial feature amount extracted from the moving image data with the registered facial feature amount included in the registered face data as a template, and the similarity is set to a predetermined value (for example, 80). %) In the above case, it is authenticated as a passing person corresponding to the registered face data.

When the registered application in the frame (starting the application) in the middle right of the screen of the display unit 3 shown in FIG. 4 is selected, the registration unit 86 sets the characteristics of the passing person as the registered face data (characteristics of the person to be notified). Execute the registration process for registering as. Here, the characteristics of the passing person used in the registration process are the face image and the feature amount of the passing person captured by the camera W, and the face image and the feature amount of the inpatient acquired in advance. In this registration process, the attributes of inpatients (permitted to go out, those who are not allowed to go out, etc.) and the period of permission to go out are also registered. The outing permission period is a period between the start date and time and the end date and time when the notification target person P can go out.

The basic notification control mode of the control unit 8 will be described. The control unit 8 controls the notification that the passing person captured by the camera W is the notification target person P. When the passing person is authenticated by the authentication unit 85 as the notification target person P, the control unit 8 does not perform notification by warning when the warning unnecessary condition is satisfied, and notifies in a mode different from the warning. Control to do. On the other hand, the control unit 8 controls to execute the notification by the warning when the passing person is authenticated as the notification target person P by the authentication unit 85 and the warning unnecessary condition is not satisfied. Here, the "warning" is a mode of notification, but is a notification mode in which a human can intuitively grasp an emergency situation when a notification target person P who does not satisfy the warning unnecessary condition goes out. is there. The "mode different from the warning" is a mode of notification different from the warning, and is a mode of notification to the extent that the observer or the like can recognize that the notification target person P has gone out. The "warning-free condition" is a condition in which notification by warning is not performed, and is associated with the notification target person P when he / she goes out or when the notification target person P goes out while observing the outing permission period associated with the notification target person P. The case where the attendant H who is not present is accompanied by the person P to be notified is included. The storage unit 4 stores the attendant H associated with the notification target person P, and as a "warning unnecessary condition", the attendant H associated with the notification target person P takes the notification target person P together. It may include the case of doing.

In this embodiment, the following warning unnecessary conditions (1) to (3) are specified as an example.
(1) When the inpatient as the notification target person P is a person who is permitted to go out (hereinafter referred to as "going out permitted person") and goes out from the entrance / exit of the hospital after the discharge time of the going out permission period (appropriate). Discharge, example of Fig. 1, notification target person P2 corresponding to the permission person notification of Fig. 4)
(2) If the person is permitted to go out and returns after passing through the entrance / exit of the hospital before the time of returning to the hospital during the permitted period of going out (appropriate return to the hospital, P1 of the person to be notified in FIG.
(3) When an inpatient as a notification target person P1 goes out with an attendant H (a hospital staff member who is an outing nursing staff member) who is permitted to go out with the notification target person P1 under predetermined conditions. (Piggybacking, example in Fig. 2, notification with staff in Fig. 4)
Here, the predetermined conditions include "when the notification target person P and the attendant H are imaged by the camera W at a predetermined time interval or distance interval" and "the notification target person P and the attendant H in the same image". Is reflected in the camera W "and the like.

As described above, since there are a plurality of warning-free conditions (1) to (3), it is preferable that the control unit 8 controls so as to notify in different modes according to each warning-free condition. In the case of the warning unnecessary condition (1) to (2), the control unit 8 is limited to the notification by the display unit 3, and in the case of the warning unnecessary condition (3), in addition to the notification by the display unit 3, the attendant H It may be controlled so as to notify the mobile terminal K of predetermined information (see FIG. 6). Further, the control unit 8 has different notification modes depending on whether the notification target person P2 satisfies the warning unnecessary condition (1) and the notification target person P1 satisfying the warning unnecessary condition (3) even if the person is allowed to go out. (For example, the display color is different) (see FIG. 4). In this way, by changing the notification mode according to each warning unnecessary condition, the observer or the like can easily grasp the attributes of the notification target person P (the person who is permitted to go out with the attendant H, the person who is permitted to go out, etc.). can do.

Other conditions that do not require warning include those who are permitted to go out and go out from the entrance / exit of the hospital within the number of times of permission to go out in one month, or those who go out from the entrance / exit of the hospital within the permitted time to go out in one month. However, in order to facilitate understanding, the warning unnecessary conditions (1) to (3) will be described below.

The following warning cases (4) to (8) are assumed as examples in which these warning unnecessary conditions are not satisfied.
(4) Assuming that the warning unnecessary condition (1) is not satisfied, the inpatient as the notification target person P is a person who is not permitted to go out (a person who needs attention such as a wanderer, hereinafter referred to as a "person who needs attention"). If the person requiring attention goes out from the entrance / exit of the hospital (5) If the warning unnecessary condition (1) is not satisfied, the inpatient as the notification target person P is in a place other than the entrance / exit of the hospital (for example, for staff). When going out from the entrance / exit (when the notification target person P is shown by another camera (not shown, an example of another imaging unit) installed at the entrance / exit other than the entrance / exit of the hospital)
(6) When the warning unnecessary condition (2) is not satisfied, and when the person who is permitted to go out does not return to the hospital even after the return time has passed (7) When the warning unnecessary condition (2) is not satisfied When the person who is permitted to go out passes through a place other than the doorway of the hospital (for example, the doorway for staff) and returns (8) When the warning unnecessary condition (3) is not satisfied, the person who is permitted to go out is a person who is permitted to go out, but under the prescribed conditions. When a person requiring attention is also reflected in the camera W Here, the predetermined condition is "when the person who is permitted to go out and the person requiring attention are imaged by the camera W at a predetermined time interval or distance interval" or For example, "when a person who is permitted to go out and a person who needs attention are shown on the camera W in the same image" and the like. That is, as in the warning unnecessary condition (3), the predetermined conditions include "when a plurality of specific passing persons are captured by the camera W at a predetermined time interval or distance interval" and "specifically to the same image". When a plurality of passing persons are reflected in the camera W "and the like.

In this way, since the control unit 8 executes the notification if it is authenticated as the notification target person P, the notification target person P can be notified without omission. At this time, even if it is authenticated that the person is the notification target person P, the warning is not executed if the warning unnecessary condition such that the passing person is the person who is permitted to go out is satisfied. That is, when notifying that the person is the notification target person P, only the person requiring attention is warned, and unnecessary warning is not given to other people. As a result, it is possible to prevent the inconvenience that the observer or the like feels annoyed because the warning is always executed if the person P is the notification target.

Further, when the authentication unit 85 authenticates that the person is the notification target person P, the notification is performed in a mode different from the warning if the warning unnecessary condition is satisfied. As a result, for example, when the passing person is a person requiring attention, a warning is given to alert the observer, etc., and when the passing person is a person who is permitted to go out, the observer notifies the time of going out, etc. It is possible to operate such as letting the person grasp. By changing the notification mode according to each warning unnecessary condition, the observer or the like can easily grasp the attributes of the notification target person P (notification target person P with an attendant H, outing permit person, etc.). it can.

In addition, if the warning-free conditions (1) and (2) include the outing permission period of the outing permitting person, no warning will be given if the outing permitting person is out while observing the outing permission period, which gives a misunderstanding to the observer. Never.

In addition, when the notification target person P is allowed to go out with an attendant H (for example, an attendant staff) as a warning unnecessary condition (3), the notification target person P and the attendant H are reflected on the camera W almost at the same time. No warning is given in such cases. As a result, unnecessary warnings can be suppressed.

The notification control unit 81 generates instruction information for operating the notification device A based on the authentication result of the authentication unit 85, and transmits this instruction information to the notification device A via the communication unit 1. The instruction information includes "notification by warning" and "notification in a mode different from the warning". As an example of the "warning", the notification lamp Ab is turned on in red to notify the observer or the like that a person requiring attention is about to go out. As an example of "notification in a mode different from the warning", by keeping the notification lamp Ab in a normal color, for example, yellow lighting, the observer or the like is made to confirm that he / she is an authorized person to go out and there is no problem. Here, the "notification in a mode different from the warning" includes not notifying.

The display control unit 82 executes display control on the display unit 3 based on the authentication result of the authentication unit 85. The display control unit 82 causes the display unit 3 to display the moving image data received from the camera W via the communication unit 1 in real time (see the “live viewer” on the upper left side of the screen of the display unit 3 shown in FIG. 4). At this time, the face area detected by the detection unit 84 may be highlighted by surrounding it with a frame or the like. In the present embodiment, a plurality of moving image data received from the plurality of cameras W are displayed on the same screen of the display unit 3 together with the attribute information of the cameras W (see “Live Viewer” on the upper left side of the screen of the display unit 3 shown in FIG. 4). It is displayed. As a result, the observer or the like can collectively view a plurality of moving image data acquired from the plurality of cameras W.

The display control unit 82 uses the face image of the notification target person P, which has been authenticated by the authentication unit 85 as a passing person corresponding to the registered face data, to be a registered face included in the video data or the registered data in which the passing person is shown. It is displayed on the display unit 3 together with the image (see "Alert monitor / Notification monitor" on the upper right side of the screen of the display unit 3 shown in FIG. 4). In addition, the display control unit 82 displays a list of application icons that can be set in a row and displays them on the display unit 3 (see “Starting an application” in the middle right of the screen of the display unit 3 shown in FIG. 4). ..

In particular, the display control unit 82 displays the reason why the warning was not given (notification with staff, notification of authorized person, etc.) and emphasizes the warning on the "alert monitor / notification monitor" on the upper right side of the screen of the display unit 3 shown in FIG. The display unit 3 controls the display to be displayed (for example, colored in orange) and the different display in the notification target person P satisfying the notification unnecessary condition (for example, the notification with staff is colored in blue, the notification of the authorized person is colored in light blue, etc.). To execute. The reason why the display control unit 82 did not give a warning is, such as "notification with staff" corresponding to the warning unnecessary condition (3) and "permitted person notification" corresponding to the warning unnecessary condition (1). Controls the display unit 3 to display the contents that can be immediately understood by. In this way, by notifying the reason why the warning is not given when the warning unnecessary condition is satisfied, the observer or the like can easily grasp what kind of person the passing person is. Further, the display unit 3 is displayed at the bottom of the screen of the display unit 3 shown in FIG. 4, such as "a patient who is not permitted to go out goes out" when the notification target person P to be warned is reflected on the camera W. It may be highlighted on the side. As a result, if the warning is highlighted when the notification target person P to be warned is reflected on the camera W, the observer or the like can immediately shift to the deterrent action so as not to let the person requiring attention go out. ..

Further, in the display control unit 82, the icon of the history information list display application of the notification target person P was clicked via the reception unit 2 in the “application startup” in the middle right of the screen of the display unit 3 shown in FIG. In this case (when a request for notification of history information is received), the display unit 3 is controlled so as to shift to the “discharge / return list” screen of FIG. On this "discharge / return list" screen, it is possible to select the camera W to be displayed on the screen, the period, the registration category, and the like. The "permitted person" in the registration category is the person who is permitted to go out, the "with staff" is the person P to be notified who went out with the attendant H, and the "specific person" is the person who is permitted to go out, but no warning is required. The notification target person P who does not satisfy the conditions, and the "warning person" is the notification target person P who is not permitted to go out.

In the figure, the history information of all the notification target persons P who went out (discharged) from the hospital from 8:00 to 20:00 on December 27, 2018 is displayed in a list. The notification target person P2 is an outing permit person who satisfies the warning unnecessary condition (1), but only the discharge time is displayed as history information, and the return time is not displayed. That is, the person who is permitted to go out does not satisfy the warning unnecessary condition (2), and the face image is highlighted by surrounding it with a red frame to be notified by a warning. On the other hand, the notification target person P1 is an outing permit person who satisfies the warning unnecessary condition (3), and both the discharge time and the return time are displayed as history information. That is, since the warning unnecessary condition (2) is satisfied, the face image is displayed normally. In this way, even if the person is allowed to go out, the notification mode is different between the notification target person P2 outside the outing permission period and the notification target person P1 within the outing permission period. Further, even if the person is permitted to go out, the notification mode (for example, the display color is different) is different depending on the case of the warning unnecessary condition (1) and the case of the warning unnecessary condition (3).

The notification control unit 83 controls the mobile terminal K to notify the predetermined information based on the authentication result of the authentication unit 85. The notification control unit 83 determines the attendant H to attend the notification target person P who satisfies the warning unnecessary condition (3) via the mobile terminal K possessed by the attendant H. Control to notify the information (see FIG. 6). The predetermined information is the fact that the notification target person P satisfies the warning unnecessary condition (3), the attribute information (face image, name, etc.) of the notification target person P, the outing permission period, and the like. In this way, if the attendant H is notified of the predetermined information, the attendant H himself can be notified of the information about the notification target person P accompanied by the attendant H. As a result, the attendant H can take out the notification target person P with confidence. Further, since the notification target person P to be taken out by the attendant H can be confirmed, it is possible to prevent an event in which another notification target person P who is not the target to be taken out by the attendant H goes out.

Subsequently, a control method of the monitoring system X will be described with reference to FIGS. 7 to 8. FIG. 7 shows a basic notification control flow in the monitoring system X, and FIG. 8 shows a specific notification control flow based on the warning unnecessary conditions (1) to (3).

As shown in FIG. 7, the storage unit 4 stores in advance the registered face data of the notification target person P and the warning unnecessary condition in which the notification by the warning is not performed (# 40, an example of the storage step of the monitoring method). The notification target person P is an inpatient, and the warning-free conditions include the outing permission period (the above-mentioned warning-free conditions (1) to (2)) and the tailgating-out-out condition (the above-mentioned warning-free condition) associated with the notification target person P. Condition (3)). Then, the passing person passing through the predetermined place is imaged by the camera W (an example of the imaging step of the monitoring method), and the management server S acquires the moving image data corresponding to the captured passing person from the camera W (# 41). ). Next, the detection unit 84 of the management server S detects the face area of the passing person included in the moving image data (# 42).

Next, the authentication unit 85 extracts a facial feature amount as a feature of the passing person from the face area detected by the detection unit 84 (an example of input processing of the monitoring program), and includes the facial feature amount and the registered face data. The registered facial features are collated with each other, and the person is authenticated based on the similarity (# 43, an example of the authentication method of the monitoring method, an example of the authentication process of the monitoring program). Then, the authentication unit 85 authenticates that the passing person is the notification target person P when the similarity between the characteristics of the passing person and the registered face data is a predetermined value (for example, 80%) or more (# 44Yes). On the other hand, when the similarity between the characteristics of the passing person and the registered face data is less than a predetermined value, the authentication unit 85 authenticates that the passing person is not the notification target person P (# 44Nо), and the control unit 8 performs notification control. Exit without executing.

Next, when the passing person is authenticated as the notification target person P (# 44Yes), the control unit 8 controls the notification that the passing person is the notification target person P (an example of the control step of the monitoring method, control of the monitoring program). An example of processing). When the passing person is authenticated as the notification target person P by the authentication unit 85, the control unit 8 determines whether or not the warning unnecessary condition is satisfied (# 45, an example of the determination process of the monitoring program). ..

As a result of the determination of # 45, when the warning unnecessary condition is satisfied (# 45Yes), the control unit 8 controls so as not to execute the notification by the warning, and notifies in a mode different from the warning (# 46). Specifically, the display control unit 82 displays the reason why the warning was not given (notification with staff, notification of authorized person, etc.) and notification on the "alert monitor / notification monitor" on the upper right side of the screen of the display unit 3 shown in FIG. Different displays (for example, staff notification is colored blue, permission person notification is colored light blue, etc.) are executed for each column corresponding to the notification target persons P1 and P2 that satisfy the unnecessary conditions.

As a result of the determination of # 45, when the warning unnecessary condition is not satisfied (# 45Nо), the control unit 8 controls to execute the notification by the warning (# 47). Specifically, the display control unit 82 emphasizes the warning for the line corresponding to the notification target person P3 in the “alert monitor / notification monitor” on the upper right side of the screen of the display unit 3 shown in the display unit 3 shown in FIG. In addition to executing the display (for example, coloring in red), the notification control unit 81 warns the observer or the like to notify the observer or the like by turning on the notification lamp Ab in red or sounding a warning sound from the speaker Aa. Control.

Next, a specific notification control method based on the above-mentioned warning unnecessary conditions (1) to (3) will be described with reference to FIG.

When there is a warning unnecessary condition (# 49Yes) and the notification target person P is reflected on the camera W together with the attendant H at almost the same time (when the warning unnecessary condition (3) is satisfied) (# 50Yes), the display control unit 82 , In the "alert monitor / notification monitor" on the upper right side of the screen of the display unit 3 shown in FIG. 4, the face image of the notification target person P1 is displayed together with the video data showing the notification target person P1 and the registered face image included in the registration data. Display (# 56). At this time, the display control unit 82 displays a "notification with staff" as a reason display for not giving a warning, assuming that the attendant H is a tailgating person P1. Then, the notification control unit 83 sends the attendant H who accompanies the notification target person P1 who satisfies the warning unnecessary condition (3) to the attendant H via the mobile terminal K possessed by the attendant H. Control so as to notify predetermined information (# 57, see FIG. 6).

If there is a warning unnecessary condition (# 49Yes) and the notification target person P is not shown on the camera W together with the attendant H at almost the same time (# 50Nо), it is determined whether or not the notification target person P is an outing authorized person (# 50Nо). # 51). As a result of the determination of # 51, when the notification target person P is not the person who is permitted to go out (# 51Nо), the control unit 8 executes the notification by warning (# 55). On the other hand, as a result of the determination of # 51, when the notification target person P is an outing authorized person (# 51Yes), it is determined whether or not the notification target person P has gone out during the outing permission period (# 52). As a result of the determination of # 52, when the notification target person P goes out outside the outing permission period (# 52Nо), the control unit 8 executes the notification by warning (# 55). On the other hand, as a result of the determination of # 52, when the notification target person P goes out during the outing permission period (# 52Yes, when the notification unnecessary condition (1) is satisfied), in the control unit 8, the person requiring attention is the camera W. It is determined whether or not the images are displayed at almost the same time (# 53).

As a result of the determination of # 53, when the person requiring attention is reflected in the camera W almost at the same time (# 53Nо), the control unit 8 warns that the person who is permitted to go out is likely to go out with the person requiring attention. Execute notification (# 55). On the other hand, as a result of the determination of # 53, when the person requiring attention is not displayed on the camera W almost at the same time (# 53Yes), the display control unit 82 is the “alert monitor / notification monitor” on the upper right side of the screen of the display unit 3 shown in FIG. In ”, the face image of the notification target person P2 who is the person who is permitted to go out is displayed together with the moving image data showing the notification target person P2 and the registered face image included in the registration data (# 54). At this time, the display control unit 82 displays the "permitted person notification" as the reason display for not giving the warning, assuming that the person is the notification target person P2 who is the person who is permitted to go out.

After the processes of # 54 and # 57 are executed, the control unit 8 determines whether or not the notification target person P returns before the return time (return time) (whether or not the warning unnecessary condition (2) is satisfied). Is determined (# 58). As a result of the determination of # 58, when the notification target person P has not returned even after the return time, the display control unit 82 controls to perform notification by warning via the display unit 3 (#). 59). As an example, when the observer or the like clicks the icon of the history information list display application of the notification target person P in the "application startup" in the middle right of the screen of the display unit 3 shown in FIG. 4, the display control unit 82 In the “discharge / return list” of FIG. 5, the face image of the notification target person P2 who does not satisfy the warning unnecessary condition (2) is highlighted by surrounding it with a red frame. At that time, on the lower side of the screen of the display unit 3, there is a notification target person P2 who does not satisfy the warning unnecessary condition (2), such as "The patient who went out has not returned even after the return time". , May be highlighted. As another example, a similar display may be displayed on the lower side of the screen of the display unit 3 shown in FIG.

When there is no warning unnecessary condition (# 51No), the administrator sets the warning unnecessary condition via the display unit 3 of the management server S (# 60). Further, even if there is a warning-free condition, the administrator can change the warning-free condition via the display unit 3 of the management server S. In this way, by freely setting the warning-free condition, when notifying that the person is the notification target person P, only the person requiring attention should be warned, and no unnecessary warning should be given to other people. Can be done. As a result, it is possible to prevent the inconvenience that the observer or the like feels annoyed because the warning is always executed if the person P is the notification target.

[Other Embodiments]
(1) The designated place in the facility is not limited to the entrance and exit of the hospital, but is the entrance and exit of VIP, the entrance and exit of nursing care facilities, the entrance and exit of shared facilities of condominiums, the entrance and exit of confidential rooms, and the entrance and exit of other facilities. Is also good. In addition, the predetermined place is not particularly limited as long as it is a place where a passing person can be confirmed inside or outside the facility.
(2) The number of cameras W provided at the entrance / exit of the hospital is not limited to four, and may be one or a plurality of cameras W other than four as long as the number of passing persons entering and exiting the hospital can be imaged. Further, the entrance and exit of the hospital may be composed of separate doors at the exit and the entrance, or one camera W or three or more cameras W may be provided at each of the exit and the entrance.
(3) The characteristics of a person may include not only the amount of facial features but also at least one of the attributes of the person such as the figure (silhouette) of the person, the color / pattern of clothes, and glasses. ..
(4) The notification device A may be built in the management server S, or may be provided near the doorway. Further, the display unit 3 may be on a mobile terminal (tablet or the like) carried by the staff instead of the management server S.
(5) An example in which the notification device A, the display unit 3, and the mobile terminal K are used as the notification form of the monitoring system X described above is shown, but only one of them may be used, or any two of them may be used. You may combine them. Further, as the notification form, the door of the doorway may be locked and unlocked.
(6) The administrator or the like may manually input the warning-free condition to the management server S, or the warning-free condition of another device may be automatically transferred to the management server S.
(7) If the person who has gone out has returned by the time of returning to the hospital, the history information of the person who has been allowed to go out may be deleted.
(8) As an example of using the mobile terminal K as the notification form for the attendant H, the notification may be made using the notification device A provided near the doorway, and the notification is not particularly limited.

The present invention can be used in a monitoring system, a monitoring method, and a monitoring program that images a passing person passing through a predetermined place and notifies the passing person if the passing person is a registered person in advance.

2: Reception unit 3: Display unit 4: Storage unit 6: Authentication unit 8: Control unit K: Mobile terminal (notification unit)
P: Notification target person P1: Notification target person P2: Notification target person W: Camera (imaging unit)
X: Monitoring system

Claims (16)

In a monitoring system that images a passing person passing through a predetermined place and can notify if the passing person is a registered notification target person in advance.
An imaging unit that captures the passing person passing through the predetermined location,
A storage unit that stores the characteristics of the notification target person and the warning unnecessary condition, which is a condition for not performing notification by warning.
An authentication unit that authenticates whether or not the passing person is the notification target person by collating the characteristics of the passing person captured by the imaging unit with the characteristics of the notification target person stored in the storage unit. When,
A control unit for controlling notification that the passing person is the notification target person is provided.
The control unit controls so that when the passing person is authenticated as the notification target person by the authentication unit and the warning unnecessary condition is satisfied, the notification by the warning is not performed. A featured monitoring system. The control unit controls so that when the passing person is authenticated as the notification target person by the authentication unit and the warning unnecessary condition is satisfied, the notification is performed in a mode different from the warning. The monitoring system according to claim 1, wherein the monitoring system is performed. When the passing person is authenticated by the authentication unit as the notification target person, the control unit notifies the reason why the warning is not given if the warning unnecessary condition is satisfied. The monitoring system according to claim 2, wherein the monitoring system is controlled. There are multiple conditions that do not require warning,
The monitoring system according to any one of claims 1 to 3, wherein the control unit controls so as to notify in different modes according to each of the warning unnecessary conditions. The storage unit stores the history information of the notification target person when the passing person is authenticated as the notification target person by the authentication unit and the warning unnecessary condition is satisfied. The monitoring system according to any one of claims 1 to 4, wherein the monitoring system is characterized. A display unit that displays the history information and
Further provided with a reception unit that receives a request for notification of the history information.
The monitoring system according to claim 5, wherein the control unit displays the history information on the display unit when the request for notification of the history information is received via the reception unit. The predetermined place is a place where the entry and exit of the notification target person to the facility can be confirmed.
The monitoring system according to claim 6, wherein the control unit displays the history information of the notification target person in a state of going out and not returning to the display unit. The predetermined place is a place where the entry and exit of the notification target person to the facility can be confirmed.
The monitoring system according to any one of claims 1 to 7, wherein the storage unit stores the outing permission period of the notification target person as the warning unnecessary condition. The outing permission period includes the time when the person to be notified leaves the facility and the time when the person to be notified returns to the facility.
The claim is characterized in that the control unit controls the notification target person who has left the facility to perform notification by the warning even after the return time has elapsed but not returned to the facility. 8. The monitoring system according to 8. The storage unit stores the characteristics of an attendant who is permitted to go out with the person to be notified.
Claims 1 to the above-mentioned warning unnecessary condition are that a plurality of the passing persons imaged by the imaging unit are authenticated by the authentication unit as being the notification target person and the attendant. The monitoring system according to any one of 9. The monitoring system according to claim 10, wherein the storage unit stores the notification target person and the attendant in association with each other. Further provided with a notification unit for notifying the attendant of predetermined information,
10. The aspect of claim 10 or 11, wherein the control unit controls to notify the attendant of the predetermined information via the notification unit when the warning unnecessary condition is satisfied. Monitoring system. When the control unit includes the passing person who has been authenticated by the authentication unit as the notification target person who is not permitted to go out among the plurality of passing persons imaged by the imaging unit. The monitoring system according to any one of claims 10 to 12, wherein the monitoring system is controlled so as to perform notification by the warning. Among the places where the person to be notified can confirm the entry and exit to the facility, another imaging unit for capturing the passing person passing through a place other than the predetermined place is further provided.
The control unit is characterized in that when the passing person imaged by the other imaging unit is authenticated by the authentication unit as the notification target person, the control unit controls to perform notification by the warning. The monitoring system according to any one of claims 1 to 13. In a monitoring method that images a passing person passing through a predetermined place and can be notified by a pre-registered notification target person.
An imaging step of imaging the passing person passing through the predetermined place,
A storage step for storing the characteristics of the notification target person and the warning unnecessary condition, which is a condition for not performing notification by warning, and
An authentication step of collating the characteristics of the passing person with the characteristics of the notification target person and authenticating whether or not the passing person is the notification target person.
A control step for controlling notification that the passing person is the notification target person is provided.
The control step controls so that when the passing person is authenticated as the notification target person by the authentication step and the warning unnecessary condition is satisfied, the notification by the warning is not performed. A characteristic monitoring method. In a monitoring program for imaging a passing person passing through a predetermined place and causing a computer to execute a process of controlling a form that can be notified if it is a registered notification target person.
An input process for inputting the characteristics of the passing person passing through the predetermined place, and
An authentication process that collates the characteristics of the passing person with the characteristics of the notification target person and authenticates whether or not the passing person is the notification target person.
Judgment processing to determine whether or not the warning unnecessary condition, which is a condition for not notifying by warning, is satisfied,
A control process for controlling notification that the passing person is the notification target person is provided.
The control process controls so that when the passing person is authenticated as the notification target person by the authentication process and the warning unnecessary condition is satisfied, the notification by the warning is not executed. A featured monitoring program.

Images