JP2010108233A - Non-detector notification device, non-detector notification system and non-detector notification method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide for appropriately notifying a person (non-detector) at a non-detected state based on a detection cycle of persons. <P>SOLUTION: A feature quantity calculation part 7 of the non-detector notification device 3 performs image processing to a portrait image included in a photographed image obtained by photographing a monitoring area to calculate a feature quantity of a person of the portrait image, a detection cycle calculation part 11 calculates the detection cycle for the person detected as the same person based on the feature quantity. A non-detection determination part 12 of the non-detector notification device 3 determines whether or not the person is at the non-detected state that he/she is not detected for a longer time than a predetermined reference cycle based on the detection cycle, and an alarm output part 13 outputs a non-detection alarm signal for notifying that the person is at the non-detected state. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a non-detection person notification device having a function of notifying a person in a non-detection state (non-detection person).

  Conventionally, in a facility where a specific person (related person) such as a condominium or a school enters and leaves, a monitoring camera is installed at an entrance and the like, and a monitoring system that checks whether the person photographed by the monitoring camera is a related person or not. Is used.

For example, a person who enters an apartment house is photographed with a surveillance camera, and a face image of the visitor is detected from the photographed image. Based on the visitor data and pre-registered resident data, the visitor is resident ( There has been proposed a system for determining whether or not a person is involved (see, for example, Patent Document 1).
JP 2006-120084 A

  However, the conventional system has a problem in that no consideration is given to the need for notification from non-detectors. In other words, if a person who is normally checked cannot be detected after a certain period of time, the person (non-detected person) may be involved in some accident or incident. It is not assumed that the non-detected person is notified.

  The present invention has been made to solve the above-described conventional problems, and is a non-detected person notification device capable of appropriately performing notification of a non-detected person (non-detected person) based on a person detection cycle. The purpose is to provide.

  The non-detector notification device according to the present invention includes: a feature amount calculating unit that performs image processing on a person image included in a captured image obtained by capturing a monitoring area to calculate a person feature amount of the person image; and the feature amount A detection cycle calculating means for calculating a detection cycle for a person detected as the same person based on whether or not the person is in a non-detection state in which the person is not detected longer than a predetermined reference cycle based on the detection cycle. Non-detection determination means for determining whether or not, and an alarm output means for outputting a non-detection alarm signal for notifying that it is in a non-detection state.

  With this configuration, the feature amount of the person is calculated from the person image included in the captured image of the monitoring area, and the detection cycle is calculated for the person detected as the same person based on the feature amount. If a person is not detected for a longer period than the predetermined reference period, it is determined that the person is in a non-detection state, and a non-detection alarm signal is output. As a result, when a person is not detected much beyond the usual detection cycle (for example, one week), it is possible to grasp that the person is in a different state from the usual, and to prevent the occurrence of an accident or incident It becomes possible to take measures such as.

  In the non-detection person notification device of the present invention, the non-detection determination unit adjusts the length of the reference period based on calendar information or time information.

  With this configuration, the length of the reference period is appropriately adjusted based on calendar information and time information. For example, when the last day of the reference period is a holiday or Sunday, the last day of the reference period is extended to the next day. When the last time of the reference period is midnight, the last time of the reference period is extended to noon on the next day. Thereby, the non-detection state of a person can be appropriately grasped in consideration of circumstances such as day of the week and time.

  In the non-detection person notification device of the present invention, the non-detection determination unit has a configuration in which an age-specific margin is set in the reference period based on the age information of the person.

  With this configuration, a margin for each age (margin corresponding to age) is set in the reference period based on the age information of the person. For example, a 1-hour margin is set for the reference period for a 30-year-old person, and a 3-hour margin is set for the reference period for a 60-year-old person. Thereby, it is possible to appropriately grasp the non-detection state of the person in consideration of the age of the person.

  The non-detector notification device according to the present invention includes a feature amount storage unit that stores the calculated feature amount, a feature amount of a person of a person image included in the photographed image, and a feature amount stored in the past. A feature amount matching unit that compares the feature amount of the person stored in the unit to determine whether or not they are the same person, and the detection cycle calculation unit includes a result of the comparison of the feature amount comparison unit. Based on this, the detection period is calculated.

  With this configuration, the feature amount of a person shown in an image (captured image) taken of a monitoring area is compared with the feature amount of a person shown in an image taken in the past, and whether or not they are the same person And the detection period of the person is calculated based on the collation result. Thereby, it is possible to determine whether or not the person is the same person without registering the person's image data in advance, and to know the non-detection state of the person.

  Further, the non-detector notification device of the present invention includes a person image storage means in which a person image of a person to be collated is registered in advance, a person feature amount of a person image included in the photographed image, and the person registration. And a feature amount matching unit that determines whether or not they are the same person by comparing the feature amount of the person in the person image, and the detection cycle calculation unit is based on a matching result of the feature amount matching unit. Thus, the detection period is calculated.

  With this configuration, the feature amount of the person shown in the image (captured image) obtained by photographing the monitoring area is collated with the feature amount of a person (for example, a related person) of the person image registered in advance, so that they are the same person. Is determined, and the detection cycle of the person is calculated based on the comparison result. Thereby, it is possible to accurately determine whether or not the person is the same person as the related person, and it is possible to grasp the non-detected state of the related person.

  A non-detector notification system according to the present invention includes a non-detector notification system including an imaging device that captures a monitoring area and a non-detector notification device that notifies a non-detector using an image captured by the imaging device. In the system, the non-detection person notification device performs image processing on a person image included in the photographed image to calculate a feature amount of a person of the person image, and based on the feature amount Detection period calculation means for calculating a detection period for the person detected as the same person, and based on the detection period, whether or not the person has been detected for longer than a predetermined reference period. It has a configuration comprising non-detection determination means for determining and alarm output means for outputting a non-detection alarm signal for notifying that it is in a non-detection state.

  Even with this system, as in the case of the above-described apparatus, when a person is not detected greatly exceeding a usual detection cycle (for example, one week), it is possible to grasp that the person is in a different state from usual. It is possible to take measures to prevent the occurrence of accidents and incidents.

  In addition, the non-detector notification system of the present invention is installed in each of a plurality of monitoring areas, and a plurality of imaging devices that take images of each monitoring area, and current captured images captured by the plurality of imaging devices. Referring to FIG. 4, there is provided a configuration including current position search means for searching for an image of the same person as the person image determined to be in the non-detection state.

  With this configuration, it is possible to search the current position of a person in a non-detected state using captured images of a plurality of imaging devices installed in a plurality of monitoring areas. As a result, the current position of the non-detected person can be grasped, and measures for preventing the occurrence of an accident or an incident can be taken.

  Further, the non-detected person notification system of the present invention refers to the recording device that records the captured image and the person image that is determined to be in the non-detection state with reference to the past captured image recorded in the recording device. And a history search means for searching for an image of the same person as that person.

  With this configuration, it is possible to search past detection histories of non-detected persons using captured images recorded in the recording device. As a result, the past detection history of the non-detected person can be grasped, and it is possible to take measures to prevent the occurrence of an accident or an incident.

  The non-detection person notification method of the present invention performs image processing on a person image included in a captured image obtained by photographing a monitoring area, calculates a person feature amount of the person image, and sets the person as the same person based on the feature amount. A detection period for the detected person is calculated, and based on the detection period, it is determined whether or not the person is in a non-detection state in which the person has not been detected longer than a predetermined reference period. If determined, a non-detection alarm signal for notifying that it is in a non-detection state is output.

  Even in this method, as in the case of the above-described apparatus, when a person is not detected greatly exceeding a normal detection cycle (for example, one week), it is possible to grasp that the person is in a state different from the normal state. It is possible to take measures to prevent the occurrence of accidents and incidents.

  The present invention can provide a non-detection person notification device having an effect of appropriately performing notification of a non-detection state person (non-detection person) based on a person detection cycle.

  Hereinafter, a non-detector notification device according to an embodiment of the present invention will be described with reference to the drawings. In the present embodiment, a case where the non-detector notification device is used in a monitoring system such as an apartment or a school is illustrated. It can be said that the system using this non-detection person notification device is a non-detection person notification system.

  A configuration of a video management apparatus according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a configuration of a non-detection person notification device, and FIG. 2 is a diagram illustrating an example of the overall configuration of a non-detection person notification system.

  Here, first, the configuration of the entire non-detector notification system will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of the configuration of the video management system. As shown in FIG. 2, the non-detector notification system 1 includes a photographing device 2 installed in each of a plurality of monitoring areas such as a condominium and a school, and a non-detector notification in which video captured by the photographing device 2 is input. An apparatus 3 and a recording apparatus 4 that records video captured by the imaging apparatus 2 are provided. In the example of FIG. 2, three imaging devices 2 are illustrated, but the number of imaging devices 2 is not limited to this.

  Returning to FIG. 1, the configuration of the non-detector notification device 3 will be described. As shown in FIG. 1, the non-detection person notification device 3 includes an image input unit 5 to which a photographed image photographed by the photographing device 2 is input, and performs image processing on the photographed image to obtain a human face image in the image. A face detection unit 6 for detection is provided. Here, the face image corresponds to the person image of the present invention.

  The non-detection person notification device 3 includes a feature amount calculation unit 7 that performs image processing on the detected face image to calculate a feature amount. For example, the feature amount calculation unit 7 calculates a feature amount vector indicating the local feature amount of the feature point included in the face image as the feature amount of the person. The calculated feature amount data is stored in the feature amount database 8 (feature amount DB) together with face image identification information (face ID) and shooting date / time data. Here, the feature quantity DB 8 corresponds to the feature quantity storage means of the present invention.

  FIG. 3 is a diagram illustrating an example of data stored in the feature amount DB 8. As shown in FIG. 3, the feature amount DB 8 includes identification information (for example, ID: 0001) of face images and feature amounts (for example, feature amount vectors (a1, b1, c1, d1,...)). And data of the shooting date and time (for example, September 19, 2008, 7:30) are stored in association with each other.

  The non-detector notification device 3 includes the feature amount calculated by the feature amount calculation unit 7 (the feature amount of the person who has moved to the current photographed image) and the feature amount stored in the feature amount DB 8 (for the person calculated in the past). And a feature amount matching unit 9 that determines whether or not they are the same person.

  Further, the non-detector notification device 3 includes a person database 10 (person DB) in which face image data of related parties (persons to be collated) is registered in advance. The feature amount calculated by the calculation unit 7 (the feature amount of the person who has moved to the current photographed image) is collated with the feature amount of the person in the face image registered in advance to determine whether or not they are the same person. The function to perform.

  FIG. 4 is a diagram illustrating an example of data registered in advance in the person DB 10. As shown in FIG. 4, in the person DB 10, the names of persons concerned (for example, A), the face image (for example, image a), and identification information (for example, ID: A01) of the face image are stored in advance. It is registered.

  The non-detection person notification device 3 includes a detection period calculation unit 11 that calculates a detection period for a person detected as the same person based on the feature amount. For example, in the example of FIG. 4, the feature amounts of the persons with face ID: 0001 and face ID: 0004 are the same, and both are detected as being the same person. Then, the detection cycle calculation unit 11 calculates the detection cycle for this person as two days (from September 19, 2008, 7:30 to September 21, 2008, 7:30).

  The non-detector notification device 3 determines whether or not the person is in a non-detection state in which the person has not been detected longer than a predetermined reference time (for example, two days) based on the detection cycle calculated in this way. A detection determination unit 12 is provided. The non-detection determination unit 12 adjusts the length of the reference period based on calendar information and time information. For example, when the last day of the reference cycle is a holiday or Sunday, the last day of the reference cycle is extended to the next day. Alternatively, if the last time of the reference period is midnight, the last time of the reference period is extended to noon on the next day. Further, the non-detection determination unit 12 sets an age-specific margin (margin corresponding to age) in the reference period based on the age information of the person. For example, a 1-hour margin is set for the reference period for a 30-year-old person, and a 3-hour margin is set for the reference period for a 60-year-old person.

  And the non-detection person notification apparatus 3 is provided with the alarm output part 13 which outputs the non-detection alarm signal for notifying that it is a non-detection state. By this non-detection alarm signal, an alarm is issued, or cooperation with an external device (not shown) is taken, and measures are taken to prevent the occurrence of an accident or incident.

  In addition, the non-detection person notification device 3 refers to the current photographed image taken by the photographing device and performs a current position search for performing an image search for the same person as the person image determined to be in the non-detection state. And a history search unit 15 that performs an image search for the same person as the person image determined to be in the non-detection state with reference to past captured images recorded in the recording device 4.

  The operation of the non-detector notification device 3 configured as described above will be described with reference to the drawings.

  FIG. 5 is a flowchart showing an operation flow of the non-detector notification device 3. As shown in FIG. 5, when a photographed image photographed by the photographing apparatus is input (S1), a process of performing image processing on the photographed image and detecting a human face image in the image is performed (S2). . Then, the detected face image is subjected to image processing to calculate a feature amount (S3), and the calculated feature amount data is stored in the feature amount DB 8 together with the face ID of the face image and shooting date / time data. Stored (S4).

  Subsequently, it is determined whether or not they are the same person based on the feature amount of the face image (S5). For example, the feature amount calculated by the feature amount calculation unit 7 (the feature amount of the person who has moved to the current captured image) and the feature amount stored in the feature amount DB 8 (the feature amount of the person calculated in the past) are collated. Then, it is determined whether or not they are the same person. Alternatively, the feature amount calculated by the feature amount calculation unit 7 (the feature amount of the person who has moved to the current photographed image) is compared with the feature amount of the person in the face image registered in advance, so that they are the same person. A determination is made whether or not.

  Then, a detection cycle for the person detected as the same person is calculated based on the feature amount as described above (S6), and the person is detected longer than a predetermined reference time (for example, 2 days) based on the detection cycle. It is determined whether or not it is a non-detected state (S7). If it is determined that it is in a non-detection state, a non-detection alarm signal is output (S8). On the other hand, if it is not determined that it is in a non-detection state, a non-detection alarm signal is output. Instead, the process ends.

  According to such a non-detection person notification device 3 of the embodiment of the present invention, it is possible to appropriately perform notification of a non-detected person (non-detection person) based on a person detection cycle.

  That is, in the present embodiment, a feature amount of a person is calculated from a person image included in a captured image in the monitoring area, and a detection cycle is calculated for a person detected as the same person based on the feature amount. If a person is not detected for a longer period than the predetermined reference period, it is determined that the person is in a non-detection state, and a non-detection alarm signal is output. As a result, when a person is not detected much beyond the usual detection cycle (for example, one week), it is possible to grasp that the person is in a different state from the usual, and to prevent the occurrence of an accident or incident It becomes possible to take measures such as.

  In the present embodiment, the length of the reference period is appropriately adjusted based on calendar information and time information. For example, when the last day of the reference period is a holiday or Sunday, the last day of the reference period is extended to the next day. When the last time of the reference period is midnight, the last time of the reference period is extended to noon on the next day. Thereby, the non-detection state of a person can be appropriately grasped in consideration of circumstances such as day of the week and time.

  In the present embodiment, age-specific margins (margins according to age) are set in the reference period based on the age information of the person. For example, a 1-hour margin is set for the reference period for a 30-year-old person, and a 3-hour margin is set for the reference period for a 60-year-old person. Thereby, it is possible to appropriately grasp the non-detection state of the person in consideration of the age of the person.

  Further, in the present embodiment, the feature amount of a person shown in an image (captured image) taken of a monitoring area is compared with the feature amount of a person shown in an image taken in the past, so that the same person It is determined whether or not there is, and the detection period of the person is calculated based on the comparison result. Thereby, it is possible to determine whether or not the person is the same person without registering the person's image data in advance, and to know the non-detection state of the person.

  Further, in the present embodiment, the feature amount of the person shown in the image (captured image) obtained by photographing the monitoring area is compared with the feature amount of the person (for example, a related person) of the person image registered in advance. It is determined whether or not they are the same person, and the detection period of the person is calculated based on the comparison result. Thereby, it is possible to accurately determine whether or not the person is the same person as the related person, and it is possible to grasp the non-detected state of the related person.

  Further, in the present embodiment, it is possible to search for the current position of a person who is in a non-detected state by using captured images of a plurality of imaging devices installed in a plurality of monitoring areas. As a result, the current position of the non-detected person can be grasped, and measures for preventing the occurrence of an accident or an incident can be taken.

  Further, in the present embodiment, it is possible to search past detection histories of a person who is in a non-detection state using a captured image recorded in the recording device 4. As a result, the past detection history of the non-detected person can be grasped, and it is possible to take measures to prevent the occurrence of an accident or an incident.

  The embodiments of the present invention have been described above by way of example, but the scope of the present invention is not limited to these embodiments, and can be changed or modified in accordance with the purpose within the scope of the claims. is there.

  For example, in the above description, the case where it is determined whether or not the person is in the non-detection state on the basis of the cycle in which the same person is detected is illustrated, but the scope of the present invention is limited to this. Instead, it may be determined whether or not the person is in a non-detection state based on the number of times that the person is detected within a predetermined period (count number). For example, if a person who is detected seven times a week (= cycle 1 day) is detected only once a week (= cycle 1 week), it is determined that the person is in a non-detection state. May be.

  In the above description, the case where the feature amount DB 8 is provided in the non-detector notification device 3 is exemplified. However, the scope of the present invention is not limited to this, and the feature amount DB 8 is not detected by the non-detector. It may be provided as an external storage device of the notification device 3.

  In the above description, the case where the current position search unit 14 and the history search unit 15 are provided in the non-detector notification device 3 is illustrated, but the scope of the present invention is not limited thereto. The current position search unit 14 and the history search unit 15 may be provided in an external device (for example, the imaging device 2 or the recording device 4) of the non-detector notification device 3.

  As described above, the non-detection person notification device according to the present invention has an effect of appropriately performing notification of a non-detection state person (non-detection person) based on a person detection cycle. It is useful for monitoring systems in schools and schools.

The block diagram which shows the structure of the non-detection person notification apparatus in this Embodiment. The figure which shows the structural example of a non-detection person notification system Illustration of feature database Illustration of the person database Flow chart for explaining the operation of the non-detector notification device in the present embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Non-detection person notification system 2 Imaging device 3 Non-detection person notification apparatus 4 Recording apparatus 5 Image input part 6 Face detection part 7 Feature-value calculation part 8 Feature-value database 9 Feature-value collation part 10 Person database 11 Detection period calculation part 12 Non Detection determination unit 13 Alarm output unit 14 Current position search unit 15 History search unit

Claims (9)

A feature amount calculating means for performing image processing on a person image included in a captured image obtained by capturing a monitoring area and calculating a feature amount of the person in the person image;
A detection cycle calculating means for calculating a detection cycle for a person detected as the same person based on the feature amount;
Non-detection determining means for determining whether or not the person is in a non-detection state in which the person has not been detected longer than a predetermined reference period based on the detection period;
Alarm output means for outputting a non-detection alarm signal for notifying that it is in a non-detection state;
A non-detector notification device comprising:   The non-detection person notification device according to claim 1, wherein the non-detection determination unit adjusts a length of the reference period based on calendar information or time information.   3. The non-detection person notification device according to claim 1, wherein the non-detection determination unit sets an age-specific margin in the reference period based on age information of the person. Feature quantity storage means for storing the calculated feature quantity;
A feature that determines whether or not they are the same person by comparing the feature amount of the person in the person image included in the photographed image with the feature amount of the person calculated in the past and stored in the feature amount storage means. A quantity verification means;
With
The non-detection person notification device according to any one of claims 1 to 3, wherein the detection cycle calculation unit calculates the detection cycle based on a collation result of the feature amount collation unit. Person image storage means in which a person image of a person to be verified is registered in advance;
A feature amount collating unit that collates a person feature amount of a person image included in the photographed image with a person feature amount of the person image registered in advance to determine whether or not they are the same person;
With
The non-detection person notification device according to any one of claims 1 to 3, wherein the detection cycle calculation unit calculates the detection cycle based on a collation result of the feature amount collation unit. A non-detector notification system comprising: an imaging device that captures a monitoring area; and a non-detector notification device that notifies a non-detector using a video captured by the imaging device,
The non-detection person notification device includes:
A feature amount calculating means for performing image processing on a person image included in the photographed image and calculating a feature amount of the person of the person image;
A detection cycle calculating means for calculating a detection cycle for a person detected as the same person based on the feature amount;
Non-detection determining means for determining whether or not the person is in a non-detection state in which the person has not been detected longer than a predetermined reference period based on the detection period;
Alarm output means for outputting a non-detection alarm signal for notifying that it is in a non-detection state;
A non-detector notification system comprising: A plurality of imaging devices installed for each of the plurality of monitoring areas, for capturing images of the respective monitoring areas;
Current position search means for searching for the same person as the person in the person image determined to be in a non-detection state with reference to the current photographed images photographed by the plurality of photographing devices;
The non-detector notification system according to claim 6, further comprising: A recording device for recording the captured image;
A history search means for searching for an image of the same person as the person image determined to be in a non-detection state with reference to a past photographed image recorded in the recording device;
The non-detector notification system according to claim 6 or 7, further comprising: Image processing is performed on a person image included in a captured image obtained by photographing a monitoring area, and a feature amount of the person in the person image is calculated;
Calculating a detection cycle for a person detected as the same person based on the feature amount;
Based on the detection period, it is determined whether or not the person is in a non-detection state that has not been detected longer than a predetermined reference period,
A non-detected person notification method characterized by outputting a non-detected alarm signal for notifying that a non-detected state is detected when it is determined that the non-detected state is detected.

Images