JP2008017093A - Monitoring system, monitoring device, and monitoring method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a monitoring system without needs to focus the photographing range of a camera onto a figure of interest only, and capable of protecting privacy of figures other than the a figure of interest. <P>SOLUTION: A data center 105 inputs a captured image photographed when a figure of interest holding a wireless IC tag 125 passes near the photographing apparatus 101, and detects a face segment as a specific area out of the captured image using a face segment detecting device 107. In addition, the amount of face features is acquired for the figure of interest registered at a data base 110 based on an individual identification information obtained from the wireless IC tag 125 by a face identifying device 108, and a face segment matched with the figure of interest is identified among the detected face segments. Then, face segments other than the identified face segment of the figure of interest are masked by a masking device 109 to generate a masked image, the masked image is associated with the individual identification information by image data management device 106, and it is held for public presentation. If there is a browsing request from a browsing terminal 111, a masked image corresponding to an authenticated individual identification information is transmitted. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a monitoring system, a monitoring apparatus, and a monitoring method for monitoring a person with a captured image.

  In recent years, the spread of the Internet has made it possible to implement a remote monitoring system via a network at a low cost. On the other hand, crimes are increasing steadily, especially violent crimes targeting children have become a major social problem.

  Under such circumstances, many monitoring systems have been developed for local governments and companies to protect the safety of children. In the surveillance system, in particular, in order to watch the children go to school, a surveillance camera is installed on the street around the school route. When approaching, a system in which a surveillance camera acquires an image and stores it in a Web server is being studied.

  In such a monitoring system, the guardian accesses the Web server from a personal computer at home and acquires the child's image by himself, so the child's safety can be watched. However, in the above monitoring system, it is considered that a person other than the target child is included in the image, and there is a possibility that the privacy of the person is infringed.

  On the other hand, the position information is acquired from the wireless IC tag held by the child, and the pan / tilt / zoom operation of the camera is performed based on the position information to photograph the image of only the target child. A monitoring system for browsing images has been proposed (see Patent Document 1). In this conventional monitoring system, it is possible to prevent other children from appearing in the image, and privacy protection is ensured.

  In this way, in a surveillance system where the camera installed on the street performs pan / tilt / zoom operations to acquire images of only the target child and the guardian views it, the guardian monitors the child's attendance at school. It is considered that privacy protection can be achieved at the same time.

JP 2002-269209 A

  However, the conventional monitoring system has the following problems when the position information is acquired from the wireless IC tag and the pan / tilt / zoom operation of the camera is performed based on the position information.

  In the above conventional monitoring system, in practice, it is difficult to accurately grasp the position information of the child from the information of the wireless IC tag, and it is not always possible to photograph only the target child. In addition, when a large number of children with wireless IC tags enter the shooting range of the camera at the same time, it is necessary to zoom and photograph the children in order with a single camera. There was a problem of missing. In addition, since a camera capable of pan / tilt / zoom operation is expensive, it is difficult to install the system by installing cameras at many points.

  The present invention has been made in view of the above circumstances, and it is not necessary to acquire accurate position information of the target person or to match the shooting range of the camera only to the target person. It is an object to provide a monitoring system, a monitoring apparatus, and a monitoring method capable of protecting privacy. In addition, the present invention provides a monitoring system, a monitoring apparatus, and a monitoring method capable of obtaining a monitoring image without missing an opportunity even when a large number of target persons simultaneously enter the shooting range of the camera. For the purpose.

The monitoring system of the present invention is a monitoring system for monitoring a person with a captured image, a signal receiving unit that receives a signal from a transmission source possessed by the target person and acquires identification information included in the received signal; An image capturing unit that captures an image in a predetermined range in response to reception of the signal; an area detection unit that detects a specific area in the captured image; and the identification from the detected specific area A region identifying unit for identifying a target specific region corresponding to information; a masking unit for generating a mask image by masking other specific regions excluding the identified target specific region; and associating the mask image with the identification information An image data holding unit that holds the mask image, and an image transmission unit that transmits the held mask image.
As a result, it is possible to protect the privacy of persons other than those who appear by chance without having to acquire accurate position information of the target person or to adjust the shooting range of the camera only to the target person. . Further, even when a large number of target persons enter the shooting range of the camera all at once, it is possible to obtain a monitoring image by shooting without missing the opportunity.

Further, the present invention is the above monitoring system, wherein an authentication information transmitting unit that transmits authentication information to be associated with the identification information, an image receiving unit that receives the transmitted mask image, and the received mask A display unit that displays an image, and the image transmission unit specifies identification information corresponding to the authentication information, and transmits a mask image related to the identification information to a transmission source of the authentication information.
As a result, the monitor can browse the mask image generated by the monitoring system on a browsing terminal or the like, and only the person who is the subject in the mask image can be viewed.

Further, the present invention is the monitoring system described above, wherein the region detection unit detects a face region in the image as the specific region, and the region identification unit detects a target person corresponding to the identification information. The face area is identified as the target specific area.
Thereby, the person who becomes object can be specified correctly.

The present invention is the monitoring system described above, further comprising a database in which facial feature amounts are registered, wherein the region identifying unit uses the identification information to identify the facial feature amounts of the target person registered in the database. , And the acquired face feature quantity is compared with the detected face feature quantity of the face area, and the face area of the target person corresponding to the identification information is identified from the comparison result.
Thus, the face area can be automatically detected by previously registering the face feature amount of the target person in the database.

Moreover, this invention is said monitoring system, Comprising: The said masking part shall mask face areas other than the target person's face area corresponding to the said identification information.
As a result, it is possible to hide a face portion that is liable to be infringed on the privacy of a person other than the target person, thereby protecting the privacy.

Moreover, this invention is said monitoring system, Comprising: The said masking part shall mask all area | regions other than the target person's face area corresponding to the said identification information.
Thereby, the privacy protection regarding persons other than the target person can be remarkably enhanced. Also, privacy can be maintained even when face regions other than the target person cannot be detected accurately.

Moreover, this invention is said monitoring system, Comprising: The said masking part shall not produce | generate the said mask image, when the said area identification part cannot identify the specific area | region corresponding to the said identification information.
Thereby, the process which produces | generates an unnecessary image can be suppressed and the efficiency of a process can be aimed at. In addition, for example, when the reliability of the accuracy of face area detection and identification is low, an image is not generated, and thus an image that has been subjected to inaccurate masking due to erroneous detection and misidentification is distributed and privacy is infringed. Can be prevented.

Moreover, this invention is said monitoring system, Comprising: The said area | region detection part shall detect the area | region of the moving object in the said image as said specific area.
Thereby, by detecting the area of the moving object as the specific area, the processing load can be reduced as compared with the detection of the face area.

Further, the present invention is the monitoring system described above, wherein the area identification unit corresponds to the area of the target person using the feature data associated with the identification information as the area of the moving object corresponding to the identification information. It is identified as a target specific area to be performed.
Thereby, the area of the moving object corresponding to the target person can be easily identified.

Moreover, this invention is said monitoring system, Comprising: The said masking part shall mask the area | region of moving objects other than the area | region of the object person corresponding to the said identification information.
Thereby, the privacy protection regarding persons other than the target person can be enhanced by masking the entire area of the moving object other than the area of the target person.

Further, the present invention is the monitoring system described above, wherein a masking method by the masking unit is selectable, and the masking unit masks an area other than the target specific area according to the selected masking method. And
As a result, it is possible to obtain a desired mask image for the supervisor in a state in which privacy is protected.

  The monitoring method of the present invention is a monitoring method for monitoring a person with a captured image, a signal receiving step of receiving a signal from a transmission source possessed by the target person and acquiring identification information included in the received signal; In response to the reception of the signal, an imaging step of capturing an image in a predetermined range by an imaging unit, an area detection step of detecting a specific area in the captured image, and the detected specific area A region identifying step for identifying a target specific region corresponding to the identification information, a masking step for generating a mask image by masking other specific regions excluding the identified target specific region, and identifying the mask image The image data holding step for holding the image in association with the information and the image transmission step for transmitting the held mask image are included.

  The monitoring device of the present invention is a monitoring device that monitors a person with a captured image, a data receiving unit that receives image data of the captured image and identification information of the person included in the image, and the captured image An area detection unit for detecting a specific area therein, an area identification unit for identifying a target specific area corresponding to the identification information from the detected specific area, and excluding the identified target specific area, A masking unit that masks a specific region to generate a mask image, an image data holding unit that holds the mask image in association with the identification information, and an image transmission unit that transmits the held mask image. is there.

  According to the present invention, it is not necessary to acquire accurate position information of a target person or to match the shooting range of the camera only to the target person, and it is possible to protect the privacy of persons other than the target. A monitoring system, a monitoring device, and a monitoring method can be provided. In addition, it is possible to provide a monitoring system, a monitoring apparatus, and a monitoring method capable of obtaining a monitoring image without missing an opportunity even when a large number of target persons enter the shooting range of the camera all at once.

  In the present embodiment, as an example of a monitoring system, a configuration example applied to a monitoring system for a parent to watch a child attending school is shown. This monitoring system is configured as a remote monitoring system in which an image taken by a camera installed in a school road is transmitted via a network, and a guardian displays and browses an image on a terminal.

(First embodiment)
FIG. 1 is a diagram showing a configuration of a monitoring system according to the first embodiment of the present invention. The monitoring system has a configuration in which a photographing apparatus 101, a data center 105, and a browsing terminal 111 are connected to each other via a network 104 such as the Internet or a public line so as to be able to perform data communication with each other. In FIG. 1, only one monitoring device and two browsing terminals 111 are depicted, but any number of devices can be connected in practice.

  The photographing apparatus 101 includes a camera 102 and an IC tag signal receiving apparatus 103. The camera 102 corresponds to an example of a photographing unit, and is a fixed camera installed in the vicinity of the IC tag signal receiving device 103, and photographs a preset photographing range. In the present embodiment, an arbitrary location on the school route of the child is set as the shooting range. The camera of this embodiment does not have a pan / tilt / zoom function, but may have a pan / tilt / zoom function.

  The IC tag signal receiving device 103 corresponds to an example of a signal receiving unit, and communicates with a wireless IC tag 125 corresponding to an example of a transmission source built in a name tag or the like possessed by a child who is a target person. When the IC tag signal receiving device 103 receives a signal (IC tag signal) output from the wireless IC tag 125 as the child approaches, the IC tag signal receiving device 103 outputs a shooting start signal to the camera 102 and also converts the IC tag signal as identification information. Acquire information such as personal identification information. Here, the wireless IC tag includes an active tag that actively transmits a signal by itself and a passive tag that transmits a signal after receiving a signal from a receiving device. However, the method of the wireless IC tag is not particularly limited.

  Image data based on an image captured by the image capturing apparatus 101 and personal identification information acquired by the IC tag signal receiving apparatus 103 are transmitted to the data center 105 via the network 104.

  The data center 105 includes an image data management device 106, a face area detection device 107, a face identification device 108, a masking device 109, and a face feature amount database 110 (DB). In the face feature amount DB 110, face feature amounts of persons to be monitored (children in this embodiment) in this monitoring system are registered and accumulated in advance.

  The face area detection device 107 corresponds to an example of an area detection unit, and detects a face area as a specific area in the received image. As a method for detecting a face region, for example, a multiple matching face detection method for extracting a region that is determined to be similar to eyes from a captured image and determining whether or not it is a face can be used. The face identification device 108 corresponds to an example of a region identification unit, refers to the face feature amount DB 110 based on personal identification information, and acquires the face feature amount of a monitoring target child who has a wireless IC tag. . Furthermore, from all the face areas detected by the face area detecting device 107, a face area having a feature amount that matches the face feature amount of the child is identified as a target specific area.

  The masking device 109 corresponds to an example of a masking unit, and among the face regions detected by the face region detection device 107, face regions other than the child's face region (target specific region) identified by the face identification device 108. And a mask image is generated so that a person not to be monitored cannot be identified. Further, the masking device 109 transmits the generated image to the image data management device 106. The image data management device 106 has functions of an image data holding unit and an image transmission unit, holds image data masked by the masking device 109 and personal identification information in association with each other so that they can be viewed from the outside. Publish to Accordingly, the image data management device 106 stores a large number of image data (including mask images) taken at a plurality of points.

  The functions of the image data management device 106, the face area detection device 107, the face identification device 108, and the masking device 109 are realized by a processor executing a program stored in a recording medium in a computer provided in the data center 105. Is done.

  The browsing terminal 111 is for browsing the image data and the like stored in the image data management device 106. The browsing terminal 111 is a general-purpose personal computer (PC) installed in the home of a child's guardian, a mobile phone device, a mobile phone. It consists of information terminals. The browsing terminal 111 includes a communication unit (not shown) that transmits and receives data via the network 104, and realizes functions of an authentication information transmission unit and an image reception unit. In addition, the browsing terminal 111 includes a display unit that displays a captured image that has become a mask image.

  The operation of the monitoring system having the above configuration will be described. FIG. 2 is a flowchart showing a monitoring processing procedure in the photographing apparatus 101. This process is repeatedly performed by the processor executing a program stored in a storage medium provided in the photographing apparatus 101.

  First, it is determined whether or not the wireless IC tag signal is received by the IC tag signal receiving device 103 (step S1). When the wireless IC tag signal is received, the personal identification information included in the wireless IC tag signal is acquired (step S2). In synchronization with the reception of the wireless IC signal, a shooting start signal is output from the IC tag signal receiving device 103 and shot by the camera 102 (step S3). The image data of the captured image and the acquired personal identification information are transmitted to the data center 105 via the network 104 (step S4). Then, this process is complete | finished. On the other hand, if the wireless IC tag signal is not received in step S1, this processing is terminated as it is.

  Specifically, when a child carrying a wireless IC tag approaches the IC tag signal receiving device 103, the IC tag signal receiving device 103 receives a wireless IC tag signal from the wireless IC tag and transmits a shooting start signal to the camera 102. To do. When the camera 102 receives a shooting start signal from the IC tag signal receiving device 103, the camera 102 takes a shooting range set in the vicinity of the IC tag signal receiving device 103 and generates image data.

  In this way, when a child carrying a wireless IC tag approaches, shooting is automatically performed and an image is generated. FIG. 3 is a diagram showing a captured image and an image subjected to image processing. FIG. 3A shows a captured image. In the photographed image 201, a large number of persons are photographed in addition to the child 201a to be photographed.

  As described above, when the image capturing apparatus 101 acquires an image captured by the camera 102, the image capturing apparatus 101 transmits the image data and related information to the data center 105 via the network 104. The related information includes personal identification information acquired from the wireless IC tag signal. As will be described later, the personal identification information and the image data are associated with each other and held in the image data management device 106 in the data center 105. At this time, since the image is not disclosed via the network, it cannot be viewed from the browsing terminal 111. That is, the guardian cannot view an image that may show an unspecified number of persons.

  FIG. 4 is a flowchart showing a processing procedure for storing image data and related information in the data center 105. This process is performed by the processor executing a program stored in a storage medium provided in each device constituting the data center 105. First, it is determined whether image data and personal identification information have been received from the photographing apparatus 101 (step S11). If image data and personal identification information are received, the image data is associated with the personal identification information and stored so as not to be browsed (step S12). An example of a method for saving the image so as not to be browsed is to save it in a storage area that is not disclosed. The stored image data is read and all face areas in the image are detected (step S13).

  FIG. 3B shows an image 202 in which a face area is detected with respect to the captured image 201 of FIG. In the image 202, all detected face regions 202a to 202d are drawn so as to be surrounded by a square frame with a broken line.

  Then, referring to the face feature DB 110 based on the personal identification information received in step S11, the registered face feature of the child possessing the IC tag is acquired (step S14). Face recognition is performed using the acquired face feature value, and a face area that matches the face feature value is detected from all face areas in the image 202 (step S15). As a result of the face recognition, masking processing is performed on other face areas excluding the matched face area so that the face area is not displayed in the image (step S16).

  FIG. 3C shows an image 203 obtained by performing masking processing on the image 202 shown in FIG. In the image 203, the masked face areas 203b, 203c, and 203d are drawn in a solid shape on a square frame.

  Next, the image data subjected to the masking process is associated with the personal identification information and stored in the image data management device 106 so as to be viewable (step S17). As a method for saving the file so as to be viewable, for example, the image data can be saved in a public storage area in the image data management apparatus 106. Then, this process is complete | finished. On the other hand, if the image data and the personal identification information are not received in step S11, this process is terminated as it is. Thereby, the masked image (mask image) can be browsed from the outside.

  When a guardian of a child browses a mask image, the image data management device 106 in the data center 105 is accessed using a browsing terminal 111 such as a personal computer in which browsing software (browser application) is installed.

  FIG. 5 is a flowchart showing a processing procedure when browsing a mask image in the browsing terminal 111 and the data center 105. FIG. 5A is a flowchart showing a browsing process procedure in the browsing terminal 111. This process is performed by the processor executing a program stored in a storage medium provided in the browsing terminal 111. FIG. 5B is a flowchart showing a browsing process procedure in the image data management apparatus 106 in the data center 105. This process is performed by the processor executing a program stored in a storage medium provided in the image data management apparatus 106.

  The browsing terminal 111 side waits until the user ID and password are input by the guardian (step S21). When the user ID and password are input, the personal identification information is transmitted to the image data management device 106 (step S22). And it is discriminate | determined whether browsing was permitted from the image data management apparatus 106 (step S23). When browsing is permitted, a list of selection screens representing time-series image data held in the image data management device 106 is transmitted from the image data management device 106 to the browsing terminal 111.

  FIG. 6 is a diagram showing a list of selection screens displayed on the portable terminal 111. The selection screen list includes a selection button 281 for requesting transmission of an image of each spot where the target child was photographed. The guardian can request a selection screen by selecting a desired selection button 281. When browsing is permitted, a request for a selection screen designated by the guardian is transmitted to the data center 105 (step S24). In this selection screen request, it is possible to request at which point a screen representing an image taken by a camera is displayed.

  The process waits until image data corresponding to the request is received from the image data management apparatus 106 (step S25). When the image data is received, the image is displayed on the screen (step S26). Thereby, the guardian can browse the mask image in which only the target child is shown.

  Thereafter, it is determined whether or not logout is input by the guardian (step S27). If logout is not input, the process returns to step S24. On the other hand, when logout is input, this process is terminated. On the other hand, when browsing is not permitted in step S23, this process is ended as it is.

  On the image data management apparatus 106 side, it is determined whether or not a user ID and a password are received as authentication information from the browsing terminal 111 (step S31). When the user ID and password are received, authentication is performed (step S32). It is determined whether or not the authentication result has been confirmed (step S33). When authentication is confirmed, browsing permission is transmitted (step S34). As authentication information, individual information and address information of a browsing terminal, ID information such as a wireless IC tag and an IC card, and the like can be used in addition to a user ID and a password.

  And it waits until the request | requirement of a selection screen is received from the terminal 111 for browsing (step S35). When the request for the selection screen is received, the image data corresponding to the request is transmitted to the browsing terminal 111 (step S36). Then, it is determined whether or not logout has been performed (step S37). When logout has been performed, this processing is terminated. On the other hand, if logout is not performed, the process returns to step S35. On the other hand, if the authentication cannot be confirmed in step S33, or if the user ID and password cannot be received in step S31, the process is terminated.

  As described above, the image data management apparatus 106 requests input of a user ID and a password. In response to this request, the guardian inputs this information. If authenticated correctly, the image data management device 106 manages session information (information from login to logout) with the guardian, always holds the personal identification information of the child corresponding to the guardian, and Only the image associated with the identification information can be viewed. On the other hand, the guardian can select what he / she wants to view from the images he / she can view and check on the screen of the browsing terminal 111. This allows the guardian to view only the mask image in which the face images other than the registered children are masked.

  According to the monitoring system of the first embodiment, it is possible to realize mutual privacy protection even in a monitoring system in which a large number of children are registered. Further, a general person who is not registered in the monitoring system may be reflected in the image of the camera, but the face image of a person other than the subject that has been captured is also masked. Therefore, even in places where many unspecified persons such as streets come and go, the introduction of this system reduces the psychological resistance of surrounding people and facilitates the introduction. Also, the camera does not require functions such as pan / tilt / zoom, which is advantageous in terms of cost.

  Further, by identifying the face, the target person can be accurately specified, and the face portion that is liable to infringe privacy can be hidden.

  Even when a plurality of persons registered in the same image are captured, it is possible to easily cope with a plurality of persons by changing the masking area in one image. That is, when a plurality of wireless IC tag signals compete, each individual identification information is acquired, and a different mask image is generated for each individual identification information from one photographed image. Then, when there is a browsing request from each guardian, a mask image corresponding to the personal identification information is transmitted. Of course, even when a plurality of wireless IC tags compete, a captured image may be generated each time an individual IC tag signal is received.

  Further, in the above embodiment, only the face area of a person other than the monitoring target is masked. However, all areas other than the face area corresponding to the personal identification information may be masked in the captured image, thereby enhancing privacy. it can.

(Second Embodiment)
FIG. 7 is a diagram showing a configuration of a monitoring system according to the second embodiment of the present invention. In the monitoring system of the first embodiment, the area is masked by performing face recognition from the captured image, but in the monitoring system of the second embodiment, an example of detecting the moving object and masking the area is shown. Indicates.

  The monitoring system of the second embodiment has a configuration in which a plurality of monitoring nodes 310 and a monitoring center 330 are connected to each other via a VPN (Virtual Private Network) 340 so that data communication is possible. A user's portable terminal 370 is connected to the watching center 330 via a network 360.

  The watching node 310 includes a camera 311, an electronic tag reader 312, a motion detection unit 313, and a controller 314.

  The camera 311 is a fixed camera installed at a monitoring target location such as a street, and shoots a preset area (shooting range) to generate image data. The electronic tag reader 312 reads a wireless IC tag signal from a wireless IC tag built in a name tag attached to the chest of the child. This wireless IC tag signal includes personal identification information as in the first embodiment.

  The motion detection unit 313 corresponds to an example of a region detection unit, calculates a difference between two temporally different images in units of pixels, and estimates that there is a moving object in a region having a difference greater than or equal to a predetermined value. The area of the moving object in the image is detected by the inter-frame difference method.

  When the controller 314 detects the wireless IC tag signal from the electronic tag reader 312, it outputs a shooting start signal. Also, the image data and metadata from the motion detection unit 310 and the personal identification information from the electronic tag reader 312 are transmitted to the watching center 330 via the VPN 340. The metadata includes the number of moving objects and their coordinates. The VPN 340 is a virtual dedicated line that connects the watching node 310 and the watching center 330.

  The watching center 330 includes a router 331, a hub (HUB) 332, a Web server 333, a mail server 334, a history data server 335, an image search server 336, and a database (DB) 337. The monitoring center 330 receives the image data, metadata, and personal identification information from the monitoring node 310 and identifies a moving object corresponding to the personal identification information (corresponding to an example of an area identification unit). Masking function (corresponding to an example of a masking unit) for masking a region of a moving object other than a moving object corresponding to personal identification information, and a mask image transmission function (an example of an image transmitting unit) for transmitting a mask image held in the database 337 Corresponding to). The database 337 corresponds to an example of an image data holding unit, in which feature data as personal identification information is registered in addition to image data of a captured image and a mask image. Examples of the feature data include face and body features, specific colors, specific shapes, specific pattern patterns, and the like.

  The portable terminal 370 is a personal computer (personal computer) 371 or a mobile phone device 372. The mobile phone device 372 can be connected to the network 360 through the mobile phone operator 380.

  The operation of the monitoring system having the above configuration will be described. FIG. 8 is a flowchart showing an operation processing procedure in the watching node 310. This process is performed by the processor executing a program stored in a storage medium provided in the watching node 310.

  First, the electronic tag reader 312 determines whether or not a wireless IC tag signal has been received (step S51). When the wireless IC tag signal is received, the personal identification information included in the wireless IC tag signal is acquired (step S52). Then, an image of the shooting range set by the camera 311 is shot (step S53). Using this captured image, a moving object in the image is detected by the inter-frame difference method (step S54).

  FIG. 9 is a diagram illustrating an example of a captured image in which a moving object is detected. In this image, two children are detected as moving objects, in addition to a child holding a name tag with a built-in IC tag 401. Each moving object is drawn with dashed frames a, b, and c. When a moving object is detected, the number of detected moving objects and their coordinates are further acquired as metadata (step S55). These pieces of information (personal identification information, the number and coordinates of moving objects) are transmitted to the watching center 330 via the VPN 340 together with the image data (step S56). Then, this process is complete | finished. On the other hand, when the wireless IC tag signal is not received in step S51, the present process is terminated.

  FIG. 10 is a flowchart showing a processing procedure for storing image data and related information in the watching center 330. This process is performed by the processor executing a program stored in a storage medium provided in the watching center 330.

  First, it is determined whether image data, metadata, and personal identification information in which a moving object is detected are received from the watching node 310 (step S61). When image data, metadata, and personal identification information are received, the image data is associated with the personal identification information and stored so as not to be browsed (step S62). As a method for saving data so that it cannot be browsed, it is possible to save it in a storage area that is not disclosed.

  Based on the number of moving objects and the coordinates of the moving objects included in the metadata, a masking process is performed on the area of other moving objects excluding the moving objects by the child holding the wireless IC tag 401 (step S63). In this masking process, the feature data of the child associated with the personal identification information registered in the database 337 is compared with the data of the moving object in the photographed image, and the personal identification information is handled based on the comparison result. A moving object to be identified is specified, and areas of moving objects other than the specified moving object are masked. As described above, the feature data corresponding to the personal information includes a face, a body feature, a specific color, a specific shape object, a specific pattern pattern, and the like.

  FIG. 11 is a diagram showing an image on which masking processing has been performed. In the figure, the area of the moving object surrounded by a broken-line frame a is an area corresponding to the target person specified by the personal identification information, and only this area is drawn as it is. The area surrounded by the broken frames b and c, which are other moving object areas, are masked and drawn in a solid color, and a person or the like is not specified.

  Then, the image data subjected to the masking process is associated with the personal identification information and stored so as to be viewable (step S64). As a method for saving the file so as to be viewable, it is possible to save it in a public storage area. Then, this process is complete | finished. On the other hand, when the image data, metadata, and personal identification information are not received in step S61, this process is terminated as it is. Thereby, the mask image can be browsed from the browsing terminal 370.

  In addition, since the operation | movement which a guardian accesses to the watching center 330 from the portable terminal 370 and browses an image is the same as that of the said 1st Embodiment, description is abbreviate | omitted here.

  According to the monitoring system of the second embodiment, since the area of the moving object is detected from the captured image, it is possible to reduce the processing load when detecting the masking target area as compared with the detection of the face area. In addition, it is possible to easily identify the area of the target moving object, and to mask the entire area of the moving object, thereby increasing privacy.

  It should be noted that the present invention is not limited to those shown in the above-described embodiments, and those skilled in the art can also make changes and applications based on the description in the specification and well-known techniques. Yes, included in the scope of protection.

  For example, in the above embodiment, the masking is solid when masking. However, masking may be performed by various methods such as mosaic, blurring, and replacement with a specific image. Further, the masking method may be selected by the user from the portable terminal, and a desired mask image can be obtained.

  Further, instead of authenticating the face in the photographed image, authentication of clothes or the like may be performed to specify the person.

  In addition, when the face image cannot be authenticated in the captured image, the image may not be masked and the image may be hidden. This eliminates the need to generate unnecessary images. In this case, the description information and time information of the IC tag may be disclosed.

  Further, when detecting a moving object, the moving object is detected by the inter-frame difference method, but the detection method is not particularly limited, and for example, the moving object may be detected by a template matching method.

  In addition, when multiple wireless IC tags compete, an image in which the masking area is changed from the same image may be generated and disclosed to each user, or an IC tag signal from each wireless IC tag may be received. A captured image may be generated each time.

  In addition, as a device for detecting and authenticating a person to be monitored, a wireless IC tag and an IC tag signal receiving device are used. A combination of devices for transmitting and receiving may be used.

  In the above embodiment, a monitoring system for a parent to watch a child attending school has been shown. However, the monitoring system of the present invention is not limited to this application, and privacy of a general monitoring system is not limited. It can also be applied to protection.

  The present invention eliminates the need to acquire accurate position information of the target person or to match the shooting range of the camera only to the target person, and can protect the privacy of persons other than the target. Even when a large number of persons enter the shooting range of the camera all at once, the monitoring system, the monitoring apparatus, and the monitoring have the effect of being able to obtain a monitoring image without missing the opportunity, and monitoring the person with the captured image Useful for methods and the like.

The figure which shows the structure of the monitoring system which concerns on the 1st Embodiment of this invention. The flowchart which shows the monitoring processing procedure in the monitoring apparatus of 1st Embodiment. The figure which shows the image by which the image | photographed image and image processing in 1st Embodiment were performed The flowchart which shows the process sequence which preserve | saves the image data in the data center of 1st Embodiment, and its related information. The flowchart which shows the process sequence at the time of browsing the mask image in the terminal for browsing of 1st Embodiment, and a data center. The figure which shows the list of the selection screen displayed on the portable terminal in 1st Embodiment. The figure which shows the structure of the monitoring system which concerns on the 2nd Embodiment of this invention. The flowchart which shows the operation | movement process procedure in the watching node of 2nd Embodiment. The figure which shows the example of the picked-up image from which the moving object in 2nd Embodiment was detected The flowchart which shows the process sequence which preserve | saves the image data in the monitoring center of 2nd Embodiment, and its related information. The figure which shows the image in which the masking process in 2nd Embodiment was performed

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Image pick-up apparatus 102, 311 Camera 103 IC tag signal receiving apparatus 104, 360 Network 105 Data center 106 Image data management apparatus 107 Face area detection apparatus 108 Face identification apparatus 109 Masking apparatus 111 Browsing terminal 125, 401 Wireless IC tag 310 Watching node 312 Electronic tag reader 313 Motion detection unit 314 Controller 330 Watching center 333 Web server 334 Mail server 335 History data server 336 Image search server 337 Database 370 Portable terminal

Claims (13)

A monitoring system for monitoring a person with a captured image,
A signal receiving unit that receives a signal from a transmission source possessed by the target person, and acquires identification information included in the received signal;
An imaging unit that captures an image of a predetermined range in response to reception of the signal;
An area detector for detecting a specific area in the captured image;
An area identifying unit for identifying a target specific area corresponding to the identification information from among the detected specific areas;
A masking unit that generates a mask image by masking other specific areas, excluding the identified target specific area;
An image data holding unit for holding the mask image in association with the identification information;
An image transmitter for transmitting the held mask image;
A monitoring system comprising: The monitoring system according to claim 1,
An authentication information transmitting unit for transmitting authentication information to be associated with the identification information;
An image receiving unit for receiving the transmitted mask image;
A display unit for displaying the received mask image;
The said image transmission part specifies the identification information corresponding to the said authentication information, The monitoring system which transmits the mask image relevant to this identification information to the transmission source of the said authentication information. The monitoring system according to claim 1,
The area detection unit detects a face area in the image as the specific area,
The area identification unit is a monitoring system that identifies a face area of a target person corresponding to the identification information as a target specific area. The monitoring system according to claim 3,
It has a database with registered facial features,
The region identification unit acquires a facial feature amount of a target person registered in the database using the identification information, and compares the acquired facial feature amount with a facial feature amount of the detected facial region. A monitoring system for identifying the face area of the target person corresponding to the identification information from the comparison result. The monitoring system according to claim 4,
The said masking part is a monitoring system which masks face areas other than the target person's face area corresponding to the said identification information. The monitoring system according to claim 4,
The said masking part is a monitoring system which masks all area | regions other than the target person's face area | region corresponding to the said identification information. The monitoring system according to claim 1,
The monitoring system, wherein the masking unit does not generate the mask image when the region identification unit cannot identify a specific region corresponding to the identification information. The monitoring system according to claim 1,
The region detection unit is a monitoring system that detects a region of a moving object in the image as the specific region. 9. The monitoring system according to claim 8, wherein
The monitoring system for identifying a moving object region corresponding to the identification information as a target specific region corresponding to a target person region, using the feature data associated with the identification information. The monitoring system according to claim 9, wherein
The said masking part is a monitoring system which masks the area | region of a moving object other than the area | region of the object person corresponding to the said identification information. The monitoring system according to claim 1,
The masking method by the masking part can be selected,
The said masking part is a monitoring system which masks area | regions other than the said object specific area | region according to the selected masking method. A monitoring method for monitoring a person with a captured image,
A signal receiving step of receiving a signal from a transmission source possessed by the target person and acquiring identification information included in the received signal;
In response to receiving the signal, a photographing step of photographing an image of a predetermined range by the photographing unit;
A region detecting step of detecting a specific region in the captured image;
An area identifying step for identifying a target specific area corresponding to the identification information from among the detected specific areas;
A masking step of generating a mask image by masking other specific regions excluding the identified target specific region;
An image data holding step for holding the mask image in association with the identification information;
An image transmission step of transmitting the held mask image;
Monitoring method. A monitoring device for monitoring a person by a captured image,
A data receiving unit for receiving image data of a photographed image and identification information of a person included in the image;
An area detector for detecting a specific area in the captured image;
An area identifying unit for identifying a target specific area corresponding to the identification information from among the detected specific areas;
A masking unit that generates a mask image by masking other specific areas, excluding the identified target specific area;
An image data holding unit for holding the mask image in association with the identification information;
An image transmitter for transmitting the held mask image;
A monitoring device comprising:

Images