KR20130110978A - Remote video monitoring method and system including privacy protecion - Google Patents

Abstract

PURPOSE: A method and system can prevent violating privacy of citizens more than necessary. CONSTITUTION: Some part within a surveillance video is set as a privacy protection target. A monitoring right of a monitor agent requesting video monitoring is checked (S105). A surveillance video is provided to a monitor in real time, a video for the privacy protection target is selectively provided according to the monitoring right of the monitor agent (S106-S110). [Reference numerals] (AA) Start; (BB) End; (S100) Initialize (set privacy protection targets and information provision levels according to each monitoring authority); (S101) Is there any video monitoring request ?; (S102) Has a monitoring requestor's personal information been inputted ?; (S103) Is he/she a registered monitor ?; (S104) Register as a monitor; (S105) Check his/her monitoring authority; (S106) First grade ?; (S107) Permit both to provide the images of the privacy protection targets and to monitor objects; (S108) Second grade ?; (S109) Prevent him/her from object-monitoring the privacy protection targets; (S110) Prevent him/her both from object-monitoring and image-monitoring the privacy protection targets

Description

Video surveillance method and system with privacy protection {REMOTE VIDEO MONITORING METHOD AND SYSTEM INCLUDING PRIVACY PROTECION}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to video surveillance technology, and more particularly, to a video surveillance method and system having a privacy protection function that can prevent an invasion of a civilian's privacy.

In order to remotely monitor the current traffic conditions, surveillance cameras are installed on the road, and images captured by the surveillance cameras are displayed on the monitor of the central control center.

Therefore, the remote monitor can check in real time the situation where the surveillance camera is installed.

As such, a system that displays images captured by a surveillance camera on various display devices is called a video surveillance system. When such a surveillance system is installed at a remote location, the monitor can freely view an image of a desired point by controlling a camera installed on a road. It becomes possible.

However, such a surveillance system has a problem of violating the privacy of ordinary citizens by capturing even the portion corresponding to an individual's privacy in some cases and displaying it on a monitor.

Accordingly, the present invention is to provide a video surveillance method and system with a privacy protection function that can block the provision of information corresponding to the privacy of the general citizen, to prevent more than infringe on the privacy of the general citizen.

As a means for solving the above problem, according to the first embodiment of the present invention, the step of setting a partial region in the surveillance image as a privacy target; A checking step of confirming a monitoring authority of a monitor requesting video surveillance; And providing a surveillance image to the observer in real time, wherein the image for the privacy subject is selectively provided according to a surveillance authority of the observer.

In the video surveillance step, a part of the entire surveillance area may be set as a privacy target.

The image monitoring step may set the specific object as a privacy protection target when the movement pattern of the specific object included in the surveillance image is a preset movement pattern.

The image monitoring step may set the specific object as a privacy target when the shape or color of the specific object included in the surveillance image is a preset shape or color.

In addition, the video monitoring step is characterized in that the object monitoring operation for the privacy target is selectively supported according to the monitoring authority of the monitor, if the object monitoring operation is allowed, by remotely controlling the camera installed in the monitoring area An image for surveillance can be obtained.

As a means for solving the above problems, according to a second embodiment of the present invention, a communication unit for receiving a surveillance image provided by the field system having at least one camera; After providing the surveillance image received through the communication unit in real time, after setting a certain area in the surveillance image as the privacy target, the image for the privacy target is selectively selected according to the surveillance authority of the current surveillance operation. Provided by the Privacy Department; And a user interface for performing an image display operation under the control of the privacy protection unit.

The privacy protection unit may include a privacy protection object setting unit that sets a portion of the surveillance image as a privacy protection object; A monitoring authority determining unit which sets and stores the monitoring authority for each monitor in advance and confirms the monitoring authority of the supervisor requesting the monitoring operation; And a privacy protection operation performing unit configured to determine whether to provide an image of the privacy target according to the monitoring authority of the monitor.

The privacy target setting unit may set a portion of the entire surveillance area as a privacy target.

The privacy protection target setting unit may set the specific object as a privacy protection target when the movement pattern of the specific object included in the surveillance image is a preset movement pattern.

The privacy protection target setting unit may set the specific object as a privacy protection target when the shape or color of the specific object included in the surveillance image is a preset shape or color.

The privacy protection operation performing unit may further include a function of selectively supporting an object monitoring operation for the privacy target according to the monitoring authority of the monitor.

The center system may further include a site controller for remotely controlling a camera installed in a surveillance area for an object monitoring operation to obtain an image for object monitoring.

As described above, in the present invention, the image of the surveillance area is displayed in real time, and according to the monitoring authority of the observer, the image is provided to the privacy target of the surveillance area and / or whether the object is monitored, so that the privacy of the general citizen is more than necessary. Prevent infringement in advance.

In addition, regardless of the level of information provided on the screen, all images of the surveillance area can be stored, so that in the event of an emergency in the future, necessary information can be provided appropriately.

1 is a view for explaining the concept of a video surveillance system according to an embodiment of the present invention.
2 is a diagram showing a detailed configuration of a video surveillance system according to an embodiment of the present invention.
3 is a diagram illustrating a detailed monitoring configuration according to an embodiment of the present invention.
Figure 4 is a diagram showing the detailed configuration of the privacy protection unit according to an embodiment of the present invention.
5 is a view for explaining the privacy target according to an embodiment of the present invention.
6 is a view for explaining a privacy protection method of the video surveillance system according to an embodiment of the present invention.
FIG. 7 is a diagram schematically illustrating an object monitoring operation of a video surveillance system according to an exemplary embodiment.
8 is a diagram showing the detailed configuration of the privacy protection unit according to another embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.

In order to clearly illustrate the present invention, parts not related to the description are omitted, and like parts are denoted by similar reference numerals throughout the specification.

Also, when a part is referred to as "including " an element, it does not exclude other elements unless specifically stated otherwise.

1 is a view for explaining the concept of a video surveillance system according to an embodiment of the present invention.

First, as shown in Figure 1, the video surveillance system according to an embodiment of the present invention, a plurality of field systems 100 installed in each monitoring area, and a surveillance image provided by a plurality of field systems 100 The center system 200 is configured to allow a monitor to monitor images of various surveillance areas at a remote location.

In particular, the video surveillance system of the present invention, in consideration of the need to protect the privacy of the general public in accordance with the purpose and the reason for the use of the video surveillance operation, each of the monitors have the right to monitor according to the purpose and purpose of the video surveillance operation. By allocating and varying the level of information provided for each monitoring authority, it is possible to prevent overexposure of the public's privacy even to those with low monitoring authority. For reference, the privacy target of the present invention may be a specific area, an object performing a specific action, an object having a specific shape, or the like.

2 is a view showing a detailed configuration of a video surveillance system according to an embodiment of the present invention, in the following description will be described as an example of monitoring a vehicle illegally parked in the video surveillance system for ease of explanation. Shall be.

FIG. 2 is a diagram illustrating a detailed configuration of a video surveillance system according to an exemplary embodiment of the present invention. In FIG. 2, a video surveillance system monitors an illegally parked vehicle for convenience of description. do.

As shown in FIG. 2, each field system 100 includes a camera unit 110, a field environment sensing unit 120, a monitoring information providing unit 130, a communication unit 140, and the like.

As shown in FIG. 1, the camera unit 110 includes at least one fixed camera 111a and 111b and a PTZ (Pan / Tilt / Zoom) camera 112. The fixed cameras 111a and 111b acquire and provide an image of the surveillance region, and the PTZ camera 112 acquires and provides a photograph of a magnified image of the surveillance object. In this case, when there are two or more fixed cameras 111a and 111b, it is preferable that each of the fixed cameras 111a and 111b have different shooting angles so as to secure a wider shooting range.

At this time, each camera controls the shutter speed, autofocus, and white balance of the fixed cameras 111a and 111b and the PTZ camera 112 according to the illuminance of the site, so that the camera unit 110 obtains the image having the best quality. Do it. In addition, the PTZ camera 112 controls pan, tilt, and zoom under the control of the center system 200 to obtain an enlarged photograph (eg, an image in which the vehicle number of the parked vehicle is enlarged). Do it.

The on-site environment sensing unit 120 includes an illuminance sensor and senses the illuminance of the site.

The surveillance information providing unit 130 generates surveillance information including at least one of a surveillance image and a photograph obtained by the camera unit 110, and transmits the surveillance information to the center system 200. In addition, the monitoring information providing unit 130 watermarks the monitoring status information on the monitoring information and provides the monitoring system with the center system 200, thereby enabling security of the monitoring information, prevention of artificial modification, and inherent protection. The monitoring situation information may include photographing date and time, photographing position, index information, coordinate information in the image of the target vehicle, and the like.

The communication unit 140 forms a wired or wireless communication channel with the center system 200 and transmits the monitoring information to the center system 200 as the monitoring information of the monitoring information providing unit 130, or the various types provided by the center system 200. The control information is transmitted to the monitoring information providing unit 130 or the camera unit 110.

Meanwhile, the center system 200 includes a communication unit 210, a monitoring execution unit 220, a monitoring data processing unit 230, an event occurrence notifying unit 240, a privacy protection unit 250, a field control unit 260, and a screen control unit. 270, a user interface 280, and the like.

The communication unit 210 forms a wired or wireless communication channel with each field system 100 to receive monitoring information provided by each field system 100 or various control information provided by the center system 200. To the field system 100.

The surveillance performing unit 220 analyzes surveillance information provided by each field system 100 and extracts at least one of the surveillance image and the photo. After analyzing the surveillance image to detect the vehicle located in the prohibited area for parking, it is determined whether to register as a crackdown vehicle based on the parking time. When the crackdown vehicle is registered, the PTZ camera 112 of the field system 100 of the surveillance area located in the crackdown vehicle is operated to obtain an evidence photograph of an enlarged photograph of the vehicle number of the crackdown vehicle, and the vehicle number is obtained therefrom. Detect. The vehicle number thus detected may be used to perform a secondary inquiry operation using a future vehicle number or to select an evidence photograph in which the vehicle number is most accurately recognized and to make a database.

In addition, the monitoring performing unit 220 of the present invention allows the evidence photograph acquisition operation and the vehicle number detection operation of the enforcement vehicle to be performed several times, so that the data obtained through the enforcement operation may have higher reliability. However, when the additional control data operation is not normally performed in the situation where the control data of the vehicle is already acquired, the previous data may be utilized to minimize unnecessary consumption of system resources.

As illustrated in FIG. 3, the monitoring data processing unit 230 includes an enforcement information DB (DataBase) 231, a vehicle number recognition DB 232, a vehicle number misrecognition DB 233, a monitoring information DB 234, and the like. The database includes a photograph of evidence of the crackdown vehicle and a vehicle number. The enforcement information DB 231 stores evidence photographs obtained through the enforcement operation, and the vehicle number recognition DB 232 selects and stores only the evidence photographs in which the vehicle number is recognized most accurately during the enforcement process, and recognizes the vehicle number misrecognition DB ( In step 233, all evidence photographs in which the vehicle number is misidentified during the control process are stored, and the surveillance information DB 234 stores the surveillance information acquired through the video surveillance operation for each surveillance region. At this time, by further mapping tagging information including at least one of a shooting location, a shooting time, a vehicle number, a file index information, and an evidence photo storage path to the monitoring information stored in each DB 231 to 234, a later monitor is tagged. Use information to search for the material you want.

When the event occurrence notification unit 240 is notified by the monitoring unit 220 that the crackdown on the specific vehicle is confirmed, the information of the vehicle is transmitted to the government agency server so that a fine may be imposed on the driver of the vehicle. do.

Meanwhile, the privacy protection unit 250 sets a part of the surveillance image as a privacy target, and then selectively provides an image of the privacy target according to the surveillance authority of the observer. Prevent invasion in advance.

When the monitor generates a site control event, the site controller 260 remotely controls the camera of the field system 100 to perform a monitoring operation in response to the event. However, in the area belonging to the subject of privacy protection, it is determined whether the camera can be remotely controlled according to the monitoring authority. That is, when the monitor wants to perform the monitoring operation on the object located in the privacy target area, the field controller 260 confirms the monitoring authority of the monitor, and then remotely controls the camera of the field system 100 to protect the privacy target. Allows you to monitor objects located in the region.

For reference, the field control event occurs when the monitor directly inputs the PTZ control value through the user interface 280 to directly control the camera unit 110 of the field system 100. In addition, this may occur when a specific coordinate of the surveillance image of the user interface 280 is selected. For this purpose, the field controller 260 may also convert the coordinate information and the PTZ control value in the image like the automatic vehicle detecting unit 222. A reference is provided, and a conversion operation between the coordinate information in the image of the vehicle of interest and the PTZ control value is performed based on the reference.

The screen controller 270 configures a screen for integrally providing the surveillance image and the photo included in the surveillance information provided by each field system 100. In particular, the screen controller 270 of the present invention provides a real-time monitoring image provided by each field system 100, the information on the subject of privacy protection under the control of the privacy protection unit 250 according to the monitoring authority of the monitor Optionally provide.

The user interface 280 includes a monitor, a control panel, a mouse, and the like, and displays various types of requests of the monitor input through the control panel and the mouse while displaying the monitoring screen generated by the screen controller 270 on the screen of the monitor. Or to obtain a control value.

Figure 4 is a diagram showing the detailed configuration of the privacy protection unit according to an embodiment of the present invention.

As shown in Figure 4, the privacy protection unit 250 according to an embodiment of the present invention is a privacy protection target setting unit 251, the monitoring authority determination unit 252, the privacy protection operation performing unit 253, etc. It may be configured to include.

The privacy target setting unit 251 sets and registers a privacy target in each monitoring area in advance. For example, as shown in FIG. 5A, the remaining area except for the monitoring target (ie, the road area) may be set as the privacy target. Of course, as shown in FIG. 5B, the range of the privacy target may be actively modified and changed according to the road environment and the traffic environment. That is, the road block and the walking block located in the building may be set as a buffer area, and an area except the road area and the buffer area may be set as a privacy target. In addition, although it is preferable that the administrator directly sets the privacy target, if the administrator fails to directly set the privacy target, an image processing method (for example, an area extraction method using an edge detection algorithm or a color detection algorithm) may be used. Through the automatic detection of the monitored object, the remaining areas except the monitored object may be automatically set as privacy targets.

The monitoring authority determining unit 252 sets and stores the monitoring authority for each monitor in advance, and when a supervisor requesting the monitoring operation occurs, the monitoring authority determination unit 252 confirms and notifies the monitoring authority of the corresponding supervisor based on the stored information.

For reference, the monitoring grade may be divided in various ways according to the system operating environment. For the sake of convenience of explanation, the monitoring grade is divided into "first grade" and "third grade", and "first grade". Can not only view the image of the privacy target, but also monitor the specific objects located on the subject of privacy, and the "second class" can view the image of the subject of privacy. In this case, the object monitoring operation cannot be performed, and the "third class" will be described only in the case where the user cannot see not only the object monitoring operation but also the image of the privacy target.

Accordingly, the monitoring authority determination unit 252 of the present invention maps and stores the information on the monitoring authority to the personal information of each watcher, and when a specific monitor inputs his or her personal information to start the video surveillance operation, the individual The monitoring authority mapped to the information is identified and notified to the privacy protection performing unit 253.

The privacy protection operation performing unit 253 sets and stores the information providing level for each monitoring authority in advance, and monitors various kinds of monitoring information at a level corresponding to the monitoring authority of the monitor determined by the monitoring authority determining unit 252. To be provided. That is, a supervisor with a "first grade" monitoring authority can not only view an image of a privacy target but also perform an object surveillance operation for monitoring a specific object located on the privacy target, but the "second class""The supervisor who has the surveillance right of" can see only the image of the privacy subject, and the supervisor who has the "privilege" of the "third grade" cannot see the image of the privacy subject. In this case, the blocking method of the image for the privacy target may be performed by overlaying the masking information on the privacy target, mosaicing the image on the privacy target.

6 is a view for explaining a privacy protection method of the video surveillance system according to an embodiment of the present invention.

First, prior to starting the video surveillance operation, the center system 200 performs an initialization process for setting the privacy provision level and the information providing level for each monitoring authority (S100).

When the surveillance requestor requesting the video surveillance operation in the state in which the initialization process is completed (S101), request the surveillance requester to input personal information (for example, login information) to receive additional personal information of the surveillance requester. (S102).

Then, by searching the watcher list based on the personal information of the watcher, it is checked whether the watcher is a registered watcher (S103).

If the monitoring requester is not a registered watcher, after allocating an appropriate monitoring right to the monitoring requester through a monitor registration procedure, the corresponding monitoring requester is registered as a monitor by mapping the assigned monitoring right to the personal information of the monitoring requester (S104). ). The personal information and the information on the monitoring authority of the monitoring requester are listed up in the list of watchers, and will be used in the next step of checking the monitor registration in step S103.

On the other hand, when the watcher list is searched, if the information on the watcher requester exists in the watcher list, the watcher checks that the watcher is a registered watcher and then checks the watcher's authority (S105).

As a result of the checking in step S105, when the monitoring authority of the monitor is "first class" (S106), various kinds of monitoring information are provided at an information providing level corresponding to "first class". That is, not only the monitoring target but also the image and object monitoring operations for all the privacy targets are allowed (S107).

On the other hand, if the result of the check in step S105 is that the monitoring authority of the monitor is "second class" (S108), it provides an image of both the monitoring target and the privacy target, but blocks the surveillance operation on the objects existing in the privacy target. (S109).

As a result of checking in step S105, if the monitoring authority of the monitor is "third class" (S108), both the provision of an image for the privacy target and the monitoring operation for the object existing in the privacy target are blocked (S110). .

FIG. 7 is a diagram for schematically describing an object monitoring operation of a video surveillance system according to an exemplary embodiment of the present invention, which is intended to explain in detail a video monitoring method in which a site control event is generated by a monitor.

First, when a supervisor generates a site control event for monitoring a specific object through the user interface 280 of the center system 200 (S200), the center system 200 generates an area where the selected object is located through a site control event. It is checked whether or not the area belongs to the privacy target (S201).

If the object selected through the field control event is located in the area belonging to the monitoring target, the monitor can directly control the PTZ camera of the field system 100 to perform the object monitoring operation (S202).

On the other hand, if the area where the object selected through the field control event is the area belonging to the privacy protection target, after checking the monitoring authority of the monitor currently performing the monitoring operation through the monitoring authority determination unit 252 (S203), In step S202, the object monitoring operation of step S202 is limited to a level in which the monitoring authority of the object permits the object monitoring operation for the privacy target.

As described above, according to the present invention, by providing an image providing operation and an object monitoring operation for a privacy target according to the monitoring authority of the observer, the low-level watcher abuses the video system in advance to unnecessarily invade the privacy of the general public. To prevent. However, in addition to the information provided on the screen, the monitoring information provided by the on-site system 100 is stored regardless of the monitoring authority of the monitor, so that a supervisor having a high authority in the future needs the previous monitoring information. To ensure that all necessary information is provided smoothly.

In addition, in the above embodiment, the privacy target is set based on location, but if necessary, the privacy target may be set in units of objects. That is, after detecting the watched object and recognizing the situation, if the object takes a specific situation, the object itself may be set to a privacy target. In this case, the video surveillance method of the present invention monitors the daily lives of the elderly in Silvertown, as well as the system for monitoring the traffic status, as well as the system for monitoring the traffic status, the system for monitoring the daily lives of the patients in the hospital It can be applied to a variety of user monitoring system, such as.

However, the privacy protection unit 250 of the present invention for supporting the operation may further include an object situation recognition unit 254 in addition to the configuration of FIG. 4 as shown in FIG. 8.

The object situation recognition unit 254 detects an object (eg, a person) to be monitored from the surveillance image and recognizes a situation thereof. That is, the object situation recognition unit 254 detects an object through an object detection algorithm, and then moves the object in a preset movement pattern (for example, viewing a toilet, taking off or taking a shower), or preset size. , Privacy, if you have a shape, color (e.g., size, shape, color, etc. that an object corresponding to a person would have as you pose, for example, showing a toilet / pee, taking a shower, etc.) I think that is a necessary situation.

Then, the privacy protection target setting unit 251 sets the privacy target of the object itself detected through the object situation recognition unit 254, so that the privacy protection operation on the object itself can be performed.

If the video surveillance system configured in this way is applied to a system for monitoring the daily lives of the elderly in Silver Town, it will be performed as follows to protect the privacy of the elderly.

If the elderly perform a specific action such as viewing the toilet, taking off clothes, taking a shower, or the like, the user situation inference unit 254 may determine the current situation through the movement pattern of the object corresponding to the elderly, or the size, shape, or color. We can see that the privacy of this old man is needed. Then, the privacy protection target setting unit 251 sets the object corresponding to the elderly as the privacy target, and the privacy protection operation performing unit 253 selectively blocks the image of the object corresponding to the elderly in response to this, You can ensure your privacy.

However, if the elderly perform an activity related to daily life, such as walking or reading, the user situation inference unit 254 determines that the privacy of the elderly is not necessary, and the elderly currently present like the existing video surveillance system. Not only the image of the place where it is located but also the image of the object corresponding to the elderly can be provided.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

Claims (13)

Setting a part of the surveillance image as a privacy target;
A checking step of confirming a monitoring authority of a monitor requesting video surveillance; And
And providing an image to the monitor in real time, wherein the image for the privacy subject is selectively provided according to the monitoring authority of the monitor. The method of claim 1, wherein the video surveillance step
A video surveillance method having a privacy protection function, characterized in that a part of the entire surveillance area is set as a privacy target. The method of claim 1, wherein the video surveillance step
And setting the specific object as a privacy target when the movement pattern of the specific object included in the surveillance image is a preset movement pattern. The method of claim 1, wherein the video surveillance step
If the shape or color of a specific object included in the surveillance image is a predetermined shape or color, the image monitoring method having a privacy protection function, characterized in that for setting the specific object as a privacy target. The method according to any one of claims 2 to 4, wherein the video surveillance step
And a method of selectively monitoring an object for the privacy target according to the monitoring authority of the monitor. The method of claim 5, wherein the video surveillance step
If the object monitoring operation is allowed, remote control of a camera installed in the surveillance area to obtain an image for privacy monitoring, characterized in that the image surveillance method with a privacy protection function. A communication unit receiving a surveillance image provided by an on-site system having at least one camera;
After providing the surveillance image received through the communication unit in real time, after setting a certain area in the surveillance image as the privacy target, the image for the privacy target is selectively selected according to the surveillance authority of the current surveillance operation. Provided by the Privacy Department; And
And a user interface for performing an image display operation under the control of the privacy protection unit. The method of claim 7, wherein the privacy protection unit
A privacy protection setting unit for setting a portion of the surveillance image as a privacy protection target;
A monitoring authority determining unit which sets and stores the monitoring authority for each monitor in advance and confirms the monitoring authority of the supervisor requesting the monitoring operation; And
And a privacy protection performing unit configured to determine whether to provide an image of the privacy protection subject according to the monitoring authority of the monitor. The method of claim 8, wherein the privacy target setting unit
A center system having a privacy protection function, which sets a part of the entire surveillance area as a privacy target. The method of claim 8, wherein the privacy target setting unit
If the movement pattern of the specific object included in the surveillance image is a predetermined movement pattern, the center system having a privacy protection function, characterized in that for setting the specific object as a privacy target. The method of claim 8, wherein the privacy target setting unit
If the shape or color of a specific object included in the surveillance image is a predetermined shape or color, the center system having a privacy protection function, characterized in that for setting the specific object as a privacy target. The method of claim 8, wherein the privacy protection performing unit
And a function of selectively supporting an object monitoring operation for the privacy target according to the monitoring authority of the monitor. The method of claim 12,
And a field controller configured to remotely control a camera installed in a surveillance area for an object monitoring operation to obtain an image for object monitoring.

Images