JP2013093673A - Information processing apparatus, control method, information processing system, program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent a privacy image from being excluded from a set masking region even when a monitoring camera is operated.SOLUTION: An information processing apparatus comprises: receiving means which receives specification of a masking region to be masked within the photographing range which can be photographed by a camera; determining means which determines in an image photographed by a camera a position to which the masking region whose specification is accepted by the receiving means is arranged; determining means which determines whether to divide the masking region according to an arranging position determined by the determining means; dividing means which divides the masking region in a predetermined number when determination is made to divide the masking region as a result of determination by the determining means; arranging means which arranges the plural masking region divided by the dividing means on a photographed image; and distributing means which distributes the photographed image on which the plural masking regions are arranged by the arranging means.

Description

  The present invention relates to a technique for masking a specific area in an image taken by a surveillance camera.

  Currently, cameras that can pan, tilt, and zoom (PTZ cameras) in various situations are used as surveillance cameras. For example, as a crime prevention purpose, it is used for the purpose of monitoring an ATM operator in a financial institution, or used for the purpose of monitoring a suspicious person in a shopping street.

  Here, the images taken by the surveillance camera may include images relating to privacy (hereinafter referred to as privacy images). It is requested to hide from. For example, there are “an area where a button for inputting a cash card PIN number is reflected” and “an area where an individual room is reflected”.

  Therefore, a function for masking a specific image has been proposed in order to prevent a privacy image from appearing in an image taken by a surveillance camera.

  For example, in Patent Documents 1 to 3, in a surveillance camera device including a surveillance camera capable of panning and tilting rotation and a control device for the surveillance camera, the surveillance camera holds mask data for masking a privacy zone reflected in an image, A technique for masking a part of an image according to this data is disclosed.

Japanese Patent Application No. 11-246194 Japanese Patent Application No. 2004-187738 Japanese Patent Application No. 2005-328393

  However, although the techniques described in Patent Documents 1 to 3 are techniques that make it possible to mask a specific area in an image, there is no disclosure about a technique that prevents the privacy image from being removed from the masking area. Not done.

  For example, if the area to be masked is specified by a rectangle, the specified masking area is recorded as coordinate data centered on the camera (recorded as a rectangular area on a spherical coordinate centered on the camera), and pan / tilt / zoom operations are performed. In the case of a surveillance camera with a mechanism in which the mask area follows the direction of the camera, the specified masking area is a rectangle projected onto the drawing plane perpendicular to the line of sight of the surveillance camera. When the tilt operation is performed, the masking area may be removed from the target object (privacy image).

  The wraparound distortion indicates the trajectory of the video during pan / tilt (1901, 1902). In the case of the surveillance camera, since the video moves so as to draw an arc around the midpoint of the image, the angle of the drawn arc becomes steeper as the distance from the center increases (see FIG. 19).

  An example in which the masking area deviates from the privacy image will be described with reference to FIG. (1) When three privacy images 2001 are displayed at the top of the display area 2000, (2) one privacy masking area 2002 covers the three privacy images. (3) When the surveillance camera is panned, the privacy image is away from the center of the screen, and thus follows a trajectory that draws an arc and deviates from the masking area. This is a problem that occurs because the privacy image follows a trajectory that draws an arc, while the masking region moves in the image with the center point 2003 fixed while maintaining the shape of the masking region. .

  Another example will be described with reference to FIG. In this example, the management camera is panned by covering the masking area 2102 on the horizontally long privacy image 2101. Since the surveillance camera is panned while the privacy image 2101 is in the upper part of the display area, both ends of the privacy image 2101 are out of the masking area 2102.

  By the way, in a surveillance camera, a wide-angle lens may be used to capture more images with a single lens, and as a feature of an image captured with a wide-angle lens, it goes up or down compared to the center of the image. Since the curvature becomes larger as the lens becomes wider, the problem that the masking region deviates from the target object becomes more prominent as the lens becomes wider.

  One way to solve this problem is to set the masking area wider so that the privacy image does not deviate from the masking area, but this method also masks the image that you originally want to monitor. Yes, the function as a surveillance camera will be diminished.

  Therefore, there is a need for a method for preventing the privacy image from being removed from the masking area even if the surveillance camera is operated while minimizing the area set as the masking area for the privacy image.

  SUMMARY OF THE INVENTION The present invention solves the above-described problems, and an object of the present invention is to provide a technique for preventing a privacy image from deviating from a set masking area even when a surveillance camera is operated.

  The present invention is an information processing apparatus that distributes a photographed image photographed by a camera, and includes a receiving unit that accepts designation of a masking area to be masked within a photographing range that can be photographed by the camera; In the captured image, a determination unit that determines a position where the masking region that has been designated by the reception unit is arranged, and whether the masking region is divided according to the arrangement position that is determined by the determination unit. A determination means for determining, and as a result of determination by the determination means, when it is determined that the masking area is to be divided, a dividing means for dividing the masking area into a predetermined number; and a plurality of parts divided by the dividing means Arranging means for arranging a masking area on the photographed image, and a plurality of masking areas are arranged by the arranging means. And having a delivery means for delivering the captured image.

  According to the present invention, it is possible to prevent the privacy image from being removed from the set masking area even if the surveillance camera is operated.

It is a block diagram which shows roughly the structure of the surveillance camera system which concerns on embodiment of this invention. It is a block diagram which shows roughly the internal structure of the server 200 in FIG. 1, and the client terminals 300a and 300b. It is a flowchart which shows the flow of the process which sets the masking area | region concerning embodiment of this invention. It is a figure which shows an example of a masking area | region setting screen. It is a figure which shows the range of the spherical coordinate centering on a camera. It is a flowchart which shows the flow of the process in which the set masking area | region concerning embodiment of this invention is divided | segmented. It is a figure which shows the relationship between the angle of a wraparound distortion, and a masking area | region. It is a figure which shows an example of a virtual display area. It is a figure (1) explaining the calculation method which calculates the angle of wraparound distortion. It is a figure (2) explaining the calculation method which calculates the angle of wraparound distortion. It is a figure which shows the relationship between the angle of a wraparound distortion, and a masking area | region. It is a flowchart which shows the flow of a detailed process of the masking process concerning embodiment of this invention. It is a figure which shows the example of the angle calculation table of wraparound distortion. It is a figure which shows the example of the table for distortion curvature calculation. It is a figure which shows the example of the table for rectangle division | segmentation calculation. It is a figure which shows the example which divides | segments a masking area | region. It is a figure which shows the example which arrange | positions the masking area | region after a division | segmentation. It is a figure which shows the other division | segmentation method. It is a figure which shows the locus | trajectory of the image | video at the time of pan / tilt. It is a figure explaining the example (1) from which a masking area | region remove | deviates from a privacy image. It is a figure explaining the example (2) from which a masking area | region remove | deviates from a privacy image.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram schematically showing a configuration of a surveillance camera system according to an embodiment of the present invention.

  In FIG. 1, the monitoring camera system 100 includes a server 200, client terminals 300a and 300b, and monitoring camera devices 400a, 400b, and 400b.

  The server 200, the client terminal 300a, and the monitoring camera devices 400a to 400c are connected to each other via the network 110. The network 110 includes a LAN, a WAN, or the Internet. The client terminal 300a and the client terminal 300b are connected to each other via the wireless line 120. A wired line may be used instead of the wireless line 120.

  Each of the monitoring camera devices 400a to 400c acquires an image (captured image) of a subject photographed through a photographing lens (not shown), and distributes the obtained image to the server 200 or the client terminal 300a via the network 110. To do. The captured image is preferably a digital full-color moving image, but may be a still image or a monochrome image. Each of the monitoring camera devices 400a to 400c has a horizontal swing function or a vertical swing function (pan / tilt function) and a zoom function. The surveillance camera device performs pan / tilt / zoom control in accordance with pan / tilt / zoom instructions from the server 200 and the client terminals 300a and 300.

  The server 200 is installed with software for recording images distributed from the monitoring camera devices 400a to 400c in an external memory such as a hard disk drive (HDD), and for searching and reproducing the recorded images. Accordingly, the server 200 functions as an image server that stores images.

  A WEB browser is installed in each of the client terminals 300a and 300b, and live display (Live display) is performed by displaying images distributed from the monitoring camera devices 400a to 400c in real time via the WEB browser. It is assumed that an additional plug-in is installed. Further, a plug-in for enabling setting of a masking area for hiding a specific subject (privacy image) in images taken by the monitoring camera devices 400a to 400c is additionally installed. It shall be. When the masking area is set, the setting content is reflected in the setting items incorporated in the monitoring camera devices 400a to 400c.

  FIG. 2 is a block diagram schematically showing the internal configuration of the server 200 and the client terminals 300a and 300b in FIG.

  As shown in FIG. 2, the server 200 is realized by a personal computer (PC). Specifically, the server 200 includes a PC main body 200a, a keyboard (KB) 209, a mouse (not shown), a CRT display (CRT) 210 as a display device, a hard disk drive (HDD) 211, an HDD 211, Includes another external memory 220. The HDD 211 stores a network video recorder program 212, a definition file 213, various tables 214, layout information (planar layout or three-dimensional layout) 215 of a shooting target portion, a shot image 216, and the like.

Further, the PC main body 200a stores a CPU 201, a RAM 202, a ROM 203, an input controller 205, a video controller 206, a memory controller 207, a communication I / F controller 208, and the like, and a system bus 204 for connecting them.
A network I / F (not shown) for connecting to the network 110 is connected to the communication I / F controller 208.

  Next, a flow of processing for setting a masking area according to the embodiment of the present invention will be described.

  FIG. 3 is a flowchart showing a flow of processing for setting a masking area according to the embodiment of the present invention.

  The client terminal is a computer such as a PC operated by a user.

  In S301, the client terminal activates a WEB browser in response to a user operation instruction.

  In S302, the client terminal requests a captured image from the monitoring camera device. This is a process performed by the WEB browser to display an image taken by the monitoring camera device on the WEB browser.

  In S303, the surveillance camera device accepts a request for a captured image.

  In S304, the monitoring camera device distributes the captured image to the requesting client terminal.

  In S305, the client terminal receives the captured image and displays the image in the display area of the WEB browser.

  In S306, the client terminal displays a masking area setting screen in response to a user operation instruction. An example of the masking area setting screen will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of a masking area setting screen.

  In FIG. 4, a captured image display area 402 and a menu area 403 are displayed in the display area 401 of the WEB browser. The user sets the masking area via the screen displayed in the areas 402 and 403.

  Next, a procedure for setting the masking area by the user will be described. First, the user selects a “masking area setting” item from the menu area 403. When the “masking area setting” item is selected, the mode is switched to the “masking area setting” mode. In this mode, the masking area 404 can be designated by a pointing device on the captured image displayed in the captured image display area 402. Finally, when registering the designated masking area 404, an “OK” button 405 is pressed. On the other hand, if not registered, a “cancel” button 406 is pressed.

  In step S307, the client terminal instructs the monitoring camera device to set a masking area. This process is performed when an “OK” button 405 is pressed.

  In S308, the surveillance camera device accepts an instruction for masking region setting.

  In S309, the monitoring camera apparatus performs the received masking area setting process. By the setting process, the masking area is recorded as a rectangular area on the spherical coordinate centered on the camera. A specific example will be described with reference to FIG.

  FIG. 5 is a diagram showing the range of spherical coordinates centered on the camera. The spherical coordinate range is determined by the tilt angle and pan angle at which the surveillance camera device operates. In this example, the tilt angle is −90 ° to + 10 °, and the pan angle is −170 ° to + 170 °. The rectangular area is recorded in the form of (tilt angle / pan angle of upper left point, tilt angle / pan angle of lower right point). When the rectangular area indicating the masking area is registered in this manner, masking that follows the direction of the camera can be performed even when the surveillance camera apparatus performs the pan / tilt / zoom operation. In the embodiment of the present invention, this spherical coordinate range is referred to as a mapping map “mapping map”.

  In S310, the monitoring camera device notifies the instruction source client terminal of completion.

  In S311, the client terminal acquires a completion notification. For example, when a completion notification is acquired, the user is notified by displaying a pop-up screen to that effect.

  In step S312, the client terminal determines whether an instruction to end the setting has been given. In the case of Yes, it complete | finishes, and in No, it returns to S307.

  The flow of processing for setting the masking area according to the embodiment of the present invention has been described above.

  Next, a flow of processing for dividing the set masking area according to the embodiment of the present invention will be described.

  FIG. 6 is a flowchart showing a flow of processing for dividing the set masking area according to the embodiment of the present invention.

  The client terminal is a computer such as a PC operated by a user.

  In step S601, the client terminal activates a WEB browser in response to a user operation instruction.

  In S602, the client terminal requests a captured image from the monitoring camera device. This is a process performed by the WEB browser to display an image taken by the monitoring camera device on the WEB browser.

  In S603, the surveillance camera device accepts a request for a captured image.

  In S604, the monitoring camera device performs a masking process. Details of the masking process will be described later with reference to FIG. 12, but the outline of the masking process will be described first with reference to FIGS.

  FIG. 7 is a diagram showing the relationship between the wraparound distortion angle and the masking region.

  Here, the wraparound distortion angle is an angle at which the masking region and the region to be masked are shifted.

  Reference numeral 70 denotes a coordinate system in which the origin is (pan angle = 0 °, tilt angle = 0 °).

  701 to 704 arranged at the coordinate 70 indicate masking rectangles, and dotted lines 705 to 708 indicate areas to be masked. 701 and 705, 702 and 706, 703 and 707, and 704 and 708 respectively correspond to the corresponding areas.

  Comparing the regions 701 and 705, it can be seen that the wraparound distortion angle is large. This is because the wraparound distortion angle increases as it moves away from the center of the display screen up or down, right or left.

  Comparing the regions 702 and 706, it can be seen that there is no wraparound distortion angle. This is because there is no distortion due to wraparound when the tilt position is 0 °.

  Comparing the regions 703 and 707, it can be seen that there is a slight wraparound distortion angle.

  Comparing the areas 704 and 708, it can be seen that there is no wraparound distortion angle. This is because there is no distortion due to wraparound when the pan position is 0 °.

  From the above, in order to correct the masking area, the angle of the wraparound distortion can be obtained by confirming the center point coordinates of the masking area and the left and right (or vertical) coordinate positions.

  It should be noted that the concept of a virtual display area is used to determine the angle of wraparound distortion. Specifically, as shown in FIG. 8, when the maximum size of the camera is VGA (640 × 480 dots) (801), in order to obtain the coordinates of the center point of the masking area when the PT operation of the camera is performed Consider a virtual display area 802 of 1280 × 680 dots. In this embodiment, since a camera having a maximum size of VGA is described as an example, the virtual display area is 1280 × 680 dots. As a matter of course, since the maximum size varies depending on the type of camera, the virtual display area also varies accordingly.

  In the example of FIG. 8, the angle of the wraparound distortion can be obtained by obtaining the difference between the coordinate 803 at the left end of the masking region and the coordinate 804 of the center point.

  Note that, when the telephoto is set by zooming, the angle of view changes, but the angle calculated in the display area on the maximum wide angle side does not change.

  Next, a specific calculation method for calculating the wraparound distortion angle will be described.

Step (1) Calculate the display area (FIG. 9)
The display area is calculated using the acquired zoom value because the display area of the angle of view changes from the wide angle 901 to the telephoto 902. In the present embodiment, a VGA (640 × 480 dots) resolution will be described as an example of the display area.

Step (2) Mapping (Fig. 9)
The display area is mapped on spherical coordinates (mapping map) centered on the camera. Whether to divide the masking area is determined depending on whether the masked area is included in the display area where the mapping is performed. In the example of FIG. 9, the “telephoto” display area does not include the masking area, and the “wide-angle” display area includes the masking area.

Step (3) Calculate the wraparound distortion angle (FIG. 10)
The angle of the wraparound distortion is calculated using two points of the rectangular center position 1001 and the rectangular right end position 1002 (or left end position 1003). The conventional surveillance camera has a function of moving the rectangle up and down by the amount of movement of the figure depending on the angle of wraparound distortion, but a portion that cannot be hidden by the masking rectangle has come out (FIG. 11).
Therefore, the masking process according to the embodiment of the present invention realizes hiding a portion that could not be hidden conventionally.

FIG. 12 is a flowchart showing a detailed process flow of the masking process according to the embodiment of the present invention. In S1201, the surveillance camera apparatus acquires a PTZ value. Here, as the PTZ value, a value set by default or a PTZ value obtained as a result of the PTZ operation by the user is acquired.

  In S1202, the monitoring camera apparatus performs a process of mapping the actual display area and the virtual display area to the mapping map using the acquired PTZ value. Specifically, as shown in FIG. 9, the wide angle / telephoto is specified by the PTZ value, and the display area is mapped to the mapping map. In the embodiment of the present invention, it is assumed that a masking area is set in advance in the mapping map.

  In S1203, the surveillance camera device determines whether a masking area is included. In the case of Yes, it progresses to S1204, and in No, it complete | finishes. Specifically, the determination is made based on whether a masking area is included in the actual display area. This is because when the masking area is not included in the actual display area, it is not necessary to perform masking processing on the video.

  In S1204, the monitoring camera device acquires the center position of the masking region and the coordinate value of the left end (or right end). The coordinate position to be acquired may be two points or three points, but in the embodiment of the present invention, the coordinate value of the center position and the coordinate value of either the left end or the right end are acquired. Whether to acquire the left end coordinate value or the right end coordinate value may be determined by the arrangement position of the masking region. In the embodiment of the present invention, the position of the end inside the display area is acquired from the coordinate position of the center position. In the example shown in FIG. 10, since the right end 1003 is on the inner side than the center position 1002, in this case, the coordinate position of the right end 1003 is acquired. In this embodiment, since the left and right masking areas are taken as an example, the coordinate value of the left end or right end is obtained in this step. You may acquire the coordinate value of a lower end.

  In S1205, the surveillance camera device calculates a wraparound distortion angle. In the embodiment of the present invention, the wraparound distortion angle is calculated by using the wraparound distortion angle calculation table shown in FIG. This table includes display screen vertical coordinate 1301 and display screen horizontal coordinate 1302. Both the display screen vertical coordinate 1301 and the display screen horizontal coordinate 1302 indicate coordinate ranges. In the embodiment of the present invention, since the display area is VGA (640 × 480 dots) and the virtual display area is 1280 × 680 dots, the range of the display screen vertical coordinate 1301 is −480 to +480 dots. The range of the display screen horizontal coordinate 1302 is −640 to +640 dots. When the resolution of the display area is different, a table corresponding to the resolution is prepared.

  The values in the table indicate the amount of movement, with positive numbers indicating upward movement and negative numbers indicating downward movement. The unit of movement is dots. This is a value indicating how many dots are shifted in the display area due to the wraparound distortion. Since the wraparound distortion increases as the distance from the center of the display area increases, in this table, the amount of movement decreases as the distance from the center increases, and the amount of movement increases as the distance from the center increases.

  A specific procedure for calculating the wraparound distortion angle will be described. First, the coordinate position of the center position and the coordinate value of the left end (or right end) acquired in S1204 are applied to this table. Then, two (or three) values are extracted. The average value of the two extracted values (or three) is calculated. This calculated value is a value (dot) indicating a deviation between the center position and the left end (or right end) coordinate value. Accordingly, by using the coordinate position of the center position, the coordinate value of the left end (or right end), and the value indicating this shift, the shift angle is calculated. An existing method can be adopted as the calculation method, and this calculated angle becomes a wraparound distortion angle (unit: θ).

  Note that this table example is merely an example, and the values vary depending on the lens of the camera mounted on the camera monitoring apparatus, the displayable view angle size, the resolution, and the like, and thus are prepared respectively.

  In S1206, the monitoring camera apparatus calculates the curvature of distortion from the zoom value. The distortion aberration is one of lens aberrations. In particular, the distortion becomes remarkable near the periphery of the image. There is a barrel distortion in which the straight line around the lens is bent outward, and a pincushion distortion in which it is bent inward.

  In the embodiment of the present invention, the distortion aberration curvature is calculated by using the distortion aberration curvature calculation table shown in FIG. This table includes display screen vertical coordinate 1401 and zoom angle of view 1402. In the embodiment of the present invention, since the display area is VGA (640 × 480 dots), the range of the display screen vertical coordinate 1401 is −240 to +240 dots. When the resolution of the display area is different, a table corresponding to the resolution is prepared.

  The value in the table indicates the curvature, and the positive number indicates the curvature of upward distortion and the negative number indicates the curvature of downward distortion. In the embodiment of the present invention, the masking area is described as a horizontally long example, but may be a vertically long masking area. In this case, a vertically long table is prepared, but the description thereof is omitted here.

  A specific procedure for calculating the curvature of distortion will be described. First, the vertical coordinate values of the left and right ends of the masking area are obtained. As a method of obtaining, there is a method of obtaining from an average value or an intermediate point. Next, the angle of view of the zoom is obtained using the acquired PTZ value. Then, the curvature of distortion can be calculated by extracting the curvature from the table using the obtained display screen vertical coordinate and the angle of view of the zoom.

  Note that this table example is merely an example, and the values vary depending on the lens of the camera mounted on the camera monitoring apparatus, the displayable view angle size, the resolution, and the like, and thus are prepared respectively.

  In S <b> 1207, the surveillance camera device calculates the number of masking regions to be divided from the wraparound distortion angle and the curvature of distortion. Then, the calculated number of divisions is determined. In the embodiment of the present invention, the number is calculated by using the rectangular division calculation table shown in FIG. This table has two tables for the horizontal direction and the vertical direction. In the embodiment of the present invention, it is determined what the shape of the masking area is, and as a result of the determination, When it is determined that the masking area is horizontally long, a rectangular division calculation table for horizontal direction is used. When it is determined that the masking area is vertically long, a rectangular division calculation table for vertical direction is used. . Of course, both tables can be used, but will not be described in detail here.

  This table is composed of distortion aberration curvatures 1501 and 1503 and wraparound distortion angles 1502 and 1504. In the embodiment of the present invention, VGA is assumed, but when the resolution of the display area is different, a table corresponding to the resolution is prepared. Also, since the values differ depending on the lens characteristics and the like, an optimum table is prepared for each. A value is extracted by fitting the wraparound distortion angle calculated in S1205 and the curvature of distortion aberration from the zoom value calculated in S1206 to a table. Note that the values in the table indicate the maximum vertical or horizontal size (in units of dots) of the rectangular area to be divided.

  Here, as a method of dividing the masking region, various methods can be adopted depending on the combination of the curvature of distortion and the wraparound distortion angle. However, in the embodiment of the present invention, as an example, when the masking region is divided. A method of obtaining the maximum size of the divided rectangle in as the greatest common divisor is shown.

  As a specific example, if 60 dots are extracted from the rectangular division calculation table when the width of the masking area is 180 dots, dividing the masking area by dividing 180 dots by 60 dots will result in “3”. “3” is calculated as the number to be used. Further, when 40 dots are extracted from the rectangular division calculation table when the horizontal width of the masking area is 180 dots, dividing the 180 dots by 40 dots results in a remainder of 20 with “4”, but the remainder is compensated. “5” is calculated as the number by which the masking area is divided by adding “1”. If the maximum size is larger than the masking area, it is not necessary to divide because the division is not necessary.

  As described above, in S1207, the number for dividing the masking area is calculated from the wraparound distortion angle specified by the masking area arranged in the display area and the curvature of the distortion. That is, the number of divisions is determined according to the arrangement position of the masking area.

  In S1208, if the monitoring camera apparatus determines Yes to determine whether to divide the masking area, the process proceeds to S1209, and if No, the process proceeds to S1211. Specifically, in S1207, when the maximum size is larger than the masking area, it is determined that division is not necessary.

  In S1209, the surveillance camera device divides the masking area. As a division method, any one of a method of dividing by the maximum size extracted from the rectangular division calculation table (pattern 1) and a method of dividing the masking region by the number calculated in S1205 (pattern 2). May be adopted. Note that the two methods differ when the masking area cannot be divided by the maximum size. For example, if the masking area is 180 dots and the maximum size is 40 dots, the former method is divided into four 40-dot rectangles and one 20-dot rectangle, and the latter method is divided into five 36-dot rectangles. It is divided (see FIG. 16). In the embodiment of the present invention, the description will be continued assuming that the latter method is adopted.

  As another division method, there is also a division method for masking regions having different sizes with reference to the maximum size. For example, as shown in FIG. 18, when the masking area is 180 dots and the maximum size is 72 dots, there is a method of dividing into 12 to 48 masking rectangles smaller than 72 dots. In this case, the size of each masking region can be obtained by sequentially multiplying the coefficient to be reduced by a predetermined ratio with respect to the maximum size. In this method, the number of divisions is not required in advance.

  In S1210, the surveillance camera apparatus arranges the center coordinates of the divided masking region according to the wraparound distortion angle and the curvature of distortion.

  Specifically, using the wraparound distortion angle and the curvature of distortion, a trajectory traced by the masking region is virtually obtained, and the center coordinates of the divided masking region are respectively arranged on the trajectory (see FIG. 17). Here, the arrangement position of the divided masking area is determined.

  When the division shown in FIG. 18 is performed, the masking area having a larger size is arranged from the side closer to the center of the display area in the drawn trajectory. This is because the shift becomes larger toward the edge of the display area, so that a smaller masking area is arranged on the edge to prevent the video to be hidden from protruding from the masking area.

  In S1211, the surveillance camera apparatus performs a process of superimposing the masking area that has not been divided or the divided masking area on the photographed video.

  The detailed process flow of the masking process according to the embodiment of the present invention has been described above.

  Subsequently, in S605, the monitoring camera device distributes the captured image to the requesting client terminal. Here, when there is no masking area setting, the video as it is is delivered, and when the masking area is set, the video masked by the masking area is delivered.

  In S606, the client terminal receives the captured image.

  In S607, the client terminal displays the received captured image in the display area of the WEB browser.

  In step S <b> 608, the client terminal determines whether a user has instructed a PTZ operation. If Yes, the process proceeds to S609, and if No, the process proceeds to S612. Specifically, it is determined whether the user has instructed the PTZ operation via the PTZ operation button displayed on the operation menu displayed on the WEB browser.

  In step S609, the client terminal instructs the monitoring camera device to perform a PTZ operation by the user.

  In S610, the monitoring camera apparatus accepts an instruction for PTZ operation.

  In S611, the monitoring camera device performs PTZ processing according to the content of the PTZ operation instruction. Since the PTZ process is a conventional camera control process, detailed description thereof is omitted. Thereafter, the process returns to S604 and the processing is continued.

  On the other hand, in step S612, the client terminal determines whether an instruction to end browsing of the image captured by the monitoring camera device has been given by the WEB browser. If Yes, the process ends. If No, the process returns to S607.

  The flow of processing for dividing the set masking area according to the embodiment of the present invention has been described above.

  As described above, according to the present invention, it is possible to prevent the privacy image from deviating from the set masking area even if the surveillance camera is operated.

  Since the masking process is performed in real time, the masking area follows and masks even if the surveillance camera continues to be operated. At that time, the masking area is divided according to the position where the masking area is arranged in the display area.

The preferred embodiment of the present invention has been described in detail above, but the present invention is not limited to the specific embodiment, and within the scope of the present invention described in the claims,
Various modifications and changes are possible.

  The object of the present invention is achieved by the following. That is, a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded is supplied to the system or apparatus. Then, the central processing means (CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium recording the program code constitutes the present invention.

  In addition, by executing the program code read by the central processing means of the system or apparatus, an operating system (OS) or the like operating on the system or apparatus performs actual processing based on the instruction of the program code. Do some or all. The case where the function of the above-described embodiment is realized by the processing is also included.

  Further, it is assumed that the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the system or apparatus or a function expansion unit connected thereto. After that, based on the instruction of the program code, the CPU of the function expansion card or function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is realized by the processing. It is.

  When the present invention is applied to the storage medium, the storage medium (computer-readable storage medium) stores program codes corresponding to the flowcharts described above.

100 surveillance camera system 200 server 300 client terminal 400 surveillance camera device

Claims (7)

An information processing apparatus that distributes captured images captured by a camera,
Accepting means for accepting designation of a masking area to be masked within a photographing range that can be photographed by the camera;
A determination unit that determines a position at which a masking region whose designation is received by the reception unit is arranged in a captured image captured by the camera;
Determining means for determining whether to divide the masking region according to the arrangement position determined by the determining means;
As a result of the determination by the determination means, when it is determined that the masking area is divided, a dividing means for dividing the masking area into a predetermined number;
Arranging means for arranging a plurality of masking regions divided by the dividing means on the captured image;
An information processing apparatus comprising: a distribution unit that distributes a captured image in which a plurality of masking areas are arranged by the arrangement unit. As a result of the determination by the determination unit, when it is determined that the masking region is divided, the determination unit further includes a determining unit that determines the number of the masking region to be divided according to the arrangement position of the masking region,
The information processing apparatus according to claim 1, wherein the dividing unit divides the masking region into the number determined by the determining unit.   3. The information processing apparatus according to claim 2, wherein the determination unit increases the number of divisions of the masking area as the arrangement position of the masking area is further away from the center of the captured image. .   4. The information processing apparatus according to claim 1, wherein the dividing unit divides the masking area by changing a size of the masking area according to an arrangement position of the masking area. 5. A control method in an information processing apparatus that distributes a photographed image photographed by a camera,
An accepting step of accepting designation of a masking area to be masked within a photographing range that can be photographed by the camera;
A determination step of determining a position where a masking region whose designation is accepted by the acceptance step is arranged in a photographed image photographed by the camera;
A determination step of determining whether to divide the masking region according to the arrangement position determined by the determination step;
As a result of the determination by the determination step, when it is determined that the masking region is divided, a dividing step of dividing the masking region into a predetermined number;
Arranging step of arranging a plurality of masking areas divided by the dividing step on the captured image;
A distribution step of distributing a captured image in which a plurality of masking regions are arranged in the arrangement step. An information processing system capable of communicating between a client terminal and an information processing device that distributes a captured image captured by a camera,
Accepting means for accepting designation of a masking area to be masked within a photographing range that can be photographed by the camera;
A determination unit that determines a position at which a masking region whose designation is received by the reception unit is arranged in a captured image captured by the camera;
Determining means for determining whether to divide the masking region according to the arrangement position determined by the determining means;
As a result of the determination by the determination means, when it is determined that the masking area is divided, a dividing means for dividing the masking area into a predetermined number;
Arranging means for arranging a plurality of masking regions divided by the dividing means on the captured image;
An information processing system comprising distribution means for distributing a captured image in which a plurality of masking areas are arranged by the arrangement means. A program that can be executed by an information processing apparatus that distributes a captured image captured by a camera,
Accepting means for accepting designation of a masking area to be masked within a photographing range that can be photographed by the camera;
A determination unit that determines a position at which a masking region whose designation is received by the reception unit is arranged in a captured image captured by the camera;
Determining means for determining whether to divide the masking region according to the arrangement position determined by the determining means;
As a result of the determination by the determination means, when it is determined that the masking area is divided, a dividing means for dividing the masking area into a predetermined number;
Arranging means for arranging a plurality of masking areas divided by the dividing means on the captured image;
A program for causing the information processing apparatus to function as distribution means for distributing a photographed image in which a plurality of masking areas are arranged by the arrangement means.

Images