JP2014239390A - Camera server device, camera system, and control method of camera server device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique enabling easy mask setting even in a case where a mask is shifted.SOLUTION: When an instruction of masking a specified area on an image is received from a client terminal device, a size of an enlarged specified area is obtained by enlarging a specified area by an increment size corresponding to a current field angle of an imaging apparatus. An image is generated by overlapping the specified area on the image with a mask image having the above-mentioned size as a composite image, and the generated composite image is transmitted to the client terminal device.

Description

  The present invention relates to masking for a region in a captured image.

  Conventionally, surveillance cameras equipped with pan, tilt, and zoom have a mask function that hides a part of a video image by superimposing a single color image for privacy protection. There is also a technique for following the area in accordance with the operation. Some cameras do not employ an encoder, but the current position is obtained by controlling to the pan / tilt control limit at initialization. There are techniques for calculating and displaying the coordinates of a mask area, which is an area to be hidden, in the video for pan / tilt operation, and changing the size of the area according to the zoom magnification.

  For example, Patent Document 1 discloses a technique for changing the size of a mask region in accordance with field angle information. Patent Document 2 discloses a technique for improving the masking rate of a mask by superimposing a corrected mask in the pan / tilt traveling direction.

Special registration 3938127 JP2009-27753

  However, in the prior art disclosed in the above-mentioned patent document, the original position is not restored depending on the stop position accuracy of the motor. When the mask area is shifted, it is necessary for the user to perform pan / tilt control of the camera after setting the mask and to repeat the mask setting procedure to set the mask, which makes it difficult to set the mask. The present invention has been made in view of such problems, and provides a technique that enables mask setting easily even in a case where the mask is displaced.

  According to one aspect of the present invention, a camera server device that distributes an image captured by an imaging device to a client terminal device, and when receiving an instruction from the client terminal device to mask a specified area on the image, The calculation means for obtaining the size of the enlarged designated area by enlarging the designated area by an incremental amount corresponding to the current angle of view of the imaging device, and the mask image having the size are overlaid so as to cover the designated area on the image Transmitting means for generating an image as a composite image and transmitting the generated composite image to the client terminal device.

  According to the configuration of the present invention, it is possible to easily set a mask even in a case where the mask is shifted.

The figure which shows the structural example of a network camera system. FIG. 2 is a block diagram illustrating a hardware configuration example of a camera server 100. The figure which shows the program group in the camera server. The block diagram which shows the hardware structural example of the client 120. FIG. The figure which shows the program group in the client 120. FIG. The figure which shows the example of a display. The flowchart of the process which the camera server 100 performs. The flowchart of the process performed in step S820 and S830. The figure which shows the example of a display. The flowchart of the process which the camera server 100 performs. The flowchart of the process which the client 120 performs. The figure which shows the example of an external appearance of the camera server 100. FIG. The flowchart of the process performed by step S830.

  Preferred embodiments of the present invention will be described below with reference to the accompanying drawings. The embodiment described below shows an example when the present invention is specifically implemented, and is one of the specific examples of the configurations described in the claims.

[First Embodiment]
First, the network camera system according to the present embodiment will be described. As shown in FIG. 1, the network camera system according to the present embodiment includes two camera servers and one client 120, and each device is connected via a network 130 so as to be able to perform data communication with each other. Yes. In FIG. 1, the number of camera servers and clients is 2 and 1 for explanation, but the present embodiment is not limited to this number.

  Each of the camera servers 100 and 110 includes a camera (imaging device) that is arranged in a space and has a variable or fixed angle of view, and a moving image captured by the camera is transmitted to the client 120 via the network 130. To deliver. The client 120 accesses both or one of the camera servers 100 and 110 and receives and displays a moving image from the access destination.

  The network 130 includes a plurality of routers, switches, cables, and the like that satisfy a communication standard such as Ethernet (registered trademark). The communication standard, scale, and configuration are not limited as long as communication between each server and client can be performed without any problem. That is, the network 130 may be, for example, the Internet or a LAN (Local Area Network).

  Next, the camera server 100 (110) will be described. In the following, the camera servers 100 and 110 will be described as having the same configuration and performing the same operation, so the camera server 100 will be described and the description relating to the camera server 110 will be omitted. That is, the operation between the camera server 100 and the client 120 described below can be similarly applied to the operation between the camera server 110 and the client 120. A hardware configuration example of the camera server 100 will be described with reference to the block diagram of FIG.

  The CPU 200 executes processes using computer programs and data stored in the primary storage device 240, thereby controlling the operation of the entire camera server 100 and executing processes described later as those performed by the camera server 100. To do.

  The primary storage device 240 is configured by a memory such as a RAM. The ROM stores setting data and a boot program for the apparatus. The RAM temporarily stores an area for temporarily storing a computer program and data loaded from the secondary storage device 250 and various data received via various I / Fs (interfaces) described later. Have an area to do. The RAM also has a work area used when the CPU 200 executes various processes. That is, the RAM can provide various areas as appropriate.

  The secondary storage device 250 is a large-capacity information storage device such as the ROM or the hard disk drive. The secondary storage device 250 stores an OS (operating system) and computer programs and data for causing the CPU 200 to execute processes described later as those performed by the camera server 100. Information handled as known information by the camera server 100 is also stored in the secondary storage device 250. Computer programs and data stored in the secondary storage device 250 are appropriately loaded into the primary storage device 240 under the control of the CPU 200 and are processed by the CPU 200. The secondary storage device 250 may be a nonvolatile storage device such as a flash memory or a CD-ROM drive.

  The position sensor 293 is a sensor represented by a gravity sensor, and measures its own installation direction. A signal indicating the measured installation direction is sent to the primary storage device 240 as installation direction data via the position acquisition I / F 292.

  The camera 230 captures a moving image, and the captured moving image (image of each frame) is sent to the primary storage device 240 as a captured image via the image capture I / F 220. For example, after the captured image is temporarily stored in the primary storage device 240, the CPU 200 performs compression encoding on the captured image to generate encoded data having a specified format, and the encoded data is stored in the primary storage device 240. To store.

  The camera 230 is also connected to the camera control I / F 290. A control command (camera control command) for designating the zoom, focus, shutter speed, exposure, exposure, white balance, and the like of the camera 230 is input from the client 120 to the CPU 200 via a network I / F 270 described later. The CPU 200 generates a control signal for controlling zoom, focus, shutter speed, exposure, exposure, white balance, and the like according to the input camera control command, and sends the control signal to the camera via the camera control I / F 290. 230. As a result, the camera 230 changes the zoom, focus, shutter speed, exposure, exposure, white balance, and the like in accordance with this control signal to perform imaging. Further, the state of the camera 230 is notified to the CPU 200 via the camera control I / F 290.

  The camera 230 is fixed to a pan head 291, and the pan head 291 is connected to the pan head control I / F 260. A control command (head control command) for designating pan / tilt / rotation of the camera platform 291 is input from the client 120 to the CPU 200 via the network I / F 270 described later. In accordance with the input pan head control command, the CPU 200 generates a control signal for controlling pan, tilt, rotation, etc. (of the camera 230) of the pan head 291 and uses the generated control signal as a pan head control I / It is sent to the camera platform 291 via F260. The camera platform 291 changes pan, tilt, rotation, etc. (of the camera 230) of the camera platform 291 in accordance with this control signal. Further, the state of the pan head 291 is notified to the CPU 200 via the pan head control I / F 260.

  The network I / F 270 is for connecting the camera server 100 to the network 130, and the camera server 100 performs data communication with the client 120 via the network I / F 270.

  Next, a computer program group related to the following description that is stored in the secondary storage device 250 of the camera server 100 and managed by the OS will be described with reference to FIG.

  As shown in FIG. 3, the OS 300 manages an imaging processing program 310, a pan head control program 320, a mask processing program 330, a distribution processing program 340, and an installation direction acquisition program 360. These programs are loaded from the secondary storage device 250 to the primary storage device 240 under the control of the CPU 200 and are executed by the CPU 200. In the following description, each program may be described as an execution subject, but actually, the corresponding processing is executed by the CPU 200 executing the corresponding program.

  The imaging processing program 310 acquires a captured image captured by the camera 230 via the image capture I / F 220 and stores the acquired captured image in the primary storage device 240 by performing compression encoding or the like.

  The pan head control program 320 generates a control signal according to a pan head control command received from the client 120 via the network I / F 270, and sends the control signal to the pan head 291. The pan head control program 320 acquires the current pan / tilt / rotation of the pan head 291 and stores the acquired pan / tilt / rotation in the primary storage device 240.

  The mask processing program 330 generates a composite image by superimposing the mask image on the captured image stored in the primary storage device 240 in accordance with a mask setting instruction received from the client 120 via the network I / F 270.

  In response to various requests received from the client 120 via the network I / F 270, the distribution processing program 340 transmits information stored in the primary storage device 240 and the secondary storage device 250 to the client 120 via the network I / F 270. Deliver to. The information to be distributed includes a composite image, a captured image, the state of the camera 230, and information such as pan / tilt / rotation of the camera platform 291.

  The installation direction acquisition program 360 stores the installation direction received from the position sensor 293 via the position acquisition I / F 292 in the primary storage device 240. This installation direction may be sent from the client 120 via the network I / F 270. In this case, the installation direction acquisition program 360 also stores this sent installation direction in the primary storage device 240.

  The CPU 200, primary storage device 240, secondary storage device 250, position acquisition I / F 292, image capture I / F 220, camera control I / F 290, pan head control I / F 260, and network I / F 270 are all connected to the internal bus 210. It is connected.

  Next, a hardware configuration example of the client 120 will be described with reference to the block diagram of FIG.

  The CPU 400 executes processing using computer programs and data stored in the primary storage device 430, thereby controlling the operation of the entire client 120 and executing each processing described later as what the client 120 performs.

  The primary storage device 430 is configured by a memory such as a RAM. The ROM stores setting data and a boot program for the apparatus. The RAM temporarily stores an area for temporarily storing computer programs and data loaded from the secondary storage device 440 and various data received via various I / Fs (interfaces) described later. Have an area to do. The RAM also has a work area used when the CPU 400 executes various processes. That is, the RAM can provide various areas as appropriate.

  The secondary storage device 440 is a large-capacity information storage device such as the ROM or the hard disk drive device. The secondary storage device 440 stores an OS (operating system) and computer programs and data for causing the CPU 400 to execute processes described later as performed by the client 120. Information that the client 120 handles as known information is also stored in the secondary storage device 440. Computer programs and data stored in the secondary storage device 440 are appropriately loaded into the primary storage device 430 under the control of the CPU 400 and are processed by the CPU 400. The secondary storage device 440 may be a nonvolatile storage device such as a flash memory or a CD-ROM drive.

  The input device 480 is configured by a user interface such as a keyboard and a mouse, and various instructions can be input to the CPU 400 by the user of the apparatus. These various instructions are notified to the CPU 400 via the user input I / F 420.

  The output device 490 is connected to the user output I / F 450 and is a display device such as a CRT or a liquid crystal screen. The output device 490 can display the processing result by the CPU 400 and the image and information received from the camera server 100 via the network I / F 460. The output device 490 is not limited to a display device, and may be another type of output device.

  The network I / F 460 is for connecting the client 120 to the network 130, and the client 120 performs data communication with the camera server 100 via the network I / F 460.

  The CPU 400, primary storage device 430, secondary storage device 440, user input I / F 420, user output I / F 450, and network I / F 460 are all connected to the internal bus 410.

  Next, a computer program group related to the following description stored in the secondary storage device 440 of the client 120 and managed by the OS will be described with reference to FIG.

  As shown in FIG. 5, the OS 500 manages an input processing program 550, a display processing program 510, a communication processing program 520, and an image processing program 530. These programs are loaded from the secondary storage device 440 to the primary storage device 430 under the control of the CPU 400 and are executed by the CPU 400. In the following description, each program may be described as an execution subject, but actually, the corresponding processing is executed by the CPU 400 executing the corresponding program.

  The input processing program 550 detects a user operation on the input device 480, generates various commands according to the detected operation, and transmits the generated commands to the camera server 100 via the network I / F 460. This command includes the camera control command, the pan head control command, and a command (mask setting instruction) for setting a mask image in the captured image.

  In addition to the input device 480, for example, the input processing program 550 may receive an input operation from an external device via a network or an execution processing result of a computer program.

  The display processing program 510 causes the output device 490 to display an image stored in the temporary storage unit 540, each direction guide, and the like.

  The communication processing program 520 is a captured image or composite image from the camera server 100, current pan / tilt / rotation of the camera platform 291 (camera 230), current zoom, focus, shutter speed, exposure, exposure, white balance of the camera 230. Etc. The received various information is stored in the primary storage device 430.

  The image processing program 530 performs various types of image processing (color processing, expansion processing, etc.) on the image received from the camera server 100.

  Next, processing when mask setting is performed on the client 120 side will be described. When the user of the client 120 operates the input device 480 and selects the camera server 100, the CPU 400 transmits a moving image transmission request to the camera server 100. In response to this transmission request, the CPU 200 of the camera server 100 transmits the captured image of each encoded frame to the client 120 via the network I / F 270. The captured image of each frame is stored in the primary storage device 430 via the network I / F 460, decompressed by the CPU 200, and displayed on the output device 490.

  The user of the client 120 observes the displayed captured image and operates the input device 480 to specify an area to be masked on the captured image. Here, in a state where the captured image as shown in FIG. 6A is displayed on the screen of the output device 490, the user operates the input device 480 to set the mask portion as a mask target area. Assume that the area 600 is designated.

  Here, when a mask image having the same size as the mask target area is superimposed on the mask target area, in each subsequent frame, the position specified by the user (the center position of the image to be superimposed) is the same as the mask target area. A mask image having a size is superimposed. In the case of FIG. 6A, a mask image having the same size as the region 600 is superimposed at the same position as the region 600 in the captured image of each frame. After that, when the user operates the input device 480 and designates the imaging direction (pan / tilt / rotation) of the camera 230, the designated imaging direction is transmitted to the camera server 100 via the network I / F 460 as a pan head control command. Is done. When receiving the pan head control command via the network I / F 270, the CPU 200 of the camera server 100 controls the pan head 291 according to the pan head control command, and directs the camera 230 in the imaging direction designated by the user. Here, after the above mask setting, after changing the imaging direction to various directions, it is assumed that the same imaging direction as in FIG. However, when the imaging direction of the camera 230 is changed to stop in an arbitrary direction (pan angle, tilt angle, or yaw angle), as described later, the stop position (imaging direction) includes an error. Therefore, even if the same imaging direction as in FIG. 6A is designated, it is difficult to point the camera 230 in the same imaging direction as this imaging direction.

  After the above mask setting, after changing the imaging direction to various directions, the captured image captured by the camera 230 is changed after the same imaging direction as in FIG. Assume that the captured image is as shown in FIG. Reference numeral 710 denotes a mask image superimposed on the mask position designated by the user in the mask setting process (the center position of the mask image to be superimposed). As described above, the mask position specified by the user in the mask setting process is shifted from the window area 600, and a part of the area to be masked is displayed without being masked.

  In the present embodiment, the size of the mask image is determined in consideration of the above error at the time of mask setting, and the mask target area is more reliably masked. A process performed by the camera server 100 for this purpose will be described with reference to FIG. 7 showing a flowchart of the process. The process according to the flowchart of FIG. 7 is executed when the CPU 200 detects that a mask setting instruction has been received from the client 120 via the network I / F 270.

  The mask setting instruction includes information for specifying the mask target area on the captured image, and includes, for example, the coordinate position of the upper left corner and the coordinate position of the lower right corner of the mask target area. Instead, the coordinate position of the upper left corner of the mask target area and the horizontal size and vertical size of the mask target area may be included.

  In step S810, the CPU 200 sets the horizontal angle of view of the field of view of the camera 230 when the left end of the mask target area is the left end of the field of view of the camera 230 and the right end of the mask target area is the right end of the field of view of the camera 230. Calculate as the horizontal angle. The horizontal angle of view of the camera 230 is relative to the horizontal image size of the captured image. However, the mask image horizontal angle is, for example, the ratio between the horizontal image size of the mask target area (which can be calculated from the information included in the mask setting instruction) and the horizontal image size of the captured image and the horizontal angle of view of the camera 230. It can be calculated from the product.

  The current horizontal angle of view of the camera 230 may be inquired of the camera platform 291 via the camera platform control I / F 260. Of course, the horizontal angle of view of the camera 230 acquired by the client 120 inquiring of the camera server 100 when setting the mask is included in the mask setting instruction and transmitted to the camera server 100, and the horizontal angle of view is acquired from the mask setting instruction. It doesn't matter. Thus, the current method for obtaining the horizontal angle of view of the camera 230 is not limited to a specific method.

  Similarly, the CPU 200 sets the vertical field angle of the field of view of the camera 230 when the upper end of the mask target area is the upper end of the field of view of the camera 230 and the lower end of the mask target area is the lower end of the field of view of the camera 230. Calculate as the vertical angle.

  In steps S820 and S830, the CPU 200 corrects the mask image horizontal angle and the mask image vertical angle, and determines the final mask image horizontal angle and mask image vertical angle. The order of steps S820 and S830 is not limited to this, and the order of steps S830 and S820 may be performed. The processing performed in steps S820 and S830 will be described later with reference to FIG.

  In step S840, CPU 200 generates a composite image in which the mask image is superimposed on the position of the mask target area included in the mask setting instruction in the captured image stored in primary storage device 240. The size of this mask image is a size determined based on the processing in step S820 and step S830. Then, the CPU 200 compresses and encodes this composite image and transmits it to the client 120 via the network I / F 270. The composite image is stored in the primary storage device 430 of the client 120 via the network I / F 460 and then decompressed and displayed on the output device 490.

  Next, processing performed in steps S820 and S830 will be described. The process of correcting the mask image horizontal angle and the process of correcting the mask image vertical angle are basically the same process except for the direction. However, in the following, a process for correcting the mask image horizontal angle will be described as an example. That is, when correcting the mask image vertical angle, “horizontal” in the following description may be read as “vertical”.

  In step S <b> 910, the CPU 200 stores a table (mechanism error), which is stored in advance in the secondary storage device 250, for each horizontal field angle of the camera 230, a value (view angle error) based on the error amount with respect to the horizontal field angle. Error table) is loaded into the primary storage device 240.

  The mechanical error table is independent in the horizontal and vertical directions, and varies depending on the mechanical characteristics. The causes of the above errors include backlash due to gear tolerance, tension applied to the harness that sends control commands to the camera head, tilt of the base plate provided for tilt control, and gravity applied to the camera head. Etc. The mechanical error table may be obtained at the stage of obtaining the durability performance and error of the mechanical at the design stage. In that case, an error may be obtained with a certain number of units and the average value may be used. In addition, an error specific to the aircraft that cannot be corrected by the average value alone also occurs. In that case, an error specific to the machine body may be obtained after the camera server is manufactured and corrected from the average value. Further, since the error changes due to gravity applied to the camera head, the error depends on the installation direction of the camera server. A mechanical error table may be used in which the error in the downward direction in the vertical direction is large when the camera is upright, and the error is large in the reverse direction of the vertical direction in the vertical direction when the camera is upside down.

  Regardless of whether the average value of the error is used or a value obtained by correcting the average value is used, a value obtained by adding a specified value to this value is added to the mechanical error table as the angle of view error. sign up. For example, in the mechanical error table, 8% as an angle of view error for the horizontal angle of view x1 and 9% as an angle of view error for the horizontal angle of view x2 are registered.

  In step S <b> 920, the CPU 200 acquires a field angle error corresponding to the current horizontal field angle of the camera 230 from the mechanical error table. If an angle-of-view error corresponding to the horizontal angle of view of the current camera 230 is not registered in the mechanical error table, the angle-of-view error corresponding to a plurality of horizontal angles of view near the horizontal angle of view of the current camera 230 is used. You may obtain | require by interpolation.

  If the acquired angle of view error is a relatively small value such as a predetermined amount or less, the CPU 200 outputs the mask image horizontal angle acquired in step S810 as the final mask image horizontal angle, The process proceeds to step S840 via S930. On the other hand, if the acquired angle-of-view error is a relatively large value, such as greater than a specified amount, the process proceeds to step S940 via step S930.

  In step S940, the CPU 200 obtains a field angle obtained by adding a value based on the field angle error acquired in step S920 to the mask image horizontal angle as a final mask image horizontal angle (corrected field angle). For example, if the field angle error acquired in step S920 is 8%, (mask image horizontal angle + mask image horizontal angle × 8/100) is obtained as the final mask image horizontal angle. Of course, the method of changing the mask image horizontal angle to a larger angle of view with a value based on the angle of view error acquired in step S920 is not limited to this method, and depends on what value is used as the angle of view error. Other methods are possible. Note that the present invention is not limited to correcting both the mask image horizontal angle and the mask image vertical angle, and only one of them may be corrected in some cases.

  In step S840, a horizontal size (number of pixels) corresponding to the final mask image horizontal angle is obtained. This can be obtained geometrically by a process reverse to the above process for obtaining the mask image horizontal angle. The same applies to the vertical direction.

  The mask image whose horizontal size and vertical size are thus determined has a size larger than the size of the mask target area. Then, by superimposing such a mask image on the position specified by the user, as a result, the mask image is superimposed so as to cover the mask target region, and the mask target region can be masked without omission. it can.

  As described above, when a mask image having the same size as the mask target area is superimposed on the mask target area, as shown in FIG. 6B, the mask position and window portion specified by the user in the mask setting process are displayed. There was a deviation from the region 600. However, a mask larger than the mask image 710 is used as shown in FIG. 9A by using a mask image whose size is enlarged based on the angle-of-view error corresponding to the current camera angle of view as in this embodiment. The image 1000 can be displayed in a superimposed manner. Thereby, it is possible to mask the region to be masked without omission.

  The configuration of the camera server described above is merely an example of a basic configuration described below. The camera server according to the basic configuration is a camera server device that distributes an image captured by an imaging device to a client terminal device. When such an instruction to mask the designated area on the image is received from the client terminal device, such a camera server device obtains the size of the enlarged designated area obtained by enlarging the designated area by an increment corresponding to the current angle of view of the imaging device. (Calculation). Then, an image in which the mask images having the above sizes are overlapped so as to cover the designated area on the image is generated as a composite image, and the generated composite image is transmitted to the client terminal device.

[Second Embodiment]
The second embodiment will be described below. In the following description, only differences from the first embodiment will be described, and unless otherwise noted, the same as the first embodiment.

  In the present embodiment, a process performed by the camera server 100 for distributing a composite image will be described with reference to FIG. 10 showing a flowchart of the process. Steps S1110, S1120, and S1130 are the same as steps S810, S820, and S830, respectively, and a description thereof will be omitted. In step S1140, the CPU 200 stores the mask image horizontal angle and mask image vertical angle obtained in steps S1120 and S1130 in the primary storage device 240.

  In step S1150, the CPU 200 generates a composite image in which a mask image having the same size as the mask target region is superimposed on a position specified by the user. Then, the CPU 200 compresses and encodes this composite image, and transmits it to the client 120 via the network I / F 270 together with the mask image horizontal angle and the mask image vertical angle obtained in steps S1120 and S1130.

  The processing performed by the client 120 when receiving the composite image, the mask image horizontal angle and the mask image vertical angle obtained in steps S1120 and S1130 from the camera server 100 will be described with reference to FIG. explain.

  First, when the CPU 400 receives the composite image, the mask image horizontal angle and the mask image vertical angle obtained in steps S1120 and S1130 via the network I / F 460, the CPU 400 stores them in the primary storage device 430.

  In step S1201, the CPU 400 has the same mask image vertical angle in the mask target area and the mask image horizontal angle obtained in step S1120, and the mask image vertical angle in the mask target area and the mask image vertical angle obtained in step S1130 are the same. Judge whether there is.

  If both are the same as a result of this determination, it is determined that the mask image horizontal angle and the mask image vertical angle are not corrected, and the processing of FIG. 11A is completed. On the other hand, if any of them is different, it is determined that correction has been made, and the process proceeds to step S1202.

  In step S1202, the CPU 400 places the frame having the horizontal size and the vertical size determined as described above from the mask image horizontal angle and the mask image vertical angle obtained in steps S1120 and S1130 at the position specified by the user on the composite image. Superimpose. The display method of the frame is not limited to a specific display method. Instead of the frame, a rectangle in which the inside of the frame is semi-transparent may be displayed. Then, the CPU 400 causes the output device 490 to display such a composite image.

  There are the following reasons for using the pre-correction angle of view (mask image horizontal angle, mask image vertical angle) for mask superposition on the camera server side and displaying the guideline on the client side. Since the user does not perform pan / tilt control at the time of setting, there is no shift in the mask target area. In addition, since it is also a display of intention that the user does not want to show, it is possible to prevent the mask area from being viewed by a third party due to eavesdropping or the like during distribution by reliably setting the mask on the camera server side. On the other hand, the guideline part does not necessarily want the user to set the mask. If the image is superimposed on the camera server side, the image must be received from the server again to output an image on which the mask is not superimposed. However, if the image is superimposed on the client side, there is no communication with the camera server. There is an advantage that the presence or absence of the mask can be selected later.

  A display example of the composite image on the output device 490 of the client 120 is shown in FIG. A mask image 710 having the same size as that of the region 600 is displayed at a position designated by the user, and a frame 1320 having a size based on the correction angle of view is displayed at the same position. This frame 1320 is a guideline indicating a range in which there is a possibility of deviation.

[Third Embodiment]
In this embodiment, the operation of the camera server 100 is the same as that of the second embodiment, but the operation of the client 120 is different from that of the second embodiment. FIG. 11 is a flowchart illustrating the processing performed when the client 120 according to the present embodiment receives the composite image, the mask image horizontal angle and the mask image vertical angle obtained in steps S1120 and S1130 from the camera server 100. This will be described with reference to b).

  First, when the CPU 400 receives the composite image, the mask image horizontal angle and the mask image vertical angle obtained in steps S1120 and S1130 via the network I / F 460, the CPU 400 stores them in the primary storage device 430.

  In step S1410, the CPU 400 has the same mask image vertical angle in the mask target area as the mask image horizontal angle obtained in step S1120, and the mask image vertical angle in the mask target area and the mask image vertical angle obtained in step S1130 are the same. Judge whether there is.

  If both are the same as a result of this determination, it is determined that the mask image horizontal angle and the mask image vertical angle are not corrected, and the processing of FIG. 11B is completed. On the other hand, if either is different, it is determined that correction has been made, and the process proceeds to step S1420.

  In step S1420, CPU 400 reads the warning panel image from secondary storage device 440, and superimposes the read warning panel image on the composite image. Then, the CPU 400 causes the output device 490 to display such a composite image.

  A display example of the composite image on the output device 490 of the client 120 is shown in FIG. A mask image 710 having the same size as that of the region 600 is displayed at a position designated by the user, and a warning panel image 1510 indicating that the mask image may be shifted is displayed in a superimposed manner.

[Fourth Embodiment]
In the present embodiment, the correction level is switched according to the installation direction. In the present embodiment, the processing in step S830 described above, that is, the processing for correcting the mask image vertical angle to obtain the final mask image vertical angle is different from that in the first embodiment.

  An appearance example of the camera server 100 is shown in FIG. Reference numeral 1600 denotes an upright camera server. The camera head 1610 is connected to a support arm 1660, and is tilt-controlled in the vertical direction by a pan head control program 320. The support arm 1660 is connected to the base plate 1620 and is tilt-controlled by the pan head control program 320. The camera head 1610 controls the imaging direction between the direction indicated by the dotted line 1630 (direction A) and the direction indicated by the dotted line 1640 (direction B) by performing tilt control. In the case of erecting, the mechanical error tends to become larger as it approaches the A direction due to the influence of gravity. The external appearance of the camera server when the installation direction is inverted is 1650. In the case of inversion, the mechanical error becomes larger as it approaches the B direction due to the influence of gravity.

  The process of switching the correction level according to the installation direction and obtaining the final mask image vertical angle performed in step S830 will be described with reference to FIG. 13 showing a flowchart of the process.

  In step S1720, the CPU 200 refers to the latest installation direction measured by the position sensor 293 and stored in the primary storage device 240 via the position acquisition I / F 292, and whether or not the installation direction indicates upright. (It may include a specified error). As a result of the determination, if the erect is indicated, the process proceeds to step S1730, and if the erect is not indicated (inverted), the process proceeds to step S1740.

  In step S <b> 1730, the CPU 200 loads, from the secondary storage device 250, a mechanical error table in which the angle of view error (mechanical error) increases as approaching the A direction illustrated in FIG.

  On the other hand, in step S1740, the CPU 200 loads, from the secondary storage device 250, a mechanical error table in which the angle of view error (mechanical error) increases as approaching the B direction shown in FIG.

  In steps S1760, S1770, and S1780, processes similar to those in steps S920, S930, and S940 are performed. Note that the mechanical error table used in the processing after step S1760 is the mechanical error table loaded into the primary storage device 240 in step S1730 or step S1740.

  A mechanical error table for correcting the mask image horizontal angle may be selected by the same method, and the mask image horizontal angle may be corrected using the selected mechanical error table. Of course, only one of them may be corrected. The above embodiments may be used in appropriate combination.

(Other examples)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

Claims (6)

A camera server device that distributes an image captured by an imaging device to a client terminal device,
When receiving an instruction from the client terminal device for masking the designated area on the image, a calculation means for obtaining a size of the enlarged designated area obtained by enlarging the designated area by an increment corresponding to the current angle of view of the imaging device;
Transmitting means for generating, as a composite image, an image in which the mask image having the size is overlapped so as to cover the designated area on the image, and transmitting the generated composite image to the client terminal device. A camera server device.   The camera server apparatus according to claim 1, wherein the increment amount is a value based on an error in an angle of view when the angle of view of the imaging device is changed to the current angle of view.   The camera server apparatus according to claim 1, wherein the calculation unit uses the increment amount according to whether or not the imaging apparatus is upright. The calculating means includes
Obtaining a size of an enlargement designated area obtained by enlarging the designated area in a horizontal direction and a vertical direction by an increment amount corresponding to a current angle of view of the imaging apparatus, or a size of an enlargement designated area enlarged in a horizontal direction or a vertical direction. The camera server device according to claim 1, wherein: A client terminal device;
A camera server device that delivers an image captured by the imaging device to the client terminal device;
A camera system comprising:
The client terminal device
Means for designating a region to be masked on the image as a designated region and transmitting an instruction to mask the designated region to the camera server device;
The camera server device
When the instruction is received from the client terminal device, calculation means for obtaining a size of the enlarged designated region obtained by enlarging the designated region by an increment corresponding to the current angle of view of the imaging device;
A transmission unit configured to generate an image in which the mask image having the size is superimposed so as to cover the designated area on the image as a composite image, and to transmit the generated composite image to the client terminal device;
The client terminal device
A camera system comprising: means for displaying a composite image transmitted by the transmission means. A control method of a camera server device that distributes an image captured by an imaging device to a client terminal device,
When the calculation unit of the imaging apparatus receives an instruction from the client terminal device for masking the designated area on the image, the enlarged designated area is enlarged by the increment corresponding to the current angle of view of the imaging apparatus. A calculation process for determining the size of
The transmission unit of the imaging device generates an image in which the mask image having the size is overlapped so as to cover the designated area on the image as a composite image, and transmits the generated composite image to the client terminal device And a transmitting step for controlling the camera server device.

Images