JP2020088507A - Image processing device and image processing method - Google Patents

Abstract

To provide a technique for allowing a user to visually recognize an effective mask region corresponding to a region to image.SOLUTION: An image processing device acquires the imaging magnification of a captured image having a mask region set thereto, and displays a first object indicating an imaging magnification range having the imaging magnification as a lower limit and a second object indicating information relating to the mask region set to a captured image with an imaging magnification not larger than the imaging magnification.SELECTED DRAWING: Figure 1

Description

The present invention relates to a technique for setting a mask area on an image.

2. Description of the Related Art Conventionally, in an image pickup apparatus such as a surveillance camera, a masking technique for shielding a part of an image or an image is known from the viewpoint of privacy protection. At this time, if the photographing area is changed by the zoom function or the like, the area to be shielded is also changed. Therefore, in order to always shield the mask target regardless of the shooting area, a process of changing the mask area according to the shooting area is performed. For example, Patent Document 1 discloses a technique of connecting adjacent masks according to an imaging region to generate an enlarged mask.

JP, 2014-107784, A

However, in the conventional technique disclosed in the above-mentioned Patent Document 1, the mask processing is changed in accordance with the change of the photographing area, and thus it is difficult for the user to grasp the mask that is effective for each photographing area. The present invention provides a technique for allowing a user to visually recognize an effective mask area corresponding to an area to be imaged.

According to one aspect of the present invention, an acquisition unit that acquires an imaging magnification of a captured image in which a mask area is set, a first object that represents an imaging magnification range having the imaging magnification as a lower limit, and an imaging magnification that is less than or equal to the imaging magnification. It is characterized by further comprising: a second object that represents information about the mask area set in the captured image; and display control means that displays the second object.

According to the present invention, it is possible to allow a user to visually recognize an effective mask area corresponding to an area to be imaged.

FIG. 3 is a block diagram showing a functional configuration example of an imaging system. The figure which concerns on setting information. The figure which concerns on a magnification range display. 9 is a flowchart of a process for displaying a magnification range display in a display area 125. The figure explaining designation|designated of the center position of zoom. The figure which concerns on a magnification range display. FIG. 3 is a block diagram showing a hardware configuration example of a computer device applicable to the image processing device 103. The figure which concerns on a pan angle range display. The figure which concerns on a tilt angle range display. 9 is a flowchart of processing for displaying a pan angle range display and a tilt angle range display in a display area 126. The figure which concerns on a magnification range display.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In addition, the embodiment described below shows an example of a case where the present invention is specifically implemented, and is one of the specific embodiments of the configuration described in the claims.

[First Embodiment]
First, a functional configuration example of the imaging system according to the present embodiment will be described with reference to the block diagram of FIG. As shown in FIG. 1, the imaging system according to this embodiment includes an imaging device 101 and an image processing device 103. The imaging device 101 and the image processing device 103 are connected to a wireless and/or wireless network 102, and are configured to be able to perform data communication with each other via the network 102. The network 102 is, for example, a local area network (LAN), and includes a router or the like that satisfies a communication standard such as Ethernet (registered trademark).

First, the image pickup apparatus 101 will be described. The image capturing unit 104 receives external light via the zoom lens group 110 on the light receiving surface of the image sensor 111. An analog electric signal corresponding to the received light is output from the image sensor 111, and the analog electric signal is amplified by the amplifier 112 and input to the image processing unit 105.

The processing unit 113 acquires a digital image (captured image) by performing image processing such as A/D conversion and development processing on the analog electric signal amplified by the amplifier 112. By such operations of the image capturing unit 104 and the processing unit 113, it is possible to acquire the captured image of each frame forming the moving image or the captured image captured periodically/irregularly.

The mask processing unit 114 sets a mask area on the captured image according to the mask area setting information, and performs mask processing on the set mask area. There are various types of mask processing, and the mask processing is not limited to specific processing. For example, it may be a process of blurring the inside of the mask region, or a process of arranging a mask image (an image of a single color or a plurality of colors) of the same size as the mask region in the mask region.

The communication unit 106 is a communication interface for performing data communication with the image processing apparatus 103 via the network 102. The drive unit 107 controls the pan angle, the tilt angle, and the zoom amount of the imaging unit 104 based on the instruction from the drive control unit 108. The changing unit 118 controls the drive of the zoom motor 115 according to an instruction from the control unit 109. The zoom motor 115 drives the zoom lens group 110 according to the drive control by the changing unit 118 to change the imaging magnification. The changing unit 119 controls driving of the pan motor 116 and the tilt motor 117 according to an instruction from the control unit 109. The pan motor 116 changes the pan angle of the imaging unit 104 according to the drive control by the changing unit 119. The tilt motor 117 changes the tilt angle of the imaging unit 104 according to the drive control by the changing unit 119.

The control unit 109 controls the operation of the entire imaging device 101. For example, when the control unit 109 receives a zoom amount/pan angle/tilt angle change instruction from the image processing apparatus 103 via the communication unit 106, the control unit 109 transfers the zoom amount change instruction to the change unit 118 to change the pan angle. The instruction and the instruction to change the tilt angle are transferred to the changing unit 119. Further, when the control unit 109 receives the mask area setting information from the image processing apparatus 103 via the communication unit 106, the control unit 109 sends the setting information to the mask processing unit 114. The mask processing unit 114 sets a mask area on the captured image according to this setting information.

Next, the image processing apparatus 103 will be described. The image processing device 103 is a computer device such as a PC (personal computer), a tablet terminal device, or a smartphone.

The communication unit 120 is a communication interface for performing data communication with the imaging device 101 via the network 102. The setting unit 122 includes a user interface such as a keyboard, a mouse, and a touch panel, and can be operated by the user to input various instructions to the image processing apparatus 103. For example, the user can operate the setting unit 122 to perform various setting operations related to the mask area.

The display unit 121 is a display device having a liquid crystal screen or a touch panel screen, and has a display screen including display regions 124, 125, 126. The display area 124 is a display area for displaying a captured image received from the image capturing apparatus 101 via the communication unit 120. The display area 125 displays a first object representing an imaging magnification range whose lower limit is the imaging magnification of the captured image in which the mask area is set, and information related to the mask area set in the captured image having an imaging magnification equal to or lower than the imaging magnification. A second object that represents the second object and a display area for displaying the second object. The display area 126 displays an object representing a range in an imaging direction in which an image including the mask area is captured when a partial area of a captured image in which the mask area is set is captured, and an object representing the mask area. This is a display area for

The control unit 123 controls the operation of the entire image processing apparatus 103. For example, the control unit 123 controls the display of the display unit 121 and controls the data communication with the imaging device 101 according to the operation of the setting unit 122 by the user.

Although the image pickup apparatus 101 and the image processing apparatus 103 are separate apparatuses in FIG. 1, the image pickup apparatus 101 and the image processing apparatus 103 may be integrated. Further, the functions of the imaging device 101 and the image processing device 103 may be implemented by three or more devices.

Next, a mask area setting process in the image processing apparatus 103 will be described. When the image processing apparatus 103 performs the mask area setting processing, the fact is transmitted to the imaging apparatus 101. In that case, the mask processing unit 114 does not operate and the imaging apparatus 101 performs the mask processing. No captured image is sent.

In the mask area setting process according to the present embodiment, the user specifies the position of the mask area on the captured image, and creates the setting information in which the information related to the mask area and the imaging magnification of the captured image are associated with each other. To do.

For example, the captured image output from the imaging device 101 is displayed in the display area 124, and the user performs an operation of designating the position of the mask area on the captured image displayed in the display area 124. For the mask area whose position has been designated on the captured image, information relating to the mask area and the imaging magnification of the captured image are registered in the setting information in association with each other. A configuration example of the setting information is shown in FIG.

The “mask number” is a number unique to each mask area whose position has been designated on the captured image, and is, for example, a number sequentially issued such as 1, 2, 3,... In the designated order. The “mask name” is the name of each mask area whose position has been specified on the captured image, and is a name that is sequentially issued, for example, M1, M2, M3,... In the specified order. The “mask name” can be appropriately edited by the user operating the setting unit 122. The “effective magnification” is the imaging magnification of the captured image in which the position of the mask area is designated. For example, a mask area having a “mask number” of “1” (mask name is “M1”) is a mask area whose position is designated by the user on a captured image captured at an imaging magnification of “1”. Further, the mask area having the “mask number” of “2” (mask name is “M2”) is a mask area whose position is designated by the user on the captured image captured at the imaging magnification of “2”. The “mask position” is the position of the mask area specified by the user on the captured image, and in the present embodiment, it is assumed to be a set of the upper left corner position and the lower right corner position of the mask area.

It is assumed that the current setting information is the setting information shown in FIG. In this case, in the display area 125, as shown in FIG. 3A, an instruction unit 390 operated by the user for designating (changing) the imaging magnification of the captured image acquired for setting the mask area, and an instruction. A movable range 301 of the unit 390 is displayed. The user can move the instruction unit 390 from one end to the other end of the range 301 by operating the setting unit 122. When the instruction unit 390 is moved to the left end, imaging magnification=1 is designated, and the instruction unit When 390 is moved to the right end, imaging magnification=Rm (Rm>1) is designated. When the user operates the setting unit 122 and moves the instruction unit 390 within the range 301 to specify the imaging magnification, the control unit 123 transmits the imaging magnification to the imaging apparatus 101 via the communication unit 120. . The image pickup apparatus 101 changes the current image pickup magnification to the transmitted image pickup magnification and outputs the picked-up image picked up with the changed image pickup magnification, so that the display area 124 displays the changed image pickup magnification in the display area 124. The captured image captured in is displayed. In this way, the display area 124 can display the captured image captured at the imaging magnification specified by the user operating the instruction unit 390.

Then, the user operates the setting unit 122 to specify the position of the mask area on the captured image displayed in the display area 124. For example, the user operates the setting unit 122 to specify the position of the upper left corner and the position of the lower right corner of the mask area as the “mask area position”. When the user operates the setting unit 122 to specify the position of the mask area, the control unit 123 sets an object representing the mask area (for example, a frame of the mask area) on the captured image in the display area 124 according to the specified position. indicate. FIG. 2B shows an example of the mask areas M1 to M4 whose positions are designated on the captured image 201. In FIG. 2B, each of the mask areas M1 to M4 is a rectangle filled with black. Is represented. Further, the control unit 123, the current imaging magnification specified by the instruction unit 390, and information regarding the mask area whose position is specified on the captured image in the display area 124 (in the example of FIG. 2A, The mask number, the mask name, and the mask position) are associated with each other and registered in the setting information.

Further, as shown in FIG. 3A, an object representing the effective magnification is displayed in the vicinity of the position corresponding to the effective magnification registered in the setting information in the range 301. Two effective magnifications of "1" and "2" are registered as the effective magnifications in the setting information of FIG. In this case, as shown in FIG. 3(a), an object 380 marked with the word "magnification 1" is placed in the vicinity of the position corresponding to the effective magnification=1 (the upper part of the position in FIG. To be done. Further, as shown in FIG. 3A, an object 381 in which the character "magnification 2" is written is arranged in the vicinity of the position corresponding to the effective magnification=2 (the upper part of the position in FIG. 3A). It

Further, as shown in FIG. 3A, for each effective magnification registered in the setting information, an object representing a range whose lower limit is the effective magnification and an effective magnification equal to or lower than the effective magnification are associated with the setting information. An object representing the held mask name is displayed. In the case of FIG. 3A, the range 301 includes a range having a lower limit of effective magnification=1 (referred to as range A) and a range having a lower limit of effective magnification=2 (referred to as range B). To do. Since the range B is a part of the range A, the range A has a lower limit of effective magnification=1 and an upper limit of effective magnification=2. In FIG. 3A, the range A is displayed as a white rectangular object 395, and “mask names M1, M3, M4 associated with effective magnifications equal to or lower than the lower limit of the range A are displayed in the vicinity of the rectangular object 395. An object 302 representing “is an effective mask name” is displayed. In FIG. 3A, the range B is displayed as a hatched rectangular object 396, and the mask names M1, M2, M3, and M4 associated with effective magnifications equal to or lower than the lower limit of the range B are valid near the rectangular object 396. The object 304 representing “is the mask name” is displayed. The processing relating to the display (magnification range display) of FIG. 3A is performed by the control unit 123.

Here, it is assumed that the imaging magnification currently designated by the instruction unit 390 is “2” and the current setting information is the setting information shown in FIG. When the user operates the setting unit 122 to specify the position of the mask area on the captured image displayed in the display area 124, the control unit 123 displays the position on the captured image in the display area 124 according to the specified position. An object representing the mask area (for example, a frame of the mask area) is displayed. Further, the control unit 123 associates the current imaging magnification “2” with the mask number “5” of the mask area, the mask name “M5”, and the mask position (x, y) and registers them in the setting information. By doing so, the setting information is updated. Then, the control unit 123 updates the magnification range display of FIG. 3A according to the updated setting information, and additionally displays the mask name “M5” on the object 304 in FIG.

When such setting information is sent to the mask processing unit 114, the mask processing unit 114 acquires the mask position registered in the setting information in association with the imaging magnification of the current imaging magnification R or less. Then, the mask processing unit 114 sets a mask area at the mask position on the captured image from the image capturing unit 104, and performs mask processing on the mask area.

It is assumed that the setting information of FIG. 2A is sent to the mask processing unit 114. At this time, if the current image pickup magnification is “1”, as shown in FIG. 3B, the mask regions M1, M3, which are registered in the setting information in association with the image pickup magnifications of the image pickup magnification “1” or less. M4 is set on the captured image 305. On the other hand, if the current imaging magnification is "2", as shown in FIG. 3C, the mask areas M1, M2, M3 registered in the setting information in association with the imaging magnification of imaging magnification "2" or less. , M4 are set on the captured image 305.

Processing for displaying the magnification range display of FIG. 3A in the display area 125 will be described with reference to the flowchart of FIG. The process according to the flowchart of FIG. 4 is performed every time the setting information is updated. For example, the processing according to the flowchart of FIG. 4 is performed each time a set of “mask number, mask name, effective magnification, mask position” is newly registered in the setting information or a registered set is edited. Also, when the user operates the setting unit 122 to delete the set registered in the setting information, the process according to the flowchart of FIG. 4 is performed.

In step S401, the control unit 123 acquires the current (latest) setting information. Then, in step S402, the control unit 123 displays the range 301 in the display area 125, and displays the instruction unit 390 at a specified position in the range 301. The control unit 123 also displays objects 380 and 381 representing the effective magnification in the vicinity of the position corresponding to the effective magnification registered in the setting information in the range 301. In addition, the control unit 123 associates rectangular objects 395 and 396, which represent a range whose lower limit is the effective magnification registered in the setting information, with the mask names stored in the setting information in association with the effective magnifications equal to or lower than the effective magnification. The objects 302 and 304 are displayed.

[Second Embodiment]
In each of the following embodiments including the present embodiment, a difference from the first embodiment will be described, and it is assumed that the same as the first embodiment unless otherwise mentioned below. In the present embodiment, the user can specify the center position of zoom on the captured image. For example, as shown in FIG. 5, the user can operate the setting unit 122 to specify the zoom center position 501 for the captured image 201 in which the mask areas M1 to M4 are set. Note that the center position of the captured image is the center position of the zoom, as in the first embodiment, unless the user specifies the center position of the zoom.

FIG. 6B shows an example of the captured image 305 in which the mask areas M1 to M4 and the zoom center position 501 are set. The captured image 305 in FIG. 6B includes mask areas M1 to M4.

A captured image 305 obtained by zooming up (increasing the imaging magnification) of the captured image 305 of FIG. 6B around the zoom center position 501 is shown in FIG. 6C. Since the captured image 305 of FIG. 6B is zoomed up around the zoom center position 501, in the captured image 305 of FIG. 6C, the mask region M4 is out of the mask regions M1 to M4. ..

A captured image 305 obtained by zooming up (increasing the imaging magnification) around the zoom center position 501 of the captured image 305 of FIG. 6C is shown in FIG. 6D. Since the captured image 305 of FIG. 6C is zoomed up around the zoom center position 501, in the captured image 305 of FIG. 6D, the mask region M3 and the mask region M4 are out of the mask regions M1 to M4. It's gone.

An example of the magnification range display displayed according to the setting information for displaying such a mask area is shown in FIG. In the magnification range display of FIG. 6A, the following information is displayed in addition to the instruction section 390 and the range 301. For each effective magnification registered in the setting information, a rectangular object 695, 696, 697 representing a range having the effective magnification as a lower limit, a mask name held in the setting information in association with the effective magnification equal to or lower than the effective magnification Objects 601, 602, and 604 representing the are displayed. Further, in the magnification range display of FIG. 6A, the zoom center position 501 is displayed as “zoom reference position (x, y)” 603.

The process related to the display of the magnification range display based on the setting information is the same as that in the first embodiment when the user does not specify the center position of the zoom. On the other hand, when the user specifies the zoom center position, the “zoom reference position (x, y)” 603 is displayed instead of the objects 380 and 381, which is the same as the first embodiment.

In the present embodiment, when the zoom center position is designated on the captured image, information indicating the center position is transmitted to the image capturing apparatus 101 by the control unit 123. The control unit 109 of the image pickup apparatus 101 controls the drive unit 107, and controls the pan angle, tilt angle, and the like so that the center position becomes the image pickup center position (zoom center position).

[Third Embodiment]
In the present embodiment, when a partial area of an image in which a mask area is set is captured as a captured image, an object that represents a range in an imaging direction in which a captured image that includes the mask area is captured, and an object that represents the mask area. , Is displayed.

In the present embodiment, for example, as shown in FIG. 5, the imaging region 502 and the pan/tilt reference position 503 are designated for the captured image 201 in which the mask regions M1 to M4 are set. The designation of the imaging region 502 and the reference position 503 may be set by the user operating the setting unit 122, or the region of the object detected by the control unit 123 from the captured image and the center of gravity thereof may be set as the imaging region 502 and the reference position, respectively. It may be 503.

The control unit 123 transmits information indicating the image pickup area 502 and the reference position 503 to the image pickup apparatus 101. The control unit 109 controls the drive unit 107 to control the pan angle and the tilt angle so that the reference position 503 becomes the imaging center position (zoom center position), and the image in the imaging region 502 is set to the size of the above-mentioned captured image. Zoom in to get at. As a result, the image processing apparatus 103 can obtain from the image capturing apparatus 101 an image captured with the reference position 503 as the image capturing center position (zoom center position) and the image in the image capturing area 502 as the image having the size of the captured image. Then, this image is displayed in the display area 124.

FIG. 8B shows an example of a captured image transmitted from the image capturing apparatus 101 after transmitting the image capturing area 502 and the reference position 503 to the image capturing apparatus 101. In FIG. 8B, the captured image 305 corresponds to the image in the captured area 502 in the captured image 201, and the reference position 503 is located at the center position of the image. The captured image 305 in FIG. 8B includes only the mask M1 among the mask regions M1 to M4.

When the user operates the setting unit 122 to change the pan angle while the captured image 305 of FIG. 8B is displayed, the control unit 123 issues a pan angle change instruction to the imaging apparatus 101. Sent out. The image capturing apparatus 101 changes the pan angle by the above operation, and transmits the captured image captured after the change to the image processing apparatus 103. An example of the captured image 305 transmitted from the image capturing apparatus 101 when the user operates the setting unit 122 to change the pan angle while the captured image 305 in FIG. 8B is displayed is illustrated in FIG. It shows in (c). The picked-up image 305 of FIG. 8C is a picked-up image in which the pan angle is changed from the picked-up image 305 of FIG. 8B, and the included mask area is different from the picked-up image 305 of FIG. 8B. The captured image 305 in FIG. 8C includes the mask area M1 and the mask area M2 among the mask areas M1 to M4.

An example of the captured image 305 transmitted from the image capturing apparatus 101 when the user operates the setting unit 122 to change the pan angle while the captured image 305 in FIG. 8C is displayed is illustrated in FIG. It shows in (d). The picked-up image 305 of FIG. 8D is a picked-up image in which the pan angle is changed from the picked-up image 305 of FIG. 8C, and the included mask area is different from the picked-up image 305 of FIG. 8C. The captured image 305 in FIG. 8D includes the mask area M1 and the mask area M3 among the mask areas M1 to M4. In this way, when the pan angle is changed, the mask area shown in the captured image also changes.

When the user specifies the position of the mask area on the captured image in the same manner as in the first embodiment, the setting unit 122 sets the pan angle range (pan angle range) in which the mask area appears on the captured image. input. The pan angle range is, for example, a set of a pan angle at one end and a pan angle at the other end of the pan angle range. Then, the control unit 123 associates the pan angle range with information on the set mask area (mask number, mask name, mask position) and registers them in the setting information.

An example of the pan angle range display displayed in the display area 126 according to such setting information is shown in FIG. The control unit 123 displays an instruction unit 890 operated by the user to change the pan angle and a range 801 in which the instruction unit 890 can move. The user can operate the setting unit 122 to move the instruction unit 890 from one end to the other end of the range 801, and when the instruction unit 890 is moved to the left end, the specified minimum pan angle is designated, and the instruction unit 890 is set. When 890 is moved to the right end, the specified maximum pan angle of the imaging area 502 is designated. When the user operates the setting unit 122 and moves the instruction unit 890 within the range 801, the pan angle is designated, and the control unit 123 transmits the pan angle to the imaging apparatus 101 via the communication unit 120. .. Then, as described above, the captured image captured with the changed pan angle is output from the image capturing apparatus 101 and displayed in the display area 124.

Then, the control unit 123 divides the range 801 into a plurality of sections by the pan angles (pan angles at both ends of the pan angle range) registered in the setting information. Then, the control unit 123 displays, for each section, an object representing the section and an object representing a mask name associated with the pan angle range including the entire section. In the example of FIG. 8A, as the pan angle range, “the pan angle P0 corresponding to the left end of the range 801 to the pan angle P3 corresponding to the right end of the range 801” is associated with the mask area having the mask name “M1”. Registered in the setting information. Further, “pan angle P1 to pan angle P3” is registered as the pan angle range in the setting information in association with the mask area having the mask name “M2”. Further, “pan angle P2 to pan angle P3” is registered in the setting information as the pan angle range in association with the mask area having the mask name “M3”. In this case, the control unit 123 divides the range 801 into three sections P0 to P1, P1 to P2, and P2 to P3.

Then, the control unit 123, for the sections P0 to P1, an oblique rectangle object 895 representing the sections P0 to P1, and an object 802 representing a mask name M1 corresponding to the pan angle range including the entire sections P0 to P1. , Is displayed.

Further, for the sections P1 and P2, the control unit 123 represents a white rectangular object 896 representing the sections P1 and P2 and mask names M1 and M2 corresponding to the pan angle range including the entire sections P1 and P2. The object 809 is displayed.

Further, for the sections P2 to P3, the control unit 123 sets diagonally shaded rectangular objects 897 representing the sections P2 to P3 and mask names M1, M2, and M3 corresponding to the pan angle range including the entire sections P2 to P3. And the object 804 that represents it are displayed. Further, the control unit 123 displays the pan/tilt reference position 503 as “pan/tilt reference position (x, y)” 808.

Further, FIG. 9B illustrates an example of a captured image transmitted from the image capturing apparatus 101 after transmitting the image capturing area 502 and the reference position 503 to the image capturing apparatus 101. The captured image 305 in FIG. 9B includes only the mask M1 among the mask regions M1 to M4.

When the user operates the setting unit 122 to change the tilt angle while the captured image 305 in FIG. 9B is displayed, a tilt angle change instruction is issued to the imaging apparatus 101 by the control unit 123. Sent out. The image capturing apparatus 101 changes the tilt angle by the above operation, and transmits the captured image captured after the change to the image processing apparatus 103. An example of the captured image 305 transmitted from the image capturing apparatus 101 when the user operates the setting unit 122 to change the tilt angle while the captured image 305 in FIG. 9B is displayed is shown in FIG. It shows in (c). The captured image 305 of FIG. 9C is a captured image in which the tilt angle is changed from the captured image 305 of FIG. 9B, and the mask area included therein is different from the captured image 305 of FIG. 9B. The captured image 305 in FIG. 9C includes the mask area M1 and the mask area M4 among the mask areas M1 to M4.

An example of the captured image 305 transmitted from the image capturing apparatus 101 when the user operates the setting unit 122 to change the tilt angle while the captured image 305 in FIG. 9C is displayed is illustrated in FIG. It shows in (d). The imaged image 305 in FIG. 9D is an imaged image in which the tilt angle is changed from the imaged image 305 in FIG. 9C, and the included mask area is different from the imaged image 305 in FIG. 9C. The captured image 305 in FIG. 9D includes only the mask area M4 among the mask areas M1 to M4. In this way, when the tilt angle is changed, the mask area shown in the captured image also changes.

When the user specifies the position of the mask area on the captured image in the same manner as in the first embodiment, the setting unit 122 sets the tilt angle range (tilt angle range) in which the mask area appears on the captured image. input. The tilt angle range is, for example, a set of a tilt angle at one end and a tilt angle at the other end of the tilt angle range. Then, the control unit 123 associates the tilt angle range with the set mask area information (mask number, mask name, mask position) and registers them in the setting information.

An example of the tilt angle range display displayed in the display area 126 according to such setting information is shown in FIG. The control unit 123 displays an instruction unit 990 operated by the user to change the tilt angle and a movable range 901 of the instruction unit 990. The user can move the instruction unit 990 from one end to the other end of the range 901 by operating the setting unit 122. When the instruction unit 990 is moved to the upper end, the specified maximum tilt angle is specified, and the instruction When the part 990 is moved to the lower end, a specified minimum tilt angle is designated. When the tilt angle is designated by the user operating the setting unit 122 and moving the instruction unit 990 within the range 901, the control unit 123 transmits the tilt angle to the imaging device 101 via the communication unit 120. .. Then, as described above, the image pickup device 101 outputs the picked-up image picked up at the changed tilt angle and is displayed in the display area 124.

Then, the control unit 123 divides the range 901 into a plurality of sections by the tilt angles (tilt angles at both ends of the tilt angle range) registered in the setting information. Then, the control unit 123 displays, for each section, an object that represents the section and an object that represents a mask name associated with a tilt angle range including the entire section. In the example of FIG. 9A, with respect to the mask area having the mask name “M1”, “tilt angle T0 to tilt angle T2 corresponding to the upper end of range 901” is associated with the setting information as the tilt angle range. It is registered. Further, for the mask area with the mask name “M4”, “tilt angle T3 corresponding to the lower end of the tilt angle T1 to range 901” is registered in the setting information as a tilt angle range. In this case, the control unit 123 divides the range 901 into three sections T0 to T1, T1 to T2, and T2 to T3. Then, the control unit 123, for the sections T0 to T1, an oblique rectangle object 995 representing the sections T0 to T1, and an object 902 representing a mask name M1 corresponding to the tilt angle range including the entire sections T0 to T1. , Is displayed. Further, for the sections T1 and T2, the control unit 123 represents a white rectangular object 996 that represents the sections T1 and T2, and mask names M1 and M4 that correspond to the tilt angle range that includes the entire sections T1 and T2. The object 909 is displayed. Further, the control unit 123, for the sections T2 to T3, an oblique rectangle object 997 representing the sections T2 to T3, and an object 904 representing a mask name M4 corresponding to the tilt angle range including the entire sections T2 to T3. , Is displayed. Further, the control unit 123 displays the pan/tilt reference position 503 as “pan/tilt reference position (x, y)” 808.

The pan angle range display of FIG. 8 and the tilt angle range display of FIG. 9 may be displayed side by side in the display area 126. Further, in the display area 126, either one of the pan angle range display of FIG. 8 and the tilt angle range display of FIG. 9 may be displayed, and the other may be switched and displayed according to a user operation. Further, the image processing apparatus 103 may be configured to display only one of the pan angle range display and the tilt angle range display.

Processing for displaying the pan angle range display of FIG. 8 and the tilt angle range display of FIG. 9 in the display area 126 will be described with reference to the flowchart of FIG. 10. The process according to the flowchart of FIG. 10 is performed every time the setting information is updated. For example, each time a set of “mask number, mask name, pan angle range/tilt angle range, mask position” is registered in the setting information or a registered set is edited, the flowchart of FIG. 10 is followed. Processing is done. Also, when the user operates the setting unit 122 to delete the set registered in the setting information, the processing according to the flowchart of FIG. 10 is performed.

In step S1001, the control unit 123 acquires the current (latest) setting information. Then, in step S1002, the control unit 123 displays the range 801/901 in the display area 126, and displays the instruction unit 890/990 at a specified position in the range 801/901. The control unit 123 divides the range 801/901 into a plurality of sections by the pan angle/tilt angle registered in the setting information, and for each section, an object representing the section, a pan angle range including the entire section/ An object representing a mask name associated with the tilt angle range is displayed. Further, the control unit 123 displays the pan/tilt reference position 503 as “pan/tilt reference position (x, y)” 808.

[Fourth Embodiment]
The acquisition source of the captured image is not limited to the image capturing apparatus 101. For example, a captured image may be received from an external server device or client terminal device via a network. Alternatively, the captured image received from the image capturing apparatus 101 or another apparatus and stored in the image processing apparatus 103 may be read and used.

Further, the above-mentioned magnification range display is an object that represents an imaging magnification range whose lower limit is the imaging magnification of the captured image in which the mask area is set, and information related to the mask area that is set in the captured image of the imaging magnification equal to or lower than the imaging magnification. It is just an example of a screen displaying an object that represents. That is, the display of the magnification range is not limited to the configuration shown in FIG. For example, the magnification range display may be a display as shown in FIG. The magnification range display of FIG. 11 is based on the setting information of FIG. That is, the range 301, the instruction unit 390, and the objects 380 and 381 are displayed as in the first embodiment. Then, the mask names registered in the setting information are displayed vertically side by side under the range 301, and the effective magnification registered in the setting information in association with the mask name is displayed on the right side of the mask name. Rectangular objects 1101 to 1104 representing the lower limit range are displayed.

The pan angle range display/tilt angle range display is an object representing the range of the imaging direction in which the captured image including the mask area is captured when the partial area of the image in which the mask area is set is captured as the captured image, and the mask area. Is only an example of a screen that displays an object that represents.

The configuration of each object described in each of the above embodiments is an example, and the configuration is not limited to the above. For example, instead of or in addition to the object representing the mask name, an object representing other information related to the mask area such as the position of the mask area or the size of the mask area may be displayed. The information included in the information related to the mask area is not limited to the above information. Further, the processing for generating the setting information and the operation performed by the user therefor are not limited to the above example.

Further, for example, a computer apparatus having a hardware configuration example as shown in FIG. 7 can be applied to the image processing apparatus 103 shown in FIG. The CPU 701 executes the computer program stored in the RAM 702 or ROM 703 using the data stored in the RAM 702 or ROM 703. As a result, the CPU 701 controls the operation of the entire computer apparatus, and also executes or controls the above-described processing that is performed by the image processing apparatus 103. The CPU 701 can operate as the above-described control unit 123, performs the above-described magnification range display, pan angle range display, tilt angle range display, display control of a captured image, and performs data communication with the imaging device 101. It can be controlled.

The RAM 702 is for storing computer programs and data loaded from the ROM 703 and the external storage device 706, and data (for example, a captured image) received from the outside (for example, the imaging device 101) via the I/F (interface) 707. Having an area. The RAM 702 has a work area used when the CPU 701 executes various processes. In this way, the RAM 702 can provide various areas as appropriate.

The ROM 703 stores information that does not need to be rewritten, such as computer setting data and a boot program. The operation unit 704 is composed of a user interface such as a keyboard, a mouse, a touch panel, and the like, and can be operated by the user to input various instructions to the CPU 701. The operation unit 704 can be used as the setting unit 122 described above, and, for example, an operation performed by the user regarding magnification range display, pan angle range display, and tilt angle range display (imaging magnification, pan angle, tilt angle change). It is operated when performing (operation).

The display unit 705 is composed of a liquid crystal screen, a touch panel screen, or the like, and can display the processing result by the CPU 701 as an image or characters. The display unit 705 can function as the above-described display unit 121, and can display a captured image, a magnification range display, a pan angle range display, and a tilt angle range display in a corresponding display area.

The external storage device 706 is a large-capacity information storage device such as a hard disk drive device. The external storage device 706 stores an OS (operating system) and computer programs and data for causing the CPU 701 to execute or control the processes described above as being performed by the image processing device 103. The data stored in the external storage device 706 includes the setting information described above and the information described as known information.

The computer programs and data stored in the external storage device 706 are appropriately loaded into the RAM 702 under the control of the CPU 701 and are processed by the CPU 701.

The I/F 707 functions as a communication interface for performing data communication with the outside. For example, data communication performed with the image pickup apparatus 101 via the network 102 is performed via the I/F 707. Is done.

The CPU 701, the RAM 702, the ROM 703, the operation unit 704, the display unit 705, the external storage device 706, and the I/F 707 are all described in the bus 708. The configuration shown in FIG. 7 is merely an example of the hardware configuration of a computer device applicable to the image processing apparatus 103, and can be appropriately modified/changed.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. It can also be realized by the processing. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Reference numeral 104: imaging unit 105: image processing unit 106: communication unit 107: drive unit 108: drive control unit 109: control unit 120: communication unit 121: display unit 122: setting unit 123: control unit

Claims (10)

An acquisition unit that acquires the imaging magnification of the captured image in which the mask area is set,
Display control for displaying a first object that represents an imaging magnification range having the imaging magnification as a lower limit, and a second object that represents information related to a mask area set in a captured image with an imaging magnification equal to or lower than the imaging magnification An image processing apparatus comprising: The display control means,
Displaying a third object for changing the imaging magnification of the captured image acquired for setting the mask area,
The image processing apparatus according to claim 1, wherein the acquisition unit acquires the imaging magnification changed by operating the third object according to a user operation. The image processing apparatus according to claim 1, wherein the display control unit displays a fourth object that represents a lower limit of the imaging magnification range. The first object is a rectangular object representing the imaging magnification range,
The image processing apparatus according to any one of claims 1 to 3, wherein the second object is an object that represents the name of the mask area. Display for displaying an object representing a range of an imaging direction in which a captured image including the mask area is captured when a partial area of the image in which the mask area is set is captured as an imaged image, and an object representing the mask area An image processing apparatus comprising a control means. The display control means,
The image processing apparatus according to claim 5, wherein an object for changing an imaging direction is displayed. 7. The image processing apparatus according to claim 5, wherein the imaging directions are a pan angle direction and a tilt angle direction, respectively. An image processing method performed by an image processing apparatus, comprising:
An acquisition step in which the acquisition unit of the image processing apparatus acquires an image pickup magnification of a picked-up image in which a mask area is set;
A display control unit of the image processing apparatus displays a first object representing an imaging magnification range with the imaging magnification as a lower limit, and information about a mask area set in a captured image with an imaging magnification equal to or lower than the imaging magnification. 2. An image processing method, comprising: a second object; and a display control step of displaying the object. An image processing method performed by an image processing apparatus, comprising:
When the display control unit of the image processing apparatus captures a partial area of an image in which a mask area is set as a captured image, an object representing a range of an imaging direction in which a captured image including the mask area is captured, and the mask. An image processing method, comprising: displaying an object representing an area. A computer program for causing a computer to function as each unit of the image processing apparatus according to claim 1.

Images