JP6306822B2 - Image processing apparatus, image processing method, and image processing program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and an image processing program.

  With the spread of videophone and video chat tools, opportunities to share video between remote locations are increasing. Examples of a system for sharing video between remote locations include a camera monitoring system, a remote video sharing system such as a video conference / remote support, and a remote communication system using a telepresence robot. In these systems, it is necessary to consider that if an original image taken by a camera is browsed as it is, a video is recorded by a remote terminal or the like, and information that should be kept secret may be leaked. Examples of information that should be kept secret include the arrangement of equipment in the facility, the position of the rack, and personal information of persons working in the facility. In these systems, an area that should not be displayed to the viewer is recognized using image recognition, RFID (Radio Frequency Identification), or the like.

  In this connection, when an image captured by the camera is compared with the identification information stored in the memory in advance, and it is identified that there is an inconvenient object by the image recognition means, an inconvenient object in the captured image. An image processing apparatus that masks a part of an object is known (for example, see Patent Document 1).

JP 2003-153252 A

  In a conventional system for sharing video between remote locations including the device described in Patent Document 1, there is a case where an area that should not be displayed is displayed due to image recognition accuracy, RFID imperfect installation, or the like. .

  The present invention has been made in view of such circumstances, and an object of the present invention is to more reliably hide an area that should not be displayed in an original image.

One aspect of the present invention is a reception unit that receives input of an image captured by an imaging unit, a detection unit that detects a detection target included in the input image, and detects region information corresponding to the detection target. Based on the position on the image of the detection target detected by the detection unit and the region information, the position on the image is centered on the position where the offset is displaced with reference to the position on the image of the detection target. A setting unit that sets a predetermined area, and a display that enables browsing within the predetermined area set by the setting unit, and makes it impossible to browse the remaining area that excludes the predetermined area from the input image comprising a generation unit for generating an image, wherein the setting unit, according to the length of the detection target of the vertical and horizontal lengths and preset the detection target aspect during the image or before Symbol imaging unit, Above Modifying said offset depending on the angles obtained by photographing a subject out, an image processing apparatus.

According to another aspect of the present invention, an image processing apparatus receives an input of an image captured by an imaging unit, detects a detection target included in the input image, and detects the detection target on the detected detection target image. A predetermined area is set on the image around the position where the offset is displaced based on the position of the image, the inside of the set predetermined area can be browsed, and the predetermined area from the input image Generating a display image in which the remaining area excluding the inside cannot be browsed, and further, the offset is the vertical and horizontal lengths of the detection target in the image and the predetermined vertical and horizontal lengths of the detection target modifying in response to or in angles taken the detected prior SL imaging unit, according to an image processing method.

According to another aspect of the present invention, the image processing apparatus receives an input of an image captured by the imaging unit, detects a detection target included in the input image, and detects the detected target image. A predetermined area is set on the image around the position where the offset is displaced based on the upper position, the inside of the predetermined area can be browsed, and the predetermined image can be viewed from the input image. A display image in which the remaining area excluding the area cannot be browsed is generated, and further, the offset is the vertical and horizontal length of the detection target in the image and a predetermined vertical and horizontal length of the detection target. in response to the, or pre SL make modified according to angles taken the detection target in the photographed portion, an image processing program.

  According to one embodiment of the present invention, an area that should not be displayed in an original image can be more reliably hidden.

1 is a system configuration example of a remote monitoring system according to a first embodiment. It is a figure which shows a mode that the tag 10A was affixed or drawn in the facility 10. FIG. It is a figure which shows typically a mode that the remote monitoring system of 1st Embodiment is utilized. It is an example of the flowchart which shows the flow of the whole process performed in the remote monitoring system of this embodiment. 4 is an example of data stored as tag information 61. It is a figure which shows the positional relationship of tag 10A and window frame WD. 4 is an example of data stored in a tag database 60 as display permission information 62. It is an example of the flowchart which shows the flow of the process performed by the image processing apparatus 5 of 1st Embodiment. It is the figure which shows the base mask BM and the data structure of the base mask BM. It is a figure which shows the schematic diagram of the window mask WM, and the data structure of the window mask WM. It is a figure for demonstrating the setting method of the window mask WM. It is the figure which shows the schematic diagram of mask data MD, and the data structure of mask data MD. In the display part 32 of the remote terminal 3, it is a figure which shows a mode that an original image is displayed only within the window frame WD set on the basis of the tag 10A, and a black color image is displayed outside the window frame WD. On the display unit 32 of the remote terminal 3, the original image is displayed only within the window frames WD (1) to WD (3) set based on the plurality of tags 10A (1) to 10A (3). It is a figure which shows a mode that the image of a black color is displayed about the remaining area | regions except the area | region in window frame WDWD (1) -WD (3). It is a system configuration example of the remote monitoring system according to the second embodiment. It is a figure which shows a mode that the range of the window frame WD is determined with two tags, a start point tag and an end point tag.

  Hereinafter, embodiments of an image processing apparatus, an image processing method, and an image processing program of the present invention will be described with reference to the drawings. In the following description, it is assumed that the image processing apparatus of the present invention is used as a part of a remote monitoring system, but the image processing apparatus of the present invention is not limited to this and is used for various purposes. Can be used.

<First Embodiment>
Hereinafter, the remote monitoring system according to the first embodiment will be described. FIG. 1 is a system configuration example of a remote monitoring system according to the first embodiment. The remote monitoring system according to the first embodiment includes a camera 1, a local terminal 2, a remote terminal 3, and an image processing device 5. The local terminal 2, the remote terminal 3, and the image processing device 5 are connected to each other via a network 9. The network 9 includes, for example, a wireless communication network such as a Wi-Fi network and a wired communication network such as an optical communication network.

[Configuration of facility 10]
The camera 1 is a camera that uses an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The camera 1 is mounted on, for example, a robot or a vehicle that can move in the facility 10. The facility 10 is an arbitrary facility including a part or person that needs to be kept secret from a third party, such as a data center, a factory, a plant, or a conference room. A robot, a vehicle, etc. are steered by the worker in the facility 10, for example. In addition, the camera 1 may be fixed at an arbitrary place in the facility 10 or may be a camera for photographing the outdoors.

  The local terminal 2 is connected to the camera 1 via a communication line or wirelessly. For example, the local terminal 2 is installed in the facility 10 and is operated by an operator in the facility 10. The local terminal 2 includes an image acquisition unit 21, an image transmission unit 22, and an audio transmission / reception unit 23. Hereinafter, “installed” includes that a portable terminal such as a notebook computer is placed.

  The image acquisition unit 21 acquires an image taken by the camera 1 from the camera 1. The image may be acquired by an analog method such as NTSC (National Television System Committee), or may be acquired as A / D converted digital data.

  The image transmission unit 22 transmits the captured image of the camera 1 acquired by the image acquisition unit 21 to the image processing device 3 via the network 9. As a method for transmitting an image via the network 9, a method such as streaming or progressive download may be used, or a method for transmitting a moving image file using a protocol such as FTP (File Transfer Protocol) may be used. Good. Note that the image processing device 5 may be installed in the facility 10, and in this case, the local terminal 2 and the image processing device 5 may be integrated and realized by the same hardware. In such a case, image transmission is an unnecessary process.

  The voice transmitting / receiving unit 23 transmits the voice input to the microphone (not shown) to the remote terminal 3 via the network 9 and outputs the voice received from the remote terminal 3 via the network 9 to a speaker (not shown). Let As a result, the image transmission unit 22 and the voice transmission / reception unit 33 of the remote terminal 3 can make a conversation between the operator who operates the local terminal 2 and the viewer who operates the remote terminal 3.

[Configuration of remote terminal 3]
The remote terminal 3 includes a display image receiving unit 31, a display unit 32, a voice transmission / reception unit 33, and a login information input receiving unit 34.

  The display image receiving unit 31 receives an image (display image) transmitted from the local terminal 2 to the image processing device 5 and subjected to mask processing by the image processing device 5 from the image processing device 5.

  The display unit 32 is a display device such as an LCD (Liquid Crystal Display), a cathode ray tube display, a plasma display, or an organic EL (Electroluminescence) display. The display unit 32 displays the display image received by the display image receiving unit 31. The display image is viewed by, for example, a viewer who monitors the above-mentioned failure location in the facility 10 from a remote location. The viewer is, for example, a maintenance specialist for equipment installed in the facility 10, but is a person who does not have the authority to view all equipment in the facility 10. The image processing apparatus 5 shows only a specific part (area in a window frame WD described later) in the facility 10 to this viewer, and masks other parts than the specific part in order not to show other parts. Processing is performed to generate a display image.

  As described above, the voice transmission / reception unit 33 causes a conversation between the operator who operates the local terminal 2 and the viewer who operates the remote terminal 3.

  The login information input receiving unit 34 receives an input by the viewer such as a user ID that is identification information of the viewer. The user ID of the viewer who has received the input by the login information input receiving unit 34 is transmitted to the image processing apparatus 5. The login information input receiving unit 34 includes, for example, a keyboard, a mouse, and drivers for these.

[Configuration of image processing apparatus]
The image processing apparatus 5 includes, for example, a tag information setting reception unit 51, a login reception unit 52, an image reception unit 53, a tag detection unit 54, a display availability determination unit 55, a mask data generation unit 56, and a display image. A generation unit 57 and a display image transmission unit 58 are provided.

  The image processing apparatus 5 also has a tag database 60 including tag information 61 and display permission information 62 on a storage device such as a hard disk drive (HDD), a solid state drive (SSD), and a random access memory (RAM). Storing. The tag information 61 and the display permission information 62 are information associated with each tag ID.

  Here, a tag (mark) that can be recognized by analyzing a captured image of the camera 1 is pasted or drawn at an arbitrary place in the facility 10. The tag is provided with a color or pattern that allows easy image recognition, such as a black and white pattern with a clear contrast in the image. FIG. 2 is a diagram illustrating a state where the tag 10 </ b> A is pasted or drawn in the facility 10.

  For each tag, an identifier (tag ID) is set for convenience. The tag information setting reception unit 51 receives an operation by an operator of the image processing apparatus 5 and sets a correspondence between a tag ID and a tag shape. The tag information setting reception unit 51 includes, for example, a keyboard, a mouse, and their drivers.

  The login reception unit 52 receives the user information of the viewer received by the login information input reception unit 34 from the remote terminal 3 and outputs it to the display permission determination unit 55 as a user ID.

  The image reception unit 53 receives an image (original image) taken by the camera 1 from the image transmission unit 22 of the local terminal 2. For example, the tag detection unit 54 detects a tag included in the image for each frame of the image captured by the camera 1, and outputs the tag ID of the detected tag to the display availability determination unit 55.

  The display availability determination unit 55 determines whether or not to allow the viewer who has input the user ID to the remote terminal 3 to display the original image within the window frame WD associated with the tag ID.

  The mask data generation unit 56 displays only the inside of the window frame WD permitted to be displayed by the display availability determination unit 55 among the original images received from the local terminal 1, and mask data MD for not displaying other portions. Is generated.

  The display image generation unit 57 combines the original image received by the image reception unit 53 and the mask data MD generated by the mask data generation unit 56 to generate a display image to be transmitted to the remote terminal 3.

  The display image transmission unit 58 transmits the display image generated by the display image generation unit 57 to the remote terminal 3 via the network 9. As an image transmission method, a method such as streaming or progressive download may be used as in the case of the transmission method from the local terminal 2 to the image processing device 5, or a method of transmitting as a moving image file using a protocol such as FTP. May be used.

  FIG. 3 is a diagram schematically illustrating how the remote monitoring system according to the first embodiment is used. As shown in FIG. 3, the worker U1 who operates the local terminal 2 and the viewer U2 who operates the remote terminal 3 adjust the shooting position of the camera 1 or give a login instruction while talking with each other. Can be. In addition, the display image sent from the image processing device 5 is displayed on the display unit 32 of the remote terminal 3.

[Flowchart etc.]
Hereinafter, the processing of each functional unit described above will be described in more detail using a flowchart or the like.

  FIG. 4 is an example of a flowchart showing the overall processing flow executed in the remote monitoring system of this embodiment.

  First, as advance preparation, the tag information setting reception unit 51 receives settings of the tag information 61 and the display permission information 62 (step S100). Further, the preliminary preparation may include pasting or drawing a tag at a desired location in the facility 10.

  FIG. 5 is an example of data stored as tag information 61. The operator of the image processing apparatus 5 uses the tag information 61 to associate the tag ID with information such as the tag size, shape (pattern), window frame shape, window frame size, center position offset, and display period. Is stored in the tag database 60.

  The size of the tag included in the tag information 61 may be the size on the image when the camera 1 photographs the tag on a trial basis, or may be the actual size of the tag. The tag shape (pattern) included in the tag information 61 may be, for example, image data when the camera 1 takes a test image, or when the tag is generated as a computer graphic, the graphic data It may be.

  The window frame in the tag information 61 means an area that is associated with the tag position and that allows display. FIG. 6 is a diagram showing a positional relationship between the tag 10A and the window frame WD. As shown in FIG. 6, the window frame WD is set to an area corresponding to the window frame shape and the window frame size with the position displaced by the “center position offset” from the (for example, the center) position of the tag. The Moreover, the display period in tag information shows the period which displays the window frame matched with the tag.

  The display permission information 62 is information in which a tag corresponding to a tag that permits display of an area in the corresponding window frame WD is associated with a user corresponding to the user ID. FIG. 7 is an example of data stored in the tag database 60 as the display permission information 62. For each user ID, the operator of the image processing apparatus 5 stores a tag ID that permits display of the area in the corresponding window frame WD as display permission information 62 in the tag database 60. For example, for the user whose user ID is “User001”, display of the area in the window frame WD corresponding to the tag whose tag ID is “Tag001” is permitted.

  When the advance preparation is completed, an image captured by the camera 1 is acquired, and a process of providing a limited display image to the viewer is performed (step S200). Details of the processing in step S200 will be described with reference to FIG.

  Then, as post processing, logout of the viewer, deletion of setting information related to the user ID, removal of a tag, and the like are performed (step S300).

  FIG. 8 is an example of a flowchart showing a flow of processing executed by the image processing apparatus 5 of the present embodiment. The flowchart in FIG. 8 explains in detail the processing in step S200 in FIG.

  First, the image receiving unit 53 starts receiving a captured image (original image) of the camera 1 (step S202). The image receiving unit 53 obtains a base mask, a window mask, and vertical and horizontal sizes {mask_size_py} [pixels] and {mask_size_px} [pixels] described below from the size of the original image.

  Next, the login reception unit 52 receives a browser login using the remote terminal 3 (step S204). Note that the order of the processes of step S202 and step S204 may be reversed. As described above, the processes of the flowcharts described in the present embodiment may be arbitrarily changed in order when there is no particular significance in the order of the processes.

  After logging in, the viewer performs, for example, an operation on the remote terminal 3 to select an original image to be browsed. In addition, a screen that the viewer wants to browse may be directly read into the remote terminal 3 by inputting a URL specified in advance.

  Next, the tag detection unit 54 detects a tag in the original image, for example, for each frame of the original image (step S206). The tag detection unit 54 compares the shape (pattern) of the tag included in the image with the shape (pattern) stored as the tag information 61 by using a known pattern matching method, for example. Detection is performed. The tag detection unit 54 outputs the tag ID and position (for example, the coordinates of the center of the tag in the image) of the detected tag.

  Next, the mask data generation unit 56 generates a base mask BM corresponding to the size of the original image (step S208). The base mask BM is, for example, data having a structure in which attribute values corresponding to the luminance values of the three primary colors are assigned to each of the number of pixels corresponding to the size of the original image.

  FIG. 9 is a schematic diagram of the base mask BM and a diagram illustrating a data structure of the base mask BM. FIG. 9A is a schematic diagram of the base mask BM, and FIG. 9B is a diagram illustrating a data structure of the base mask BM. As shown in FIG. 9, if the image handled by the image processing device 5 is a color image and the maximum value of the luminance values [R, G, B] of the three primary colors is +255, respectively, the base mask BM has three primary colors. The attribute value [−255] is assigned to all the pixels p1 to pn for each of the luminance values [R, G, B]. The base mask BM has an attribute value [−255] for all pixels if the image handled by the image processing device 5 is a monochrome image and the maximum luminance value of each pixel is +255. Data.

  Next, the display permission determination unit 55 determines whether or not to allow the logged-in viewer to display the original image in the window frame WD associated with the tag ID detected in step S206 (step S210). ). Specifically, the display permission determination unit 55 includes a combination of the tag ID of the tag output from the tag detection unit 54 and the user ID output from the login reception unit 52 in the display permission information 62, and the current date and time. Is within the displayable period of the tag ID in the tag information 61. When the above condition is satisfied, the display availability determination unit 55 permits the viewer who has input the user ID to display the original image in the window frame WD associated with the tag ID.

  Next, the mask data generation unit 56 generates a window mask WM for the window frame permitted to be displayed by the display availability determination unit 55 (step S212). As described with reference to FIG. 6, the window mask WM is an area corresponding to the window frame shape and the window frame size centered on the position displaced by the “center position offset” from the tag position related to the permitted tag ID. Set to If there are a plurality of tags detected in step S206, a plurality of window masks WM may be generated.

  FIG. 10 is a schematic diagram of the window mask WM and a data structure of the window mask WM. FIG. 10A is a schematic diagram of the window mask WM, and FIG. 10B is a diagram illustrating a data structure of the window mask WM. As shown in FIG. 10, the window mask WM has an attribute value [NA (no data)] for each of the luminance values [R, G, B] of the three primary colors if the image handled by the image processing device 5 is a color image. It is given to pixels outside the window frame (for example, p1, pn), and the attribute value [0] for each of the luminance values [R, G, B] of the three primary colors is assigned to the pixels (for example, pk) in the window frame WD. This is the data assigned. If the image handled by the image processing device 5 is a black and white image, the window mask WM is given, for example, the attribute value [NA] to pixels outside the window frame, and the attribute value [0] is within the window frame WD, for example. This is data given to a pixel.

  FIG. 11 is a diagram for explaining a method of setting the window mask WM. Here, the position of the tag detected by the tag detection unit 54 is (tag_posi_px, tag_posi_py), and the vertical and horizontal sizes of the window frame obtained from the tag information 61 using the tag ID detected by the tag detection unit 54 are {window_size_py, respectively. }, {Window_size_px}, and the center position offset is {offset_py}, {offset_px}, respectively. The window frame shape is assumed to be a square.

  Here, it is preferable that the set values {window_size_py}, {window_size_px}, {offset_py}, and {offset_px} are corrected according to the angle at which the object is photographed and the distance to the object. The mask data generation unit 56 preferably corrects the set value by performing processing such as affine transformation and keystone correction based on the length and width of the tag in the original image and the size of the tag included in the tag information 61. That is, the mask data generation unit 56 may set the window mask WM to be smaller as the tag size in the original image is smaller than the reference, and may be set to be larger as the tag size is larger. Further, the mask data generation unit 56 sets the setting values {window_size_py} and {window_size_px} according to different degrees if the length ratio of the tag in the original image is different from the size of the tag included in the tag information 61. You may modify the ratio.

  In FIG. 11, the x coordinate of the left edge line of the window frame WD is represented by {tag_posi_px + offset_px-1 / 2 (window_size_px)}, and the x coordinate of the right edge line of the window frame WD is {tag_posi_px + offset_px + 1/2 (window_size_px)}. The y coordinate of the upper end line of the window frame WD is represented by {tag_posi_py + offset_py-1 / 2 (window_size_py)}, and the y coordinate of the right end line of the window frame WD is {tag_posi_py + offset_py + 1/2 (window_size_py) )}.

  Therefore, the mask data generation unit 56 has an x coordinate of {tag_posi_px + offset_px-1 / 2 (window_size_px)} or more and {tag_posi_px + offset_px + 1/2 (window_size_px)} or less and a y coordinate of {tag_posi_py + If it is more than offset_py-1 / 2 (window_size_py)} and {tag_posi_py + offset_py + 1/2 (window_size_py)}, it is determined that the pixel is in the window frame WD. For example, the mask data generation unit 56 determines whether or not the above condition is satisfied for all the pixels, and determines whether the pixel is within the window frame WD or outside the window frame. Thereby, the window mask WM is set.

  Returning to FIG. 8, the flowchart will be described. The mask data generation unit 56 combines the base mask BM and the window mask WM to generate mask data MD (step S214).

  FIG. 12 is a schematic diagram of the mask data MD and a data structure of the mask data MD. FIG. 11A is a schematic diagram of the mask data MD, and FIG. 11B is a diagram illustrating a data structure of the mask data MD. As illustrated in FIG. 11, for example, the mask data generation unit 56 sets, for each pixel of the base mask BM, attribute values [0, 0, 0] to corresponding pixels (pixels having the same coordinates) in the window mask MD. If it is assigned, the attribute value is replaced with [0, 0, 0]. If the attribute value of the corresponding pixel is [NA, NA, NA], the attribute value remains as [-255, -255, -255]. By maintaining, mask data MD is generated. As a result, the luminance value parameters [0, 0, 0] of the three primary colors are given to the pixels in the window frame WD, and [−255, −255, −255] are given to the pixels outside the window frame. Mask data MD is generated.

  Note that such a technique is merely an example, and the mask data generation unit 56 uses the luminance values [R, G, B] = [255, 255, 255] of the three primary colors for the pixels in the window frame WD in the window mask WM. ] May be given. In this case, the mask data generating unit 56 adds the attribute value of each pixel of the base mask BM and the attribute value of the corresponding pixel of the window mask WM to generate mask data MD.

  Returning to FIG. 8, the flowchart will be described. The display image generation unit 57 combines the original image and the mask data MD to generate a display image (step S216). For each pixel of the original image, the display image generation unit 57 adds the attribute value of the corresponding pixel of the mask data to the luminance value of the three primary colors, and corrects the negative value to 0, thereby correcting each pixel of the display image. The luminance values of the three primary colors are calculated. When the luminance values of the three primary colors of each pixel of the original image are [Rgk (k = 1 to n), Ggk, Bgk] and the attribute value of each pixel of the mask data is [Rmk, Gmk, Bmk], each pixel of the display image The luminance values [Rk, Gk, Bk] are calculated by the following equation (1).

  [Rk, Gk, Bk] = [max (Rgk + Rmk, 0), max (Ggk + Gmk, 0), max (Bgk + Bmk, 0)] (1)

  Then, the display image transmission unit 58 transmits the generated display image to the remote terminal 3 (step S218).

  As a result of such processing, the display unit 32 of the remote terminal 3 displays the original image only within the window frame WD set with reference to the tag, and displays a black one-color image (all the three primary color luminance values are outside the window frame WD). Is displayed). FIG. 13 shows the display unit 32 of the remote terminal 3 in which the original image is displayed only in the window frame WD set with the tag 10A as a reference, and the remaining area excluding the area in the window frame WD from the original image is black. It is a figure which shows a mode that the image of is displayed.

  If a plurality of tags are included in the image, a plurality of window frames WD may be set. In this case, the original image is displayed in the plurality of window frames WD, and a black color image is displayed for the remaining area excluding the areas in the plurality of window frames WD from the original image. FIG. 14 shows that the display unit 32 of the remote terminal 3 displays the original image only in the window frames WD (1) to WD (3) set based on the plurality of tags 10A (1) to 10A (3). It is a figure which shows a mode that the image of a black color is displayed about the remaining area | region which excluded the area | region in several window frames WDWD (1) -WD (3) from the original image.

[Summary]
According to the image processing apparatus 5 of the first embodiment, the original image can be viewed in the area within the window frame WD set with reference to the position (coordinates) of the tag among the original images received from the local terminal 2. In order to generate a display image in which the remaining area obtained by excluding the area in the window frame WD from the original image is an area in which the original image is not viewable, the area that should not be displayed in the original image is more reliably Can be concealed.

  The image processing apparatus 5 according to the present embodiment does not specify an area that should not be displayed to the viewer in the original image, but pre-embeds information (tag) that specifies an area permitted to be displayed in the image. A viewable area is determined from the information. As a result, the display image displayed on the remote terminal 3 is in a state where the original image cannot be seen at all when the tag is not recognized. And only when the tag is detected, the display image is based on information associated with the tag (the shape and size of the window frame WD, the display period, etc.), and only the area within the explicitly specified window frame WD. Becomes a viewable image. As a result, the image processing apparatus 5 can reduce the possibility of erroneously displaying an area that should not be displayed, and can improve security.

  In addition, the image processing apparatus 5 according to the present embodiment associates information such as the shape, size, and display period of the window frame WD with the tag and the user ID, so that the display area can be set easily and with high reliability. Changes can be realized. For example, when the image processing apparatus 5 tries to browse different areas for different viewers, the image processing apparatus 5 can change the area to be browsed only by changing information associated with the user ID. In addition, the image processing apparatus 5 can easily realize that the display period other than the designated period is not displayed by setting the display period associated with the tag.

Second Embodiment
Hereinafter, the remote monitoring system according to the second embodiment will be described. In the first embodiment, the reference position for setting the window frame WD is the position of the tag attached to or drawn on the equipment in the facility 10. On the other hand, in the second embodiment, the operator of the image processing apparatus 5 (which may be the operator of the local terminal 2) who views the image captured by the camera 1 performs marking at a specific position in the image, The window frame WD is set with this specific position as a reference.

  FIG. 15 is a system configuration example of a remote monitoring system according to the second embodiment. About the local terminal 2 and the remote terminal 3 in 2nd Embodiment, since it is the same as that of 1st Embodiment, description is abbreviate | omitted.

  Compared with the image processing apparatus 5 according to the first embodiment, the image processing apparatus 5 according to the second embodiment newly includes a virtual tag setting unit 70 and includes a virtual tag detection unit 71 instead of the tag detection unit 54. .

  The virtual tag setting unit 70 detects, for example, a position (marked position) where the operator of the image processing device 5 clicks or touches with the mouse in the original image. The virtual tag setting unit 70 associates an image in the reference area centered on the marked position with any of tag IDs having various predetermined parameters, and forms a tag database as a tag shape (pattern). 60. The reference area is an area such as a rectangle or a circle having an arbitrary size with the marked position as the center. Hereinafter, a tag whose shape (pattern) is registered in the tag database 60 is referred to as a virtual tag.

  The virtual tag detection unit 71 performs a feature point tracking process and the like, and extracts the virtual tag set by the virtual tag setting unit 70 from the original image. For example, the virtual tag detection unit 71 calculates a histogram feature amount in the virtual tag, calculates a histogram feature amount for a plurality of regions for each frame of the original image, and sets a region having the closest histogram feature amount as a virtual tag. To detect.

  Hereinafter, the image processing apparatus 5 according to the second embodiment performs the same processing as the image processing apparatus 5 according to the first embodiment, replacing “tag” with “virtual tag”. As a result, the virtual tag centered on the marked position is tracked, and the window frame WD is set based on the marked position. Therefore, similarly to the image processing apparatus 5 according to the first example, the image processing apparatus 5 according to the second embodiment can more reliably hide the area that should not be displayed in the original image.

<Hardware configuration>
The local terminal 2, the remote terminal 3, and the image processing device 5 in each embodiment described above have a computer system therein. The “computer system” includes a memory device such as a CPU (Central Processing Unit) and a RAM (Random Access Memory), a storage device such as a ROM (Read Only Memory), an HDD (Hard Disk Drive), and an SSD (Solid State Drive). It includes hardware such as a drive device and a peripheral device in which a medium can be mounted.

  The image acquisition unit 21, the image transmission unit 22, the voice transmission / reception unit 23, the display image reception unit 31, the display unit 32, the voice transmission / reception unit 33, the login information input reception unit 34, and the remote terminal 3 described above, Tag information setting reception unit 51, login reception unit 52, image reception unit 53, tag detection unit 54, display availability determination unit 55, mask data generation unit 56, display image generation unit 57, display image transmission unit 58 of image processing apparatus 5 The operation process is stored in, for example, a computer-readable recording medium in the form of a program, and the above-described processing is performed by the computer system reading and executing the program. In addition, it is not necessary to perform all the processing of each functional unit by executing a program. Some functional units are implemented by hardware such as an IC (Integrated Circuit), an LSI (Large Scale Integration), or a network card. It may be realized.

  The “computer-readable recording medium” refers to a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as an HDD built in the computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are included.

  The program may be for realizing a part of the functions described above, and further, the program described above may be realized in combination with a program already recorded in a computer system. good.

  Note that the mask data generation unit 56 and the display image generation unit 57 in each of the above embodiments are examples of “generation unit”, and the region in the window frame WD is an example of “predetermined region”.

<Other embodiments>
As mentioned above, although the form for implementing this invention was demonstrated using embodiment, this invention is not limited to such embodiment at all, In the range which does not deviate from the summary of this invention, various deformation | transformation and substitution Other components can be added.

  For example, the first embodiment and the second embodiment are not in an exclusive relationship, and the image processing apparatus 5 is marked in the original image with the function of setting the window frame WD based on the tag detected from the original image. It is also possible to have both functions of setting the window frame WD with reference to the determined position.

  The setting method of the window frame WD is not limited to the method of the above embodiment. For example, when the shape of the window frame WD is a circle, the range of the window frame WD can be determined by two tags, a start point tag and an end point tag. FIG. 16 is a diagram illustrating a state in which the range of the window frame WD is determined by two tags, that is, a start point tag and an end point tag. As shown in FIG. 16, the start point tag is pasted or drawn at the center point of the window frame WD which is, for example, a circle. Further, the end point tag is pasted or drawn at an arbitrary point on the circumference of the window frame WD which is, for example, a circle. This eliminates the need to store information such as the window frame size and the center position offset in the tag database 60 in advance.

  In the above embodiment, the area outside the window frame WD is displayed in black, but instead, the area outside the window frame WD is displayed in mosaic display or one color other than black. As long as the original image cannot be browsed, it may be displayed in any display mode.

  The image processing apparatus 5 according to the present invention is not limited to monitoring a specific facility from a remote location, and can be used in various scenes where it is necessary to conceal a specific part of an image.

DESCRIPTION OF SYMBOLS 1 Camera 2 Local terminal 21 Image acquisition part 22 Image transmission part 23 Audio | voice transmission / reception part 3 Remote terminal 31 Display image reception part 32 Display part 33 Voice transmission / reception part 34 Login information input reception part 5 Image processing apparatus 51 Tag information setting reception part 52 Login Reception unit 53 Image reception unit 54 Tag detection unit 55 Display availability determination unit 56 Mask data generation unit 57 Display image generation unit 58 Display image transmission unit 60 Tag database 61 Tag information 62 Display permission information 70 Virtual tag setting unit 71 Virtual tag 9 Network BM Base mask WM Window mask MD Mask data WD Window frame

Claims (6)

A reception unit that receives input of an image captured by the imaging unit;
A detection unit for detecting a detection target included in the input image and detecting region information corresponding to the detection target;
Based on the position on the detection target image detected by the detection unit and the region information, a predetermined position on the image is centered on the position where the offset is displaced with reference to the position on the detection target image. A setting section for setting the area of
A generation unit that generates a display image in which the inside of the predetermined area set by the setting unit can be browsed and the remaining area excluding the inside of the predetermined area cannot be browsed from the input image;
With
The setting unit, depending on the detection of the target aspect length as the preset the detection target aspect in accordance with the length or pre Symbol angles taken the detection target in the imaging unit, during the image Correct the offset,
Image processing device. The image processing apparatus according to claim 1,
The detection target is an object installed in the vicinity of an object that can be viewed in the display image in the space photographed by the photographing unit,
The setting unit sets the predetermined area based on a position on the image of the detection target and information on a positional relationship between the position of the detection target set in advance and the predetermined area;
Image processing device. The image processing apparatus according to claim 1, wherein:
The generation unit includes browsing disabled data including information that disables browsing of all areas of the input image, and data corresponding to the predetermined area, and includes one of the browsing disabled data. By combining the invalidation data for invalidating the information of the part, and synthesizing the synthesized data and the input image, the remaining area excluding the predetermined area from the input image is obtained. Generate a display image that cannot be viewed,
Image processing device. The image processing apparatus according to any one of claims 1 to 3,
A coordinate designation accepting unit for accepting designation of coordinates in the input image;
A second setting unit that sets the predetermined area with reference to the coordinates received by the coordinate designation receiving unit;
An image processing apparatus further comprising: The image processing device
Accept input of images taken by the shooting unit,
Detecting a detection target included in the input image,
Set a predetermined region on the image around the position where the offset is displaced based on the detected position on the detection target image,
Generate a display image in which the set predetermined area can be browsed, and the remaining area excluding the predetermined area from the input image cannot be browsed,
Further, the offset, the detection of the target horizontal and vertical preset the detection target aspect and lengths depending on the length or angles taken the detected prior SL imaging unit during the image Modify accordingly,
Image processing method. In the image processing device,
Accept input of images taken by the shooting unit,
Detecting a detection target included in the input image;
Centered on the position where the offset is displaced based on the detected position on the detection target image, a predetermined area is set on the image,
Allowing the set predetermined area to be browsed and generating a display image in which the remaining area excluding the predetermined area from the input image cannot be browsed;
Further, the offset, the detection of the target horizontal and vertical preset the detection target aspect and lengths depending on the length or angles taken the detected prior SL imaging unit during the image Let me fix it,
Image processing program.