JP6852500B2 - Information output device, program and information output method - Google Patents

Description

The present invention relates to an information output device, a program, and an information output method for outputting information for adjusting the imaging range of the image pickup device.

When installing the surveillance camera, it is necessary to adjust the imaging range of the surveillance camera so that the captured image including the object to be monitored is output (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2016-123004

Conventionally, in order to adjust the imaging range of the surveillance camera, two people, a person who instructs the direction to move the surveillance camera while visually recognizing the image captured by the surveillance camera and a person who moves the position of the surveillance camera, perform the work. I had to. Under these circumstances, in order to reduce the cost required for the installation work, a technique for reducing the number of workers required for the installation work of the surveillance camera is required.

Therefore, the present invention has been made in view of these points, and is an information output device, an information output method, and an information output device for outputting information for reducing the number of workers required for the installation work of the image pickup device used for monitoring. The purpose is to provide a program.

The information output device according to the first aspect of the present invention includes a target image acquisition unit that acquires a target image that is an image of a target range in a range captured by the imaging device, and an captured image that acquires an captured image captured by the imaging device. The acquisition unit, a specific unit that specifies the position of an image region similar to the image of at least a part of the target image in the captured image, the position specified by the specific unit, and the center position of the captured image. It has an information output unit that outputs information based on the relationship between.

The target image acquisition unit further acquires area designation information for specifying the position or region of the captured image to be imaged by the imaging device, and the specific unit obtains a position corresponding to the region designation information in the captured image. , The position of an image region similar to the image of at least a part of the target image may be specified.

The target image acquisition unit further acquires height information indicating the height at which the target image was captured.
The specific unit may specify the position of the image in at least a part of the corrected target image obtained by correcting the target image based on the height information.

The specific unit extracts one or more feature points included in the target image, and has the same features as the feature points in the captured image as the position of the image in at least a part of the target image. The position of one or more pixels may be specified.

The information output unit may output sound information based on the relationship between the position specified by the specific unit and the center position of the captured image.

The information output unit may output control information for controlling the position of the image pickup device based on the relationship between the position specified by the specific unit and the center position of the captured image.

In the program of the second aspect of the present invention, the computer is subjected to a target image acquisition unit that acquires a target image that is an image of a target range in a range captured by the imaging device, and an captured image that acquires an captured image captured by the imaging device. The acquisition unit, the specific unit that specifies the position of an image region similar to the image of at least a part of the target image in the captured image, and the position specified by the specific unit and the center position of the captured image. Output information based on relationships.

The information output method of the third aspect of the present invention is a step of acquiring a target image which is an image of a target range of a range imaged by an imaging device, which is executed by a computer, and an image captured by the imaging device. Information based on the step, the step of specifying the position of an image region similar to the image of at least a part of the target image in the captured image, and the relationship between the specified position and the center position of the captured image. It has a step to output and.

According to the present invention, it is possible to reduce the number of workers required for the installation work of the image pickup apparatus used for monitoring.

It is a figure which shows the structure of the work support system of 1st Embodiment. It is a figure for demonstrating the outline of the processing flow in a work support system. It is a figure which shows the configuration of a server. It is a figure for demonstrating the correction of the target image based on the height information. It is a figure for demonstrating the method of specifying the position of the image area similar to a target image. It is a figure for demonstrating the method of generating the information output by an information output part. It is a figure which shows an example of the processing sequence in the work support system when the user adjusts the image pickup range of an image pickup apparatus. It is a figure which shows the structure of the image pickup apparatus. It is a figure for demonstrating operation of an image pickup apparatus. It is a figure which shows an example of the processing sequence at the time of adjusting the image pickup range of the image pickup apparatus in the work support system of 2nd Embodiment. It is a figure which shows an example of the processing sequence at the time of adjusting the image pickup range of the image pickup apparatus in the work support system of 2nd Embodiment. It is a figure which shows an example of the processing sequence at the time of adjusting the image pickup range of the image pickup apparatus in the work support system of 3rd Embodiment.

<First Embodiment>
[Outline of configuration of work support system S]
FIG. 1 is a diagram showing a configuration of a work support system S according to the first embodiment. The work support system S includes an image pickup device 1, a mobile terminal 2, and a server 3. The image pickup device 1, the mobile terminal 2, and the server 3 can send and receive information to and from each other via the network N. Network N includes, for example, the Internet and mobile phone networks.

The imaging device 1 is a camera used for surveillance, captures a subject within a predetermined imaging range, and generates an captured image including the captured subject. The image pickup device 1 sequentially generates captured images at a predetermined frame rate, and transmits the generated captured images to the mobile terminal 2 or the server 3 via the network N.

The mobile terminal 2 is, for example, a smartphone or a tablet terminal, and is an operation terminal operated by an installation worker (hereinafter referred to as a user) of the image pickup device 1. A touch panel is provided on the screen of the mobile terminal 2, and the user can input an instruction to be transmitted to the server 3 by touching the screen. The mobile terminal 2 captures a subject based on an operation by the user and generates an captured image. The mobile terminal 2 transmits the generated captured image to the server 3 as a target image which is an image of a target range in the range captured by the imaging device 1.

The server 3 adjusts the installation position of the image pickup device 1 so that the image pickup range by the image pickup device 1 becomes an appropriate range based on the target image acquired from the mobile terminal 2 and the image pickup image acquired from the image pickup device 1. This is an information output device that outputs the information of the above to at least one of the image pickup device 1 and the mobile terminal 2. The server 3 may be a server installed in the business establishment where the image pickup apparatus 1 is installed, or may be a server on the cloud.

[Outline of processing flow in work support system S]
FIG. 2 is a diagram for explaining an outline of the processing flow in the work support system S.
First, the mobile terminal 2 generates a target image based on the user's operation ((1) in FIG. 2). The mobile terminal 2 transmits the generated target image to the server 3, and the server 3 acquires the target image ((2) in FIG. 2).

Subsequently, the imaging device 1 sequentially generates captured images and transmits them to the server 3, and the server 3 acquires the captured images ((3) in FIG. 2). The server 3 searches for an image region (hereinafter, referred to as a target image region) similar to the target image in the acquired captured image. When the server 3 specifies the position of the target image area in the captured image, the server 3 specifies the relationship between the center position of the captured image and the center position of the target image area. The server 3 generates information for adjusting the imaging range of the imaging device 1 based on the specified relationship. The server 3 of the present embodiment outputs sound information for the mobile terminal 2 to output a sound for adjusting the imaging range of the imaging device 1 ((4) in FIG. 2).

When the mobile terminal 2 receives the sound information from the server 3, the mobile terminal 2 outputs the sound based on the sound information from the speaker ((4) in FIG. 2). The details of the sound output by the mobile terminal 2 will be described later. For example, the mobile terminal 2 moves the distance between the center position of the target image area and the center position of the captured image and the direction in which the image pickup device 1 is moved up, down, left or right. Then, a sound indicating whether the center position of the captured image approaches the center position of the target image area is output. When the mobile terminal 2 outputs such a sound, the user can move the direction of the image pickup device 1 by himself / herself with both hands while the mobile terminal 2 is in the pocket to obtain the image pickup range of the image pickup device 1. Can be adjusted. In the above description, it is assumed that the mobile terminal 2 generates the target image, but the terminal that generates the target image is arbitrary, and a person other than the user (for example, a person in the business establishment where the image pickup device 1 is installed). ) May generate a target image.

[Configuration of server 3]
Hereinafter, the detailed configuration of the server 3 will be described.
FIG. 3 is a diagram showing the configuration of the server 3. The server 3 has a communication unit 31, a storage unit 32, and a control unit 33. The communication unit 31 is a communication interface for transmitting and receiving information via the network N, and includes, for example, a LAN (Local Area Network) controller. The communication unit 31 notifies the control unit 33 of the information received from the image pickup device 1 or the mobile terminal 2. Further, the communication unit 31 transmits the information input from the control unit 33 to the image pickup device 1 or the mobile terminal 2.

The storage unit 32 is a storage medium for storing information, and includes, for example, a hard disk, a ROM (Read Only Memory), and a RAM (Random Access Memory). The storage unit 32 stores a program executed by the control unit 33.

The control unit 33 is, for example, a CPU (Central Processing Unit), and by executing a program stored in the storage unit 32, the control unit 33 can be used as an image capture image acquisition unit 331, a target image acquisition unit 332, a specific unit 333, and an information output unit 334. Function.

The captured image acquisition unit 331 acquires the captured image transmitted by the imaging device 1. Specifically, the captured image acquisition unit 331 acquires an captured image to be used while the user adjusts the imaging range of the imaging device 1.

The target image acquisition unit 332 acquires a target image from, for example, a mobile terminal. The target image acquisition unit 332 stores the acquired target image in the storage unit 32. The target image acquisition unit 332 further acquires the area designation information for specifying the position or region of the captured image to be imaged by the imaging device 1, for example, which is input by the user, and among the acquired target images, the region designation information is The indicated area may be stored in the storage unit 32 as a target image. Further, the target image acquisition unit 332 may acquire height information indicating the height at which the target image is captured. The target image acquisition unit 332 acquires, for example, height information included as metadata of the target image.

The identification unit 333 specifies the position of an image region similar to the image of at least a part of the target image in the captured image. For example, the identification unit 333 specifies a region having the same size as the target image, which has the highest correlation with the target image in the captured image, as the target image region. When the target image acquisition unit 332 acquires the area designation information, the specific unit 333 specifies the position corresponding to the area designation information in the captured image as the position of the target image area. Then, the specific unit 333 calculates the difference between the center position of the target image region and the center position of the captured image, and notifies the information output unit 334 of the information indicating the calculated difference.

In the identification unit 333, the height at which the target image indicated by the height information is captured is the height at which the target image indicated by the height information is captured before specifying the position of the image region similar to the image of at least a part of the target image in the captured image. If is different from the height of the installation position, the target image is corrected based on the height information.

FIG. 4 is a diagram for explaining the correction of the target image based on the height information, which is executed by the specific unit 333. As shown in FIG. 4A, the imaging device 1 used as a surveillance camera is often installed at a position higher than the height of a person. In this case, the first height when the user takes a picture of the subject for generating the target image using the mobile terminal 2 is lower than the second height at the position where the image pickup device 1 is installed.

FIG. 4B is a target image generated by the mobile terminal 2 taking a picture of the subject, and FIG. 4C is an image taken by the image pickup device 1 taking the same subject. As shown in FIGS. 4 (b) and 4 (c), the vertical width of the subject in the captured image generated by the imaging device 1 is larger than the vertical width of the subject in the target image generated by the mobile terminal 2. It becomes smaller. Therefore, the specific unit 333 generates a correction target image by correcting the width of the target image in the vertical direction based on the relationship between the first height and the second height. Then, the identification unit 333 specifies, in the captured image, a region having the highest correlation with the correction target image and having the same size as the correction target image as the target image region.

FIG. 5 is a diagram for explaining a method of specifying the position of an image region similar to the target image. The image shown in FIG. 5 has the origin at the upper left position, and as shown in FIG. 5A, the left-right direction is the x-coordinate and the vertical direction is the y-coordinate.

The identification unit 333 specifies, for example, feature points included in the correction target image in order to specify the position of an image region similar to the target image. The feature point is a position having a feature different from that of an image in another region in the correction target image, such as a position on the contour of the subject included in the correction target image. In FIG. 5B, it is assumed that the specific portion 333 has the top portion of the tree on the right side as a feature point.

The identification unit 333 specifies the coordinates of the feature points in the correction target image (feature point coordinates F) and the coordinates of the center position of the correction target image (center coordinates C1). The feature point coordinate F1 is deviated from the center coordinate C1 by x1 in the left-right direction and y1 in the up-down direction. The specific unit 333 notifies the information output unit 334 of the first difference vector (x1, y1) indicating the difference between the feature point coordinate F1 and the center coordinate C1.

5 (c) and 5 (d) are captured images generated by the imaging device 1. FIG. 5C is a first captured image generated before the imaging range of the imaging device 1 is adjusted, and FIG. 5D is generated after the imaging range of the imaging device 1 is adjusted. This is the second captured image. In the first captured image, the specific unit 333 searches for an image region similar to the image around the feature point coordinates F1 of the correction target image. In the example of FIG. 5C, the identification unit 333 identifies that the feature point exists at the feature point coordinate F2 near the left end of the first captured image.

The feature point coordinates F2 deviate from the coordinates of the center position of the first captured image (center coordinates C2) by x2 in the left-right direction and y2 in the up-down direction. The specific unit 333 notifies the information output unit 334 of the second difference vector (x2, y2) indicating the difference between the feature point coordinate F2 and the center coordinate C2.

The information output unit 334 outputs information for adjusting the imaging range of the imaging device 1 so that the second difference vector notified from the specific unit 333 becomes equal to the first difference vector. Specifically, the information output unit 334 outputs information indicating the difference between the first difference vector and the second difference vector.

FIG. 6 is a diagram for explaining a method of generating information output by the information output unit 334. The horizontal axis is the difference value X between the left and right components x1 of the first difference vector and the left and right components x2 of the second difference vector, and the vertical axis is the upper and lower components y1 of the first difference vector and the upper and lower components y2 of the second difference vector. The difference value Y from. The information output unit 334 generates information based on the coordinates of the difference values (X, Y).

When the difference value (X, Y) is included in the area R, the information output unit 334 generates sound information including a content instructing the image pickup apparatus 1 to be adjusted to the left. For example, the information output unit 334 generates sound information including a voice indicating the direction to be moved and the amount to be moved, such as "Please move 10 degrees to the left".

When the difference value (X, Y) is included in the region U, the information output unit 334 generates sound information including a content instructing the image pickup apparatus 1 to be adjusted downward. When (X, Y) is included in the area L, the information output unit 334 generates sound information including a content instructing the image pickup apparatus 1 to be adjusted to the right. When the difference value (X, Y) is included in the area D, the information output unit 334 generates sound information including a content instructing the image pickup apparatus 1 to be adjusted upward.

The information output unit 334 may generate sound information including an electronic sound whose generation interval changes according to the distance between the center position of the target image region and the center position of the captured image, instead of the amount to be moved. For example, the information output unit 334 "left" when the difference value (X, Y) is included in the region R and the distance between the center position of the target image region and the center position of the captured image is the first distance. Sound information including electronic sounds generated at the first interval (for example, 1 second interval) is generated. Then, when the distance between the center position of the target image region and the center position of the captured image becomes the second distance shorter than the first distance, the information output unit 334 says "to the left, pip pip pip" and is shorter than the first interval. Sound information including electronic sounds generated at two intervals (for example, 0.5 second intervals) is generated. The information output unit 334 generates sound information indicating that the adjustment may be completed when the distance between the center position of the target image area and the center position of the captured image is within a predetermined threshold value.

The information output unit 334 may change the frequency of the electronic sound according to the distance between the center position of the target image region and the center position of the captured image, instead of changing the generation interval of the electronic sound. Further, the information output unit 334 may generate an electronic sound in a mode corresponding to the direction to be moved. In this way, the information output unit 334 generates sound information of the sound that changes according to the distance between the center position of the target image area and the center position of the captured image, so that the user hears the sound on the mobile terminal 2. However, the imaging range of the imaging device 1 can be adjusted.

[Processing sequence in work support system S]
FIG. 7 is a diagram showing an example of a processing sequence in the work support system S when the user adjusts the imaging range of the imaging device 1. First, the mobile terminal 2 generates a target image based on the user's operation (S11). The mobile terminal 2 transmits the generated target image to the server 3.

When the target image acquisition unit 332 of the server 3 acquires the target image (S12), the specific unit 333 generates the correction target image by correcting the target image based on the height information (S13). The specific unit 333 extracts the feature points included in the correction target image, and calculates the first difference vector which is the difference between the coordinates of the feature points and the coordinates of the center position (S14). The specific unit 333 stores the calculated first difference vector in the storage unit 32.

Subsequently, the information output unit 334 of the server 3 transmits an instruction to start the generation of the captured image to the imaging device 1. Upon receiving the instruction to start the generation of the captured image, the imaging device 1 starts generating the captured image (S15), and sequentially transmits the generated captured images to the server 3. When the captured image acquisition unit 331 of the server 3 acquires the captured image (S16), the specific unit 333 identifies and identifies the center position of the target image region similar to the image of the feature point included in the correction target image. The second difference vector, which is the difference between the coordinates of the center position and the coordinates of the center position of the captured image, is calculated (S17).

Subsequently, as described with reference to FIG. 6, the information output unit 334 uses sound information for adjusting the angle of view of the imaging device 1 based on the difference value between the first difference vector and the second difference vector. Is generated (S18) and transmitted to the mobile terminal 2. The mobile terminal 2 outputs a sound based on the received sound information (S19).

[Modification example]
In the above description, it is not assumed that the target image acquisition unit 332 acquires a plurality of target images, but the target image acquisition unit 332 may acquire a plurality of target images captured at different positions. Good. In this case, the target image acquisition unit 332 acquires position information indicating the position where the target image is captured in association with each of the plurality of target images. Further, the image pickup device 1 transmits a captured image associated with the position information indicating its own position to the server 3.

The specific unit 333 selects the target image associated with the position information closest to the position information associated with the captured image acquired by the captured image acquisition unit 331, and in the captured image, at least a part of the selected target image region. Identify the location of an image area similar to the image in. By doing so, when it is necessary to install a plurality of image pickup devices 1, it is not necessary for the user to select a target image corresponding to the installation location, so that the work efficiency can be improved.

[Effect of the work support system S of the first embodiment]
As described above, in the work support system S, the target image acquisition unit 332 of the server 3 acquires the target image generated by the user or another person taking a picture using the mobile terminal 2 or another terminal. Then, the identification unit 333 specifies the position of the image region similar to the target image in the captured image. Then, the information output unit 334 outputs sound information based on the relationship between the position specified by the specific unit 333 and the center position of the captured image. By doing so, the user can adjust the imaging range of the imaging device 1 in an appropriate direction by himself / herself while listening to the sound output from the mobile terminal 2.

Since the target image can be created in advance by any person, for example, a person in the business establishment where the image pickup apparatus 1 is installed can prepare the target image in advance. Therefore, the person in the business establishment who installs the image pickup device 1 can have the image pickup device 1 installed so that the desired range can be monitored without accompanying the installation work of the image pickup device 1.

<Second embodiment>
In the first embodiment, a case where the user adjusts the orientation of the image pickup device 1 in order to adjust the image pickup range of the image pickup device 1 has been described. The second embodiment is different from the first embodiment in that the imaging device 1 is a camera whose imaging range can be adjusted by itself. The image pickup device 1 enlarges / reduces the pan operation of moving the lens direction in the left-right direction, the tilt operation of moving the lens direction in the up-down direction, and the captured image based on the control information input from the outside. The zoom operation can be performed.

FIG. 8 is a diagram showing the configuration of the image pickup apparatus 1. The image pickup device 1 includes an image pickup unit 11, a drive unit 12, a communication unit 13, a storage unit 14, and a control unit 15.

The image pickup unit 11 includes an optical system component including a lens and an image pickup element that converts light incident through the lens into an electric signal. The drive unit 12 has an actuator that changes the direction of the optical axis and the zoom rate of the image pickup unit 11 based on the control of the control unit 15. The communication unit 13 is a wireless or wired communication interface for transmitting and receiving information to and from the mobile terminal 2 or the server 3. The communication unit 13 receives, for example, a target image from the server 3.

The storage unit 14 has a ROM and a RAM, and stores a program executed by the control unit 15. Further, the storage unit 14 temporarily stores the captured image generated by the imaging unit 11 based on the control of the control unit 15.

The control unit 15 is, for example, a CPU. By executing the program stored in the storage unit 14, the control unit 15 controls the drive unit 12 to change the direction of the optical axis of the image pickup unit 11 or causes the image pickup unit 11 to generate an image. ..

FIG. 9 is a diagram for explaining the operation of the image pickup apparatus 1. FIG. 9 shows an image pickup range A in which the image pickup apparatus 1 can change the direction of the optical axis. The imaging device 1 can pan or tilt in the horizontal and vertical directions over a length larger than the horizontal length and the vertical length of the imaging range. When the control unit 15 receives the target image from the server 3, the control unit 15 controls the drive unit 12 to set the imaging range to the upper left initial position as shown in FIG.

After that, the control unit 15 causes the drive unit 12 to pan to the right to move the imaging range to the right. When the image pickup range reaches the right end, the control unit 15 tilts the drive unit 12 downward to move the image pickup range downward. The control unit 15 moves the image pickup range in the horizontal direction by panning the drive unit 12 at a position where the image pickup range is moved downward.

The control unit 15 may move the imaging range for each minimum unit in which the direction of the lens can be moved, but may also move the imaging range for each width of the imaging range. The control unit 15 causes the imaging unit 11 to generate an image to be captured each time the imaging range is moved, and transmits the generated image to the server 3. When the control unit 15 receives control information for moving the direction of the optical axis of the image pickup unit 11 from the server 3, the control unit 15 controls the drive unit 12 according to the received control information to change the direction of the optical axis of the image pickup unit 11. By doing so, the imaging range is changed.

10 and 11 are diagrams showing an example of a processing sequence when adjusting the imaging range of the imaging device 1 in the work support system S of the second embodiment. Steps S11 to S14 are the same as the processing sequence of the first embodiment shown in FIG. 7.

When the information output unit 334 of the server 3 calculates the first difference vector in step S14, the information output unit 334 transmits an instruction to start the generation of the captured image to the imaging device 1. Upon receiving the instruction, the control unit 15 of the image pickup apparatus 1 controls the drive unit 12 to move the image pickup range to the initial position (S21). The control unit 15 causes the imaging unit 11 to generate an captured image (S22), and transmits the captured image to the server 3 via the communication unit 13.

When the identification unit 333 of the server 3 acquires the captured image (S23), it determines whether or not the captured image contains the same feature points as those included in the correction target image generated in step S13. (S24). When the specific unit 333 determines that the feature points are not included in the captured image, the information output unit 334 transmits control information including an instruction to change the imaging range to the imaging device 1. The control unit 15 of the image pickup apparatus 1 controls the drive unit 12 based on the received instruction to change the image pickup range (S25), and returns the process to step S22.

When the specific unit 333 determines in step S24 that the feature points are included in the captured image, the server 3 moves to the process shown in FIG. The specific unit 333 calculates a second difference vector between the position of the feature point detected in the captured image and the center position of the captured image, and notifies the information output unit 334 of the second difference vector (S26). The information output unit 334 generates control information for adjusting the imaging range of the image pickup apparatus 1 so that the second difference vector notified from the specific unit 333 becomes equal to the first difference vector (S27), and the generated control Information is transmitted to the image pickup apparatus 1. For example, when the first difference vector is (500, 200) and the second difference vector is (200, 100), the information output unit 334 moves the imaging range by 300 pixels to the right and 100 pixels to the bottom. The control information including the instruction to cause the image is transmitted to the image pickup apparatus 1.

The control unit 15 of the image pickup apparatus 1 changes the image pickup range by controlling the drive unit 12 based on the received control information (S28). As a result, the center position of the imaging range becomes equal to the center position of the target image. The control unit 15 notifies the server 3 that the adjustment has been completed, and the server 3 notifies the mobile terminal 2 that the adjustment has been completed.

The control unit 15 of the image pickup apparatus 1 may adjust the zoom based on the control information received from the server 3. For example, the information output unit 334 changes the zoom ratio so that the imaging range of the captured image becomes equal to the imaging range of the target image when the captured image generated by the imaging device 1 includes the target image. The control information is output to the image pickup apparatus 1. By doing so, the imaging device 1 can not only align the center position of the imaging range with the center position of the target image, but also match the imaging range with the target image. It becomes possible to image a range closer to the request.

[Effect of the second embodiment]
As described above, in the work support system S of the second embodiment, the captured image generated while the imaging device 1 changes the imaging range is transmitted to the server 3. Then, the identification unit 333 of the server 3 specifies the position of the image region similar to the target image in the captured image. The information output unit 334 outputs control information based on the relationship between the position specified by the specific unit 333 and the center position of the captured image to the image pickup apparatus 1. By doing so, it is possible to easily adjust the imaging range of the imaging device 1 by capturing a range that the user wants to be the imaging range of the imaging device 1 and generating a target image.

<Third embodiment>
In the work support system S of the first embodiment, the server 3 generates sound information or control information, but in the work support system S of the third embodiment, the mobile terminal 2 generates sound information. It differs in that it does. For example, when the CPU of the mobile terminal 2 executes the program, it executes the same functions as the captured image acquisition unit 331, the target image acquisition unit 332, the specific unit 333, and the information output unit 334 in the server 3 of the first embodiment. To do.

FIG. 12 is a diagram showing an example of a processing sequence when adjusting the imaging range of the imaging device 1 in the work support system S of the third embodiment. The mobile terminal 2 generates a target image according to the operation of the user (S11). The mobile terminal 2 corrects the target image based on the height of the mobile terminal 2 at the time when the mobile terminal 2 captures the target image and the height at which the image pickup device 1 is installed to generate a corrected target image. (S31). Subsequently, the mobile terminal 2 calculates the first difference vector, which is the difference between the feature point and the center position in the target image (S32).

Next, the image pickup device 1 generates a captured image (S33), and the mobile terminal 2 acquires the captured image generated by the image pickup device 1. The mobile terminal 2 is a second difference between the center position of the captured image and the position of the image similar to the feature point by specifying the position of the image similar to the feature point in the acquired image. The difference vector is calculated (S34). The mobile terminal 2 generates sound information based on the relationship between the first difference vector and the second difference vector (S35), and outputs the sound based on the generated sound information (S36). From step S34 to step S36, the mobile terminal 2 is based on the captured image transmitted from the imaging device 1 until the user finishes the adjustment work of the imaging range of the imaging device 1 and stops the execution of the program. Repeat the process.

[Effect of the work support system S of the third embodiment]
As described above, according to the work support system S of the third embodiment, by using the image pickup device 1 and the mobile terminal 2 without using the server 3, one user can set the image pickup range of the image pickup device 1. It can be easily adjusted.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the gist thereof. is there. For example, the specific embodiment of the distribution / integration of the device is not limited to the above embodiment, and all or a part thereof may be functionally or physically distributed / integrated in an arbitrary unit. Can be done. Also included in the embodiments of the present invention are new embodiments resulting from any combination of the plurality of embodiments. The effect of the new embodiment produced by the combination has the effect of the original embodiment together.

For example, in the above description, the case where the mobile terminal 2 or the server 3 outputs sound information or control information has been described, but the image pickup device 1 acquires the target image and the CPU of the image pickup device 1 executes the program. May generate sound information or control information for controlling the orientation of its own lens. That is, the information output device of the present invention is not limited to the server 3, and the image pickup device 1 or the mobile terminal 2 may include all or a part of the configuration of the information output device.

1 Imaging device 2 Mobile terminal 3 Server 11 Imaging unit 12 Drive unit 13 Communication unit 14 Storage unit 15 Control unit 31 Communication unit 32 Storage unit 33 Control unit 331 Captured image acquisition unit 332 Target image acquisition unit 333 Specific unit 334 Information output unit

Claims (8)

A target image acquisition unit that acquires a target image, which is an image of the target range of the range captured by the imaging device,
An image acquisition unit that acquires an image captured by the image pickup device, and an image acquisition unit.
A specific portion of the captured image that specifies the position of an image region similar to the image of at least a part of the target image.
An information output unit that outputs information based on the relationship between the position specified by the specific unit and the center position of the captured image.
Information output device with. The target image acquisition unit further acquires area designation information for specifying the position or area of the captured image to be imaged by the image pickup device.
The specific unit specifies a position corresponding to the area designation information in the captured image as a position of an image region similar to an image of at least a part of the target image.
The information output device according to claim 1. The target image acquisition unit further acquires height information indicating the height at which the target image was captured.
The specific portion specifies the position of an image in at least a part of a corrected target image obtained by correcting the target image based on the height information.
The information output device according to claim 1 or 2. The specific unit extracts one or more feature points included in the target image, and has the same features as the feature points in the captured image as the position of the image in at least a part of the target image. Identify the position of one or more pixels,
The information output device according to any one of claims 1 to 3. The information output unit outputs sound information based on the relationship between the position specified by the specific unit and the center position of the captured image.
The information output device according to any one of claims 1 to 4. The information output unit outputs control information for controlling the position of the image pickup device based on the relationship between the position specified by the specific unit and the center position of the captured image.
The information output device according to any one of claims 1 to 4. Computer,
Target image acquisition unit that acquires a target image, which is an image of the target range of the range captured by the image pickup device.
An image capture image acquisition unit that acquires an image captured by the image pickup device,
Based on the specific portion that specifies the position of an image region similar to the image of at least a part of the target image in the captured image, and the relationship between the position specified by the specific portion and the center position of the captured image. Information output section that outputs information,
A program to function as. Computer runs,
The step of acquiring the target image, which is the image of the target range of the range captured by the image pickup device, and
The step of acquiring the captured image captured by the imaging device, and
A step of identifying the position of an image region similar to the image of at least a part of the target image in the captured image, and
A step of outputting information based on the relationship between the specified position and the center position of the captured image, and
Information output method having.

Images