JP5621089B2 - Image correction method under vibration of moving body - Google Patents

Description

  The present invention relates to an image correction method under a vibration state of a moving body, and in particular, by correcting the image under a state where a display monitor provided in the moving body vibrates due to vibration of the moving body, The present invention relates to a new improvement for enabling an image to be seen without blurring when a display monitor is viewed with the.

Conventionally, generally, as shown in FIG. 8, the image 2 of the external camera 1 is displayed on the display monitor 3, and as a method for correcting image blurring when the image 2 itself has blurring, for example, The method shown by patent document 1 and 2 can be mentioned.
That is, in the image shift correction apparatus disclosed in Patent Document 1, the light of light incident on the imaging device that obtains an image signal from light incident on the window is fixed to a revolving frame that revolves the window, and further incident on the window. An image shift amount is detected based on a marking indicating an optical axis position arranged at a position where an image is formed on the road and a marking position change in an image signal supplied from an image pickup device, and output based on the shift amount. It is possible to detect and correct image blur due to distortion of the imaging device main body and inclination of the visual axis stabilization system by providing correction means for correcting image shift, and stable image display is always possible It becomes.

In addition, in the target detection processing device, the flying object, and the target detection processing method disclosed in Patent Document 2, a small and low-luminance target is detected by correcting an image shift amount between frames caused by a difference in imaging conditions. Therefore, when imaging the target during the flight of the flying object, first, the altitude and flying speed of the flying object detected by the flying speed / altitude detector are detected, and in addition to the detection result, the gimbal mechanism unit Imaging conditions such as the visual axis direction of the imaging device obtained from the above, the imaging field of view obtained from the imaging device, and the imaging interval. Then, the image flow amount calculation unit obtains the flow amount of each frame image generated according to the distance in the field of view of the imager from the acquired imaging conditions, and the image flow amount correction unit calculates the flow amount of the image in the video signal. In this method, the flow amount is shifted for each frame in accordance with the obtained flow amount, and a correlation between frames is obtained by a frame integration processing unit to detect a target in the imager scanning.
Accordingly, a target detection processing device and a target detection processing method capable of reliably correcting a shift amount of an image between frames caused by a difference in imaging conditions and thereby detecting a small and low-luminance target are provided. An aircraft capable of detecting a target using a processing device can be provided.

Japanese Patent Laid-Open No. 2001-211379 JP 2003-270317 A

Since the conventional method for correcting image blur has been configured as described above, the following problems existed.
In other words, the methods disclosed in Patent Documents 1 and 2 described above are methods for correcting the image by post-processing when the captured image itself is misaligned or blurred. If the image itself is corrected and corrected and displayed as a normal image on the display monitor in the moving body, the image can be seen stably if there is no vibration of the moving body. When the mobile object vibrates due to the vibration of the moving body, when the image on the display monitor is viewed inside the mobile body, the screen is shaken due to vibration or the like. It was difficult to do.
That is, according to the present invention, when a normal image without blurring is sent to the display monitor, the display monitor itself vibrates due to the vibration of the moving body and the image is blurred. Is a way to be able to see.

An image correction method under a vibration state of a moving body according to the present invention includes:
A display monitor provided in a moving body composed of any one of a vehicle, a flying object, and a ship, having a recognition standard with a ten mark on a frame outside the screen, and the display monitor maintained in a stationary state by a space stabilizer. An image input device for photographing in a state, an image capture correction device for inputting a correction amount from the screen input device, capturing an uncorrected image from the outside, and outputting the corrected image to the display monitor; After the start of processing (first step 101), the image is displayed on the screen as the image reference position recognition (second step 101) when the moving body is stationary, and the recognition reference is satisfied The display monitor is imaged only once at the initial stage by the image input device, and the recognition image captured in the second step is input to the image input device (third step 102). After the second step 101 is finished, even after the moving body starts moving, the photographing of the display monitor is continued, and the state of shaking generated on the display monitor due to vibration during the movement of the moving body is observed. By input to the image input device, a blur amount with respect to the recognition reference is calculated by the image input device (fourth step 103), and a correction amount for the blur amount is sent to the image capture correction device, Based on the amount of correction, correction is performed to shift the image before correction (fifth step 104), and the corrected image output from the image capture correction device is displayed on the display monitor (sixth step). The third step 102 to the sixth step 105 are always repeated while the display monitor (3) is used with the moving body, and are generated by the vibration of the moving body. Regardless of the state of blur is a method of displaying no blurred image on the display monitor,
The pre-correction image may be a television broadcast image or an image captured by an external camera provided via a space stabilization device provided on the moving body .

Since the image correction method under the vibration state of the moving body according to the present invention is configured as described above, the following effects can be obtained.
That is, by using a separate image capturing device that is not affected by the vibration of the moving body in the moving body, the vibrating display monitor is photographed, and the amount of correction obtained by producing the amount of blur of the monitor screen is obtained. Since the pre-correction image is corrected to shift the image, and the post-correction corrected image is displayed on the display monitor, the display monitor viewed inside the moving body is an image that is not shaken regardless of the vibration of the moving body. Can see.

It is a block diagram which shows the image correction method by this invention. It is a specific block diagram which shows the display monitor of the principal part of FIG. 1 in a stationary state . It is a block diagram showing a recognition image of FIG. FIG. 3 is a specific configuration diagram illustrating the occurrence of blur in FIG. 2 . FIG. 5 is a configuration diagram illustrating a recognition image of occurrence of blur in FIG. 4. It is a block diagram which shows the image after correction | amendment after the correction | amendment of the screen of FIG. It is a flowchart which shows the processing method of FIG. It is a block diagram which shows the conventional display method.

  The present invention corrects an image while the display monitor provided in the moving body vibrates due to the vibration of the moving body, so that the image can be seen without blurring when the display monitor is viewed in the moving body. An object of the present invention is to provide a method for correcting an image under a vibration state of a moving body that can be used.

DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, a preferred embodiment of an image correction method under a vibration state of a moving body according to the invention will be described with reference to the drawings.
In addition, the same code | symbol is attached | subjected and demonstrated to a part the same as that of a prior art example, or an equivalent part.
FIG. 1 is a block diagram showing an image correction method according to the present invention. In this block diagram, reference numeral 10 denotes a moving body made up of an airplane, a helicopter, a ship, and the like. The apparatus 11 is configured to capture an uncorrected image 2 that is an image from the external camera 1.
The pre-correction image 2 is not limited to the image from the external camera 1, and may be various images received by an antenna, for example.

The corrected image 12 from the image capturing / correcting device 11 is displayed on the display monitor 3 in the moving body 10, and the display monitor 3 is displayed on the display monitor 3 by the image input device 13 in the moving body 10. A correction amount 13a obtained by photographing and calculating the blur amount 15 of the display monitor 3 by the image input device 13 is sent to the post-image capture correction device 11.

Next, the case where the image correction shown in the block diagram of FIG. 1 is actually performed in the above-described configuration will be described.
First, as shown in the flow of the processing method in FIG. 7, after the start of processing (first step 100), as image reference position recognition (second step 101), as shown in FIGS. 2 and 3, An image 3b is displayed on the screen 3a of the monitor 3 and is photographed by the image input device 13 in a state having a recognition standard 3d including a cross mark formed on the frame 3c.

The second step 101 is performed when the moving body is stationary, and is performed only once at the initial stage.
The image input device 13 is configured so as not to be affected by vibration or the like in the moving body 10 (for example, provided in a well-known space stabilization device or the like). The camera is configured to be able to take a picture of the shake state.

  The recognition image 3e obtained by photographing the recognition reference 3d in the second step 101 and inputted to the image input device 13 is as shown in FIG. 3, and this recognition image 3e is inputted to the image input device 13 (first 3 steps 102).

  As described above, the second step 101 described above is only once at the initial rise, but after this operation is completed, the image input device 13 continues to shoot and the moving body 10 moves. Even after the start, photographing on the display monitor 3 is continued.

Therefore, Oite the continuous operation of the third step 102, the blur 14 of the display monitor 3 by vibration or the like in the moving of the moving body 10 occurs (shown in FIG. 4), the state of the blurring 14 is an image input By input to the device 13, the blur amount 15 with respect to the recognition standard 3d in FIG. 3 is instantaneously calculated in the image input device 13 (fourth step 103), and the correction amount 13a for this blur amount 15 is shown in FIG. As shown in FIGS. 5 and 6 (the corrected image obtained by correcting the image of FIG . 5 ) ( showing the blurring state of FIG. 4 ) , the correction amount 13a is Based on this, a correction for shifting the pre-correction image 2 is performed (fifth step 104), and the corrected image 12 output from the image capture correction device 11 is displayed on the display monitor 3 (sixth step 10). ).

Since the third step 102 to the sixth step 105 described above are always repeated while the display monitor 3 is used with the moving body 10, the third step 102 to the sixth step 105 are performed regardless of the state of the shake generated by the vibration of the moving body 10. Since the optimum image shift is performed instantaneously, a stable screen without blurring can always be seen in the moving body 10.
Note that a technique for performing image shift in accordance with the above-described blur can be performed using a known technique as disclosed in Patent Documents 1 and 2 described above, for example.

  The image correction method under the vibration state of the moving body according to the present invention is not limited to the display monitor in the moving body, and can be applied to, for example, a steel manufacturing site, a metal processing site, etc. where there is a lot of vibration.

DESCRIPTION OF SYMBOLS 1 External camera 2 Image before correction | amendment 3 Display monitor 10 Moving body 11 Image capture correction apparatus 12 Image after correction | amendment 13 Image input apparatus 14 Blur
15 blur amount 100 first step 101 second step 102 third step 103 fourth step 104 fifth step 105 sixth step

Claims (2)

A display monitor (3) provided in a moving body (10) composed of any one of a vehicle, a flying object, and a ship, and having a recognition standard (3d) with a ten mark on a frame (3c) outside the screen (3a); An image input device (13) for photographing the display monitor (3) in a stationary state by a space stabilizer and a correction amount (13a) from the screen input device (13) are input. In addition, an image capture correction device (11) for capturing an externally corrected image (2) and outputting the corrected image (12) to the display monitor (3) is used to start processing (first step 101). ) After that, when the moving body (10) is stationary, the image (3b) is displayed on the screen (3a) as the image reference position recognition (second step 101) and the recognition reference (3d) is included. Then, the display monitor (3) is imaged only once at the initial stage by the image input device (13), and the recognized image (3) captured in the second step (101) e) is input to the image input device (13) (third step 102), and after the second step 101 is finished, the moving monitor (10) starts moving and the display monitor (3) Shooting is continued, and the state of blur (14) generated in the display monitor (3) due to vibration during movement of the moving body (10) is input to the image input device (13), so that A blur amount (15) with respect to the recognition standard (3d) is calculated by the image input device (13) (fourth step 103), and a correction amount (13a) for the blur amount (15) is calculated as the image capture correction device (11). ), And performs a correction for shifting the pre-correction image (2) based on the correction amount (13a) (fifth step 104), and outputs the post-correction image output from the image capture correction device (11) (12) is displayed on the display monitor (3) (sixth step). From the third step 102 to the sixth step 105, It is always repeated while using the display monitor (3) using the moving body (10), regardless of the state of the blur caused by the vibration by the moving body (10) (image without blur ( 3b) is displayed on the display monitor (3), the image correction method under the vibration state of the moving body.   The pre-correction image (2) is a television broadcast image or an image captured by an external camera provided via a space stabilization device provided in the moving body (10). The image correction method under the vibration state of the moving body according to 1.

Images