JP2011175007A - Image correction method in vibration state of moving body - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent an image from blurring when a monitor for display is seen in a moving body, by correcting the image while the monitor for display disposed in the moving body is vibrated by vibration of the moving body. <P>SOLUTION: In the image correction method in the vibration state of the moving body, the monitor (3) for display is photographed by an image input device (13) kept in a static state, a correction amount (13a) obtained by calculating the blurring amount of the monitor (3) for display is input into an image fetching correcting device (11), correction for shifting the image based on the correction amount (13a) of the image (2) before the correction is performed, the image (12) after the correction is displayed. Thus, an image without blurring can be seen. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image correction method under a vibration state of a moving body, and in particular, by correcting the image under a state where a display monitor provided in the moving body vibrates due to vibration of the moving body, The present invention relates to a new improvement for enabling an image to be seen without blurring when a display monitor is viewed with the.

Conventionally, generally, as shown in FIG. 8, the image 2 of the external camera 1 is displayed on the display monitor 3, and as a method for correcting image blurring when the image 2 itself has blurring, for example, The method shown by patent document 1 and 2 can be mentioned.
That is, in the image shift correction apparatus disclosed in Patent Document 1, the light of light incident on the imaging device that obtains an image signal from light incident on the window is fixed to a revolving frame that revolves the window, and further incident on the window. An image shift amount is detected based on a marking indicating an optical axis position arranged at a position where an image is formed on the road and a marking position change in an image signal supplied from an image pickup device, and output based on the shift amount. It is possible to detect and correct image blur due to distortion of the imaging device main body and inclination of the visual axis stabilization system by providing correction means for correcting image shift, and stable image display is always possible It becomes.

In addition, in the target detection processing device, the flying object, and the target detection processing method disclosed in Patent Document 2, a small and low-luminance target is detected by correcting an image shift amount between frames caused by a difference in imaging conditions. Therefore, when imaging the target during the flight of the flying object, first, the altitude and flying speed of the flying object detected by the flying speed / altitude detector are detected, and in addition to the detection result, the gimbal mechanism unit Imaging conditions such as the visual axis direction of the imaging device obtained from the above, the imaging field of view obtained from the imaging device, and the imaging interval. Then, the image flow amount calculation unit obtains the flow amount of each frame image generated according to the distance in the field of view of the imager from the acquired imaging conditions, and the image flow amount correction unit calculates the flow amount of the image in the video signal. In this method, the flow amount is shifted for each frame in accordance with the obtained flow amount, and a correlation between frames is obtained by a frame integration processing unit to detect a target in the imager scanning.
Accordingly, a target detection processing device and a target detection processing method capable of reliably correcting a shift amount of an image between frames caused by a difference in imaging conditions and thereby detecting a small and low-luminance target are provided. An aircraft capable of detecting a target using a processing device can be provided.

Japanese Patent Laid-Open No. 2001-211379 JP 2003-270317 A

Since the conventional method for correcting image blur has been configured as described above, the following problems existed.
In other words, the methods disclosed in Patent Documents 1 and 2 described above are methods for correcting the image by post-processing when the captured image itself is misaligned or blurred. If the image itself is corrected and corrected and displayed as a normal image on the display monitor in the moving body, the image can be seen stably if there is no vibration of the moving body. When the mobile object vibrates due to the vibration of the moving body, when the image on the display monitor is viewed inside the mobile body, the screen is shaken due to vibration or the like. It was difficult to do.
That is, according to the present invention, when a normal image without blurring is sent to the display monitor, the display monitor itself vibrates due to the vibration of the moving body and the image is blurred. Is a way to be able to see.

  The image correction method under the vibration state of the moving body according to the present invention is such that the display monitor in the moving body consisting of any one of a vehicle, a flying body, and a ship is shaken by the vibration of the moving body. Photographing the display monitor with an image input device maintained in an unrelated still state, inputting a correction amount obtained by calculating a blur amount of the display monitor to the image capture correction device, and the image capture correction device In this method, correction is performed to shift the image before correction input to the display monitor based on the correction amount, and the corrected image after correction is displayed on the display monitor instead of the image before correction. In addition, the pre-correction image may be a television broadcast image or an image captured by an external camera provided via a space stabilization device provided on the moving body.

Since the image correction method under the vibration state of the moving body according to the present invention is configured as described above, the following effects can be obtained.
That is, by using a separate image capturing device that is not affected by the vibration of the moving body in the moving body, the vibrating display monitor is photographed, and the amount of correction obtained by producing the amount of blur of the monitor screen is obtained. Since the pre-correction image is corrected to shift the image, and the post-correction corrected image is displayed on the display monitor, the display monitor viewed inside the moving body is an image that is not shaken regardless of the vibration of the moving body. Can see.

It is a block diagram which shows the image correction method by this invention. It is a specific block diagram of the principal part of FIG. It is a block diagram which shows the recognition image of FIG. FIG. 2 is a specific configuration diagram illustrating the occurrence of blur in FIG. 1. FIG. 5 is a configuration diagram illustrating a recognition image of occurrence of blur in FIG. 4. It is a block diagram which shows the image after correction | amendment after correction | amendment. It is a flowchart which shows the processing method of FIG. It is a block diagram which shows the conventional display method.

  The present invention corrects an image while the display monitor provided in the moving body vibrates due to the vibration of the moving body, so that the image can be seen without blurring when the display monitor is viewed in the moving body. An object of the present invention is to provide a method for correcting an image under a vibration state of a moving body that can be used.

DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of an image correction method under a vibration state of a moving body according to the invention will be described with reference to the drawings.
In addition, the same code | symbol is attached | subjected and demonstrated to a part the same as that of a prior art example, or an equivalent part.
FIG. 1 is a block diagram showing an image correction method according to the present invention. In this block diagram, reference numeral 10 denotes a moving body made up of an airplane, a helicopter, a ship, and the like. The apparatus 11 is configured to capture an uncorrected image 2 that is an image from the external camera 1.
The pre-correction image 2 is not limited to the image from the external camera 1, and may be various images received by an antenna, for example.

  The corrected image 12 from the image capturing / correcting device 11 is displayed on the display monitor 3 in the moving body 10, and the display monitor 3 is displayed on the display monitor 3 by the image input device 13 in the moving body 10. A correction amount 13a obtained by taking a picture and calculating the blur amount of the display monitor 3 by the image input device 13 is sent to the post-image capture correction device 11.

Next, the case where the image correction shown in the block diagram of FIG. 1 is actually performed in the above-described configuration will be described.
First, as shown in the flow of the processing method in FIG. 7, after the start of processing (first step 100), as image reference position recognition (second step 101), as shown in FIGS. 2 and 3, An image 3b is displayed on the screen 3a of the monitor 3 and is photographed by the image input device 13 in a state having a recognition standard 3d including a cross mark formed on the frame 3c.

The second step 101 is performed when the moving body is stationary, and is performed only once at the initial stage.
The image input device 13 is configured so as not to be affected by vibration or the like in the moving body 10 (for example, provided in a well-known space stabilization device or the like). The camera is configured to be able to take a picture of the shake state.

  The recognition image 3e obtained by photographing the recognition reference 3d in the second step 101 and inputted to the image input device 13 is as shown in FIG. 3, and this recognition image 3e is inputted to the image input device 13 (first 3 steps 102).

  As described above, the second step 101 described above is only once at the initial rise, but after this operation is completed, the image input device 13 continues to shoot and the moving body 10 moves. Even after the start, photographing on the display monitor 3 is continued.

  For this reason, as the operation of the third step 102 continues, a shake 14 of the display monitor 3 due to vibration or the like during the movement of the moving body 10 occurs (shown in FIG. 4). As a result of the input, a deviation amount 15 from the recognition reference 3d in FIG. 3 is instantaneously calculated (fourth step 103), and a correction amount 13a corresponding to the deviation amount 15 is input to the image capturing correction apparatus 11 as shown in FIG. 5 and FIG. 6, correction is performed to shift the pre-correction image 2 based on the correction amount 13 a (fifth step 104) and output from the image capture correction device 11. The corrected image 12 is displayed on the display monitor 3 (sixth step 105).

Since the third step 102 to the sixth step 105 described above are always repeated while the display monitor 3 is used with the moving body 10, the third step 102 to the sixth step 105 are performed regardless of the state of the shake generated by the vibration of the moving body 10. Since the optimum image shift is performed instantaneously, a stable screen without blurring can always be seen in the moving body 10.
Note that a technique for performing image shift in accordance with the above-described blur can be performed using a known technique as disclosed in Patent Documents 1 and 2 described above, for example.

  The image correction method under the vibration state of the moving body according to the present invention is not limited to the display monitor in the moving body, and can be applied to, for example, a steel manufacturing site, a metal processing site, etc. where there is a lot of vibration.

DESCRIPTION OF SYMBOLS 1 External camera 2 Image before correction | amendment 3 Display monitor 10 Mobile body 11 Image capture correction apparatus 12 Image after correction | amendment 13 Image input apparatus 14 Blur 100 1st step 101 2nd step 102 3rd step 103 4th step 104 5th step 105 6th step

Claims (2)

  In a state where the display monitor (3) in the moving body (10) composed of any one of a vehicle, a flying body, and a ship is shaken by the vibration of the moving body (10), a stationary state unrelated to the vibration The display monitor (3) is photographed with the image input device (13) maintained at the same position, and the correction amount (13a) obtained by calculating the blur amount of the display monitor (3) is used as the image capture correction device (11 ), The image capture correction device (11) performs a correction to shift the image before correction (2) input to the display monitor (3) based on the correction amount (13a), and the correction An image correction method under a vibration state of a moving body, characterized in that a post-correction image (12) after is displayed on the display monitor (3) instead of the pre-correction image (2).   The pre-correction image (2) is a television broadcast image or an image captured by an external camera provided via a space stabilization device provided in the moving body (10). The image correction method under the vibration state of the moving body according to 1.

Images