JP2007019828A - Camera image distortion correction display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera image distortion correction display device which is capable of more accurately recognizing a radio wave arrival direction by displaying an estimation result of a radio wave visualizing system of radio wave holography or the like and a camera image resulting from correcting a distortion caused by a lens and an image taking-in system, one over the other in order to more accurately recognize the radio wave arrival direction. <P>SOLUTION: A camera 12 for recording an image of an arriving radio wave direction is connected to a side face of an array antenna 11 for receiving an arriving radio wave. and an output of the antenna 11 is input to a frequency conversion part 13, and an output of the frequency conversion part 13 is input to an A/D conversion part 14. An output of the A/D conversion part 14 is input to a radio wave emission source visualization processing operation part 15. Meanwhile, an image obtained by photographing a scene in the radio wave arrival direction by the camera 12 is input to an image processing part 16 and is subjected to processing of correcting an image distortion caused by lens performance and the image taking-in system and then is displayed on a display device 17 by superimposing the crrected image over the processing result of the radio wave emission source visualization processing operation part 15. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an apparatus capable of displaying a radio wave arrival direction estimation result using a technique for visualizing radio waves on a camera image and accurately visualizing the position of an object emitting the radio waves.

  With the spread of mobile communication systems and wireless LAN systems, problems such as radio interference due to radio wave interference and the need to detect illegal radio stations have arisen. In order to solve such a problem, an apparatus for identifying and visualizing a radio wave emission source is required.

  A radio wave emission source visualization device is a system that estimates the direction of arrival of radio waves by receiving radio waves with an array antenna with a plurality of antenna elements arranged on a flat surface and visualizing the radio waves using the received radio waves. is there. As a method for visualizing radio waves, a radio holography method as shown in Reference 1 is known. The estimation result of the radio wave arrival direction is displayed on the screen as an estimated value (elevation angle, azimuth angle).

  In a conventional apparatus, only an estimation result calculated from a method of visualizing radio waves such as radio holography is displayed as a distribution of electric field strength. Or only estimated values (elevation angle, azimuth angle) were displayed. In this case, it is possible to know the arrival direction (elevation angle, azimuth angle) of radio waves, but it has not been possible to specifically identify the location from which the radio waves arrive.

  In order to solve this problem, an attempt has been made to capture the vicinity of the radio wave reception range with a camera and to display the estimation result of the radio wave arrival direction such as radio holography on the captured camera image. By this display method, it is possible to recognize a place where radio waves are generated.

However, since the captured camera image is distorted by the lens performance and the image capture system, the location where the radio wave is generated is accurate even if it is superimposed on the estimation result of the radio wave arrival direction using the radio holography method. There was a problem that it was difficult to specify.
Japanese Patent Laid-Open No. 11-326480

  Therefore, the present invention has been made in view of the above, and an object thereof is to superimpose an estimation result using a radio wave visualization method such as radio holography in order to accurately recognize an object emitting a radio wave. Then, distortion correction of the captured camera image is performed. Radio waves are emitted by correcting distortion (magnification, lens distortion) of the captured camera image, and displaying the radio wave arrival direction estimation result by radio wave visualization method on the corrected camera image. It is an object of the present invention to provide a camera image distortion correction display device that enables an accurate position of an object to be specified.

In order to solve the above problems, in the camera image distortion correction display device of the present invention,
An array antenna for receiving incoming radio waves,
A camera that captures the direction of arrival of radio waves,
A frequency converter that converts the radio frequency received by the antenna into a predetermined frequency;
An A / D converter that converts the analog signal converted by the frequency converter into a digital signal;
A radio wave emission source visualization processing calculation unit that calculates a position of a radio wave emission source from the signal A / D converted by the A / D conversion unit; a video processing unit that performs image processing on a video signal captured by the camera; and the video processing A display device for displaying an image in which the image calculated by the radio wave emission source visualization processing calculation unit is superimposed on the image of the unit,
The lens performance of the camera and the image distortion generated in the image capturing system are corrected.

  According to the present invention, the lens performance of the camera and the image distortion generated in the image capturing system are corrected, so that the radio wave arrival direction estimated value estimated by radio holography or the like can be accurately displayed in the photographed image. It becomes possible to specify the radiation object specifically.

  Hereinafter, embodiments of the present invention will be described in detail. FIG. 1 is a block diagram showing a configuration of a radio wave emission source visualization apparatus according to an embodiment of the present invention. 11 is an array antenna, 12 is a camera, 13 is a frequency conversion unit, 14 is an A / D conversion unit, and 15 is a radio wave. An emission source visualization processing calculation unit, 16 is a video processing unit, and 17 is a display device.

  A camera 12 that records an image in the direction of the incoming radio wave is connected to the side of the array antenna 11 that receives the incoming radio wave, the output of the antenna 11 is input to the frequency changing unit 13, and the output of the frequency converting unit 13 is the A / D converting unit. 14 is input. The output of the A / D conversion unit 14 is input to the radio wave emission source visualization processing calculation unit 15. On the other hand, an image obtained by shooting a scene in the direction of arrival of radio waves by the camera 12 is input to the video processing unit 16, and after correcting for lens performance and image distortion generated in the image capture system, radio wave emission source visualization processing computation The display device 17 is configured to superimpose the processing result with the unit 15 on the display device 17.

Array antenna 11, for example, ^two N T-type half-wave dipole antenna in the vertical and horizontal (N × NN is a positive integer) are arranged on the same plane, the reference antenna is set at the center. The radio wave arrival direction can be calculated by comparing the amplitude and phase difference between the outputs of the reference antenna and the surrounding antennas and obtaining the direction in which the radio waves are strengthened most. This method is called a radio holography method.

  In the present invention, the image processing unit 16 corrects the distortion of the captured camera image before superimposing it on the estimation result. The camera image taken by the video processing unit is corrected for distortion (magnification, lens distortion), and the corrected camera image and the radio wave arrival direction estimation result using the radio holography method are superimposed on the display device 17 and displayed. This makes it possible to more accurately recognize the direction of arrival of radio waves.

Next, the processing sequence of the camera image distortion correction display apparatus according to the present invention will be described in detail with reference to the flowchart shown in FIG. Received radio waves in a certain frequency band are received by the array antenna 11. (S201)
Next, the output of the antenna 11 is down-converted to a certain frequency (for example, 21.4 MHz) by the frequency changing unit 13 in order to match the processing method of the radio wave emission source visualization processing calculation unit 15 connected at a later stage. (S202)
Thereafter, the frequency-converted analog signal is converted into a digital signal by the A / D converter 14. (S203)
This digital signal can be obtained by the radio wave emission source visualization processing calculation unit 15 by the radio holography method described above, and the radio wave arrival direction, that is, the direction angle, the elevation angle, and the electric field intensity distribution. (S204)
On the other hand, by attaching the camera 12 to the array antenna 11, it is possible to take a picture of an environment (location) where radio waves are received. (S205)
Then, the captured camera image is transferred to the video processing unit 16 attached to the radio wave emission source visualization processing calculation unit 15. (S206)
The direction of arrival estimation results by radio holography are expressed in terms of azimuth and elevation with the center of the array antenna as the origin, so if there is distortion of the captured camera image (magnification, lens distortion), naturally An error occurs in the azimuth angle and elevation angle. This camera image distortion is corrected. Details of the distortion compensation will be described later. (S207)
The estimation result of the arrival direction of radio waves by radio holography and the camera image with offset compensation are superimposed. (S208)
The image data is transferred to the display device 17. (S209)
This series of flows makes it possible to accurately recognize the arrival of radio waves. (S210)
Fig. 3- (a) shows an example of a screen displayed as a conventional radio field intensity distribution. The black part of the screen indicates the part where the electric field strength is strong. There is a black part with a strong electric field strength in the upper left, and it can be estimated that it is the direction of arrival of radio waves.

  FIG. 3- (b) shows an example of a screen when camera image distortion correction is not performed. Since it is displayed superimposed on the camera image, it can be recognized from where the radio waves are coming from. However, in this case, since the camera image distortion is not corrected, the radio wave arrival direction (antenna direction) does not match the estimation result.

  FIG. 3- (c) shows a screen example of the estimation result of the radio wave arrival direction when the camera image distortion correction is performed. In this setting, radio waves are emitted from the antenna on the top left of the building. In this case, since the distortion of the camera image is corrected, a portion with a strong electric field strength is covered on the antenna, and the radio wave arrival direction can be accurately recognized.

As a specific example, an example of an image distortion correction method is shown. First, the magnification of the photographed image generated by the image capturing system is corrected by (Expression 1) and (Expression 2). AZ_1 and EL_1 indicate coordinates before correction, and AZ_2 and EL_2 indicate coordinates after correction. (AZ is azimuth, EL is elevation) A, B (magnification) and C are optional.

Next, the distortion of the lens is next corrected using the image after the magnification change. Lens distortion correction formulas are (Formula 3) and (Formula 4). AZ_2 and EL_2 indicate coordinates before correction, and AZ_3 and EL_3 indicate coordinates after correction. The parameter k is arbitrary and indicates the degree of distortion of the lens.

  As described above, it is possible to more accurately recognize the radio wave arrival direction by correcting the distortion of the camera image by performing the coordinate conversion and displaying it superimposed on the estimation result of the radio wave arrival direction.

  According to the camera image distortion correction display device according to the embodiment of the present invention configured as described above, it is estimated by radio holography or the like because it corrects the lens performance of the camera and the image distortion generated in the image capturing system. The radio wave arrival direction estimated value can be accurately displayed in the photographed image, and the radio wave radiation object can be specifically specified.

  The present invention is not limited to the above-described embodiment as it is, and can be embodied without departing from the spirit of the invention at the stage of implementation.

It is a block diagram which shows the structure of the camera image distortion correction display apparatus in one Example of this invention. It is a flowchart which shows the process of the camera image distortion correction display apparatus in one Example of this invention. It is an output screen of the camera image distortion correction display apparatus in one Example of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Array antenna 12 ... Camera 13 ... Frequency conversion part 14 ... A / D conversion part 15 ... Radio wave emission source visualization process calculating part 16 ... Video processing part 17 ... Display apparatus

Claims (1)

An array antenna for receiving incoming radio waves,
A camera that captures the direction of arrival of radio waves,
A frequency converter that converts the radio frequency received by the antenna into a predetermined frequency;
An A / D converter that converts the analog converted by the frequency converter into a signal digital signal;
A radio wave emission source enabling visual processing processing unit that calculates a position of a radio wave emission source from a signal A / D converted by the A / D conversion unit; a video processing unit that performs image processing on a video signal photographed by the camera; and A display device for displaying a video in which the image calculated by the radio wave emission source visualization processing calculation unit is superimposed on the image of the video processing unit,
A camera image distortion correction display device that corrects lens performance of the camera and image distortion generated in an image capturing system.

Images