Binocular ranging method and system based on pixel frequency domain calibration correction CCD/CMOS
Technical Field
The invention relates to the technical field of optical imaging, image processing and signal processing, in particular to a binocular distance measuring method and system based on pixel frequency domain calibration correction CCD/CMOS.
Background
At present, CCD/CMOS is widely applied in the fields of digital photography, aerospace, astronomical detection, spectrum telescope and the like, and is industrially used for measuring size, collecting images and detecting high temperature. The CCD/CMOS can directly convert the optical signal into a digital electric signal to realize the acquisition, storage, transmission, processing and reproduction of the image.
The binocular ranging is a depth information acquisition mode based on a triangular ranging principle, and compared with other depth information acquisition systems, the binocular ranging system has the advantages of simple structure, good environmental adaptability, dense depth information and the like, and is widely applied to the fields of autonomous navigation, obstacle detection and the like.
The binocular ranging system mainly comprises a pair of CCD/CMOS cameras with fixed pose relationship and an operation platform for processing images. The measurement principle is as follows: the same object point in the scene is imaged at different positions of a CCD/CMOS image surface due to the optical geometric relation, the position difference is called parallax, the distance of the object point can be calculated by calculating the parallax and combining the parameters of the pair of cameras, and the depth information can be obtained. According to the measurement principle of the binocular ranging system, the measurement accuracy thereof depends on the accuracy of parallax.
The current measurement algorithm is based on the assumption that CCD/CMOS pixels are uniformly distributed, and does not consider the fact that the actual CCD/CMOS pixels have a certain micro-deviation of a geometric position from the theoretical position, so that a certain error is introduced; in addition, the measurement resolution of the binocular ranging system is limited by the resolution of parallax, and the resolution of parallax is determined by the pixel size of the CCD/CMOS sensor, so the most direct method for improving the measurement resolution of the binocular ranging system is to replace an image sensor with a smaller pixel size.
However, in the case of the CCD/CMOS sensor, the sensitivity of the pixel is easily reduced due to the gradual reduction of the size of the pixel, and at the same time, the CCD/CMOS sensor poses a great challenge to the manufacturing process and is easy to create a technical barrier. In view of this situation, researchers expect that the method of dynamic young's interference correction and pixel frequency domain response function reconstruction CCD/CMOS can be applied to image preprocessing of the binocular ranging system to improve the measurement accuracy of the binocular ranging system.
The CCD/CMOS technology for dynamic Young's interference correction mainly aims at calculating the tiny deviation of the position of a pixel set, and is limited by a CCD/CMOS processing technology, so that the position of a pixel of a CCD/CMOS usually has a certain deviation from a preset integer coordinate position, and the position of an output image is easy to be inaccurate.
Disclosure of Invention
The invention aims to provide a binocular distance measurement method and system based on pixel frequency domain calibration correction CCD/CMOS, which utilizes a dynamic Young's interference method to calibrate the frequency domain response function of a CCD/CMOS sensor and combines a binocular distance measurement technology to ensure that the measurement precision is better and the resolution is higher.
In order to achieve the above object, in a first aspect, the present invention provides a binocular ranging method based on pixel frequency domain calibration correction CCD/CMOS, comprising the steps of:
1) the laser output by the light source is divided into two beams of light by the beam splitter, and after the two beams of light are respectively subjected to frequency modulation by the two acousto-optic modulators, the two beams of light have certain frequency difference and are respectively coupled into the optical fibers;
2) fixing an optical fiber bearing two beams of light on a multi-channel optical fiber fixing base, wherein the two beams of light interfere with each other to form a dynamic interference fringe at a far distance;
3) using a CCD/CMOS sensor to be calibrated to acquire continuous fringe images of two optical fibers at different transverse intervals and longitudinal intervals, wherein the different transverse intervals and the longitudinal intervals correspond to different wave vector directions of an incident light field;
4) calculating each parameter of the pixel frequency domain response function through fitting of a plurality of groups of collected continuous images in different wave vector directions, and storing the parameters for later use;
5) selecting optical lenses with the same parameters from a pair of CCD/CMOS sensors calibrated in the mode to form a binocular camera, performing Fourier transform on images acquired by the CCD/CMOS sensors, combining each parameter of the frequency domain response function in the step 4), solving the frequency domain distribution of an incident light field, obtaining the spatial distribution of the incident light field after inverse Fourier transform, and then performing resampling to obtain an image with ideal pixel position and higher resolution;
6) and taking the processed image as the input of a binocular ranging system to further acquire the measured distance.
In the above technical solution, the frequency domain response function of each pixel of the CCD/CMOS sensor can be calibrated by the dynamic young's interference correction technique, and then the frequency domain response function of the CCD/CMOS sensor is obtained, and according to the fourier optical theory, the output of the CCD/CMOS sensor is the convolution of the incident optical field distribution and the response function in the spatial domain, and is the product of the incident optical field distribution and the response function in the frequency domain. Therefore, after knowing the frequency domain response function of the CCD/CMOS sensor, the Fourier transform result of the incident light field can be obtained from the output of the CCD/CMOS sensor, and after inverse Fourier transform, the accurate incident light field distribution can be recovered, and the sampling is carried out again according to the mode of uniform distribution of pixels and the required resolution (pixel size), thereby improving the measurement precision and resolution of the binocular ranging system.
In step 1), a HeNe laser is used as a light source.
In the step 3), the transverse interval and the longitudinal interval of the two bundles of optical fibers can be changed by replacing the positions of the two bundles of optical fibers in the multichannel optical fiber fixing base.
And 4) in the step 4), fitting and calculating parameters of the pixel frequency domain response function by using a four-step phase method.
In step 5), the image collected by the CCD/CMOS sensor is the product of the frequency domain distribution of the incident light field and the frequency domain response function on the frequency domain.
In step 6), according to the basic formula of the binocular ranging system
d is depth, f is cameraThe focal length of the lens, L is the base line distance of the used camera pair, D is the parallax, after the image processed in the step 5) is used, the obtained parallax is more accurate, and meanwhile, the resolution ratio is higher, so that the measurement result is more accurate and the resolution ratio is higher.
In a second aspect, the binocular ranging system based on the pixel frequency domain calibration correction CCD/CMOS provided by the present invention is used for implementing the binocular ranging method based on the pixel frequency domain calibration correction CCD/CMOS, and includes:
the CCD/CMOS sensors are respectively used for acquiring images in front of two optical lenses of the binocular camera;
the Young dynamic interference module is used for calibrating parameters of a frequency domain response function of the CCD/CMOS sensor;
and the computer is used for fitting and calculating each parameter of the pixel frequency domain response function and storing the parameters.
The Young dynamic interference module comprises a HeNe laser, a beam splitter, a pair of light shields, a pair of polarization controllers, a pair of acousto-optic modulators and an optical fiber base; the beam splitter divides laser emitted by the HeNe laser into two beams of light which respectively enter the light chopper, the polarization controller and the acousto-optic modulator in sequence along two paths.
Compared with the prior art, the invention has the advantages that:
the invention can calibrate the frequency domain response function of the CCD/CMOS sensor, thereby recovering the accurate incident light field distribution, and resampling the incident light field distribution with the required resolution (pixel size) according to the mode of uniform distribution of the pixels, thereby improving the measurement precision and resolution of the binocular ranging system.
Drawings
FIG. 1 is a diagram of a binocular ranging system based on a pixel frequency domain calibration correction CCD/CMOS in an embodiment of the present invention;
FIG. 2 is a schematic diagram of a binocular ranging system according to an embodiment of the present invention;
FIG. 3 is a flowchart of a binocular ranging method based on pixel frequency domain calibration correction CCD/CMOS in the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described with reference to the following embodiments and accompanying drawings. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments without any inventive step, are within the scope of protection of the invention.
Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this invention belongs. The use of the word "comprise" or "comprises", and the like, in the context of this application, is intended to mean that the elements or items listed before that word, in addition to those listed after that word, do not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used merely to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.
Examples
The binocular distance measuring system based on the pixel frequency domain calibration correction CCD/CMOS comprises a pair of CCD/CMOS sensors 7, a pair of optical lenses 8 with the same parameters and a CCD/CMOS dynamic Young's interference calibration pixel deviation and frequency domain response function reconstruction module. The CCD/CMOS dynamic Young's interference calibration pixel shift and frequency domain response function reconstruction module comprises a HeNe laser 1, a beam splitter 2, a pair of light shields 3, a pair of polarization controllers 4, a pair of acousto-optic modulators (AOMs) 5 and an optical fiber base 6.
Firstly, calibrating a CCD/CMOS sensor in a binocular ranging system. As shown in figure 1, a CCD/CMOS dynamic Young interference is used for calibrating a pixel offset and frequency domain response function reconstruction module, laser generated by a HeNe laser 1 is coupled into an optical fiber, and then split into two beams of light beams 2, the two beams of light beams are respectively modulated by an acousto-optic modulator 5 to generate a certain frequency difference, and then the two beams of optical fibers are respectively fixed at different positions of a multichannel optical fiber base, so that the two beams of light interfere in space. The emergent light intensity of the two optical fibers is measured by using the light chopper 3 to shade one optical fiber light beam and measuring the emergent light intensity of the other optical fiber light beam. The shutter 3 is opened, the CCD/CMOS sensor 7 to be calibrated is used for recording an interference fringe image for a period of time, and the interference fringe image is stored. The fixed position of the fiber is changed, the interference fringes within a period of time are recaptured, and the same operation is repeated for a plurality of times. And all the captured interference fringe images, the CCD/CMOS sensor 7 and the relevant parameters of the laser used are input into a computer program to obtain the frequency domain response function of the CCD/CMOS sensor 7.
Referring to fig. 2, a pair of calibrated CCD/CMOS sensors and optical lenses with the same parameters are used to form a binocular camera, and a scene to be measured is photographed to obtain an image. The image collected by the sensor is subjected to Fourier transform, and then the frequency domain distribution of the incident light field can be obtained by combining with the calibrated CCD/CMOS frequency domain response function, after the Fourier inverse transformation, the spatial distribution of the incident light field can be obtained, then the resampling is carried out, the image with ideal pixel position and higher resolution is obtained, the image is input into a binocular matching algorithm for calculation, the depth of the scene to be measured is obtained, and the overall flow is shown in figure 3. After the CCD/CMOS sensor is calibrated, a more accurate imaging position of the object point to be measured can be obtained, and therefore a more accurate distance measurement result of the object point to be measured is obtained.