CN108900734A - A kind of wide-angle lens automatic distortion correction device and method - Google Patents
A kind of wide-angle lens automatic distortion correction device and method Download PDFInfo
- Publication number
- CN108900734A CN108900734A CN201810780492.9A CN201810780492A CN108900734A CN 108900734 A CN108900734 A CN 108900734A CN 201810780492 A CN201810780492 A CN 201810780492A CN 108900734 A CN108900734 A CN 108900734A
- Authority
- CN
- China
- Prior art keywords
- module
- wide
- image
- angle lens
- fpga
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012937 correction Methods 0.000 title claims abstract description 46
- 238000000034 method Methods 0.000 title claims abstract description 16
- 230000000007 visual effect Effects 0.000 claims abstract description 17
- 230000004927 fusion Effects 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims description 7
- 238000001914 filtration Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000000465 moulding Methods 0.000 claims 1
- 238000003384 imaging method Methods 0.000 abstract description 4
- 238000013178 mathematical model Methods 0.000 description 2
- 238000002156 mixing Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000009738 saturating Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
Abstract
The invention discloses a kind of wide-angle lens automatic distortion correction device and method, described device includes：Image Acquisition control circuit, controllable diaphragm, CCD image camera, FPGA distortion correction circuit divide view field image to restore fusion circuit；Host computer image is shown and state modulator software.The present apparatus carries out a distortion point visual field to wide-angle lens by software and hardware combining and automatically corrects, and overcomes the problem of distorting big correction low precision in traditional wide-angle lens imaging process, greatly improves the quality of imaging and improve correcting rate.
Description
Technical field
The present invention relates to computer, electronics and optical fields, are a kind of wide-angle lens automatic distortion correction dresses specifically
It sets and method.
Background technique
Nowadays, wide-angle lens is played in camera in fields such as military affairs, monitoring, medical treatment, traffic, photographies more and more important
Effect.In above-mentioned field, wide-angle lens is widely used because that can obtain the image information of bigger visual field.But due to wide
The design feature of angle mirror head itself, so that taken image would generally generate a degree of nonlinear distortion, to lead
It causes the geometric position precision of objects in images to be affected, keeps it more demanding in geometric accuracies such as image measurement, image recognitions
Field lose application value.Unquestionably, carrying out distortion correction to image can effectively solve wide-angle lens imaging problem.
Currently, the primarily radial distortion of the nonlinear distortion occurred in wide-angle lens, has had certain research and has mentioned
A set of widely accepted mathematical model is gone out, which is based on, and concrete mathematical model is as follows：
δx, δyRespectively indicate the offset of pixel in the x and y direction, k1,k2,k3,r2=x2+y2It is distortion factor.
Based on above-mentioned model, research is very important the distortion correction of wide-angle lens, and wide angle imaging system is come
It says, it is usually required mainly for solve the problems, such as follows:(1) distortion correction is usually realized on computers, is not easy to be handled in real time
With observation；(2) different visual field distortion are different, and current correction method is substantially all same to be treated, and causes correction accuracy poor.
Summary of the invention
In view of the deficiencies of the prior art, the present invention proposes a kind of wide-angle lens automatic distortion correction device and method, energy
It enough effectively shortens and correction time and improves correction accuracy.Its technical solution is as follows：
A kind of wide-angle lens automatic distortion correction device, including wide-angle lens parameter collection module, image are shown and parameter
Control module, wide angle picture correction module, FPGA control processing module, image capture module, divide view field image Fusion Module, can
Diaphragm control module is controlled,
The signal output end of wide-angle lens acquisition parameter module and image capture module and FPGA control processing module input
End is connected, and FPGA control processing module output end shows with image defeated with parameter control module, controllable diaphragm control module respectively
Enter end to be connected, wide angle picture correction module output end is connected with a point view field image Fusion Module input terminal.
Further, be inserted into controllable diaphragm between the wide-angle lens and CCD of described image acquisition module, control size and
Lateral position.
Further, the wide angle picture correction module uses FPGA hardware circuit with view field image Fusion Module is divided.
A kind of wide-angle lens automatic distortion correction method, includes the following steps：
Step 1：Wide-angle lens parameter collection module acquires lens parameters in advance, is stored in FPGA；
Step 2：Controllable diaphragm control module control field stop moves left and right and size, makes the image information point visual field be in
It is synchronous with the CCD time for exposure on present CCD, a point visual field is carried out since 60 ° of field angle and is acquired, according to every visual field for increasing by 10 °
Angle carries out dividing acquisition point view field image；
Step 3：I2C bus is first passed through using ccd sensor array in image capture module, and video flowing is placed in RAM
Middle storage, then the fault image data in RAM pass through again I/O control port by the image of each frame frame by frame be passed to FPGA
In；
Step 4：It include look-up table means, image data buffer module, geometric correction in wide angle picture correction module
Module, gray correction module；It is corrected under different visual fields respectively using the correcting algorithm based on bilinear interpolation by FPGA
Every frame image；
Step 5：Point view field image after correction is merged by point view field image Fusion Module, and is filtered
Deng operation；
Step 6：Image and relevant parameter after image display display correction.
Further, in step 5, for obtained image after fusion, it is carried out median filtering and mean filter with
Remove noise therein.
Further, further include MANUAL CONTROL mode, set under MANUAL CONTROL mode to FPGA configured transmission with controlling hardware
It is standby.
Advantage of the invention is that：
Different degrees of correction has been carried out for the image in wide-angle lens difference field angle, has obtained more accurate image.
Control circuit control diaphragm is made using FPGA and directly acquires a point view field image, the image of each visual field is corrected respectively, by each visual field
Image is merged according to visual field division after correction, and reconstruct obtains blending image, and obtained correction image is very high in precision,
And real-time performance is preferable.
Detailed description of the invention
Fig. 1 is wide-angle lens automatic distortion correction device and method block process schematic diagram
Fig. 2 is wide-angle lens automatic distortion correction device and method structural scheme of mechanism
Specific embodiment
In order to reduce the distortion of wide-angle lens, and it is able to achieve real-time processing, is corrected using optical means cooperation FPGA.
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that specific embodiment described herein is used only for explaining the present invention, and
It is not used in the restriction present invention.
As shown in Figure 1, it includes the following steps：
Step 1：Wide-angle lens is assembled, controllable field stop is inserted between CCD and wide-angle lens, as shown in Fig. 2, simultaneously
It carries out image input, divide the operations such as visual field acquisition image.Entire wide-angle apparatus system includes that image, the wide-angle of input object plane are saturating
Mirror, controllable diaphragm, CCD image camera, FPGA.The image for inputting object plane passes through wide-angle lens and field stop is on CCD.
Step 2：It is moved left and right by FPGA real-time control field stop and size, it is synchronous with the CCD time for exposure, according to
Every field angle for increasing by 10 ° carries out dividing acquisition point view field image.
Step 3：CCD acquires Video stream information, and framing image is passed in FPGA frame by frame.FPGA include control module and
Distortion correction module is respectively stored into the block RAM inside FPGA according to field angle.
Step 4：It is correcting distorted by the bearing calibration based on bilinear interpolation in image distortion correction module, and pass
Enter image co-registration module.
Step 5：Point view field image that distortion correction module has corrected is merged in image co-registration module, for each
Visual field merges image after the recovery of each visual field according to visual field division, and reconstruct obtains blending image.
For the image obtained after fusion, median filtering and mean filter are carried out to it to remove noise therein.
Step 6：It is shown in image and software is write by serial ports and FPGA by using host computer with parameter control module
Communication, the display of image after being responsible for original image and restoring.
Claims (6)
1. a kind of wide-angle lens automatic distortion correction device, including wide-angle lens parameter collection module, image are shown and parameter control
Molding block, FPGA control processing module, image capture module, divides view field image Fusion Module, is controllable wide angle picture correction module
Diaphragm control module, it is characterised in that：
The signal output end of wide-angle lens acquisition parameter module and image capture module controls processing module input terminal phase with FPGA
Even, FPGA control processing module output end is shown with image and parameter control module, controllable diaphragm control module input terminal respectively
It is connected, wide angle picture correction module output end is connected with a point view field image Fusion Module input terminal.
2. a kind of wide-angle lens automatic distortion correction device according to claim 1, which is characterized in that in described image
It is inserted into controllable diaphragm between the wide-angle lens and CCD of acquisition module, controls size and lateral position.
3. a kind of wide-angle lens automatic distortion correction device and method according to claim 1, which is characterized in that described
Wide angle picture correction module uses FPGA hardware circuit with view field image Fusion Module is divided.
4. a kind of wide-angle lens automatic distortion correction method, which is characterized in that include the following steps：
Step 1：Wide-angle lens parameter collection module acquires lens parameters in advance, is stored in FPGA；
Step 2：Controllable diaphragm control module control field stop moves left and right and size, is presented on image information point visual field
It is synchronous with the CCD time for exposure on CCD, carry out a point visual field since 60 ° of field angle and acquire, according to it is every increase by 10 ° field angle into
Row divides acquisition and divides view field image；
Step 3：Using ccd sensor array I2C bus is first passed through in image capture module video flowing is placed in RAM deposit
Storage, then the fault image data in RAM pass through I/O control port again and are passed to the image of each frame in FPGA frame by frame；
Step 4：In wide angle picture correction module, comprising look-up table means, image data buffer module, geometric correction module,
Gray correction module；Every frame figure under different visual fields is corrected by FPGA respectively using the correcting algorithm based on bilinear interpolation
Picture；
Step 5：Point view field image after correction such as is merged, and is filtered at the behaviour by point view field image Fusion Module
Make；
Step 6：Image and relevant parameter after image display display correction.
5. wide-angle lens automatic distortion correction method according to claim 4, it is characterised in that：
In step 5, for the image obtained after fusion, median filtering and mean filter are carried out to it to remove therein make an uproar
Sound.
6. wide-angle lens automatic distortion correction method according to claim 4, it is characterised in that：It further include manually controlling mould
Formula, to FPGA configured transmission to control hardware device under MANUAL CONTROL mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810780492.9A CN108900734B (en) | 2018-07-16 | 2018-07-16 | Wide-angle lens distortion automatic correction device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810780492.9A CN108900734B (en) | 2018-07-16 | 2018-07-16 | Wide-angle lens distortion automatic correction device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108900734A true CN108900734A (en) | 2018-11-27 |
| CN108900734B CN108900734B (en) | 2020-12-08 |
Family
ID=64349789
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810780492.9A Active CN108900734B (en) | 2018-07-16 | 2018-07-16 | Wide-angle lens distortion automatic correction device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108900734B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109712058A (en) * | 2018-12-03 | 2019-05-03 | 深圳前海达闼云端智能科技有限公司 | Dataset acquisition device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070133107A1 (en) * | 2005-12-09 | 2007-06-14 | Konica Minolta Opto, Inc. | Ultra wide angle imaging optical system, ultra wide angle imaging lens device, and image sensing apparatus |
| CN201690518U (en) * | 2010-01-21 | 2010-12-29 | 天津理工大学 | Embedded fisheye image real-time distortion correction device based on FPGA |
| CN104360467A (en) * | 2014-11-29 | 2015-02-18 | 福建福光数码科技有限公司 | Large-target-surface high-precision mold high-definition zooming monitoring lens |
| JP2017116594A (en) * | 2015-12-21 | 2017-06-29 | カンタツ株式会社 | Image capturing lens |
| CN107577032A (en) * | 2017-09-19 | 2018-01-12 | 舜宇光学(中山)有限公司 | Low distortion wide-angle lens |
-
2018
- 2018-07-16 CN CN201810780492.9A patent/CN108900734B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070133107A1 (en) * | 2005-12-09 | 2007-06-14 | Konica Minolta Opto, Inc. | Ultra wide angle imaging optical system, ultra wide angle imaging lens device, and image sensing apparatus |
| CN201690518U (en) * | 2010-01-21 | 2010-12-29 | 天津理工大学 | Embedded fisheye image real-time distortion correction device based on FPGA |
| CN104360467A (en) * | 2014-11-29 | 2015-02-18 | 福建福光数码科技有限公司 | Large-target-surface high-precision mold high-definition zooming monitoring lens |
| JP2017116594A (en) * | 2015-12-21 | 2017-06-29 | カンタツ株式会社 | Image capturing lens |
| CN107577032A (en) * | 2017-09-19 | 2018-01-12 | 舜宇光学(中山)有限公司 | Low distortion wide-angle lens |
Non-Patent Citations (1)
| Title |
|---|
| 汤旭涛: "广角摄像头视频图像实时校正系统设计", 《中国优秀硕士学位论文全文数据库》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109712058A (en) * | 2018-12-03 | 2019-05-03 | 深圳前海达闼云端智能科技有限公司 | Dataset acquisition device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108900734B (en) | 2020-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210266516A1 (en) | Primary and auxiliary image capture devices for image processing and related methods | |
| EP4020958B1 (en) | Frame synchronization in a dual-aperture camera system | |
| US10764496B2 (en) | Fast scan-type panoramic image synthesis method and device | |
| CN112261387B (en) | Image fusion method and device for multi-camera module, storage medium and mobile terminal | |
| CN108848354B (en) | VR content camera system and working method thereof | |
| US10728529B2 (en) | Synchronization of frame captures from multiple cameras with different fields of capture | |
| US8964043B2 (en) | Imaging apparatus and control method thereof | |
| US10275584B2 (en) | Method and system for unlocking mobile terminal on the basis of a high-quality eyeprint image | |
| CN111818304B (en) | Image fusion method and device | |
| CN103379344B (en) | Semiconductor equipment, electronic installation and image processing method | |
| CN106600548A (en) | Fish-eye camera image processing method and system | |
| CN105701809A (en) | Flat-field correction method based on line-scan digital camera scanning | |
| CN114339042A (en) | Image processing method and device based on multiple cameras and computer readable storage medium | |
| CN108900734A (en) | A kind of wide-angle lens automatic distortion correction device and method | |
| CN109089048B (en) | Multi-lens panoramic linkage device and method | |
| CN106686323B (en) | Imaging method and system of high-speed CMOS camera | |
| CN205647708U (en) | System for use hardware circuit to correct and concatenation image that fisheye lens becomes is real -time | |
| CN109309784B (en) | Mobile terminal | |
| CN115984124A (en) | Method and device for de-noising and super-resolution of neuromorphic pulse signals | |
| CN111652967B (en) | Three-dimensional reconstruction system and method based on front-back fusion imaging | |
| US20220286611A1 (en) | Electrical image stabilization (eis)-assisted digital image stabilization (dis) | |
| CN204350148U (en) | The multiple dimensioned real-time monitor video splicing apparatus of distinguished point based | |
| US20110267434A1 (en) | Camera device, arrangement and system | |
| WO2022135359A1 (en) | Dual-mode image signal processor and dual-mode image signal processing system | |
| CN111654676B (en) | Cooperative shooting system and shooting method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20181127 Assignee: ZHEJIANG TIMES MEASURE TECHNOLOGY Co.,Ltd. Assignor: HANGZHOU DIANZI University Contract record no.: X2023980048728 Denomination of invention: A wide-angle lens distortion automatic correction device and method Granted publication date: 20201208 License type: Common License Record date: 20231128 |
|
| EE01 | Entry into force of recordation of patent licensing contract |