CN108765301B - An optical system and its distortion correction method and system - Google Patents

An optical system and its distortion correction method and system Download PDF

Info

Publication number
CN108765301B
CN108765301B CN201810258291.2A CN201810258291A CN108765301B CN 108765301 B CN108765301 B CN 108765301B CN 201810258291 A CN201810258291 A CN 201810258291A CN 108765301 B CN108765301 B CN 108765301B
Authority
CN
China
Prior art keywords
image
visible light
infrared
optical system
collimator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810258291.2A
Other languages
Chinese (zh)
Other versions
CN108765301A (en
Inventor
景文博
刘健
王晓曼
罗秦
刘智
王春艳
刘鹏
赵海丽
姜会林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changchun University of Science and Technology
Original Assignee
Changchun University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changchun University of Science and Technology filed Critical Changchun University of Science and Technology
Priority to CN201810258291.2A priority Critical patent/CN108765301B/en
Publication of CN108765301A publication Critical patent/CN108765301A/en
Application granted granted Critical
Publication of CN108765301B publication Critical patent/CN108765301B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/80Geometric correction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10048Infrared image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

本发明公开了一种光学系统及其畸变校正方法及系统。所述畸变校正方法包括:获取平行光管产生平行光时的第一平行光管透镜焦距;根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像;以入射光的光轴为Z轴,垂直于光轴的平面为XOY面,建立图像坐标系;获取网格板内的单位正方形的边长;所述网格板包括多个单位正方形;根据所述边长确定所述单位正方形对应的像素点;根据所述像素点以及所述图像坐标系确定坐标变换矩阵;根据所述可见光图像以及所述变换矩阵确定可见光无畸变图像;根据所述近红外图像以及所述变换矩阵确定近红外无畸变图像。采用本发明所提供的光学系统及其畸变校正方法及系统能够降低光学系统的测量误差。

Figure 201810258291

The invention discloses an optical system and its distortion correction method and system. The distortion correction method includes: acquiring the focal length of the first collimator lens when the collimator produces parallel light; determining the visible light image and the near-infrared image according to the focal length of the first collimator lens; taking the optical axis of the incident light as Z axis, the plane perpendicular to the optical axis is the XOY plane, and the image coordinate system is established; the side length of the unit square in the grid plate is obtained; the grid plate includes a plurality of unit squares; the unit square is determined according to the side length. corresponding pixel points; determine a coordinate transformation matrix according to the pixel points and the image coordinate system; determine a visible light undistorted image according to the visible light image and the transformation matrix; determine a near-infrared image according to the near-infrared image and the transformation matrix Infrared distortion-free images. Using the optical system and the distortion correction method and system provided by the present invention can reduce the measurement error of the optical system.

Figure 201810258291

Description

一种光学系统及其畸变校正方法及系统An optical system and its distortion correction method and system

技术领域technical field

本发明涉及光学畸变校正技术领域,特别是涉及一种光学系统及其畸变校正方法及系统。The invention relates to the technical field of optical distortion correction, in particular to an optical system and a distortion correction method and system thereof.

背景技术Background technique

激光半主动末制导武器系统由照射器和制导弹药组成,照射器发射激光照射被攻击目标,制导弹药依据照射光斑识别并打击目标;激光照射性能是评价武器系统的重要指标,激光照射性能空间特性监测系统是对移动的漫反射靶板进行捕获,通过单个可见光相机进行测量。但是单个可见光相机降级使用进行测量时,由于可见光相机的成像光谱响应范围只在可见光范围有较高的量子效率,对1064nm的近红外光虽然有响应,但是量子效率较低,所以单个可见光相机对靶板(可见光)和光斑(近红外)同时成像时,单个可见光相机必须要有较大的积分时间才能成像,因此会引入较大背景噪声,光斑图像信噪比低,造成光学系统测量误差大。The laser semi-active terminal-guided weapon system consists of an illuminator and a guided munition. The illuminator emits laser light to illuminate the attacked target, and the guided munition recognizes and strikes the target according to the irradiation spot; the laser irradiation performance is an important indicator for evaluating the weapon system, and the spatial characteristics of the laser irradiation performance The monitoring system captures the moving diffuse reflection target and measures it with a single visible light camera. However, when a single visible light camera is downgraded for measurement, since the imaging spectral response range of the visible light camera only has a high quantum efficiency in the visible light range, although it has a response to the near-infrared light of 1064 nm, the quantum efficiency is low, so a single visible light camera has a low quantum efficiency. When the target plate (visible light) and the spot (near-infrared) are imaged at the same time, a single visible light camera must have a large integration time to image, so a large background noise will be introduced, and the signal-to-noise ratio of the spot image will be low, resulting in a large measurement error of the optical system. .

发明内容SUMMARY OF THE INVENTION

本发明的目的是提供一种光学系统及其畸变校正方法及系统,以解决现有技术中光学系统测量误差大的问题。The purpose of the present invention is to provide an optical system and its distortion correction method and system, so as to solve the problem of large measurement error of the optical system in the prior art.

为实现上述目的,本发明提供了如下方案:For achieving the above object, the present invention provides the following scheme:

一种光学系统,包括:光源,在所述光源的一侧依次设有平行光管以及摄远光学系统,所述摄远光学系统与计算机相连接;An optical system, comprising: a light source, a collimator light pipe and a telephoto optical system are sequentially arranged on one side of the light source, and the telephoto optical system is connected with a computer;

所述平行光管内设有网格板;The parallel light pipe is provided with a grid plate;

所述光源、所述平行光管以及所述摄远光学系统的底部分别设有调整台;所述调整台用于调整所述光源、所述平行光管以及所述摄远光学系统的位置;The light source, the collimator light pipe and the bottom of the telephoto optical system are respectively provided with an adjustment table; the adjustment table is used to adjust the positions of the light source, the collimator light pipe and the telephoto optical system;

所述摄远光学系统包括卡塞格林反射结构、透镜、分光棱镜、可见光相机、滤光片、反射镜以及近红外相机;所述透镜包括第一透镜、第二透镜以及第三透镜;所述摄远光学系统接收所述光源所发射的光线,由所述卡塞格林反射结构经由所述第一透镜传播到所述分光棱镜上;所述分光棱镜将所述光线分为两路,第一路光线通过第二透镜由所述可见光相机所采集,调整所述网格板以及所述摄远光学系统的位置,得到可见光图像;第二路光线通过所述滤波片,再经所述反射镜将所述第二路光线通过所述第三透镜由所述近红外相机所采集,再次调整所述网格板以及所述摄远光学系统的位置,得到近红外图像;对所述可见光图像以及所述近红外图像进行坐标系转换,得到可见光无畸变图像以及近红外无畸变图像。The telephoto optical system includes a Cassegrain reflection structure, a lens, a beam splitter prism, a visible light camera, a filter, a reflection mirror and a near-infrared camera; the lens includes a first lens, a second lens and a third lens; the The telephoto optical system receives the light emitted by the light source, and is transmitted to the beam splitting prism by the Cassegrain reflection structure through the first lens; the beam splitting prism divides the light into two paths, the first The path light is collected by the visible light camera through the second lens, and the positions of the grid plate and the telephoto optical system are adjusted to obtain a visible light image; the second path light passes through the filter, and then passes through the reflector. The second path of light is collected by the near-infrared camera through the third lens, and the positions of the grid plate and the telephoto optical system are adjusted again to obtain a near-infrared image; The coordinate system conversion of the near-infrared image is performed to obtain an undistorted visible light image and a near-infrared undistorted image.

一种光学系统畸变校正方法,所述畸变校正方法应用于权利要求1的一种光学系统,所述畸变校正方法包括:A distortion correction method for an optical system, the distortion correction method being applied to an optical system of claim 1, the distortion correction method comprising:

获取平行光管产生平行光时的第一平行光管透镜焦距;Obtain the focal length of the first collimator lens when the collimator produces parallel light;

根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像;Determine the visible light image and the near-infrared image according to the focal length of the first collimator lens;

以入射光的光轴为Z轴,垂直于光轴的平面为XOY面,建立图像坐标系;Taking the optical axis of the incident light as the Z axis and the plane perpendicular to the optical axis as the XOY plane, establish the image coordinate system;

获取网格板内的单位正方形的边长;所述网格板包括多个单位正方形;Obtain the side length of the unit square in the grid plate; the grid plate includes a plurality of unit squares;

根据所述边长确定所述单位正方形对应的像素点;Determine the pixel point corresponding to the unit square according to the side length;

根据所述像素点以及所述图像坐标系确定坐标变换矩阵;所述坐标变换矩阵用于将畸变图像变换到无畸变图像;所述畸变图像为可见光图像以及近红外图像;所述无畸变图像包括可见光无畸变图像以及近红外无畸变图像;A coordinate transformation matrix is determined according to the pixel points and the image coordinate system; the coordinate transformation matrix is used to transform the distorted image into an undistorted image; the distorted image is a visible light image and a near-infrared image; the undistorted image includes Visible light distortion-free images and near-infrared distortion-free images;

根据所述可见光图像以及所述变换矩阵确定可见光无畸变图像;determining an undistorted visible light image according to the visible light image and the transformation matrix;

根据所述近红外图像以及所述变换矩阵确定近红外无畸变图像。A near-infrared undistorted image is determined according to the near-infrared image and the transformation matrix.

可选的,所述根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像,具体包括:Optionally, the determining of the visible light image and the near-infrared image according to the focal length of the first collimator lens specifically includes:

根据所述第一平行光管透镜焦距确定所述平行光管的可见光调整距离;Determine the visible light adjustment distance of the collimator according to the focal length of the first collimator lens;

根据所述可见光调整距离确定可见光图像。A visible light image is determined according to the visible light adjustment distance.

可选的,所述根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像,具体包括:Optionally, the determining of the visible light image and the near-infrared image according to the focal length of the first collimator lens specifically includes:

根据所述第一平行光管透镜焦距确定第二平行光管透镜焦距;determining the focal length of the second collimator lens according to the focal length of the first collimator lens;

根据所述第二平行光管透镜焦距确定所述平行光管的近红外调整距离;determining the near-infrared adjustment distance of the collimator according to the focal length of the second collimator lens;

根据所述近红外调整距离确定近红外图像。A near-infrared image is determined according to the near-infrared adjustment distance.

可选的,所述根据所述边长确定所述单位正方形对应的像素点,具体包括:Optionally, the determining the pixel point corresponding to the unit square according to the side length specifically includes:

根据所述边长,利用小孔成像模型确定所述单位正方形对应的像素点。According to the side length, a pinhole imaging model is used to determine the pixel point corresponding to the unit square.

可选的,所述根据所述像素点以及所述图像坐标系确定坐标变换矩阵,具体包括:Optionally, the determining a coordinate transformation matrix according to the pixel points and the image coordinate system specifically includes:

获取世界坐标系;Get the world coordinate system;

根据所述世界坐标系以及所述图像坐标系确定世界-图像变换矩阵;determining a world-image transformation matrix according to the world coordinate system and the image coordinate system;

根据所述像素点以及所述世界-图像变换矩阵确定坐标变换矩阵。A coordinate transformation matrix is determined according to the pixel points and the world-image transformation matrix.

一种光学系统畸变校正系统,包括:An optical system distortion correction system, comprising:

第一平行光管透镜焦距获取模块,用于获取平行光管产生平行光时的第一平行光管透镜焦距;The first collimator lens focal length acquiring module is used to acquire the focal length of the first collimator lens when the collimator generates parallel light;

图像确定模块,用于根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像;an image determination module, configured to determine a visible light image and a near-infrared image according to the focal length of the first collimator lens;

图像坐标系建立模块,用于以入射光的光轴为Z轴,垂直于光轴的平面为XOY面,建立图像坐标系;The image coordinate system establishment module is used to establish the image coordinate system with the optical axis of the incident light as the Z axis and the plane perpendicular to the optical axis as the XOY plane;

边长获取模块,用于获取网格板内的单位正方形的边长;所述网格板包括多个单位正方形;a side length acquiring module, used for acquiring the side length of a unit square in the grid board; the grid board includes a plurality of unit squares;

像素点确定模块,用于根据所述边长确定所述单位正方形对应的像素点;a pixel point determination module, configured to determine the pixel point corresponding to the unit square according to the side length;

坐标变换矩阵确定模块,用于根据所述像素点以及所述图像坐标系确定坐标变换矩阵;所述坐标变换矩阵用于将畸变图像变换到无畸变图像;所述畸变图像为可见光图像以及近红外图像;所述无畸变图像包括可见光无畸变图像以及近红外无畸变图像;a coordinate transformation matrix determination module, configured to determine a coordinate transformation matrix according to the pixel points and the image coordinate system; the coordinate transformation matrix is used to transform a distorted image into an undistorted image; the distorted image is a visible light image and a near-infrared image an image; the undistorted image includes a visible light undistorted image and a near-infrared undistorted image;

可见光无畸变图像确定模块,用于根据所述可见光图像以及所述变换矩阵确定可见光无畸变图像;a visible light undistorted image determination module, configured to determine a visible light undistorted image according to the visible light image and the transformation matrix;

近红外无畸变图像确定模块,用于根据所述近红外图像以及所述变换矩阵确定近红外无畸变图像。A near-infrared undistorted image determination module, configured to determine a near-infrared undistorted image according to the near-infrared image and the transformation matrix.

可选的,所述图像确定模块具体包括:Optionally, the image determination module specifically includes:

可见光调整距离确定单元,用于根据所述第一平行光管透镜焦距确定所述平行光管的可见光调整距离;a visible light adjustment distance determining unit, configured to determine the visible light adjustment distance of the collimator according to the focal length of the first collimator lens;

可见光图像确定单元,用于根据所述可见光调整距离确定可见光图像。A visible light image determination unit, configured to determine a visible light image according to the visible light adjustment distance.

可选的,所述图像确定模块具体包括:Optionally, the image determination module specifically includes:

第二平行光管透镜焦距确定单元,用于根据所述第一平行光管透镜焦距确定第二平行光管透镜焦距;a second collimator lens focal length determining unit, configured to determine the second collimator lens focal length according to the first collimator lens focal length;

近红外调整距离确定单元,用于根据所述第二平行光管透镜焦距确定所述平行光管的近红外调整距离;a near-infrared adjustment distance determining unit, configured to determine the near-infrared adjustment distance of the collimator according to the focal length of the second collimator lens;

近红外图像确定单元,用于根据所述近红外调整距离确定近红外图像。A near-infrared image determination unit, configured to determine a near-infrared image according to the near-infrared adjustment distance.

可选的,所述像素点确定模块具体包括:Optionally, the pixel point determination module specifically includes:

像素点确定单元,用于根据所述边长,利用小孔成像模型确定所述单位正方形对应的像素点。The pixel point determination unit is configured to use the pinhole imaging model to determine the pixel point corresponding to the unit square according to the side length.

根据本发明提供的具体实施例,本发明公开了以下技术效果:本发明提供了一种光学系统及其畸变校正方法及系统。所述光学系统设有一个可见光相机以及一个近红外相机,通过对两个相机所获取的图像进行校正,得到校正后的无畸变图像,相对于现有技术中采用单个可见光相机的成像技术,能够大大缩短成像时间,且降低光学系统的测量误差。According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects: the present invention provides an optical system and a distortion correction method and system thereof. The optical system is provided with a visible light camera and a near-infrared camera. By correcting the images obtained by the two cameras, a corrected image without distortion can be obtained. Compared with the imaging technology using a single visible light camera in the prior art, it can The imaging time is greatly shortened, and the measurement error of the optical system is reduced.

本发明所提供的光学系统的畸变校正方法及系统,根据网格板内的单位正方形确定坐标变换矩阵,从而将可见光相机所得到的可见光图像变换成可见光无畸变图像,并将近红外相机所得到的近红外图像变换成近红外无畸变图像,从而降低光学系统的测量误差。The distortion correction method and system of the optical system provided by the present invention determine the coordinate transformation matrix according to the unit square in the grid plate, thereby transforming the visible light image obtained by the visible light camera into a visible light undistorted image, and converting the image obtained by the near-infrared camera. The near-infrared image is transformed into a near-infrared undistorted image, thereby reducing the measurement error of the optical system.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present invention. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative labor.

图1为本发明所提供的光学系统结构图;1 is a structural diagram of an optical system provided by the present invention;

图2为本发明所提供的第一标定图像;Fig. 2 is the first calibration image provided by the present invention;

图3为本发明所提供的摄远光学系统结构图;3 is a structural diagram of a telephoto optical system provided by the present invention;

图4为本发明所提供的光学畸变校正方法流程图;4 is a flowchart of an optical distortion correction method provided by the present invention;

图5为本发明所提供的坐标系变换关系图;Fig. 5 is the coordinate system transformation relation diagram provided by the present invention;

图6为本发明所提供的第一采集图像示意图;6 is a schematic diagram of a first captured image provided by the present invention;

图7为本发明所提供的图6中的第一采集图像经过畸变校正后的图像示意图;FIG. 7 is a schematic diagram of an image after distortion correction of the first captured image in FIG. 6 provided by the present invention;

图8为本发明所提供的标记图6中的第一采集图像所要采集的坐标点标记图;Fig. 8 is the coordinate point marking diagram to be collected to mark the first collected image in Fig. 6 provided by the present invention;

图9为本发明所提供的近红外图像示意图;9 is a schematic diagram of a near-infrared image provided by the present invention;

图10为本发明所提供的图9中的近红外图像经过畸变校正后的图像示意图;10 is a schematic diagram of the near-infrared image in FIG. 9 after distortion correction provided by the present invention;

图11为本发明所提供的标记图9中的近红外图像所要采集的坐标点标记图Fig. 11 is a marker diagram of coordinate points to be collected to mark the near-infrared image in Fig. 9 provided by the present invention

图12为本发明所提供的光学系统畸变校正系统结构图。FIG. 12 is a structural diagram of an optical system distortion correction system provided by the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

本发明的目的是提供一种光学系统及其畸变校正方法及系统,以降低光学系统的测量误差。The purpose of the present invention is to provide an optical system and its distortion correction method and system to reduce the measurement error of the optical system.

为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本发明作进一步详细的说明。In order to make the above objects, features and advantages of the present invention more clearly understood, the present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments.

图1为本发明所提供的光学系统结构图,如图1所示,一种光学系统,包括:光源1,在所述光源1的一侧依次设有平行光管2以及摄远光学系统3,所述摄远光学系统3与计算机4相连接;所述平行光管2内设有网格板5;所述光源1、所述平行光管2以及所述摄远光学系统3的底部分别设有调整台;所述调整台用于调整所述光源1、所述平行光管2以及所述摄远光学系统3的位置;所述调整台包括第一调整台6、第二调整台7、第三调整台8,其中,如图1所示,所述第一调整台6、第二调整台7以及第三调整台8与光源1、平行光管2以及摄远光学系统3一一对应。获取图像之前,首先调整所述光学系统内各个设备的位置,使得所述网格板5中心点成像于可见光图像的中心,如图2所示。FIG. 1 is a structural diagram of an optical system provided by the present invention. As shown in FIG. 1, an optical system includes: a light source 1, and a collimator light pipe 2 and a telephoto optical system 3 are arranged on one side of the light source 1 in sequence. , the telephoto optical system 3 is connected with the computer 4; the parallel light pipe 2 is provided with a grid plate 5; the bottom of the light source 1, the collimated light pipe 2 and the telephoto optical system 3 are respectively There is an adjustment table; the adjustment table is used to adjust the positions of the light source 1, the collimator light pipe 2 and the telephoto optical system 3; the adjustment table includes a first adjustment table 6 and a second adjustment table 7 , the third adjustment stage 8, wherein, as shown in FIG. 1, the first adjustment stage 6, the second adjustment stage 7 and the third adjustment stage 8 are connected with the light source 1, the collimator light pipe 2 and the telephoto optical system 3 one by one correspond. Before acquiring an image, first adjust the positions of each device in the optical system so that the center point of the grid plate 5 is imaged in the center of the visible light image, as shown in FIG. 2 .

图3为本发明所提供的摄远光学系统结构图,如图3所示,所述摄远光学系统包括卡塞格林反射结构3-1、透镜、分光棱镜3-2、可见光相机3-3、滤光片3-4、反射镜3-5以及近红外相机3-6;所述透镜包括第一透镜、第二透镜以及第三透镜;所述摄远光学系统接收所述光源1所发射的光线,由所述卡塞格林反射结构3-1经由所述第一透镜3-7传播到所述分光棱镜3-2上;所述分光棱镜3-2将所述光线分为两路,第一路光线通过第二透镜3-8由所述可见光相机3-3所采集,调整所述网格板5以及所述摄远光学系统的位置,得到可见光图像;第二路光线通过所述滤光片3-4以及所述反射镜3-5,经所述反射镜3-5将所述第二路光线通过所述第三透镜3-9由所述近红外相机3-6所采集,再次调整所述网格板5以及所述摄远光学系统的位置,得到近红外图像;对所述可见光图像以及所述近红外图像进行坐标系转换,得到可见光无畸变图像以及近红外无畸变图像。FIG. 3 is a structural diagram of a telephoto optical system provided by the present invention. As shown in FIG. 3 , the telephoto optical system includes a Cassegrain reflection structure 3-1, a lens, a beam splitter prism 3-2, and a visible light camera 3-3 , a filter 3-4, a mirror 3-5 and a near-infrared camera 3-6; the lens includes a first lens, a second lens and a third lens; the telephoto optical system receives the light emitted by the light source 1 The light is transmitted by the Cassegrain reflection structure 3-1 to the beam splitting prism 3-2 via the first lens 3-7; the beam splitting prism 3-2 divides the light into two paths, The first line of light is collected by the visible light camera 3-3 through the second lens 3-8, and the positions of the grid plate 5 and the telephoto optical system are adjusted to obtain a visible light image; the second line of light passes through the The filter 3-4 and the reflector 3-5, through the reflector 3-5, the second path of light is collected by the near-infrared camera 3-6 through the third lens 3-9 , adjust the position of the grid plate 5 and the telephoto optical system again to obtain a near-infrared image; perform coordinate system conversion on the visible light image and the near-infrared image to obtain an undistorted visible light image and a near-infrared undistorted image image.

采用本发明所提供的光学系统,能够缩短成像时间,降低背景噪声,提高光斑图像信噪比,从而降低光学系统的测量误差,提高光学系统的测量精度。The optical system provided by the invention can shorten the imaging time, reduce the background noise, and improve the signal-to-noise ratio of the spot image, thereby reducing the measurement error of the optical system and improving the measurement accuracy of the optical system.

根据本发明所提供的光学系统,采用平行光管等效距离L处光源,两个相机对应等效L光源的网格板5调整位置的计算如下:According to the optical system provided by the present invention, the light source at the equivalent distance L of the collimator is adopted, and the adjustment position of the grid plate 5 corresponding to the equivalent L light source of the two cameras is calculated as follows:

其中,所用平行光管为可调视度式平行光管,产生平行光时焦距为f',平行光管微调标尺刻度为r。Among them, the collimator used is an adjustable collimator, the focal length is f' when the parallel light is generated, and the scale of the fine-tuning scale of the collimator is r.

图4为本发明所提供的光学畸变校正方法流程图,如图4所示,一种光学系统畸变校正方法,包括:FIG. 4 is a flowchart of an optical distortion correction method provided by the present invention. As shown in FIG. 4 , a method for correcting optical system distortion includes:

步骤401:获取平行光管产生平行光时的第一平行光管透镜焦距。Step 401: Obtain the focal length of the first collimator lens when the collimator produces parallel light.

已知第一平行光管透镜焦距与折射率关系公式为

Figure BDA0001609556580000071
其中k为比例常系数,n为空气中折射率,n'为可见光相机透镜折射率。It is known that the relationship between the focal length of the first collimator lens and the refractive index is as follows
Figure BDA0001609556580000071
Where k is the proportional constant coefficient, n is the refractive index in air, and n' is the refractive index of the visible light camera lens.

步骤402:根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像。Step 402: Determine a visible light image and a near-infrared image according to the focal length of the first collimator lens.

由步骤401已知参数,f',n,n'可以得到:

Figure BDA0001609556580000072
由此计算第二平行光管透镜焦距,此时,空气中折射率n,近红外光谱范围透镜折射率n'IR,k已知,可得
Figure BDA0001609556580000073
其中f'IR为产生近红外平行光等效目标源时,平行光管调整后的第二平行光管透镜焦距。From the known parameters in step 401, f', n, n' can be obtained:
Figure BDA0001609556580000072
From this, the focal length of the second collimator lens is calculated. At this time, the refractive index n in the air and the refractive index n' IR of the lens in the near-infrared spectral range are known, and k can be obtained.
Figure BDA0001609556580000073
Wherein f' IR is the focal length of the second collimator lens adjusted by the collimator when the near-infrared parallel light equivalent target source is generated.

成像公式:

Figure BDA0001609556580000074
等效v=L网格板距离平行光管的距离为
Figure BDA0001609556580000075
其中,f是焦距,v为像距(就是等效距离L),u是物距,就是网格板距离平行光管透镜的距离。Imaging formula:
Figure BDA0001609556580000074
The distance between the equivalent v=L grid plate and the collimator light pipe is
Figure BDA0001609556580000075
Among them, f is the focal length, v is the image distance (that is, the equivalent distance L), and u is the object distance, which is the distance between the grid plate and the collimator lens.

由成像公式计算可得可见光时,网格板距离平行光管透镜的距离

Figure BDA0001609556580000076
近红外光时,网格板距离平行光管透镜的距离
Figure BDA0001609556580000077
When the visible light is calculated by the imaging formula, the distance between the grid plate and the collimator lens
Figure BDA0001609556580000076
For near-infrared light, the distance between the grid plate and the collimator lens
Figure BDA0001609556580000077

因此,相对于平行光管焦距调整相对位置为:Therefore, the relative position adjustment relative to the focal length of the collimator is:

可见光时:ΔuVis=uVis-f';When visible light: Δu Vis = u Vis -f';

近红外光时:ΔuIR=uIR-f'。For near-infrared light: Δu IR =u IR -f'.

对应平行光管微调标尺刻度为:The corresponding collimator fine-tuning scale scale is:

可见光时:rVis=r+ΔuVisIn visible light: r Vis =r+Δu Vis ;

近红外光时:rIR=r+ΔuIRFor near-infrared light: r IR =r+Δu IR .

调节网格板位置至rVis,使可见光相机成像清晰,采集可见光图像;再次调节网格板位置至rIR,使近红外相机成像清晰,采集近红外图像。Adjust the position of the grid plate to r Vis to make the visible light camera image clear and collect the visible light image; adjust the position of the grid plate to r IR again to make the near-infrared camera image clear and collect the near-infrared image.

旋转摄远光学系统,在每次旋转过程中图像中心轴不变,以网格板中心成像在两相机视场中心、网格线与水平线角度逐渐增大为调整依据。When rotating the telephoto optical system, the central axis of the image remains unchanged during each rotation, and the adjustment is based on the fact that the center of the grid plate is imaged in the center of the field of view of the two cameras, and the angle between the grid line and the horizontal line gradually increases.

循环调节网格板位置,调整摄远光学系统,使可见光相机和近红外相机获得不同拍摄角度的图像,并重新采集多对不同角度的可见光图像以及近红外图像,且循环次数N大于等于14次(次数依据最终要求的未知数个数、及每幅图像能列出的方程个数决定,以及重投影误差来计算)。The position of the grid plate is adjusted cyclically, and the telephoto optical system is adjusted, so that the visible light camera and the near-infrared camera can obtain images from different shooting angles, and re-collect multiple pairs of visible light images and near-infrared images of different angles, and the number of cycles N is greater than or equal to 14 times (The number of times is determined by the final required number of unknowns, the number of equations that can be listed per image, and the reprojection error).

步骤403:以入射光的光轴为Z轴,垂直于光轴的平面为XOY面,建立图像坐标系。Step 403: Taking the optical axis of the incident light as the Z axis, and the plane perpendicular to the optical axis as the XOY plane, establish an image coordinate system.

如图5所示,以入射光的光轴为Z轴,垂直于光轴的平面为XOY面,建立入射光坐标系O-XCYCZC;以可见光相机的光轴为Z轴,垂直于可见光入射光轴为XOY面,建立可见光相机坐标系OC1-XC1YC1ZC1;以近红外相机的光轴为Z轴,垂直于近红外入射光轴为XOY面,建立近红外相机坐标系OC2-XC2YC2ZC2;图像像素坐标系:以二维图像左上角为坐标原点,横轴为u轴,纵轴为v轴,建立图像像素坐标系;图像物理坐标系:以图像中心点为原点,横轴为x轴,纵轴为y轴。世界坐标系O-XWYWZW与入射光坐标系O-XCYCZC是旋转与平移关系,需要6个参数;P点是世界坐标系O-XWYWZW中任意点,通过入射光坐标系O-XCYCZC将可见光相机坐标系OC1-XC1YC1ZC1和近红外相机坐标系OC2-XC2YC2ZC2联系起来,需要12个参数,其中,三维坐标系变换为旋转和平移关系,旋转和平移分别3个参数,共6个参数;因此,入射光坐标系O-XCYCZC与可见光相机坐标系OC1-XC1YC1ZC1间为旋转与平移关系,共6个参数;同理,入射光坐标系O-XCYCZC与近红外相机坐标系OC2-XC2YC2ZC2间也需要6个参数;如图5所示,共轴部分就是入射光轴,就是入射光坐标系O-XCYCZC的ZC轴。到达两相机的光线,在分光棱镜之前为同一光线,通过这个共轴部分将两个相机联系起来了。As shown in Figure 5, take the optical axis of the incident light as the Z axis, and the plane perpendicular to the optical axis as the XOY plane, establish the incident light coordinate system O-XCYCZC; take the optical axis of the visible light camera as the Z axis, perpendicular to the visible light incident light The axis is the XOY plane, and the visible camera coordinate system OC1-XC1YC1ZC1 is established; the optical axis of the near-infrared camera is the Z axis, and the XOY plane is perpendicular to the near-infrared incident optical axis, and the near-infrared camera coordinate system OC2-XC2YC2ZC2 is established; the image pixel coordinate system: Taking the upper left corner of the two-dimensional image as the coordinate origin, the horizontal axis is the u axis, and the vertical axis is the v axis, the image pixel coordinate system is established; the image physical coordinate system: the image center point is the origin, the horizontal axis is the x axis, and the vertical axis is y. axis. The world coordinate system OX W Y W Z W and the incident light coordinate system OX C Y C Z C are the relationship between rotation and translation, which requires 6 parameters; point P is any point in the world coordinate system OX W Y W Z W , through the incident light The coordinate system OX C Y C Z C connects the visible light camera coordinate system O C1 -X C1 Y C1 Z C1 with the near-infrared camera coordinate system O C2 -X C2 Y C2 Z C2 , and requires 12 parameters, among which, the three-dimensional coordinate system It is transformed into a rotation and translation relationship, and the rotation and translation have 3 parameters respectively, a total of 6 parameters; therefore, between the incident light coordinate system OX C Y C Z C and the visible light camera coordinate system O C1 -X C1 Y C1 Z C1 is the rotation and The translation relationship has a total of 6 parameters; similarly, 6 parameters are also required between the incident light coordinate system OX C Y C Z C and the near-infrared camera coordinate system O C2 -X C2 Y C2 Z C2 ; as shown in Figure 5, a total of 6 parameters are required. The axis part is the incident light axis, which is the Z C axis of the incident light coordinate system OX C Y C Z C. The light reaching the two cameras is the same light before the beam splitting prism, and the two cameras are connected by this coaxial part.

可见光相机坐标系OC1-XC1YC1ZC1与可见光图像像素坐标系u1ov1之间关系即为相机内参数为4个参数,同理近红外相机也存在4个内参数,进而可见光图像像素坐标系u1ov1和近红外图像像素坐标系u2ov2关系确定。共需要求解6+12+4+4=26个参数。这里说明一下,一个相机需要求解16个参数,如果是两个相机没有关联的情况下,需要求解32个参数,这里两个相机有共轴部分,因此可以少做一次刚体变换。The relationship between the visible light camera coordinate system OC1-XC1YC1ZC1 and the visible light image pixel coordinate system u1ov1 is that the internal parameters of the camera are 4 parameters. Similarly, the near-infrared camera also has 4 internal parameters, and then the visible light image pixel coordinate system u1ov1 and the near-infrared image. The pixel coordinate system u2ov2 relationship is determined. A total of 6+12+4+4=26 parameters need to be solved. Here, it is explained that a camera needs to solve 16 parameters. If the two cameras are not related, 32 parameters need to be solved. Here, the two cameras have coaxial parts, so one less rigid body transformation can be done.

由此可知,传统单相机光学校正需要求解16个参数,两个相机需要32个参数。而我们的光学校正方法,两个相机共需要26个参数,本发明所提供的畸变校正方法能够降低参数求解的计算量。It can be seen that the traditional single-camera optical correction needs to solve 16 parameters, and the two cameras need 32 parameters. While our optical correction method requires a total of 26 parameters for the two cameras, the distortion correction method provided by the present invention can reduce the calculation amount of the parameter solution.

对于平面图像能够提供8个方差,即映射一个正方形到四边形可以用4个(x,y)来描述,对于四个视场就有8*4=32=4*6+4+4,即求解所有的参数,至少需要四个视场,即可见光相机与近红外相机共需要四个视场,因此共需要4幅图像(可见光两幅,近红外两幅)。为了提高精度,减小随机误差,多次试验,图像个数N大于等于14,重投影误差小于0.5像素,表1为重投影误差统计表,如表1所示,It can provide 8 variances for plane images, that is, mapping a square to a quadrilateral can be described by 4 (x, y), and for four fields of view, there are 8*4=32=4*6+4+4, that is, the solution For all parameters, at least four fields of view are required, that is, the visible light camera and the near-infrared camera require a total of four fields of view, so a total of four images (two for visible light and two for near-infrared) are required. In order to improve the accuracy and reduce the random error, the number of images N is greater than or equal to 14, and the reprojection error is less than 0.5 pixels. Table 1 is the reprojection error statistics table, as shown in Table 1.

表1Table 1

图像个数number of images 1010 1414 1616 1818 重投影误差(像素)Reprojection error (pixels) 0.5503240.550324 0.4514220.451422 0.4401310.440131 0.3803540.380354

由表1可知,在获取图像个数越大,重投影误差越低。It can be seen from Table 1 that the larger the number of acquired images, the lower the reprojection error.

步骤404:获取网格板内的单位正方形的边长;所述网格板包括多个单位正方形。Step 404: Obtain the side lengths of the unit squares in the grid board; the grid board includes a plurality of unit squares.

步骤405:根据所述边长确定所述单位正方形对应的像素点。Step 405: Determine the pixel point corresponding to the unit square according to the side length.

步骤406:根据所述像素点以及所述图像坐标系确定坐标变换矩阵;所述坐标变换矩阵用于将畸变图像变换到无畸变图像;所述畸变图像为可见光图像以及近红外图像;所述无畸变图像包括可见光无畸变图像以及近红外无畸变图像。Step 406: Determine a coordinate transformation matrix according to the pixel points and the image coordinate system; the coordinate transformation matrix is used to transform the distorted image into an undistorted image; the distorted image is a visible light image and a near-infrared image; Distorted images include visible light undistorted images and near-infrared undistorted images.

步骤407:根据所述可见光图像以及所述变换矩阵确定可见光无畸变图像。Step 407: Determine an undistorted visible light image according to the visible light image and the transformation matrix.

步骤408:根据所述近红外图像以及所述变换矩阵确定近红外无畸变图像。Step 408: Determine a near-infrared undistorted image according to the near-infrared image and the transformation matrix.

畸变坐标提取,采集图像如图6,图9所示,选择以图像中心9*9矩阵大小的网格角点,即如图2中虚线框内9*9的网格点所成的像,提取网格角点坐标。提取坐标如图8,图11中标记的网格点坐标,其中,图8是可见光图像标记的网格点,图11是近红外图像标记的网格点;其中,所标记的网格点坐标是亮色的圆点。Distortion coordinate extraction, the collected images are shown in Figure 6 and Figure 9, and the grid corner points with the size of the 9*9 matrix in the image center are selected, that is, the image formed by the 9*9 grid points in the dotted frame in Figure 2, Extract grid corner coordinates. The extraction coordinates are as shown in Figure 8, the grid point coordinates marked in Figure 11, wherein, Figure 8 is the grid point marked by the visible light image, and Figure 11 is the grid point marked by the near-infrared image; wherein, the marked grid point coordinates It's a bright dot.

计算双相机标定模型,如图5所示,可见光图像物理坐标系x1oy1,近红外图像物理坐标系x2oy2,可见光图像像素坐标系u1ov1,近红外图像像素坐标系u2ov2,世界坐标系O-XWYWZW,入射光以光轴为Z轴、垂直于光轴为XOY面建立坐标系(入射光坐标系)O-XCYCZC,可见光相机坐标系OC1-XC1YC1ZC1,近红外相机坐标系OC2-XC2YC2ZC2。由世界坐标系到图像像素坐标系用矩阵Tm表示。如图2中网格板,每一个小格都是边长为d的正方形,通过小孔成像模型可以计算出边长d在理想图像上对应的像素大小dpix,根据dpix确定理想无畸变图像上网格点坐标关系,结合矩阵Tm得到理想无畸变图像坐标Cd,因此,之前所提取的畸变坐标记为C,Cd与C之间关系为:Cd=C·T,其中T是畸变图像到无畸变图像的坐标变换矩阵。Calculate the dual camera calibration model, as shown in Figure 5, the visible light image physical coordinate system x1oy1, the near-infrared image physical coordinate system x2oy2, the visible light image pixel coordinate system u1ov1, the near-infrared image pixel coordinate system u2ov2, and the world coordinate system OX W Y W Z W , the incident light takes the optical axis as the Z axis and the XOY plane perpendicular to the optical axis to establish a coordinate system (incident light coordinate system) OX C Y C Z C , the visible light camera coordinate system O C1 -X C1 Y C1 Z C1 , near infrared Camera coordinate system O C2 -X C2 Y C2 Z C2 . From the world coordinate system to the image pixel coordinate system is represented by the matrix T m . As shown in the grid plate in Figure 2, each small grid is a square with side length d. Through the small hole imaging model, the pixel size dpix corresponding to the side length d on the ideal image can be calculated, and the ideal undistorted image can be determined according to dpix. The grid point coordinate relationship, combined with the matrix T m to obtain the ideal undistorted image coordinate C d , therefore, the previously extracted distortion coordinate is marked as C, and the relationship between C d and C is: C d =C · T, where T is the distortion The coordinate transformation matrix of the image to the undistorted image.

设光学校正后图像为I’,带有光学畸变的图像为I,根据矩阵T得到三者关系为:I'=I·TAssume that the image after optical correction is I', and the image with optical distortion is I. According to the matrix T, the relationship between the three is obtained as: I'=I·T

采集图像,经过矩阵变换,得到可见光与近红外无畸变图像,可见光图像如图6、近红外图像如图9所示图像,进行矩阵T变换得到可见光无畸变图像如图7、近红外无畸变图像如图10所示的图像。Collect the images, and through matrix transformation, the visible light and near-infrared undistorted images are obtained. The visible light images are shown in Figure 6 and the near-infrared images are shown in Figure 9. The matrix T transformation is performed to obtain the visible light undistorted images as shown in Figure 7 and the near-infrared undistorted images. The image shown in Figure 10.

将本发明所提供的畸变校正方法应用到实际中,本发明采用平行光管等效1Km光源,两个相机对应等效1Km光源的网格板调整位置的计算如下:Applying the distortion correction method provided by the present invention to practice, the present invention adopts the equivalent 1Km light source of the collimator, and the calculation of the adjustment position of the grid plate corresponding to the equivalent 1Km light source of the two cameras is as follows:

本发明产生平行光时f'=1604.07mm,平行光管微调标尺刻度为r=97.2mm,则f'=1604.07mm,n=1,n'=1.5194725831可以得到,

Figure BDA0001609556580000101
因此,n=1,n'=1.516960102,k=0.0012000907;
Figure BDA0001609556580000102
即产生等效1Km近红外光的平行光管焦距为f'IR=1611.87mm;平行光管微调标尺刻度为r=105mm。When the invention generates parallel light, f'=1604.07mm, and the scale of the fine-tuning scale of the parallel light pipe is r=97.2mm, then f'=1604.07mm, n=1, n'=1.5194725831 can be obtained,
Figure BDA0001609556580000101
Therefore, n=1, n'=1.516960102, k=0.0012000907;
Figure BDA0001609556580000102
That is, the focal length of the collimator that generates the near-infrared light equivalent to 1Km is f' IR =1611.87mm; the scale of the fine-tuning scale of the collimator is r=105mm.

由成像公式:

Figure BDA0001609556580000103
等效v=1000000mm网格板放置位置为
Figure BDA0001609556580000104
计算可得,uVis=1606.64717mm,uIR=1614.47232mm,那么相对于平行光管焦距调整相对位置为ΔuVis=uVis-f'=1606.64717-1604.07=2.57717mm以及ΔuIR=uIR-f'=1614.47232-1604.07=10.40232mm;对应平行光管微调标尺刻度为rVis=r+ΔuVis=99.77717mm以及rIR=r+ΔuIR=107.60232mm;By the imaging formula:
Figure BDA0001609556580000103
The equivalent v=1000000mm grid plate placement position is
Figure BDA0001609556580000104
It can be calculated that u Vis =1606.64717mm, u IR =1614.47232mm, then the relative position adjustment relative to the focal length of the collimator is Δu Vis =u Vis -f'=1606.64717-1604.07=2.57717mm and Δu IR =u IR -f '=1614.47232-1604.07=10.40232mm; the corresponding collimator fine-tuning scale scale is r Vis =r+Δu Vis =99.77717mm and r IR =r+Δu IR =107.60232mm;

调节网格板位置至rVis,使可见光相机成像清晰,采集可见光图像;再次调节网格板位置至rIR,使近红外相机成像清晰,采集近红外图像;旋转摄远光学系统,在每次旋转过程中图像中心轴不变,以网格板中心成像在两相机视场中心、网格线与水平线角度逐渐增大为调整依据。Adjust the position of the grid plate to r Vis to make the visible light camera image clear and collect the visible light image; adjust the position of the grid plate to r IR again to make the near-infrared camera image clear and collect the near-infrared image; The center axis of the image remains unchanged during the rotation process, and the adjustment is based on the fact that the center of the grid plate is imaged in the center of the field of view of the two cameras, and the angle between the grid line and the horizontal line gradually increases.

循环上述调整步骤,循环次数N大于等于14次(次数依据最终要求的未知数个数、及每幅图像能列出的方程个数决定,以及计算重投影误差)。The above adjustment steps are repeated, and the number of cycles N is greater than or equal to 14 times (the number of times is determined by the number of unknowns finally required and the number of equations that can be listed in each image, and the reprojection error is calculated).

如图5所示,确定坐标变换矩阵T。As shown in FIG. 5, the coordinate transformation matrix T is determined.

复原校正,试验过程中,采集图像,在A/D转换之后,系统级矩阵T处理图像,得到可见光与近红外无畸变图像,如图6-11所示。For restoration and correction, during the test, images are collected, and after A/D conversion, the system-level matrix T processes the images to obtain visible light and near-infrared distortion-free images, as shown in Figure 6-11.

图12为本发明所提供的光学系统畸变校正系统结构图,如图12所示,一种光学系统畸变校正系统,包括:FIG. 12 is a structural diagram of an optical system distortion correction system provided by the present invention. As shown in FIG. 12 , an optical system distortion correction system includes:

第一平行光管透镜焦距获取模块1201,用于获取平行光管产生平行光时的第一平行光管透镜焦距。The first collimator lens focal length acquiring module 1201 is configured to acquire the focal length of the first collimator lens when the collimator generates parallel light.

图像确定模块1202,用于根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像。The image determination module 1202 is configured to determine a visible light image and a near-infrared image according to the focal length of the first collimator lens.

所述图像确定模块1202具体包括:可见光调整距离确定单元,用于根据所述第一平行光管透镜焦距确定所述平行光管的可见光调整距离;可见光图像确定单元,用于根据所述可见光调整距离确定可见光图像。The image determination module 1202 specifically includes: a visible light adjustment distance determination unit, used for determining the visible light adjustment distance of the collimator according to the focal length of the first collimator lens; a visible light image determination unit, used for adjusting according to the visible light Distance determines the visible light image.

所述图像确定模块1202具体包括:第二平行光管透镜焦距确定单元,用于根据所述第一平行光管透镜焦距确定第二平行光管透镜焦距;近红外调整距离确定单元,用于根据所述第二平行光管透镜焦距确定所述平行光管的近红外调整距离;近红外图像确定单元,用于根据所述近红外调整距离确定近红外图像。The image determination module 1202 specifically includes: a second collimator lens focal length determination unit, used to determine the second collimator lens focal length according to the first collimator lens focal length; The focal length of the second collimator lens determines the near-infrared adjustment distance of the collimator; the near-infrared image determination unit is configured to determine the near-infrared image according to the near-infrared adjustment distance.

图像坐标系建立模块1203,用于以入射光的光轴为Z轴,垂直于光轴的平面为XOY面,建立图像坐标系。The image coordinate system establishing module 1203 is used for establishing the image coordinate system with the optical axis of the incident light as the Z axis and the plane perpendicular to the optical axis as the XOY plane.

边长获取模块1204,用于获取网格板内的单位正方形的边长;所述网格板包括多个单位正方形。The side length acquiring module 1204 is configured to acquire the side length of a unit square in the grid board; the grid board includes a plurality of unit squares.

像素点确定模块1205,用于根据所述边长确定所述单位正方形对应的像素点。The pixel point determination module 1205 is configured to determine the pixel point corresponding to the unit square according to the side length.

所述像素点确定模块1205具体包括:像素点确定单元,用于根据所述边长,利用小孔成像模型确定所述单位正方形对应的像素点。The pixel point determination module 1205 specifically includes: a pixel point determination unit, configured to use a pinhole imaging model to determine the pixel point corresponding to the unit square according to the side length.

坐标变换矩阵确定模块1206,用于根据所述像素点以及所述图像坐标系确定坐标变换矩阵;所述坐标变换矩阵用于将畸变图像变换到无畸变图像;所述畸变图像为可见光图像以及近红外图像;所述无畸变图像包括可见光无畸变图像以及近红外无畸变图像。The coordinate transformation matrix determination module 1206 is used to determine a coordinate transformation matrix according to the pixel points and the image coordinate system; the coordinate transformation matrix is used to transform the distorted image into an undistorted image; the distorted image is a visible light image and a near- Infrared images; the undistorted images include visible light undistorted images and near-infrared undistorted images.

可见光无畸变图像确定模块1207,用于根据所述可见光图像以及所述变换矩阵确定可见光无畸变图像。The visible light undistorted image determination module 1207 is configured to determine the visible light undistorted image according to the visible light image and the transformation matrix.

近红外无畸变图像确定模块1208,用于根据所述近红外图像以及所述变换矩阵确定近红外无畸变图像。The near-infrared undistorted image determination module 1208 is configured to determine the near-infrared undistorted image according to the near-infrared image and the transformation matrix.

采用本发明所提供的光学系统畸变校正方法及系统能够提高光学系统的测量精度,降低测量误差。Using the optical system distortion correction method and system provided by the present invention can improve the measurement accuracy of the optical system and reduce the measurement error.

本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的系统而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can be referred to the description of the method.

本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处。综上所述,本说明书内容不应理解为对本发明的限制。The principles and implementations of the present invention are described herein using specific examples. The descriptions of the above embodiments are only used to help understand the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the present invention There will be changes in the specific implementation and application scope. In conclusion, the contents of this specification should not be construed as limiting the present invention.

Claims (10)

1.一种光学系统,其特征在于,包括:光源,在所述光源的一侧依次设有平行光管以及摄远光学系统,所述摄远光学系统与计算机相连接;1. An optical system, characterized in that, comprising: a light source, a parallel light pipe and a telephoto optical system are sequentially arranged on one side of the light source, and the telephoto optical system is connected with a computer; 所述平行光管内设有网格板;The parallel light pipe is provided with a grid plate; 所述光源、所述平行光管以及所述摄远光学系统的底部分别设有调整台;所述调整台用于调整所述光源、所述平行光管以及所述摄远光学系统的位置;所述调整台包括第一调整台、第二调整台、第三调整台,其中,所述第一调整台、第二调整台以及第三调整台与光源、平行光管以及摄远光学系统一一对应;获取图像之前,首先调整所述光学系统内各个设备的位置,使得所述网格板中心点成像于可见光图像的中心;The light source, the collimator light pipe and the bottom of the telephoto optical system are respectively provided with an adjustment table; the adjustment table is used to adjust the positions of the light source, the collimator light pipe and the telephoto optical system; The adjustment stage includes a first adjustment stage, a second adjustment stage, and a third adjustment stage, wherein the first adjustment stage, the second adjustment stage and the third adjustment stage are connected to the light source, the collimator light pipe and the telephoto optical system. One correspondence; before acquiring the image, first adjust the position of each device in the optical system, so that the center point of the grid plate is imaged in the center of the visible light image; 所述摄远光学系统包括卡塞格林反射结构、透镜、分光棱镜、可见光相机、滤光片、反射镜以及近红外相机;所述透镜包括第一透镜、第二透镜以及第三透镜;所述摄远光学系统接收所述光源所发射的光线,由所述卡塞格林反射结构经由所述第一透镜传播到所述分光棱镜上;所述分光棱镜将所述光线分为两路,第一路光线通过第二透镜由所述可见光相机所采集,调整所述网格板以及所述摄远光学系统的位置,得到可见光图像;第二路光线通过所述滤光片,再经所述反射镜将所述第二路光线通过所述第三透镜由所述近红外相机所采集,再次调整所述网格板以及所述摄远光学系统的位置,得到近红外图像;对所述可见光图像以及所述近红外图像进行坐标系转换,得到可见光无畸变图像以及近红外无畸变图像。The telephoto optical system includes a Cassegrain reflection structure, a lens, a beam splitter prism, a visible light camera, a filter, a reflection mirror and a near-infrared camera; the lens includes a first lens, a second lens and a third lens; the The telephoto optical system receives the light emitted by the light source, and is transmitted to the beam splitting prism by the Cassegrain reflection structure through the first lens; the beam splitting prism divides the light into two paths, the first The path light is collected by the visible light camera through the second lens, and the positions of the grid plate and the telephoto optical system are adjusted to obtain a visible light image; the second path light passes through the filter, and is then reflected by the The second path of light is collected by the near-infrared camera through the third lens, and the positions of the grid plate and the telephoto optical system are adjusted again to obtain a near-infrared image; for the visible light image And the coordinate system conversion of the near-infrared image is performed to obtain an undistorted visible light image and a near-infrared undistorted image. 2.一种光学系统畸变校正方法,其特征在于,所述畸变校正方法应用于权利要求1的一种光学系统,所述畸变校正方法包括:2. An optical system distortion correction method, wherein the distortion correction method is applied to an optical system of claim 1, and the distortion correction method comprises: 获取平行光管产生平行光时的第一平行光管透镜焦距;Obtain the focal length of the first collimator lens when the collimator produces parallel light; 根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像;Determine the visible light image and the near-infrared image according to the focal length of the first collimator lens; 以入射光的光轴为Z轴,垂直于光轴的平面为XOY面,建立图像坐标系;Taking the optical axis of the incident light as the Z axis and the plane perpendicular to the optical axis as the XOY plane, establish the image coordinate system; 获取网格板内的单位正方形的边长;所述网格板包括多个单位正方形;Obtain the side length of the unit square in the grid plate; the grid plate includes a plurality of unit squares; 根据所述边长确定所述单位正方形对应的像素点;Determine the pixel point corresponding to the unit square according to the side length; 根据所述像素点以及所述图像坐标系确定坐标变换矩阵;所述坐标变换矩阵用于将畸变图像变换到无畸变图像;所述畸变图像为可见光图像以及近红外图像;所述无畸变图像包括可见光无畸变图像以及近红外无畸变图像;A coordinate transformation matrix is determined according to the pixel points and the image coordinate system; the coordinate transformation matrix is used to transform the distorted image into an undistorted image; the distorted image is a visible light image and a near-infrared image; the undistorted image includes Visible light distortion-free images and near-infrared distortion-free images; 根据所述可见光图像以及所述变换矩阵确定可见光无畸变图像;determining an undistorted visible light image according to the visible light image and the transformation matrix; 根据所述近红外图像以及所述变换矩阵确定近红外无畸变图像。A near-infrared undistorted image is determined according to the near-infrared image and the transformation matrix. 3.根据权利要求2所述的畸变校正方法,其特征在于,所述根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像,具体包括:3. The distortion correction method according to claim 2, wherein the determining of the visible light image and the near-infrared image according to the focal length of the first collimator lens specifically comprises: 根据所述第一平行光管透镜焦距确定所述平行光管的可见光调整距离;Determine the visible light adjustment distance of the collimator according to the focal length of the first collimator lens; 根据所述可见光调整距离确定可见光图像。A visible light image is determined according to the visible light adjustment distance. 4.根据权利要求3所述的畸变校正方法,其特征在于,所述根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像,具体包括:4 . The distortion correction method according to claim 3 , wherein the determining of the visible light image and the near-infrared image according to the focal length of the first collimator lens specifically comprises: 5 . 根据所述第一平行光管透镜焦距确定第二平行光管透镜焦距;determining the focal length of the second collimator lens according to the focal length of the first collimator lens; 根据所述第二平行光管透镜焦距确定所述平行光管的近红外调整距离;determining the near-infrared adjustment distance of the collimator according to the focal length of the second collimator lens; 根据所述近红外调整距离确定近红外图像。A near-infrared image is determined according to the near-infrared adjustment distance. 5.根据权利要求2所述的畸变校正方法,其特征在于,所述根据所述边长确定所述单位正方形对应的像素点,具体包括:5. The distortion correction method according to claim 2, wherein the determining the pixel corresponding to the unit square according to the side length specifically comprises: 根据所述边长,利用小孔成像模型确定所述单位正方形对应的像素点。According to the side length, a pinhole imaging model is used to determine the pixel point corresponding to the unit square. 6.根据权利要求2所述的畸变校正方法,其特征在于,所述根据所述像素点以及所述图像坐标系确定坐标变换矩阵,具体包括:6. The distortion correction method according to claim 2, wherein the determining a coordinate transformation matrix according to the pixel points and the image coordinate system specifically comprises: 获取世界坐标系;Get the world coordinate system; 根据所述世界坐标系以及所述图像坐标系确定世界-图像变换矩阵;determining a world-image transformation matrix according to the world coordinate system and the image coordinate system; 根据所述像素点以及所述世界-图像变换矩阵确定坐标变换矩阵。A coordinate transformation matrix is determined according to the pixel points and the world-image transformation matrix. 7.一种光学系统畸变校正系统,其特征在于,所述光学系统畸变校正系统应用于权利要求1的一种光学系统,包括:7. An optical system distortion correction system, wherein the optical system distortion correction system is applied to an optical system of claim 1, comprising: 第一平行光管透镜焦距获取模块,用于获取平行光管产生平行光时的第一平行光管透镜焦距;The first collimator lens focal length acquiring module is used to acquire the focal length of the first collimator lens when the collimator generates parallel light; 图像确定模块,用于根据所述第一平行光管透镜焦距确定可见光图像以及近红外图像;an image determination module, configured to determine a visible light image and a near-infrared image according to the focal length of the first collimator lens; 图像坐标系建立模块,用于以入射光的光轴为Z轴,垂直于光轴的平面为XOY面,建立图像坐标系;The image coordinate system establishment module is used to establish the image coordinate system with the optical axis of the incident light as the Z axis and the plane perpendicular to the optical axis as the XOY plane; 边长获取模块,用于获取网格板内的单位正方形的边长;所述网格板包括多个单位正方形;a side length acquiring module, used for acquiring the side length of a unit square in the grid board; the grid board includes a plurality of unit squares; 像素点确定模块,用于根据所述边长确定所述单位正方形对应的像素点;a pixel point determination module, configured to determine the pixel point corresponding to the unit square according to the side length; 坐标变换矩阵确定模块,用于根据所述像素点以及所述图像坐标系确定坐标变换矩阵;所述坐标变换矩阵用于将畸变图像变换到无畸变图像;所述畸变图像为可见光图像以及近红外图像;所述无畸变图像包括可见光无畸变图像以及近红外无畸变图像;a coordinate transformation matrix determination module, configured to determine a coordinate transformation matrix according to the pixel points and the image coordinate system; the coordinate transformation matrix is used to transform a distorted image into an undistorted image; the distorted image is a visible light image and a near-infrared image an image; the undistorted image includes a visible light undistorted image and a near-infrared undistorted image; 可见光无畸变图像确定模块,用于根据所述可见光图像以及所述变换矩阵确定可见光无畸变图像;a visible light undistorted image determination module, configured to determine a visible light undistorted image according to the visible light image and the transformation matrix; 近红外无畸变图像确定模块,用于根据所述近红外图像以及所述变换矩阵确定近红外无畸变图像。A near-infrared undistorted image determination module, configured to determine a near-infrared undistorted image according to the near-infrared image and the transformation matrix. 8.根据权利要求7所述的畸变校正系统,其特征在于,所述图像确定模块具体包括:8. The distortion correction system according to claim 7, wherein the image determination module specifically comprises: 可见光调整距离确定单元,用于根据所述第一平行光管透镜焦距确定所述平行光管的可见光调整距离;a visible light adjustment distance determining unit, configured to determine the visible light adjustment distance of the collimator according to the focal length of the first collimator lens; 可见光图像确定单元,用于根据所述可见光调整距离确定可见光图像。A visible light image determination unit, configured to determine a visible light image according to the visible light adjustment distance. 9.根据权利要求8所述的畸变校正系统,其特征在于,所述图像确定模块具体包括:9. The distortion correction system according to claim 8, wherein the image determination module specifically comprises: 第二平行光管透镜焦距确定单元,用于根据所述第一平行光管透镜焦距确定第二平行光管透镜焦距;a second collimator lens focal length determining unit, configured to determine the second collimator lens focal length according to the first collimator lens focal length; 近红外调整距离确定单元,用于根据所述第二平行光管透镜焦距确定所述平行光管的近红外调整距离;a near-infrared adjustment distance determining unit, configured to determine the near-infrared adjustment distance of the collimator according to the focal length of the second collimator lens; 近红外图像确定单元,用于根据所述近红外调整距离确定近红外图像。A near-infrared image determination unit, configured to determine a near-infrared image according to the near-infrared adjustment distance. 10.根据权利要求7所述的畸变校正系统,其特征在于,所述像素点确定模块具体包括:10. The distortion correction system according to claim 7, wherein the pixel point determination module specifically comprises: 像素点确定单元,用于根据所述边长,利用小孔成像模型确定所述单位正方形对应的像素点。The pixel point determination unit is configured to use the pinhole imaging model to determine the pixel point corresponding to the unit square according to the side length.
CN201810258291.2A 2018-03-27 2018-03-27 An optical system and its distortion correction method and system Active CN108765301B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810258291.2A CN108765301B (en) 2018-03-27 2018-03-27 An optical system and its distortion correction method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810258291.2A CN108765301B (en) 2018-03-27 2018-03-27 An optical system and its distortion correction method and system

Publications (2)

Publication Number Publication Date
CN108765301A CN108765301A (en) 2018-11-06
CN108765301B true CN108765301B (en) 2020-08-07

Family

ID=63980400

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810258291.2A Active CN108765301B (en) 2018-03-27 2018-03-27 An optical system and its distortion correction method and system

Country Status (1)

Country Link
CN (1) CN108765301B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110864878A (en) * 2019-10-14 2020-03-06 中国航空工业集团公司洛阳电光设备研究所 Method for detecting display distortion of high-efficiency large-view-field flat display system
CN113037212B (en) * 2019-12-05 2022-10-18 致茂电子(苏州)有限公司 Photoelectric assembly characteristic measuring device
CN117523025B (en) * 2024-01-05 2024-05-10 之江实验室 Digital imitation generation method based on light intensity distribution adjustment

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201096717Y (en) * 2007-09-30 2008-08-06 北京农业信息技术研究中心 Vegetation difference index and its geographical coordinate tester
CN101676704A (en) * 2008-09-19 2010-03-24 中国科学院西安光学精密机械研究所 distortion tester
CN101753812A (en) * 2008-12-05 2010-06-23 索尼株式会社 Imaging apparatus and imaging method
CN102449451A (en) * 2009-06-02 2012-05-09 C8麦迪森瑟斯公司 All reflective apparatus for injecting excitation light and collecting in-elastically scattered light from a sample
US8407012B2 (en) * 2008-07-03 2013-03-26 Cold Spring Harbor Laboratory Methods and systems of DNA sequencing
CN103370010A (en) * 2011-10-24 2013-10-23 松下电器产业株式会社 Photoacoustic imaging apparatus
CN104257345A (en) * 2014-09-17 2015-01-07 夏明亮 Illuminating unit, imaging system and use method thereof
CN104856643A (en) * 2015-04-27 2015-08-26 奉化科创科技服务有限公司 Focus-adjustable retina camera imaging system based on liquid lens
CN105136732A (en) * 2015-08-24 2015-12-09 中国农业科学院农业环境与可持续发展研究所 Field crop dual band imaging NDVI measurement apparatus
CN205138642U (en) * 2015-10-26 2016-04-06 苑高强 Light source with broadband spectrum
CN105637382A (en) * 2013-08-19 2016-06-01 巴斯夫欧洲公司 Detector for determining a position of at least one object
US9465988B1 (en) * 2014-12-17 2016-10-11 Amazon Technologies, Inc. Camera and illuminator for iris imaging in cell phones and tablets
CN106250839A (en) * 2016-07-27 2016-12-21 徐鹤菲 A kind of iris image perspective correction method, device and mobile terminal
CN106932097A (en) * 2017-02-15 2017-07-07 南京华图信息技术有限公司 A kind of dual-waveband imaging associates the weak signal target detection device and method that full spectrum surveys spectrum

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201096717Y (en) * 2007-09-30 2008-08-06 北京农业信息技术研究中心 Vegetation difference index and its geographical coordinate tester
US8407012B2 (en) * 2008-07-03 2013-03-26 Cold Spring Harbor Laboratory Methods and systems of DNA sequencing
CN101676704A (en) * 2008-09-19 2010-03-24 中国科学院西安光学精密机械研究所 distortion tester
CN101753812A (en) * 2008-12-05 2010-06-23 索尼株式会社 Imaging apparatus and imaging method
CN102449451A (en) * 2009-06-02 2012-05-09 C8麦迪森瑟斯公司 All reflective apparatus for injecting excitation light and collecting in-elastically scattered light from a sample
CN103370010A (en) * 2011-10-24 2013-10-23 松下电器产业株式会社 Photoacoustic imaging apparatus
CN105637382A (en) * 2013-08-19 2016-06-01 巴斯夫欧洲公司 Detector for determining a position of at least one object
CN104257345A (en) * 2014-09-17 2015-01-07 夏明亮 Illuminating unit, imaging system and use method thereof
US9465988B1 (en) * 2014-12-17 2016-10-11 Amazon Technologies, Inc. Camera and illuminator for iris imaging in cell phones and tablets
CN104856643A (en) * 2015-04-27 2015-08-26 奉化科创科技服务有限公司 Focus-adjustable retina camera imaging system based on liquid lens
CN105136732A (en) * 2015-08-24 2015-12-09 中国农业科学院农业环境与可持续发展研究所 Field crop dual band imaging NDVI measurement apparatus
CN205138642U (en) * 2015-10-26 2016-04-06 苑高强 Light source with broadband spectrum
CN106250839A (en) * 2016-07-27 2016-12-21 徐鹤菲 A kind of iris image perspective correction method, device and mobile terminal
CN106932097A (en) * 2017-02-15 2017-07-07 南京华图信息技术有限公司 A kind of dual-waveband imaging associates the weak signal target detection device and method that full spectrum surveys spectrum

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
近红外镜头系统的设计与装调;刘婷毓等;《红外与激光工程》;20130331;第42卷(第3期);全文 *

Also Published As

Publication number Publication date
CN108765301A (en) 2018-11-06

Similar Documents

Publication Publication Date Title
US10690492B2 (en) Structural light parameter calibration device and method based on front-coating plane mirror
CN106504290B (en) A high-precision camera dynamic calibration method
CN107462184B (en) Parameter recalibration method and equipment for structured light three-dimensional measurement system
CN105258710B (en) A kind of high-precision principal point for camera scaling method
CN107144241B (en) A kind of binocular vision high-precision measuring method based on depth of field compensation
WO2020199439A1 (en) Single- and dual-camera hybrid measurement-based three-dimensional point cloud computing method
CN110057295A (en) It is a kind of to exempt from the monocular vision plan range measurement method as control
CN108765301B (en) An optical system and its distortion correction method and system
CN106289106A (en) Stereo vision sensor that a kind of line-scan digital camera and area array cameras combine and scaling method
CN106705898A (en) Method for measuring planeness through lattice structure light
CN107941153B (en) Visual system for optimizing calibration of laser ranging
CN109084959B (en) An Optical Axis Parallelism Correction Method Based on Binocular Ranging Algorithm
CN104165598B (en) Automatic reflection light spot positioning method for large-caliber mirror interferometer vertical type detection
CN110827360B (en) A photometric stereo measurement system and method for calibrating light source direction
CN104240233A (en) Method for solving camera homography matrix and projector homography matrix
CN108871190B (en) A kind of hand-held spherical target used in binocular stereo vision measurement and measurement method
CN111595302A (en) A double-sided array CCD-assisted three-line array CCD pose optical measurement and calibration method
CN110146032B (en) Synthetic aperture camera calibration method based on light field distribution
CN112880563A (en) Single-dimensional pixel combination mode equivalent narrow-area-array camera spatial position measuring method
CN116485915A (en) Laser auxiliary calibration device and application method thereof
CN115457141A (en) Large-view-field three-dimensional digital image correlation system calibration method based on photogrammetry
CN112991532B (en) Underwater high-precision three-dimensional reconstruction method based on photometric stereo method and laser triangulation method
RU2692970C2 (en) Method of calibration of video sensors of the multispectral system of technical vision
WO2025016085A1 (en) Measurement apparatus and method for rotation angle of geometric axis of object
CN103528569B (en) The orthogonal spectroscopic imaging pose method of testing of index point and sensor

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant