CN111598931A - Monocular vision system imaging parameter calibration device and method - Google Patents

Monocular vision system imaging parameter calibration device and method Download PDF

Info

Publication number
CN111598931A
CN111598931A CN202010286455.XA CN202010286455A CN111598931A CN 111598931 A CN111598931 A CN 111598931A CN 202010286455 A CN202010286455 A CN 202010286455A CN 111598931 A CN111598931 A CN 111598931A
Authority
CN
China
Prior art keywords
vision system
monocular vision
calibration
lens
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010286455.XA
Other languages
Chinese (zh)
Other versions
CN111598931B (en
Inventor
夏晓华
秦绪芳
杨殿斌
田明锐
刘晓辉
王朋辉
董畅
陈仕旗
岳鹏举
孙宏斐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changan University
Original Assignee
Changan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changan University filed Critical Changan University
Priority to CN202010286455.XA priority Critical patent/CN111598931B/en
Publication of CN111598931A publication Critical patent/CN111598931A/en
Application granted granted Critical
Publication of CN111598931B publication Critical patent/CN111598931B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85Stereo camera calibration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/40Analysis of texture

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a monocular vision system imaging parameter calibration device and a method, comprising a monocular vision system, a calibration object arranged in front of the monocular vision system and an image acquisition and analysis module, wherein the monocular vision system comprises a lens and a camera, and the distance between the lens and the camera or the distance between a lens group in the lens and the camera is adjustable; the calibration object is one or a group of plane calibration plates with textures on the surfaces; a plane calibration plate can move and the moving distance can be measured; the plane calibration plates are parallel to each other and the distance between the plane calibration plates can be measured; or the calibration object is a three-dimensional calibration block with texture on the surface, and the surface appearance information of the three-dimensional calibration block is known; the three-dimensional calibration block is fixed or movable. The method records system state information and focused point position information by adjusting the monocular vision system to focus on different distant objects or areas, and solves imaging parameters by using an imaging formula simultaneous equation set. The method is easy to realize the accurate calibration of the imaging parameters of the monocular vision system.

Description

Monocular vision system imaging parameter calibration device and method
Technical Field
The invention belongs to the field of machine vision, and particularly relates to a monocular vision system imaging parameter calibration device and method.
Background
Monocular multi-focus stereo vision is a vision technology for realizing scene three-dimensional perception by acquiring scene multi-focus images, the precondition for realizing scene three-dimensional perception is that imaging parameters of a monocular vision system are accurately acquired, the existing camera calibration method mostly assumes that the image distance is equal to the focal length, and the accurate calibration of the imaging parameters of the monocular vision system cannot be realized, so the three-dimensional perception precision of the monocular multi-focus stereo vision technology is restricted.
Disclosure of Invention
Aiming at the defects and shortcomings in the prior art, the invention provides a monocular vision system imaging parameter calibration device and method, which can realize accurate calibration of monocular vision system imaging parameters and provide technical conditions for guaranteeing three-dimensional perception accuracy of monocular multi-focus stereo vision technology.
In order to achieve the purpose, the invention adopts the following technical scheme:
a monocular vision system imaging parameter calibration device comprises a monocular vision system, a calibration object arranged in front of the monocular vision system and an image acquisition and analysis module connected with the monocular vision system, wherein the image acquisition and analysis module is used for acquiring an image of the calibration object shot by the monocular vision system and analyzing whether the whole image or a partial area of the image is focused accurately;
the monocular vision system comprises a lens and a camera, and the lens is positioned between the camera and the calibration object; the distance between the lens and the camera or the distance between a lens group in the lens and the camera is adjustable, and a first displacement sensor or a first distance measuring sensor is arranged on the monocular vision system so that the moving distances of the lens, the lens group in the lens and the camera can be measured;
the calibration object is one or a group of plane calibration plates with textures on the surface; if the calibration object is a plane calibration plate, the plane calibration plate can move and the moving distance can be measured; if the calibration object is a group of plane calibration plates, the plane calibration plates are parallel and the distance between the plane calibration plates can be measured;
or the calibration object is a three-dimensional calibration block with texture on the surface, and the surface appearance information of the three-dimensional calibration block is known; the three-dimensional calibration block is fixed or movable, and the moving distance can be measured or not;
the texture includes a texture formed by surface treatment, pasting, or projection.
The invention also comprises the following technical characteristics:
specifically, a second displacement sensor or a second distance measuring sensor is arranged beside the plane calibration plate to measure the moving distance of the plane calibration plate.
The invention also provides a monocular vision system imaging parameter calibration method adopting the monocular vision system imaging parameter calibration device, which comprises the following steps:
the method comprises the following steps: placing the calibration object in front of the monocular vision system;
step two: adjusting the distance between a lens and a camera in the monocular vision system or the distance between a lens group in the lens and the camera to focus the monocular vision system on a calibration object or a certain area of the calibration object, and recording the state information of the monocular vision system and the position information of a focused point;
step three: changing the position of the focused point, adjusting the distance between a lens and a camera in the monocular vision system or the distance between a lens group in the lens and the camera, enabling the monocular vision system to focus again, and recording the state information of the monocular vision system and the position information of the focused point;
step four: judging whether the third step needs to be repeated, if so, jumping to the third step, and if not, executing the fifth step;
step five: according to the recorded monocular vision system state information and the position information of the focused point, calculating imaging parameters according to an imaging formula column equation set of the monocular vision system;
specifically, the state information of the monocular vision system is obtained by a first distance measuring sensor or a first displacement sensor, and the position information of the focused point is known in advance or obtained by a second distance measuring sensor or a second displacement sensor.
Specifically, the fourth step of determining whether the third step needs to be repeated is to determine whether the focusing frequency of the monocular vision system in the calibration process is smaller than a certain value, if so, the third step needs to be repeated, otherwise, the third step does not need to be repeated;
the determined number is greater than or equal to the number of the imaging parameters to be calibrated.
Specifically, the imaging formula of the monocular vision system is a lens imaging formula, and when the number of the equation sets is more than the number of the imaging parameters to be calibrated, the solving method of the equation sets is a least square method.
Compared with the prior art, the invention has the beneficial technical effects that:
the invention provides a monocular vision system imaging parameter calibration device, which has a simple structure, only needs to measure distance or displacement and is easy to realize monocular vision system imaging parameter calibration; the monocular vision system is adjusted to focus on objects or areas with different distances, imaging parameters are solved by using an imaging formula simultaneous equation set through monocular vision system state information and focused point position information, and accurate calibration of the imaging parameters of the monocular vision system is easy to realize.
Drawings
FIG. 1 is a schematic view of an imaging parameter calibration apparatus for a monocular vision system of the present invention, FIG. 1;
FIG. 2 is a schematic view of an imaging parameter calibration apparatus of the monocular vision system of the present invention 2;
FIG. 3 is a schematic view of an imaging parameter calibration apparatus for monocular vision systems according to the present invention, FIG. 3;
FIG. 4 is a flowchart of a monocular vision system imaging parameter calibration method of the present invention.
The number in the figure represents 1-monocular vision system, 2-calibration object, 3-image acquisition and analysis module;
11-lens, 12-camera;
21-plane calibration plate, 22-three-dimensional calibration block.
The following describes in detail specific embodiments of the present invention. It should be understood that the detailed description and specific examples, while indicating the present invention, are given by way of illustration and explanation only, not limitation.
Detailed Description
Example 1:
the embodiment provides a monocular vision system imaging parameter calibration device, which comprises a monocular vision system 1, a calibration object 2 arranged in front of the monocular vision system 1, and an image acquisition and analysis module 3 connected with the monocular vision system 1, wherein the image acquisition and analysis module is used for acquiring an image of the calibration object 2 shot by the monocular vision system 1 and analyzing whether the whole image or a partial area of the image is focused accurately.
The monocular vision system 1 includes a lens 11 and a camera 12, and the lens 11 is located between the camera 12 and the calibration object 2; the distance between the lens 11 and the camera 12 or the distance between the lens set in the lens 11 and the camera 12 is adjustable, and the monocular vision system 1 is provided with a first displacement sensor or a first distance measuring sensor so that the movement distances of the lens 11, the lens set in the lens 11 and the camera 12 can be measured.
The calibration object 2 is one or a group of plane calibration plates 21 with textures on the surface; if the calibration object 2 is a plane calibration plate 21, the plane calibration plate 21 can move and the moving distance can be measured; if the calibration object 2 is a set of plane calibration plates 21, the plane calibration plates 21 are parallel and the distance between the plane calibration plates 21 can be measured. Specifically, as shown in fig. 1, in the present embodiment, the calibration object 2 is a plane calibration plate 21 with a texture on the surface and the plane calibration plate 21 can move and the moving distance can be measured. In other embodiments, as shown in fig. 2, the calibration object 2 is a set of planar calibration plates 21 with texture on the surface and the planar calibration plates 21 are parallel and the distance between the planar calibration plates 21 is measurable.
In another embodiment, as shown in fig. 3, the calibration object 2 is a three-dimensional calibration block 22 with a texture on the surface and the surface topography information of the three-dimensional calibration block 22 is known; the three-dimensional calibration block 22 is fixed or movable, with or without measurable distance of movement.
The surface texture of the plane calibration plate or the surface texture of the three-dimensional calibration block comprises textures formed by surface treatment, pasting or projection.
In this embodiment, a second displacement sensor or a second distance measuring sensor is disposed beside the plane calibration plate 21 to measure the moving distance of the plane calibration plate 21.
Example 2:
the present embodiment provides a monocular vision system imaging parameter calibration method using the monocular vision system imaging parameter calibration device of embodiment 1, including the following steps:
the method comprises the following steps: placing the calibration object in front of the monocular vision system;
step two: adjusting the distance between a lens and a camera in the monocular vision system or the distance between a lens group in the lens and the camera to focus the monocular vision system on a calibration object or a certain area of the calibration object, and recording the state information of the monocular vision system and the position information of a focused point;
step three: changing the position of the focused point, adjusting the distance between a lens and a camera in the monocular vision system or the distance between a lens group in the lens and the camera, enabling the monocular vision system to focus again, and recording the state information of the monocular vision system and the position information of the focused point; the state information of the monocular vision system is obtained by a first ranging sensor or a first displacement sensor, and the position information of the focused point is known in advance or obtained by a second ranging sensor or a second displacement sensor.
Step four: judging whether the third step needs to be repeated, if so, jumping to the third step, and if not, executing the fifth step; specifically, the step four judges whether the step three needs to be repeated or not by judging whether the focusing times of the monocular vision system in the calibration process are smaller than a determined value or not, if so, the step three needs to be repeated, otherwise, the step three does not need to be repeated; the determined number is greater than or equal to the number of the imaging parameters to be calibrated.
Step five: according to the recorded monocular vision system state information and the position information of the focused point, calculating imaging parameters according to an imaging formula column equation set of the monocular vision system; specifically, the imaging formula of the monocular vision system is a lens imaging formula, and when the number of the equation sets is more than the number of the imaging parameters to be calibrated, the solving method of the equation sets is a least square method.
In the embodiment, a newton imaging formula is taken as an example to illustrate a calibration method of imaging parameters of a monocular vision system, and a calibration method using other imaging formulas can be implemented in comparison with the embodiment.
In this embodiment, the newton imaging formula is xx ═ ff ', where x is the distance from the object focus to the object point, x ' is the distance from the image focus to the image point, f is the object focal length, and f ' is the image focal length. For monocular vision systems that image in air, the object side focal length is equal to the image side focal length, i.e., f ═ f', so the newton imaging formula becomes xx ═ f2The parameters to be calibrated are x, x' and f3 parameters. In the calibration process, focusing is carried out three times by moving the lens group and the plane calibration plate in the lens, the moving distances of the plane calibration plate between two adjacent times of focusing are all +100mm, and the moving distances of the lens group are measured to be-0.407 mm and-0.291 mm respectively, so that the following equations can be listed:
Figure BDA0002448698590000051
the equation set is solved to obtain x which is 501.724, x which is 2.449, and f which is 35.053, that is, the focal length of the monocular vision system is 35.053mm, the distance from the object focus to the object point in the initial state of the monocular vision system is 501.724mm, and the distance from the image focus to the image point is 2.449 mm.
The focal length of the lens of the monocular vision system measured by a magnification method is 35.125mm, so that the measurement error of the method is calculated to be 0.2%, and the monocular vision system has good measurement precision.

Claims (6)

1. The monocular vision system imaging parameter calibration device is characterized by comprising a monocular vision system (1), a calibration object (2) arranged in front of the monocular vision system (1) and an image acquisition and analysis module (3) connected with the monocular vision system (1) for acquiring an image of the calibration object (2) shot by the monocular vision system (1) and analyzing whether the whole image or a partial area of the image is focused accurately or not;
the monocular vision system (1) comprises a lens (11) and a camera (12), and the lens (11) is positioned between the camera (12) and the calibration object (2); the distance between the lens (11) and the camera (12) or the distance between a lens group in the lens (11) and the camera (12) is adjustable, and a first displacement sensor or a first distance measuring sensor is arranged on the monocular vision system (1) so that the moving distances of the lens (11), the lens group in the lens (11) and the camera (12) can be measured;
the calibration object (2) is one or a group of plane calibration plates (21) with textures on the surface; if the calibration object (2) is a plane calibration plate (21), the plane calibration plate (21) can move and the moving distance can be measured; if the calibration object (2) is a group of plane calibration plates (21), the plane calibration plates (21) are parallel and the distance between the plane calibration plates (21) can be measured;
or the calibration object (2) is a three-dimensional calibration block (22) with texture on the surface, and the surface topography information of the three-dimensional calibration block (22) is known; the three-dimensional calibration block (22) is fixed or movable, and the moving distance can be measured or not measured;
the texture includes a texture formed by surface treatment, pasting, or projection.
2. Monocular vision system imaging parameter calibration device according to claim 1, characterized in that, a second displacement sensor or a second distance measuring sensor is provided beside the planar calibration plate (21) to measure the moving distance of the planar calibration plate (21).
3. The monocular vision system imaging parameter calibration method using the monocular vision system imaging parameter calibration device of claim 1 or 2, characterized by comprising the steps of:
the method comprises the following steps: placing the calibration object in front of the monocular vision system;
step two: adjusting the distance between a lens and a camera in the monocular vision system or the distance between a lens group in the lens and the camera to focus the monocular vision system on a calibration object or a certain area of the calibration object, and recording the state information of the monocular vision system and the position information of a focused point;
step three: changing the position of the focused point, adjusting the distance between a lens and a camera in the monocular vision system or the distance between a lens group in the lens and the camera, enabling the monocular vision system to focus again, and recording the state information of the monocular vision system and the position information of the focused point;
step four: judging whether the third step needs to be repeated, if so, jumping to the third step, and if not, executing the fifth step;
step five: and calculating imaging parameters according to the recorded monocular vision system state information and the position information of the focused point and the imaging formula column equation set of the monocular vision system.
4. The monocular vision system imaging parameter calibration method of claim 3, wherein the state information of the monocular vision system is obtained by a first distance measurement sensor or a first displacement sensor, and the position information of the focused point is known in advance or obtained by a second distance measurement sensor or a second displacement sensor.
5. The method for calibrating imaging parameters of a monocular vision system according to claim 3, wherein the step four for determining whether the step three needs to be repeated is a step for determining whether the focusing frequency of the monocular vision system in the calibration process is smaller than a certain value, if so, the step three needs to be repeated, otherwise, the step three does not need to be repeated;
the determined number is greater than or equal to the number of the imaging parameters to be calibrated.
6. The method for calibrating imaging parameters of a monocular vision system of claim 3, wherein the imaging formula of the monocular vision system is a lens imaging formula, and when the number of the equation sets is greater than the number of the imaging parameters to be calibrated, the solution method of the equation sets is a least square method.
CN202010286455.XA 2020-04-13 2020-04-13 Monocular vision system imaging parameter calibration device and method Active CN111598931B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010286455.XA CN111598931B (en) 2020-04-13 2020-04-13 Monocular vision system imaging parameter calibration device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010286455.XA CN111598931B (en) 2020-04-13 2020-04-13 Monocular vision system imaging parameter calibration device and method

Publications (2)

Publication Number Publication Date
CN111598931A true CN111598931A (en) 2020-08-28
CN111598931B CN111598931B (en) 2023-03-14

Family

ID=72190575

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010286455.XA Active CN111598931B (en) 2020-04-13 2020-04-13 Monocular vision system imaging parameter calibration device and method

Country Status (1)

Country Link
CN (1) CN111598931B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112526746A (en) * 2020-12-05 2021-03-19 中国人民解放军国防科技大学 Simulation system and method for targets with different distances
CN112581547A (en) * 2020-12-30 2021-03-30 安徽地势坤光电科技有限公司 Rapid method for adjusting installation angle of imaging lens
CN112631064A (en) * 2020-12-30 2021-04-09 安徽地势坤光电科技有限公司 Method for adjusting installation angle of imaging lens
CN113115017A (en) * 2021-03-05 2021-07-13 上海炬佑智能科技有限公司 3D imaging module parameter inspection method and 3D imaging device
CN113532274A (en) * 2021-07-13 2021-10-22 苏州天准科技股份有限公司 Optical image measuring apparatus, optical image measuring method, storage medium, and terminal

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170127045A1 (en) * 2015-10-28 2017-05-04 Toppano Co., Ltd. Image calibrating, stitching and depth rebuilding method of a panoramic fish-eye camera and a system thereof
CN109323650A (en) * 2018-01-31 2019-02-12 黑龙江科技大学 Image visual transducer and the unified approach for putting ligh-ranging sensor measurement coordinate system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170127045A1 (en) * 2015-10-28 2017-05-04 Toppano Co., Ltd. Image calibrating, stitching and depth rebuilding method of a panoramic fish-eye camera and a system thereof
CN109323650A (en) * 2018-01-31 2019-02-12 黑龙江科技大学 Image visual transducer and the unified approach for putting ligh-ranging sensor measurement coordinate system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
曹小华等: "基于平面投影的单目视觉AGV定位算法", 《起重运输机械》 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112526746A (en) * 2020-12-05 2021-03-19 中国人民解放军国防科技大学 Simulation system and method for targets with different distances
CN112581547A (en) * 2020-12-30 2021-03-30 安徽地势坤光电科技有限公司 Rapid method for adjusting installation angle of imaging lens
CN112631064A (en) * 2020-12-30 2021-04-09 安徽地势坤光电科技有限公司 Method for adjusting installation angle of imaging lens
CN112631064B (en) * 2020-12-30 2022-04-08 安徽地势坤光电科技有限公司 Method for adjusting installation angle of imaging lens
CN112581547B (en) * 2020-12-30 2022-11-08 安徽地势坤光电科技有限公司 Rapid method for adjusting installation angle of imaging lens
CN113115017A (en) * 2021-03-05 2021-07-13 上海炬佑智能科技有限公司 3D imaging module parameter inspection method and 3D imaging device
CN113115017B (en) * 2021-03-05 2022-03-18 上海炬佑智能科技有限公司 3D imaging module parameter inspection method and 3D imaging device
CN113532274A (en) * 2021-07-13 2021-10-22 苏州天准科技股份有限公司 Optical image measuring apparatus, optical image measuring method, storage medium, and terminal

Also Published As

Publication number Publication date
CN111598931B (en) 2023-03-14

Similar Documents

Publication Publication Date Title
CN111598931B (en) Monocular vision system imaging parameter calibration device and method
CN107358631B (en) Binocular vision reconstruction method considering three-dimensional distortion
CN1260544C (en) Compatible and accurate calibration method for double eye line structure photo-sensor and implementing apparatus
JP4896373B2 (en) Three-dimensional three-dimensional measurement system and method
CN108986070B (en) Rock crack propagation experiment monitoring method based on high-speed video measurement
CN106709955B (en) Space coordinate system calibration system and method based on binocular stereo vision
CN109084688B (en) Binocular vision distance measurement method based on variable-focus camera
CN108198224B (en) Linear array camera calibration device and calibration method for stereoscopic vision measurement
US11200714B2 (en) Virtual image distance measurement method, apparatus and device
CN107941153B (en) Visual system for optimizing calibration of laser ranging
JP2005514606A5 (en)
WO2011125937A1 (en) Calibration data selection device, method of selection, selection program, and three dimensional position measuring device
CN102944559A (en) Vision measurement method for anisotropic performance parameters in sheet forming
CN108332946A (en) A kind of reflection focal length in microlens array mold turnery processing is in position detecting method
CN106289086B (en) A kind of double camera measurement method for apart from Accurate Calibration between optical indicia point
CN102889864A (en) Detection system for tower shape of object with strip coil edge and detection method thereof
CN102759788A (en) Surface multi-point focusing system and surface multi-point focusing method
CN208091821U (en) Young's modulus measuring system
CN111982061B (en) Distance measurement method based on different focal lengths of binocular fixed-focus cameras
CN109389648B (en) Method for reducing measurement data error through data iteration
CN208061260U (en) A kind of line-scan digital camera caliberating device for stereo-visiuon measurement
CN113411497B (en) Automatic focusing method and device based on curve intersection point and Gaussian curve fitting
CN212646048U (en) MTF detection device
CN102338618A (en) On-site calibration and correction method for image measurement system
CN201392182Y (en) Lead rail linear deflection precision detection device based on optical lever

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20200828

Assignee: Xi'an Lianke Information Technology Co.,Ltd.

Assignor: CHANG'AN University

Contract record no.: X2023980048491

Denomination of invention: A device and method for calibrating imaging parameters of monocular vision systems

Granted publication date: 20230314

License type: Common License

Record date: 20231127