CN104729428A - Coaxial structural light based mirror face part three-dimensional shape measuring system and measuring method - Google Patents

Coaxial structural light based mirror face part three-dimensional shape measuring system and measuring method Download PDF

Info

Publication number
CN104729428A
CN104729428A CN201510089586.8A CN201510089586A CN104729428A CN 104729428 A CN104729428 A CN 104729428A CN 201510089586 A CN201510089586 A CN 201510089586A CN 104729428 A CN104729428 A CN 104729428A
Authority
CN
China
Prior art keywords
image
projector
light
camera
reflection mirror
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510089586.8A
Other languages
Chinese (zh)
Other versions
CN104729428B (en
Inventor
王中任
万仁全
刘海生
周岳斌
雷海燕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hubei University of Arts and Science
Original Assignee
Hubei University of Arts and Science
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hubei University of Arts and Science filed Critical Hubei University of Arts and Science
Priority to CN201510089586.8A priority Critical patent/CN104729428B/en
Publication of CN104729428A publication Critical patent/CN104729428A/en
Application granted granted Critical
Publication of CN104729428B publication Critical patent/CN104729428B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a coaxial structural light based mirror face part three-dimensional shape measuring system. The coaxial structural light based mirror face part three-dimensional shape measuring system comprises a projector, an industrial camera, a central processing unit and a light path system. The invention further discloses a measuring method of the measuring system. The measuring method comprises a demarcating stage and a measuring stage. Based on the structure and the measuring algorithm, the problem of the integrality of the accuracy, the efficiency and the data integrity of mirror face part three-dimensional shape measuring with the higher reflectivity is solved.

Description

Based on mirror face part three dimensional shape measurement system and the measuring method of coaxial configuration light
Technical field
The invention belongs to optical three-dimensional measurement technical field, relate to a kind of mirror face part three dimensional shape measurement system based on coaxial configuration light, the invention still further relates to the measuring method of this measuring system.
Background technology
Along with the high speed development of computing machine and the information processing technology, the three-dimensional measurement technology of structure based light reaches its maturity.Multi-line structured light three-dimensional measurement is a kind contactless metering system, has that automaticity is high, speed fast, precision high, is widely used at present in fields such as reverse-engineering, product quality Real-Time Monitoring, dress designing.Time but multi-line structured light three-dimensional measurement is carried out to accurately machined metal primary colors piece surface, multi-line structured light project piece surface can produce local mirror-reflection, reciprocally to penetrate, in these areas of specular reflection, do not observe reflecting object self, can only see its surrounding objects its surface formed picture, this similarly be distortion and can change with the change of viewing angle.In addition, mirror-reflection also can cause forming Gao Guang in the picture, and the region of this Gao Guang comprises stripe information seldom, and its color is different from the color of body surface itself.These factors bring very large interference to the image procossing in subsequent optical non-cpntact measurement, directly have influence on measuring accuracy, even cannot measure.Therefore, in the real-time three-dimensional of strong reflecting metal structural member is measured, the strong reflective problem in metal surface and repeatedly reflective problem are the bottleneck problems that must solve, and Fundamentals of Measurement theory and gordian technique need to break through.
For this problem, propose different solutions both at home and abroad.Traditional method is at the low chemical reagent of measured lens surface parts surface spraying one deck reflecting rate, as developer etc.The reflection characteristic method improving piece surface by coating can improve the precision of optical measurement greatly, but also exists that to measure operation long, the shortcomings such as destruction surface of the work performance.Document 1 (patent: Japan, JP 2010-185820 publication) a kind of lighting system of novelty is proposed, the light that lighting source is sent can not shine directly on testee, thus reduce the specular reflectance of metal parts, but the method that the document relates to just uses two dimensional image treatment technology, cannot measure and highly wait three-dimensional information.Liu Yuankun (Liu Yuankun, Su Xianyu, Wu Qingyang, based on class minute surface three dimension profile measurement method [J] of streak reflex. Acta Optica .2006.2 (11): 1636-1640.) etc. a kind of 3 D measuring method of class mirror article surface is proposed, he using thin film transistor (TFT) as projection source, the picture of the projection source utilizing single industrial camera observed objects surface to reflect is measured, but the measurement range of this method is less, and measuring accuracy is not high yet.Christopher (Christopher Waddington, Jonathan Kofman.Analysis ofmeasurement sensitivity to illuminance and fringe-pattern gray levels forfringe-pattern projection adaptive to ambient lighting [J] .Opt Laser Eng.2010; 48 (2): 251 – 256.) etc. for object illumination and fringe gray level level made striped projection measuring accuracy sensitivity analysis.The method only have adjusted the gray level of maximum candy strip for eliminating the impact of surround lighting, and avoids the saturated of image.When the brightness of surround lighting is higher, the saturated signal to noise ratio (S/N ratio) that can reduce stripe pattern of image.Disclose a kind of line-structured light triangulation method based on polarization structure light in patent US7092094B2, utilize polaroid to suppress mirror-reflection and the reciprocal light penetrated, there is certain effect.But this method needs the angle of constantly adjustment polaroid in measuring process, cause measuring process to be responsible for, inefficiency, the real-time that cannot be used for industry spot measures requirement.
Summary of the invention
The object of this invention is to provide a kind of mirror face part three dimensional shape measurement system based on coaxial configuration light, solve the precision of the stronger mirror face part optical 3-dimensional topography measurement of reflectivity, efficiency and data integrity issues.
Another object of the present invention is to provide the measuring method of above-mentioned measuring system.
The technical solution adopted in the present invention is, a kind of mirror face part three dimensional shape measurement system based on coaxial configuration light, comprises projector, industrial camera, central processing unit and light path system; Projector is other arranges light path system, light path system is made up of Fresnel Lenses, spectroscope, the first anti-reflection mirror and the second anti-reflection mirror, projector is installed in parallel in the focus place of Fresnel Lenses side, spectroscope level is that miter angle is arranged on Fresnel Lenses opposite side, Fresnel Lenses upper horizontal arranges the first anti-reflection mirror, Fresnel Lenses lower horizontal arranges the second anti-reflection mirror, below second anti-reflection mirror, chessboard calibration plate is set, the top of the first anti-reflection mirror arranges industrial camera, and central processing unit is connected with projector and industrial camera respectively.
Another technical scheme of the present invention is, a kind of measuring method of the mirror face part three dimensional shape measurement system based on coaxial configuration light, comprises calibration phase and measuring phases:
Calibration phase:
Step 1, projective structure light also gathers image, concrete steps are: the below first chessboard calibration plate being placed on the second anti-reflection mirror, projector projects goes out divergent shape structural light stripes pattern and becomes parallel shape structural light stripes by Fresnel Lenses, and the structural light stripes of level is by passing through the second anti-reflection mirror vertical directive chessboard calibration plate after dichroic mirror; Often project a width structural light stripes on chessboard calibration plate, industrial camera will catch by the second anti-reflection mirror, spectroscope and the first anti-reflection mirror the chessboard calibration plate illuminated by structural light stripes, by data line transfer to central processing unit, the image sequence number of vertical direction striped is 20 width, add the scaling board image that 1 width projection is complete in vain, 1 width projection is entirely black, the scaling board image of one group is 42 width, converts chessboard calibration plate after shooting, gathers 42 width images of next group;
Step 2, demarcates the internal reference matrix of industrial camera: complete 5 groups of scaling board pictures to be collected, and central processing unit, first by the chessboard calibration board size information inputted, generates the world coordinates information (X of each angle point w, Y w, Z w), due to XOY plane and the chessboard calibration plate target planes overlapping of world coordinate system, therefore Z w=0; Then Corner Detection is carried out to first complete white scaling board image, generate the camera image coordinate information (x of each angle point c, y c), the internal reference matrix of industrial camera is drawn with Zhang Zhengyou scaling method;
Step 3, the internal reference matrix of labeling projection instrument: utilize the code structure striations image sequence of horizontal direction and vertical direction to come direct light component and the indirect light component of computed image, if S={I 1, I 2..., I kbe the coded structured light stripe pattern sequence inputted, p is certain pixel on figure, and direct light component and the indirect light component of some p are respectively L d(p) and L gp (), then have:
L p + = max 0 < i &le; k I i ( p ) , L p - = min 0 < i &le; k I i ( p ) - - - ( 1 )
L d ( p ) = L p + - L p - 1 - b , L g ( p ) = 2 L p - - b L p + 1 - b 2 - - - ( 2 )
Wherein K represents the sum of the coded structured light stripe pattern sequence of input; I is current coded structured light stripe pattern sequence; L + prepresent the max pixel value of some p in all Selective sequences; L + prepresent the minimum pixel value of some p in all Selective sequences; B ∈ [0,1), representing the ratio of environmental light brightness and the brightness of projector direct light, is determined by the dark fringe gray-scale value of projector projects;
Step 4, utilizes the L of each pixel of image d(p) and L gp (), carries out Threshold segmentation to the structural light stripes in image, then decode to the image after Threshold segmentation with the inverse process of coding, draw each pixel coordinate on each projector image; The a that sets up an office is the some pixels on camera image, and b point is the corresponding pixel on projector image planes of a, a and b at the respective homogeneous pixel coordinate as plane is:
a=[x c,y c,1] T,b=[x p,y p,1] T(3)
Wherein [x c, y c, 1] tfor an a at camera as the homogeneous coordinates in plane; [x p, y p, 1] tfor a b at projector as the homogeneous coordinates in plane;
Step 5, the homography matrix between defining point a and b is H, makes formula (4) below minimum:
H ^ = arg min H &Sigma; &ForAll; a | | a - Hb | | 2 - - - ( 4 )
Wherein for the minimum value of above-mentioned functional;
Step 6, the angle point under each camera image coordinate system that step 2 obtains formula (5) below of applying can show that this angle point is corresponding under projector image coordinate system
b &OverBar; = H ^ &CenterDot; a &OverBar; - - - ( 5 )
Step 7, by obtaining each corner pixels coordinate (x under camera image coordinate system above c, y c) corresponding pixel coordinate (x under projector image coordinate system p, y p), and the world coordinates information of angle point is (X w, Y w, Z w), use the method for Zhang Zhengyou can demarcate the internal reference matrix drawing projector;
Step 8, the outer ginseng matrix between labeling projection instrument and camera: for the chessboard calibration plate image determining attitude, the transformational relation between camera coordinates system C and projector coordinates system C ' is such as formula shown in (6):
C'=R·C+T (6)
Wherein [R, T] is the outer ginseng matrix between camera and projector;
Step 9, according to the inside and outside parameter of video camera and projector, draws reprojection's error of demarcation, as the criterion of stated accuracy;
Measuring phases:
Step 10, imports the calibrating parameters that calibration phase obtains;
Step 11, projective structure light also gathers image: below mirror face part being placed on the second anti-reflection mirror, according to the Part I of calibration phase, successively to mirror face part projective structure light;
Step 12, industrial camera can catch the mirror face part illuminated by structural light stripes, by data line transfer to central processing unit by the second anti-reflection mirror, spectroscope and the first anti-reflection mirror;
Step 13, calculate the three-dimensional information of testee: central processing unit to this 42 width the mirror face part image that irradiates by structured light carry out the calculating of direct light component and indirect light component, Threshold segmentation is carried out to the structural light stripes in image, then with the inverse process of coding, the image after Threshold segmentation is decoded, in conjunction with the calibration result of measurement mechanism, thus draw the three-dimensional appearance information of testee.
The invention has the beneficial effects as follows, for the reflective problem of metallic mirror surface part, structurally, the present invention utilizes Fresnel Lenses to form a parallel structured light, parallel construction striations be mapped to level be miter angle spectroscope on, after the mirror that is split reflection by anti-reflection mirror vertical sand shooting to mirror face part, the light of reflection is vertically upward through spectroscope, enter camera, so both eliminated reflective, turn avoid in image the inverted image producing camera; In Measurement Algorithm, direct light component and the indirect light component of part reflection configuration light is first calculated during decoding, can distinguish camera collection to image in specular light and diffuse, thus Threshold segmentation is carried out to the structural light stripes of mirror face part reflection, effectively can solve mirror face part and reflect the excessive problem of the structural light stripes Threshold segmentation error that causes.The present invention solves the precision of the stronger mirror face part optical 3-dimensional topography measurement of reflectivity, efficiency and data integrity issues from structure and Measurement Algorithm.
Accompanying drawing explanation
Fig. 1 is that three-dimensional measuring apparatus of the present invention demarcates schematic diagram.
Fig. 2 is three-dimensional measuring apparatus instrumentation plan of the present invention.
Fig. 3 is the calibration algorithm process flow diagram in the present invention.
Fig. 4 is the measurement procedure figure in the present invention.
In figure, 1. projector, 2. Fresnel Lenses, 3. industrial camera, 4. the first anti-reflection mirror, 5. spectroscope, 6. light path system, 7. the second anti-reflection mirror, 8. structural light stripes, 9. chessboard calibration plate, 10. central processing unit, 11. mirror face parts.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in detail.
A kind of mirror face part three dimensional shape measurement system based on coaxial configuration light of the present invention, structural representation as Figure 1-Figure 2,
Comprise: projector 1, industrial camera 3, central processing unit 10 and light path system 6.
Projector 1 is other arranges light path system 6, light path system 6 is by Fresnel Lenses 2, spectroscope 5, first anti-reflection mirror 4 and the second anti-reflection mirror 7 form, projector 1 is installed in parallel in the focus place of Fresnel Lenses 2 side, spectroscope 5 level is that miter angle is arranged on Fresnel Lenses 2 opposite side, Fresnel Lenses 2 upper horizontal arranges the first anti-reflection mirror 4, Fresnel Lenses 2 lower horizontal arranges the second anti-reflection mirror 7, below second anti-reflection mirror 7, chessboard calibration plate 9 is set, the top of the first anti-reflection mirror 4 arranges industrial camera 3, central processing unit 10 is connected with projector 1 and industrial camera 3 respectively.
Projector 1: in chronological order structured light provision pattern is projected on measurand and chessboard scaling board 9 successively by light path system 6.
Industrial camera 3: for the image of catching measurand and chessboard scaling board 9 and the structured light provision pattern changed in chronological order.
Central processing unit 10: with image pick-up card, for connecting projector 1 above and industrial camera 3,1024*768 is set to according to by the resolution of projector 1, the projector 1 that central processing unit 10 controls projects 42 width structured light provision patterns, and the order of projection is complete white, 1 width black, 20 width horizontal directions, the 20 width vertical direction structured light provision patterns entirely of 1 width.In addition, by above-mentioned industrial camera 3 gather the measurement scene image that illuminates by structural light stripes 8, in conjunction with the inside and outside parameter of demarcating the measuring system obtained, above-mentioned carrying out is decoded and calculates the three-dimensional point cloud information of measurand.
Light path system 6: be made up of Fresnel Lenses 2, spectroscope 5 and the anti-reflection mirror 7 of the first anti-reflection mirror 4, second, projector 1 is installed in parallel in the focus place of Fresnel Lenses 2, the divergent structure striations that projector 1 projects becomes parallel construction striations after Fresnel Lenses 2, parallel construction striations be mapped to level be miter angle spectroscope 5 on, the mirror 5 that is split reflection after by the second anti-reflection mirror 7 vertical sand shooting in measurand and chessboard scaling board 9.
Measuring method based on the mirror face part three dimensional shape measurement system of coaxial configuration light comprises calibration phase and measuring phases:
Calibration phase: accompanying drawing 1 is shown in by calibration structure schematic diagram, calibration algorithm process flow diagram is shown in Fig. 3.
Step 1, projective structure light also gathers image, concrete steps are: the below first chessboard calibration plate 9 being placed on the second anti-reflection mirror 7, projector 1 projects divergent shape structural light stripes pattern and becomes parallel shape structural light stripes by Fresnel Lenses 2, by the second anti-reflection mirror 7 vertically directive chessboard calibration plate 9 after the structural light stripes of level is reflected by spectroscope 5; Often project a width structural light stripes on chessboard calibration plate 9, industrial camera 3 will catch by the second anti-reflection mirror 7, spectroscope 5 and the first anti-reflection mirror 4 the chessboard calibration plate 9 illuminated by structural light stripes, by data line transfer to central processing unit 10, the present invention's projector 1 resolution used is 1024*768, according to the coding rule of structural light stripes, the image sequence number of horizontal direction striped is 2*log 21024=20 width, the image sequence number 2*log of vertical direction striped 2768=19.1699, rounds up here, therefore the image sequence number of vertical direction striped is 20 width, add the scaling board image that 1 width projection is complete in vain, 1 width projection is entirely black, the scaling board image of one group is 42 width, converts chessboard calibration plate 9 after shooting, gathers 42 width images of next group.
Step 2, demarcates the internal reference matrix of industrial camera: complete 5 groups of scaling board pictures to be collected, and central processing unit 10, first by chessboard calibration plate 9 dimension information inputted, generates the world coordinates information (X of each angle point w, Y w, Z w), due to XOY plane and the chessboard calibration plate 9 target planes overlapping of world coordinate system, therefore Z w=0.Then Corner Detection is carried out to first complete white scaling board image, generate the camera image coordinate information (x of each angle point c, y c), the internal reference matrix of industrial camera is drawn with the scaling method of Zhang Zhengyou.
Step 3, the internal reference matrix of labeling projection instrument 1: utilize the code structure striations image sequence of horizontal direction and vertical direction to come direct light component and the indirect light component of computed image, if S={I 1, I 2..., I kbe the code structure striations image sequence inputted, p is certain pixel on figure, and direct light component and the indirect light component of some p are respectively L d(p) and L gp (), then have:
L p + = max 0 < i &le; k I i ( p ) , L p - = min 0 < i &le; k I i ( p ) - - - ( 1 )
L d ( p ) = L p + - L p - 1 - b , L g ( p ) = 2 L p - - b L p + 1 - b 2 - - - ( 2 )
Wherein K represents the sum of the coded structured light stripe pattern sequence of input; I is current coded structured light stripe pattern sequence; L + prepresent the max pixel value of some p in all Selective sequences; L + prepresent the minimum pixel value of some p in all Selective sequences; Wherein b ∈ [0,1), representing that ambient light intensity accounts for the ratio of projector direct light intensity, is determined by the dark fringe gray-scale value of projector projects.
Step 4, utilizes the L of each pixel of image d(p) and L gp (), carries out Threshold segmentation to the structural light stripes in image, then decode to the image after Threshold segmentation with the inverse process of coding, draw each pixel coordinate on each projector image.The a that sets up an office is the some pixels on camera image, and b point is the corresponding pixel on projector image planes of a, a and b at the respective homogeneous pixel coordinate as plane is:
a=[x c,y c,1] T,b=[x p,y p,1] T(3)
Wherein [x c, y c, 1] tfor an a at camera as the homogeneous coordinates in plane; [x p, y p, 1] tfor a b at projector as the homogeneous coordinates in plane.
Step 5, between defining point a and b homography matrix be H, make formula (4) below minimum:
H ^ = arg min H &Sigma; &ForAll; a | | a - Hb | | 2 - - - ( 4 )
Wherein for the minimum value of above-mentioned functional.
Step 6, the angle point under each camera image coordinate system that step 2 obtains formula (5) below of applying can show that this angle point is corresponding under projector image coordinate system
b &OverBar; = H ^ &CenterDot; a &OverBar; - - - ( 5 )
Step 7, by obtaining each corner pixels coordinate (x under camera image coordinate system above c, y c) corresponding pixel coordinate (x under projector image coordinate system p, y p), and the world coordinates information of angle point is (X w, Y w, Z w), use the method for Zhang Zhengyou can demarcate the internal reference matrix drawing projector.
Step 8, the outer ginseng matrix between labeling projection instrument and camera: for the chessboard calibration plate image determining attitude, the transformational relation between camera coordinates system C and projector coordinates system C ' is such as formula shown in (6):
C’=R·C+T (6)
Wherein [R, T] is the outer ginseng matrix between camera and projector.
Step 9, according to the inside and outside parameter of video camera and projector, draws reprojection's error of demarcation, as the criterion of stated accuracy.
Measuring phases: schematic diagram as shown in Figure 2; Process flow diagram as shown in Figure 4.
Step 10, imports the calibrating parameters that calibration phase obtains.
Step 11, projective structure light also gathers image: below mirror face part 11 being placed on the second anti-reflection mirror 7, according to the Part I of calibration phase, successively to mirror face part 11 projective structure light.
Step 12, industrial camera 3 can catch the mirror face part 11 illuminated by structural light stripes, by data line transfer to central processing unit 10 by the second anti-reflection mirror 7, spectroscope 5 and the first anti-reflection mirror 4.
Step 13, calculate the three-dimensional information of testee: central processing unit 10 to this 42 width mirror face part 11 image that irradiates by structured light carry out the calculating of direct light component and indirect light component, Threshold segmentation is carried out to the structural light stripes in image, then with the inverse process of coding, the image after Threshold segmentation is decoded.In conjunction with the calibration result of measurement mechanism, thus draw the three-dimensional appearance information of testee.
Measuring process is divided into calibration phase and measuring phases, after once demarcating, if the structural parameters of system do not change, then can carry out lasting repetitive measurement.Patent of the present invention uses the DLP projector of brightness constancy as structured light light source, utilize semi-transparent semi-reflecting spectroscope vertical reflection structured light to chessboard calibration plate and measure body surface, the three-dimensional appearance information of body surface again with different intensity light vertical reflection light to semi-transparent semi-reflecting spectroscope and through eyeglass gather by camera, utilize the one side anti-reflection eyeglass close with projector light wave to increase effective light transmission rate in process, utilize inside surface to be atomized the impact of blackening process minimizing parasitic light.

Claims (3)

1. based on a mirror face part three dimensional shape measurement system for coaxial configuration light, it is characterized in that, comprise projector (1), industrial camera (3), central processing unit (10) and light path system (6);
Projector (1) is other arranges light path system (6), light path system (6) is by Fresnel Lenses (2), spectroscope (5), first anti-reflection mirror (4) and the second anti-reflection mirror (7) form, projector (1) is installed in parallel in the focus place of Fresnel Lenses (2) side, spectroscope (5) level is that miter angle is arranged on Fresnel Lenses (2) opposite side, Fresnel Lenses (2) upper horizontal arranges the first anti-reflection mirror (4), Fresnel Lenses (2) lower horizontal arranges the second anti-reflection mirror (7), second anti-reflection mirror (7) below arranges chessboard calibration plate (9), the top of the first anti-reflection mirror (4) arranges industrial camera (3), central processing unit (10) is connected with projector (1) and industrial camera (3) respectively.
2. a kind of mirror face part three dimensional shape measurement system based on coaxial configuration light according to claim 1, it is characterized in that, described central processing unit (10) is with image pick-up card.
3. based on a measuring method for the mirror face part three dimensional shape measurement system of coaxial configuration light, it is characterized in that, comprise calibration phase and measuring phases:
Calibration phase:
Step 1, projective structure light also gathers image, concrete steps are: the below first chessboard calibration plate (9) being placed on the second anti-reflection mirror (7), projector (1) projects divergent shape structural light stripes pattern and becomes parallel shape structural light stripes by Fresnel Lenses (2), and the structural light stripes of level is by passing through the second anti-reflection mirror (7) vertically directive chessboard calibration plate (9) after spectroscope (5) reflection; Often project a width structural light stripes on chessboard calibration plate (9), industrial camera (3) will pass through the second anti-reflection mirror (7), spectroscope (5) and the first anti-reflection mirror (4) and catch the chessboard calibration plate (9) illuminated by structural light stripes, by data line transfer to central processing unit (10), the image sequence number of vertical direction striped is 20 width, add the scaling board image that 1 width projection is complete in vain, 1 width projection is entirely black, the scaling board image of one group is 42 width, convert chessboard calibration plate (9) after shooting, gather 42 width images of next group;
Step 2, demarcates the internal reference matrix of industrial camera: complete 5 groups of scaling board pictures to be collected, and central processing unit (10), first by chessboard calibration plate (9) dimension information inputted, generates the world coordinates information (X of each angle point w, Y w, Z w), due to XOY plane and chessboard calibration plate (9) the target planes overlapping of world coordinate system, therefore Z w=0; Then Corner Detection is carried out to first complete white scaling board image, generate the camera image coordinate information (x of each angle point c, y c), the internal reference matrix of industrial camera is drawn with Zhang Zhengyou scaling method;
Step 3, the internal reference matrix of labeling projection instrument (1): utilize the code structure striations image sequence of horizontal direction and vertical direction to come direct light component and the indirect light component of computed image, if S={I 1, I 2..., I kbe the coded structured light stripe pattern sequence inputted, p is certain pixel on figure, and direct light component and the indirect light component of some p are respectively L d(p) and L gp (), then have:
L p + = max 0 < i &le; k I i ( p ) , L p - = min 0 < i &le; k I i ( p ) - - - ( 1 )
L d ( p ) = L p + - L p - 1 - b , L g ( p ) = 2 L p - - b L p + 1 - b 2 - - - ( 2 )
Wherein K represents the sum of the coded structured light stripe pattern sequence of input; I is current coded structured light stripe pattern sequence; L + prepresent the max pixel value of some p in all Selective sequences; L + prepresent the minimum pixel value of some p in all Selective sequences; B ∈ [0,1), representing the ratio of environmental light brightness and the brightness of projector direct light, is determined by the dark fringe gray-scale value of projector projects;
Step 4, utilizes the L of each pixel of image d(p) and L gp (), carries out Threshold segmentation to the structural light stripes in image, then decode to the image after Threshold segmentation with the inverse process of coding, draw each pixel coordinate on each projector image; The a that sets up an office is the some pixels on camera image, and b point is the corresponding pixel on projector image planes of a, a and b at the respective homogeneous pixel coordinate as plane is:
a=[x c,y c,1] T,b=[x p,y p,1] T(3)
Wherein [x c, y c, 1] tfor an a at camera as the homogeneous coordinates in plane; [x p, y p, 1] tfor a b at projector as the homogeneous coordinates in plane;
Step 5, the homography matrix between defining point a and b is H, makes formula (4) below minimum:
H ^ = arg min H &Sigma; &ForAll; a | | a - Hb | | 2 - - - ( 4 )
Wherein for the minimum value of above-mentioned functional;
Step 6, the angle point under each camera image coordinate system that step 2 obtains formula (5) below of applying can show that this angle point is corresponding under projector image coordinate system
b &OverBar; = H ^ &CenterDot; a &OverBar; - - - ( 5 )
Step 7, by obtaining each corner pixels coordinate (x under camera image coordinate system above c, y c) corresponding pixel coordinate (x under projector image coordinate system p, y p), and the world coordinates information of angle point is (X w, Y w, Z w), use the method for Zhang Zhengyou can demarcate the internal reference matrix drawing projector;
Step 8, the outer ginseng matrix between labeling projection instrument and camera: for the chessboard calibration plate image determining attitude, the transformational relation between camera coordinates system C and projector coordinates system C ' is such as formula shown in (6):
C′=R·C+T (6)
Wherein [R, T] is the outer ginseng matrix between camera and projector;
Step 9, according to the inside and outside parameter of video camera and projector, draws reprojection's error of demarcation, as the criterion of stated accuracy;
Measuring phases:
Step 10, imports the calibrating parameters that calibration phase obtains;
Step 11, projective structure light also gathers image: below mirror face part (11) being placed on the second anti-reflection mirror (7), according to the Part I of calibration phase, successively to mirror face part (11) projective structure light;
Step 12, industrial camera (3) can catch the mirror face part (11) illuminated by structural light stripes, by data line transfer to central processing unit (10) by the second anti-reflection mirror (7), spectroscope (5) and the first anti-reflection mirror (4);
Step 13, calculate the three-dimensional information of testee: central processing unit (10) to this 42 width mirror face part (11) image that irradiates by structured light carry out the calculating of direct light component and indirect light component, Threshold segmentation is carried out to the structural light stripes in image, then with the inverse process of coding, the image after Threshold segmentation is decoded, in conjunction with the calibration result of measurement mechanism, thus draw the three-dimensional appearance information of testee.
CN201510089586.8A 2015-02-27 2015-02-27 Mirror face part three dimensional shape measurement system and measurement method based on coaxial configuration light Active CN104729428B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510089586.8A CN104729428B (en) 2015-02-27 2015-02-27 Mirror face part three dimensional shape measurement system and measurement method based on coaxial configuration light

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510089586.8A CN104729428B (en) 2015-02-27 2015-02-27 Mirror face part three dimensional shape measurement system and measurement method based on coaxial configuration light

Publications (2)

Publication Number Publication Date
CN104729428A true CN104729428A (en) 2015-06-24
CN104729428B CN104729428B (en) 2018-12-14

Family

ID=53453554

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510089586.8A Active CN104729428B (en) 2015-02-27 2015-02-27 Mirror face part three dimensional shape measurement system and measurement method based on coaxial configuration light

Country Status (1)

Country Link
CN (1) CN104729428B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105157615A (en) * 2015-06-30 2015-12-16 上海航天动力科技工程有限公司 Three-dimensional shape measurement system for vacuum
CN105403173A (en) * 2015-12-29 2016-03-16 上海大学 Calibration mirror of light field deflection measuring system and application method of calibration mirror
CN107063122A (en) * 2017-04-28 2017-08-18 西安工业大学 The detection method and its device of surface shape of optical aspheric surface
CN107144240A (en) * 2017-05-12 2017-09-08 电子科技大学 A kind of system and method for detecting glass panel surface defect
CN108303040A (en) * 2018-02-27 2018-07-20 武汉理工大学 A kind of three-dimension measuring system and application method based on plane compound eye and coaxial configuration light
CN108507494A (en) * 2018-03-07 2018-09-07 北京航空航天大学 A kind of 3 D measuring method that indirect light can be inhibited to shine
US10261025B2 (en) 2016-11-04 2019-04-16 Industrial Technology Research Institute Workpiece surface detection method and system using the same
CN113227707A (en) * 2019-01-08 2021-08-06 欧姆龙株式会社 Three-dimensional shape measurement device, three-dimensional shape measurement method, and program
CN114280075A (en) * 2021-12-28 2022-04-05 无锡维度机器视觉产业技术研究院有限公司 Online visual inspection system and method for surface defects of pipe parts

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5337096A (en) * 1993-08-23 1994-08-09 Pantech, Inc. Method for generating three-dimensional spatial images
JPH06281423A (en) * 1993-03-26 1994-10-07 Komatsu Ltd Three-dimensional measuring device
JP2006058142A (en) * 2004-08-20 2006-03-02 Fuji Xerox Co Ltd Three-dimensional profile measuring apparatus and method
FR2921732A1 (en) * 2007-09-28 2009-04-03 Noomeo Soc Par Actions Simplif Contactless scanning device for constructing synthesis image of apple in e.g. industrial field, has camera including sensor placed in optical axle, where distance between sensor and mirror is less than distance between pattern and mirror
US8094318B2 (en) * 2002-09-25 2012-01-10 New York University Method and apparatus for determining reflectance data of a subject
CN102752484A (en) * 2012-06-25 2012-10-24 清华大学 Fast non-global uniform image shaking blur removal algorithm and system thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06281423A (en) * 1993-03-26 1994-10-07 Komatsu Ltd Three-dimensional measuring device
US5337096A (en) * 1993-08-23 1994-08-09 Pantech, Inc. Method for generating three-dimensional spatial images
US8094318B2 (en) * 2002-09-25 2012-01-10 New York University Method and apparatus for determining reflectance data of a subject
JP2006058142A (en) * 2004-08-20 2006-03-02 Fuji Xerox Co Ltd Three-dimensional profile measuring apparatus and method
FR2921732A1 (en) * 2007-09-28 2009-04-03 Noomeo Soc Par Actions Simplif Contactless scanning device for constructing synthesis image of apple in e.g. industrial field, has camera including sensor placed in optical axle, where distance between sensor and mirror is less than distance between pattern and mirror
CN102752484A (en) * 2012-06-25 2012-10-24 清华大学 Fast non-global uniform image shaking blur removal algorithm and system thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SHREE K. NAYAR 等: "《Fast Separation of Direct and Global Components of a Scene using High Frequency Illumination》", 《ASSOCIATION FOR COMPUTING MACHINERY》 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105157615A (en) * 2015-06-30 2015-12-16 上海航天动力科技工程有限公司 Three-dimensional shape measurement system for vacuum
CN105157615B (en) * 2015-06-30 2018-08-31 上海航天动力科技工程有限公司 A kind of three dimensional shape measurement system for vacuum
CN105403173B (en) * 2015-12-29 2018-05-01 上海大学 A kind of light field deviation art measuring system calibration mirror and its application process
CN105403173A (en) * 2015-12-29 2016-03-16 上海大学 Calibration mirror of light field deflection measuring system and application method of calibration mirror
US10261025B2 (en) 2016-11-04 2019-04-16 Industrial Technology Research Institute Workpiece surface detection method and system using the same
CN107063122A (en) * 2017-04-28 2017-08-18 西安工业大学 The detection method and its device of surface shape of optical aspheric surface
CN107063122B (en) * 2017-04-28 2019-11-29 西安工业大学 The detection method and its device of surface shape of optical aspheric surface
CN107144240A (en) * 2017-05-12 2017-09-08 电子科技大学 A kind of system and method for detecting glass panel surface defect
CN108303040A (en) * 2018-02-27 2018-07-20 武汉理工大学 A kind of three-dimension measuring system and application method based on plane compound eye and coaxial configuration light
CN108303040B (en) * 2018-02-27 2019-04-09 武汉理工大学 Three-dimension measuring system and application method based on plane compound eye and coaxial configuration light
CN108507494A (en) * 2018-03-07 2018-09-07 北京航空航天大学 A kind of 3 D measuring method that indirect light can be inhibited to shine
CN113227707A (en) * 2019-01-08 2021-08-06 欧姆龙株式会社 Three-dimensional shape measurement device, three-dimensional shape measurement method, and program
CN114280075A (en) * 2021-12-28 2022-04-05 无锡维度机器视觉产业技术研究院有限公司 Online visual inspection system and method for surface defects of pipe parts

Also Published As

Publication number Publication date
CN104729428B (en) 2018-12-14

Similar Documents

Publication Publication Date Title
CN104729428A (en) Coaxial structural light based mirror face part three-dimensional shape measuring system and measuring method
CN107607040B (en) Three-dimensional scanning measurement device and method suitable for strong reflection surface
Feng et al. General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique
Feng et al. Fast three-dimensional measurements for dynamic scenes with shiny surfaces
Jiang et al. High dynamic range fringe acquisition: a novel 3-D scanning technique for high-reflective surfaces
Lin et al. Three-dimensional shape measurement technique for shiny surfaces by adaptive pixel-wise projection intensity adjustment
Tarini et al. 3D acquisition of mirroring objects using striped patterns
WO2018103693A1 (en) Hybrid light measurement method for measuring three-dimensional profile
EP2881702B1 (en) Image processing system, and image processing method
CN104677308B (en) A kind of 3-D scanning method of high frequency two-value striped
Zhang et al. A robust surface coding method for optically challenging objects using structured light
Huang et al. A fast and flexible projector-camera calibration system
Lin et al. Review and comparison of high‐dynamic range three‐dimensional shape measurement techniques
CN105651203A (en) High-dynamic-range three-dimensional shape measurement method for self-adaptation fringe brightness
Zhongdong et al. 3D laser scanner system using high dynamic range imaging
JP2011002240A (en) Three-dimensional shape measurement method and device
CN204902786U (en) Can reduce three -dimensional measurement system of measured object surface reflection of light
Yin et al. High dynamic range imaging for fringe projection profilometry with single-shot raw data of the color camera
Zou et al. High-accuracy calibration of line-structured light vision sensors using a plane mirror
Wang et al. Highly reflective surface measurement based on dual stereo monocular structured light system fusion
CN103868473A (en) Method for highlight body surface phase quick recovery based on recurrence method
Xu et al. An effective framework for 3D shape measurement of specular surface based on the dichromatic reflection model
Masuyama et al. Depth from projector's defocus based on multiple focus pattern projection
CN102798354A (en) Binary stripe stack based sinusoidal grating generation method
CN114612409A (en) Projection calibration method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant