CN107462184A - The parameter recalibration method and its equipment of a kind of structured light three-dimensional measurement system - Google Patents

The parameter recalibration method and its equipment of a kind of structured light three-dimensional measurement system Download PDF

Info

Publication number
CN107462184A
CN107462184A CN201710695449.8A CN201710695449A CN107462184A CN 107462184 A CN107462184 A CN 107462184A CN 201710695449 A CN201710695449 A CN 201710695449A CN 107462184 A CN107462184 A CN 107462184A
Authority
CN
China
Prior art keywords
msub
mtd
mrow
projecting apparatus
mtr
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710695449.8A
Other languages
Chinese (zh)
Other versions
CN107462184B (en
Inventor
周平
于云雷
何思渊
蔡国超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southeast University
Original Assignee
Southeast University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southeast University filed Critical Southeast University
Priority to CN201710695449.8A priority Critical patent/CN107462184B/en
Publication of CN107462184A publication Critical patent/CN107462184A/en
Application granted granted Critical
Publication of CN107462184B publication Critical patent/CN107462184B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/2433Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures for measuring outlines by shadow casting

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The parameter recalibration method and its equipment of a kind of structured light three-dimensional measurement system, increase auxiliary camera in the system with a camera and a projecting apparatus to projecting apparatus intrinsic parameter progress recalibration.Place high-precision white plate, projector projects structured light patterns, original system camera and auxiliary camera collection white plate pattern.Double camera is demarcated first, obtains auxiliary camera parameter;Secondly white plate is rebuild according to principle of stereoscopic vision using the photo of shooting, on the Dian Yun back projections of reconstruction to projector are practised physiognomy again, calculate corresponding projected phase, and make the difference to obtain phase residual error value with its actual phase, the error amount of projecting apparatus transverse direction equivalent focal length and horizontal photocentre is finally calculated using the principle of least square, the recalibration of projecting apparatus intrinsic parameter is completed, improves the stated accuracy of structured light three-dimensional measurement system.

Description

The parameter recalibration method and its equipment of a kind of structured light three-dimensional measurement system
Technical field
The present invention relates to a kind of projecting apparatus intrinsic parameter recalibration method in structured light three-dimensional measurement system and its equipment, category In technical field of computer vision.
Background technology
Structured light three-dimensional measurement system is a kind of important three-dimension measuring system in computer vision field, have it is quick, Assemble simple, high-precision feature.And the precision of systematic parameter then directly determines the measurement accuracy of system.
The parameter of structured light three-dimensional measurement system is obtained by demarcating, and the quality of scaling method, which directly determines, to be obtained Systematic parameter precision.The demarcation of system at present mainly includes two parts, respectively camera calibration and projector calibrating.Phase The research of machine demarcation is long-standing, and classical method has Method of Direct Liner Transformation, Tsai two-stage calibration method, Zhang Zhengyou plane Standardization and self-calibrating method etc..It is the most commonly used and ripe with Zhang Zhengyou plane reference method at present, form different languages Say tool box.Projector calibrating is completed based on the scaling method of camera, and it is different that different researchers are that projecting apparatus establishes Mathematical modeling simultaneously gives corresponding scaling method, wherein it is more conventional it is a kind of be that projecting apparatus is considered as a reverse phase Machine, projecting apparatus " is shot " photo by the method for structure light, then projecting apparatus is demarcated.The mark of projecting apparatus at present Fixed still immature, the proj ector parameters error that the above method is obtained is often the several times of camera parameter error, and this is also current Structured light three-dimensional measurement system, the measurement accuracy for the measuring system being particularly made up of a camera and a projecting apparatus be not high Main cause.
The content of the invention
The problem of existing for existing projector calibrating technology, the present invention proposes a kind of structured light three-dimensional measurement system The recalibration method and apparatus of middle projecting apparatus intrinsic parameter, technical scheme are as follows:
A kind of parameter recalibration method of structured light three-dimensional measurement system, structured light three-dimensional measurement system include a camera With a projecting apparatus, it is characterised in that:The proj ector parameters in structured light three-dimensional measurement system are demarcated for the first time first, so An auxiliary camera is set up in structured light three-dimensional measurement system afterwards, based on to intrinsic parameter in the first calibration process of proj ector parameters The analysis of error, parameter error is attributed to the error of horizontal principal point and horizontal equivalent focal length in projecting apparatus intrinsic parameter, then divided The specific influence of horizontal principal point and horizontal equivalent focal length both intrinsic parameter errors for system is separated out, is marked again by auxiliary camera The intrinsic parameter of projecting apparatus is determined, to improve the stated accuracy of structured light three-dimensional measurement system;Comprise the following steps:
1) camera and projecting apparatus are built into structured light three-dimensional measurement system, just deutero-albumose is carried out to the parameter of projecting apparatus Fixed, projecting apparatus is that scaling board projects one group of grating to testee, using phase measuring profilometer method, is obtained through testee I.e. scaling board case depth modulation phase, accordingly direct reverse obtain world coordinates:
Wherein, fcx,fcy,fpxRepresent respectively the horizontal equivalent focal length of camera, longitudinal equivalent focal length and projecting apparatus laterally etc. Imitate focal length;cccx,cccy,ccpxThe horizontal principal point of the horizontal principal point of camera, longitudinal principal point and projecting apparatus is represented respectively;Xw,Yw,Zw Represent coordinate value of the certain point under world coordinate system in space;Due to fpxWith ccpxRespectively include error delta f and Δ cc, Δ F=fT-fpx,fTFor fpxTrue value, Δ cc=ccT-ccpx, ccTFor ccpxTrue value, therefore the weight obtained by formula (1)~(3) Cloud of laying foundations also includes error;R in formula (1)~(3)i,mj,tkBy Rc,Tc,Rp,TpObtain, wherein ri=r1~r9, mj=m1 ~m9, tk=t1~t6, Rc,TcRepresent the spin matrix and translation vector of camera, Rp,TpRepresent the spin matrix peace of projecting apparatus The amount of shifting to, concrete form are as follows:
2) auxiliary camera, the position of setting are set up in the structured light three-dimensional measurement system that a camera and projecting apparatus are formed Basic demand is that auxiliary camera photographs scaling board simultaneously with original camera, and scaling board is placed in into auxiliary camera and original camera In tested region, combined calibrating is carried out to the dual camera systems being made up of auxiliary camera and former camera, obtains the interior of auxiliary camera Outer parameter matrix between parameter matrix and two cameras;
3) scaling board is measured and rebuild, start projector projects grating pattern, two cameras gather demarcation respectively Plate image, based on principle of stereoscopic vision, scaling board is carried out using the image of two cameras to rebuild acquisition three dimensional point cloud PA;
4) the three dimensional point cloud PA of acquisition is calculated according to projection equation and projected in the projection plane of projecting apparatus, obtained uFAnd Xn, wherein uFThe row coordinate projected to for the proj ector parameters of the included errors of three dimensional point cloud PA after projection plane, Xn Normalization projector coordinates are represented, are defined as Xn=(Xp/Zp);According further to projector projects pattern phase and projection plane One-to-one relationship directly obtains up, upFor the row coordinate of the projector projects plane directly calculated by phase, consider to sit in the world An arbitrfary point C in given space under mark systemw, remember Cw=[Xw Yw Zw] represent coordinate of this under world coordinate system, then its Corresponding point C in projector coordinates systempCoordinate be just denoted as Cw=[Xp Yp Zp];Projection equation is as follows:
Cp=RpCw+Tp (4)
It is hereby achieved that:
uF=fpxXn+ccpx (6)
up=(fpx+Δf)Xn+ccpx+Δcc (7)
Because projecting apparatus intrinsic parameter includes error, therefore the projection row coordinate u of gainedFWith error, and upPass through phase Directly it is calculated, not comprising projecting apparatus intrinsic parameter error, re-projection row coordinate u is calculatedFWith true row coordinate up, counterweight Project row coordinate uFWith true row coordinate upMake the difference, obtain phase residual error;
5) institute in the three dimensional point cloud PA of acquisition is a little handled according to step 4) is described, obtained by row coordinate uFWith upThe residual error set of composition, u can be directly obtained from phasep, u is obtained further according to a cloud PA re-projectionFAnd XnAfterwards using most A young waiter in a wineshop or an inn multiplies principle and obtains the error amount of the corrected value of projecting apparatus intrinsic parameter, i.e., horizontal equivalent focal length correction value delta f and horizontal photocentre Δ cc, according to the derivation in step 4), obtain following formula
up-uF=(Δ f) Xn+(Δcc) (8)
6) projecting apparatus intrinsic parameter is directly corrected according to correction value delta f and Δ cc, that is, obtains the mark again of projecting apparatus intrinsic parameter Definite value.
Equipment used in the parameter recalibration method of said structure light three-dimension measuring system, is characterised by:Including white Scaling board, two industrial cameras, a Digital light projector, a computer and data transmission link and control circuit, will One camera and projecting apparatus point or so are fixed on support, and camera is hit exactly in support one end, projecting apparatus in support, adjusts optical axis Angle less parallel, structured light three-dimensional measurement system is formed, then this structured light three-dimensional measurement system is demarcated for the first time, just After the completion of secondary demarcation, another auxiliary camera is placed in the support other end, adjusts the camera focus, focused to tested plane, two Platform camera and projecting apparatus are connected by data transmission link and control circuit with computer, and it is unglazed that whole system is placed in into one In darkroom, white calibration plate is placed in focal distance front and back position on projector projects direction, projected image is clearly shown In tested flat area, two phase functions photograph demarcation plate pattern simultaneously, start computer-controlled program control projecting apparatus to Scaling board projects digital raster image, and gathers the lithograph picture after being projected in real time by the camera of left and right two, completes collection Afterwards, the image of collection is handled according to recalibration method, by be calculated projecting apparatus intrinsic parameter recalibration result and Systematic parameter after recalibration.
Advantages of the present invention and remarkable result:Stated accuracy is evaluated by the way of re-projection at present, but in projecting apparatus The calibrated error of parameter has no idea to find by re-projection, therefore is difficult to the stated accuracy for further improving projecting apparatus intrinsic parameter. The present invention increases auxiliary camera in the system with a camera and a projecting apparatus and carries out recalibration to projecting apparatus intrinsic parameter. Place high-precision white plate, projector projects structured light patterns, original system camera and auxiliary camera collection white plate figure Case.Double camera is demarcated first, obtains auxiliary camera parameter;Secondly using the photo of shooting according to principle of stereoscopic vision weight Build white plate, the Dian Yun back projections of reconstruction to projector are practised physiognomy again on, calculate corresponding projected phase, and with Its actual phase makes the difference to obtain phase residual error value, finally using the principle of least square be calculated projecting apparatus transverse direction equivalent focal length and The error amount of horizontal photocentre, the projecting apparatus intrinsic parameter of structured light three-dimensional measurement system is corrected, completes projecting apparatus intrinsic parameter Recalibration, further improve its three-dimensional stated accuracy or even measurement accuracy.System reconstructing result and recalibration after recalibration Before compared to having clear improvement, its absolute spatial position and relative accuracy are all improved.
Brief description of the drawings
Fig. 1 is impact analysis of the horizontal principal point error for system;
Fig. 2 is the influence result signal of horizontal principal point error;
Fig. 3 is impact analysis of the horizontal equivalent focal length error for system;
Fig. 4 is the influence result signal of horizontal equivalent focal length error pair;
Fig. 5 is to use equipment structure chart used in the inventive method.
Embodiment
A kind of projecting apparatus intrinsic parameter recalibration method of structured light three-dimensional measurement system of the present invention, specific to one The measuring system of camera and a projecting apparatus, improve system calibrating precision.Specifically increase auxiliary camera on original system, place High-precision white plate (scaling board), projector projects structured light patterns, original system camera and auxiliary camera collection white are flat Plate pattern.Double camera is demarcated first, obtains auxiliary camera parameter;Secondly it is former according to stereoscopic vision using the photo of shooting Reason rebuilds white plate, the Dian Yun back projections of reconstruction to projector are practised physiognomy again on, calculate corresponding projected phase, And make the difference to obtain phase residual error value with its actual phase;Projecting apparatus laterally equivalent Jiao finally is calculated using the principle of least square Away from the error amount with horizontal photocentre, the recalibration of completion projecting apparatus intrinsic parameter, the demarcation for improving structured light three-dimensional measurement system is smart Degree.
If the horizontal principal point in projecting apparatus intrinsic parameter is ccpx, true value ccT, influence of its error for system such as Fig. 1 institutes Show.MlMrRepresent in space 2 points on physical plane of line, Ml'Mr' represent the M after three-dimensional reconstructionlMr.Each coordinate in Fig. 1 System is defined as follows:Ow:{Xw Yw ZwRepresent world coordinate system, corresponding [Xw Yw Zw] certain point is represented in space in world coordinates Coordinate value under system;Define Op:{Xp Yp ZpRepresent projector coordinates system, corresponding [Xp Yp Zp] represent certain point in space and exist Coordinate value under projector coordinates system;Define Oc:{Xc Yc ZcRepresent camera coordinates system, corresponding [Xc Yc Zc] represent in space Coordinate value of the certain point under camera coordinates system;Define { uc vcRepresent the pixel coordinate system of camera imaging front, corresponding ucWith vcThe row coordinate and row coordinate of certain point on camera imaging front are represented respectively, and unit is pixel;Define { up vpRepresent projection Instrument projects the pixel coordinate system of front, corresponding upWith vpThe row coordinate and row for representing certain point on projector projects front respectively are sat Mark, unit is pixel.Remember horizontal principal point ccpxComprising error be Δ cc, can be expressed as
Δ cc=ccT-ccpx
As seen from Figure 1, actual object MlMrError be more than the translation of position, but including certain rotation and Deformation.Point cloud area after reconstruction is slightly larger than original objects, and not parallel with original objects.This means the point cloud after reconstruction is deposited In certain linear deformation, and error can't be reacted directly into the result of re-projection as caused by principal point offset.Fig. 1 institutes Corresponding plane emulation signal is as shown in Figure 2.
If the horizontal equivalent focal length in projecting apparatus intrinsic parameter is fpx, true value fT, influence of its error for system such as Fig. 3 It is shown.As can be seen that the error of horizontal equivalent focal length can't cause the obvious inclined of a cloud position as horizontal principal point error Difference.Point cloud after reconstruction is equipped with a kind of " tendency " of rotation compared to raw bits, and rotary middle point is denoted as M.And it can be seen that rotation During turning, point M does not have the skew for producing position.Remember fpxError be Δ f, can be expressed as:
Δ f=fT-fpx
Wherein fTIt is the true value after correction, for example, in figure 3, Δ f < 0.Plane emulation signal such as Fig. 4 corresponding to Fig. 3 It is shown.
Structured-light system is typically made up of a projecting apparatus and a camera, and its specific three-dimensional measurement scheme is as follows:
Projecting apparatus to testee project one group of grating, using the certain methods in phase measuring profilometer can obtain through The phase that object surface depth is modulated, accordingly can directly reverse obtain world coordinates.Formula is as follows:
Wherein fcx,fcy,fpxThe transverse direction of the horizontal equivalent focal length of camera, longitudinal equivalent focal length and projecting apparatus is represented respectively Equivalent focal length.cccx,cccy,ccpxThe horizontal principal point of the horizontal principal point of camera, longitudinal principal point and projecting apparatus, X are represented respectivelyw, Yw,ZwRepresent coordinate value of the certain point under world coordinate system in space.Due to fpxWith ccpxError is included, therefore by above formula Obtained reconstruction point cloud also includes error.ri,mj,tkBy Rc,Tc,Rp,TpObtain, wherein ri=r1~r9, mj=m1~m9, tk= t1~t6, Rc,TcRepresent the spin matrix and translation vector of camera, Rp,TpRepresent the spin matrix and translation vector of projecting apparatus.It is fixed Justice is as follows:
Said system parameter can be obtained by the first demarcation to systematic parameter.
The bearing calibration of projecting apparatus intrinsic parameter is specific as follows:
It is assumed that an arbitrfary point C in space is given under world coordinate systemw, remember Cw=[Xw Yw Zw] represent that the point is sat in the world The coordinate under system is marked, then its corresponding point C in projector coordinates systempCoordinate be denoted as Cp=[Xp Yp Zp].Projection equation is such as Under:
Cp=RpCw+Tp (4)
In practice, it is necessary to use normalized projector coordinates, X is defined asn=(Xp/Zp)。
Further assume that uFObtained for projection, contain intrinsic parameter error;And upDirectly it is calculated for phase, not comprising interior Parameter error.It can then obtain:
uF=fpxXn+ccpx (6)
up=(fpx+Δf)Xn+ccpx+Δcc (7)
It is possible thereby to export
up-uF=(Δ f) Xn+(Δcc) (8)
It can be seen from the three-dimensional reconstruction formula of structure light, u can be directly obtained from phasep, further according to the throwing again of true point cloud Shadow obtains uFAnd XnAfterwards, you can correction value delta f and Δ cc are obtained according to the principle of least square.
Such as Fig. 5, equipment used in the parameter recalibration method of structured light three-dimensional measurement system includes white calibration plate, two Platform industrial camera, a Digital light projector, a computer and data transmission link and control circuit, by a camera and Projecting apparatus point or so is fixed on support, and camera is hit exactly in support one end, projecting apparatus in support, forms structural light three-dimensional measurement System, then this structured light three-dimensional measurement system is demarcated for the first time, after the completion of first demarcation, another auxiliary camera put In the support other end, the camera focus is adjusted, focuses and passes through data transmission link to tested plane, two cameras and projecting apparatus It is connected with control circuit with computer, whole system is placed in a unglazed darkroom, white calibration plate is placed in into projecting apparatus throws Focal distance front and back position on direction is penetrated, projected image is clearly shown in tested flat area, one is placed after master plate Open and photograph demarcation plate pattern simultaneously with black dossal, two phase functions, start computer-controlled program and control projecting apparatus to mark Fixed board projects digital raster image, and gathers the lithograph picture after being projected in real time by the camera of left and right two, after completing collection, The image of collection is input in supporting computer program, by the recalibration result and again that projecting apparatus intrinsic parameter is calculated Calibrated systematic parameter.
1) as shown in figure 5, building the structured light three-dimensional measurement system being made up of a camera and a projecting apparatus first, and System is demarcated.
2) as shown in figure 5, increasing auxiliary camera in original system structure, and one piece of high-precision white plate is placed in tested In region, adjustment auxiliary camera is focused to focal plane.
3) auxiliary camera is demarcated, and on the basis of original structure light three-dimension measuring system, dual camera systems carried out Combined calibrating.
4) projector projects grating pattern is started, two cameras gather flat board pattern in real time simultaneously respectively.
5) photo collected according to two cameras, point cloud registering and three-dimensional reconstruction are carried out according to principle of stereoscopic vision, Obtain the three-dimensional point cloud of white plate.
7) three-dimensional point cloud of acquisition is projected on the plane of departure of projecting apparatus according to proj ector parameters, i.e., according to the cloud Re-projection obtain uFAnd Xn.U is obtained according further to phase calculationp, to uFAnd upMake the difference, obtain phase residual error.
8) according to phase residual error, using the principle of least square, the corrected value of projecting apparatus intrinsic parameter is calculated, completes system The recalibration of parameter.

Claims (2)

1. a kind of parameter recalibration method of structured light three-dimensional measurement system, structured light three-dimensional measurement system include a camera and One projecting apparatus, it is characterised in that:The proj ector parameters in structured light three-dimensional measurement system are demarcated for the first time first, then An auxiliary camera is set up in structured light three-dimensional measurement system, based on being missed to intrinsic parameter in the first calibration process of proj ector parameters The analysis of difference, parameter error is attributed to the error of horizontal principal point and horizontal equivalent focal length in projecting apparatus intrinsic parameter, and post analysis Go out the specific influence of horizontal principal point and horizontal equivalent focal length both intrinsic parameter errors for system, by auxiliary camera recalibration The intrinsic parameter of projecting apparatus, to improve the stated accuracy of structured light three-dimensional measurement system;Comprise the following steps:
1) camera and projecting apparatus are built into structured light three-dimensional measurement system, the parameter of projecting apparatus are demarcated for the first time, Projecting apparatus is that scaling board projects one group of grating to testee, using phase measuring profilometer method, is obtained through testee i.e. Scaling board case depth modulation phase, accordingly direct reverse obtain world coordinates:
<mrow> <msub> <mi>u</mi> <mi>c</mi> </msub> <mo>=</mo> <msub> <mi>f</mi> <mrow> <mi>c</mi> <mi>x</mi> </mrow> </msub> <mfrac> <mrow> <msub> <mi>r</mi> <mn>1</mn> </msub> <msub> <mi>X</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>r</mi> <mn>2</mn> </msub> <msub> <mi>Y</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>r</mi> <mn>3</mn> </msub> <msub> <mi>Z</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>t</mi> <mn>1</mn> </msub> </mrow> <mrow> <msub> <mi>r</mi> <mn>7</mn> </msub> <msub> <mi>X</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>r</mi> <mn>8</mn> </msub> <msub> <mi>Y</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>r</mi> <mn>9</mn> </msub> <msub> <mi>Z</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>t</mi> <mn>3</mn> </msub> </mrow> </mfrac> <mo>+</mo> <msub> <mi>cc</mi> <mrow> <mi>c</mi> <mi>x</mi> </mrow> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow>
<mrow> <msub> <mi>v</mi> <mi>c</mi> </msub> <mo>=</mo> <msub> <mi>f</mi> <mrow> <mi>c</mi> <mi>y</mi> </mrow> </msub> <mfrac> <mrow> <msub> <mi>r</mi> <mn>4</mn> </msub> <msub> <mi>X</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>r</mi> <mn>5</mn> </msub> <msub> <mi>Y</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>r</mi> <mn>6</mn> </msub> <msub> <mi>Z</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>t</mi> <mn>2</mn> </msub> </mrow> <mrow> <msub> <mi>r</mi> <mn>7</mn> </msub> <msub> <mi>X</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>r</mi> <mn>8</mn> </msub> <msub> <mi>Y</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>r</mi> <mn>9</mn> </msub> <msub> <mi>Z</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>t</mi> <mn>3</mn> </msub> </mrow> </mfrac> <mo>+</mo> <msub> <mi>cc</mi> <mrow> <mi>c</mi> <mi>y</mi> </mrow> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>2</mn> <mo>)</mo> </mrow> </mrow>
<mrow> <msub> <mi>u</mi> <mi>p</mi> </msub> <mo>=</mo> <msub> <mi>f</mi> <mrow> <mi>p</mi> <mi>x</mi> </mrow> </msub> <mfrac> <mrow> <msub> <mi>m</mi> <mn>1</mn> </msub> <msub> <mi>X</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>m</mi> <mn>2</mn> </msub> <msub> <mi>Y</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>m</mi> <mn>3</mn> </msub> <msub> <mi>Z</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>t</mi> <mn>4</mn> </msub> </mrow> <mrow> <msub> <mi>m</mi> <mn>7</mn> </msub> <msub> <mi>X</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>m</mi> <mn>8</mn> </msub> <msub> <mi>Y</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>m</mi> <mn>9</mn> </msub> <msub> <mi>Z</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>t</mi> <mn>6</mn> </msub> </mrow> </mfrac> <mo>+</mo> <msub> <mi>cc</mi> <mrow> <mi>p</mi> <mi>x</mi> </mrow> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>3</mn> <mo>)</mo> </mrow> </mrow>
Wherein, fcx,fcy,fpxHorizontal equivalent focal length, equivalent Jiao of the transverse direction of longitudinal equivalent focal length and projecting apparatus of camera are represented respectively Away from;cccx,cccy,ccpxThe horizontal principal point of the horizontal principal point of camera, longitudinal principal point and projecting apparatus is represented respectively;Xw,Yw,ZwRepresent Coordinate value of the certain point under world coordinate system in space;Due to fpxWith ccpxRespectively include error delta f and Δ cc, Δ f= fT-fpx,fTFor fpxTrue value, Δ cc=ccT-ccpx, ccTFor ccpxTrue value, therefore the reconstruction obtained by formula (1)~(3) Point cloud also includes error;R in formula (1)~(3)i,mj,tkBy Rc,Tc,Rp,TpObtain, wherein ri=r1~r9, mj=m1~ m9, tk=t1~t6, Rc,TcRepresent the spin matrix and translation vector of camera, Rp,TpRepresent spin matrix and the translation of projecting apparatus Vector, concrete form are as follows:
<mfenced open = "" close = ""> <mtable> <mtr> <mtd> <mrow> <msub> <mi>R</mi> <mi>c</mi> </msub> <mo>=</mo> <mfenced open = "[" close = "]"> <mtable> <mtr> <mtd> <msub> <mi>r</mi> <mn>1</mn> </msub> </mtd> <mtd> <msub> <mi>r</mi> <mn>2</mn> </msub> </mtd> <mtd> <msub> <mi>r</mi> <mn>3</mn> </msub> </mtd> </mtr> <mtr> <mtd> <msub> <mi>r</mi> <mn>4</mn> </msub> </mtd> <mtd> <msub> <mi>r</mi> <mn>5</mn> </msub> </mtd> <mtd> <msub> <mi>r</mi> <mn>6</mn> </msub> </mtd> </mtr> <mtr> <mtd> <msub> <mi>r</mi> <mn>7</mn> </msub> </mtd> <mtd> <msub> <mi>r</mi> <mn>8</mn> </msub> </mtd> <mtd> <msub> <mi>r</mi> <mn>9</mn> </msub> </mtd> </mtr> </mtable> </mfenced> </mrow> </mtd> <mtd> <mrow> <mi>a</mi> <mi>n</mi> <mi>d</mi> </mrow> </mtd> <mtd> <mrow> <msub> <mi>T</mi> <mi>c</mi> </msub> <mo>=</mo> <mfenced open = "[" close = "]"> <mtable> <mtr> <mtd> <msub> <mi>t</mi> <mn>1</mn> </msub> </mtd> </mtr> <mtr> <mtd> <msub> <mi>t</mi> <mn>2</mn> </msub> </mtd> </mtr> <mtr> <mtd> <msub> <mi>t</mi> <mn>3</mn> </msub> </mtd> </mtr> </mtable> </mfenced> </mrow> </mtd> </mtr> </mtable> </mfenced>
<mfenced open = "" close = ""> <mtable> <mtr> <mtd> <mrow> <msub> <mi>R</mi> <mi>p</mi> </msub> <mo>=</mo> <mfenced open = "[" close = "]"> <mtable> <mtr> <mtd> <msub> <mi>m</mi> <mn>1</mn> </msub> </mtd> <mtd> <msub> <mi>m</mi> <mn>2</mn> </msub> </mtd> <mtd> <msub> <mi>m</mi> <mn>3</mn> </msub> </mtd> </mtr> <mtr> <mtd> <msub> <mi>m</mi> <mn>4</mn> </msub> </mtd> <mtd> <msub> <mi>m</mi> <mn>5</mn> </msub> </mtd> <mtd> <msub> <mi>m</mi> <mn>6</mn> </msub> </mtd> </mtr> <mtr> <mtd> <msub> <mi>m</mi> <mn>7</mn> </msub> </mtd> <mtd> <msub> <mi>m</mi> <mn>8</mn> </msub> </mtd> <mtd> <msub> <mi>m</mi> <mn>9</mn> </msub> </mtd> </mtr> </mtable> </mfenced> </mrow> </mtd> <mtd> <mrow> <mi>a</mi> <mi>n</mi> <mi>d</mi> </mrow> </mtd> <mtd> <mrow> <msub> <mi>T</mi> <mi>p</mi> </msub> <mo>=</mo> <mfenced open = "[" close = "]"> <mtable> <mtr> <mtd> <msub> <mi>t</mi> <mn>4</mn> </msub> </mtd> </mtr> <mtr> <mtd> <msub> <mi>t</mi> <mn>5</mn> </msub> </mtd> </mtr> <mtr> <mtd> <msub> <mi>t</mi> <mn>6</mn> </msub> </mtd> </mtr> </mtable> </mfenced> </mrow> </mtd> </mtr> </mtable> </mfenced>
2) auxiliary camera is set up in the structured light three-dimensional measurement system that a camera and projecting apparatus are formed, the position of setting is basic It is required that photograph scaling board simultaneously for auxiliary camera and original camera, scaling board is placed in the tested of auxiliary camera and original camera In region, combined calibrating is carried out to the dual camera systems being made up of auxiliary camera and former camera, obtains the intrinsic parameter of auxiliary camera Outer parameter matrix between matrix and two cameras;
3) scaling board is measured and rebuild, start projector projects grating pattern, two cameras gather scaling board figure respectively Picture, based on principle of stereoscopic vision, scaling board is carried out using the image of two cameras to rebuild acquisition three dimensional point cloud PA;
4) the three dimensional point cloud PA of acquisition is calculated according to projection equation and projected in the projection plane of projecting apparatus, obtain uFWith Xn, wherein uFThe row coordinate projected to for the proj ector parameters of the included errors of three dimensional point cloud PA after projection plane, XnRepresent Projector coordinates are normalized, are defined as Xn=(Xp/Zp);According further to projector projects pattern phase and projection plane one by one Corresponding relation directly obtains up, upFor the row coordinate of the projector projects plane directly calculated by phase, consider in world coordinate system An arbitrfary point C in given space downw, remember Cw=[Xw Yw Zw] representing coordinate of this under world coordinate system, then it is being projected Corresponding point C in instrument coordinate systempCoordinate be just denoted as Cp=[Xp Yp Zp];Projection equation is as follows:
Cp=RpCw+Tp (4)
It is hereby achieved that:
<mrow> <msub> <mi>X</mi> <mi>n</mi> </msub> <mo>=</mo> <mfrac> <msub> <mi>X</mi> <mi>p</mi> </msub> <msub> <mi>Z</mi> <mi>p</mi> </msub> </mfrac> <mo>=</mo> <mfrac> <mrow> <msub> <mi>m</mi> <mn>1</mn> </msub> <msub> <mi>X</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>m</mi> <mn>2</mn> </msub> <msub> <mi>Y</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>m</mi> <mn>3</mn> </msub> <msub> <mi>Z</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>t</mi> <mn>4</mn> </msub> </mrow> <mrow> <msub> <mi>m</mi> <mn>7</mn> </msub> <msub> <mi>X</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>m</mi> <mn>8</mn> </msub> <msub> <mi>Y</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>m</mi> <mn>9</mn> </msub> <msub> <mi>Z</mi> <mi>w</mi> </msub> <mo>+</mo> <msub> <mi>t</mi> <mn>6</mn> </msub> </mrow> </mfrac> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>5</mn> <mo>)</mo> </mrow> </mrow>
uF=fpxXn+ccpx (6)
up=(fpx+Δf)Xn+ccpx+Δcc (7)
Because projecting apparatus intrinsic parameter includes error, therefore the projection row coordinate u of gainedFWith error, and upIt is direct by phase It is calculated, not comprising projecting apparatus intrinsic parameter error, re-projection row coordinate u is calculatedFWith true row coordinate up, to re-projection Row coordinate uFWith true row coordinate upMake the difference, obtain phase residual error;
5) institute in the three dimensional point cloud PA of acquisition is a little handled according to step 4) is described, obtained by row coordinate uFWith upThe residual error set of composition, u can be directly obtained from phasep, u is obtained further according to a cloud PA re-projectionFAnd XnA most young waiter in a wineshop or an inn is utilized afterwards Multiply principle and obtain the error amount Δ cc of the corrected value of projecting apparatus intrinsic parameter, i.e., horizontal equivalent focal length correction value delta f and horizontal photocentre, According to the derivation in step 4), following formula is obtained
up-uF=(Δ f) Xn+(Δcc) (8)
6) projecting apparatus intrinsic parameter is directly corrected according to correction value delta f and Δ cc, that is, obtains the recalibration value of projecting apparatus intrinsic parameter.
2. equipment used in the parameter recalibration method of structured light three-dimensional measurement system according to claim 1, feature It is:Including white calibration plate, two industrial cameras, a Digital light projector, a computer and data transmission link And control circuit, a camera and projecting apparatus point or so are fixed on support, by camera in support one end, projecting apparatus is in support Center, optical axis angle less parallel is adjusted, form structured light three-dimensional measurement system, then this structured light three-dimensional measurement system is entered The first demarcation of row, after the completion of first demarcation, is placed in the support other end by another auxiliary camera, adjusts the camera focus, focus To tested plane, two cameras and projecting apparatus are connected by data transmission link and control circuit with computer, will be entirely System is placed in a unglazed darkroom, and white calibration plate is placed in into focal distance front and back position on projector projects direction, makes projection Image can clearly be shown in tested flat area, and two phase functions photograph demarcation plate pattern simultaneously, start computer control journey Sequence controls projecting apparatus to project digital raster image to scaling board, and gathers the flat board after being projected in real time by the camera of left and right two Image, after completing collection, the image of collection is handled according to recalibration method, by the way that projecting apparatus intrinsic parameter is calculated Systematic parameter after recalibration result and recalibration.
CN201710695449.8A 2017-08-15 2017-08-15 A kind of the parameter recalibration method and its equipment of structured light three-dimensional measurement system Active CN107462184B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710695449.8A CN107462184B (en) 2017-08-15 2017-08-15 A kind of the parameter recalibration method and its equipment of structured light three-dimensional measurement system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710695449.8A CN107462184B (en) 2017-08-15 2017-08-15 A kind of the parameter recalibration method and its equipment of structured light three-dimensional measurement system

Publications (2)

Publication Number Publication Date
CN107462184A true CN107462184A (en) 2017-12-12
CN107462184B CN107462184B (en) 2019-01-22

Family

ID=60549796

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710695449.8A Active CN107462184B (en) 2017-08-15 2017-08-15 A kind of the parameter recalibration method and its equipment of structured light three-dimensional measurement system

Country Status (1)

Country Link
CN (1) CN107462184B (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108132473A (en) * 2017-12-25 2018-06-08 湖南卫导信息科技有限公司 A kind of 3D methods of exhibiting of the navigation terminal test scene based on OpenGL
CN108827187A (en) * 2018-07-28 2018-11-16 西安交通大学 A kind of measuring system for workpiece progress measuring three-dimensional profile
CN109003308A (en) * 2018-06-27 2018-12-14 浙江大学 A kind of special areas imaging camera calibration system and method based on phase code
CN109194780A (en) * 2018-08-15 2019-01-11 信利光电股份有限公司 The rotation AA method, apparatus and readable storage medium storing program for executing of structure optical mode group
CN109343076A (en) * 2018-10-30 2019-02-15 合肥泰禾光电科技股份有限公司 A kind of distance calibration method and range unit
CN109712232A (en) * 2018-12-25 2019-05-03 东南大学苏州医疗器械研究院 A kind of profiling object surface three-D imaging method based on light field
CN110060301A (en) * 2019-03-18 2019-07-26 盎锐(上海)信息科技有限公司 Calibration system and method for projection grating modeling
CN110118762A (en) * 2019-05-14 2019-08-13 哈尔滨工业大学 Flame CH base is synchronous with NO molecule or selective excitation measuring device and method
CN110398199A (en) * 2019-07-05 2019-11-01 内蒙古能建数字信息科技有限公司 A kind of track clearance detection method
CN110415303A (en) * 2019-07-29 2019-11-05 华天慧创科技(西安)有限公司 Scaling method is imaged in a kind of camera 3D imaging caliberating device and 3D
CN111397537A (en) * 2020-04-03 2020-07-10 西安交通大学 Principal point pixel coordinate solving method for projection system
WO2020237418A1 (en) * 2019-05-24 2020-12-03 深圳市速腾聚创科技有限公司 Coordinate correction method and apparatus, and computing device and computer storage medium
CN112284295A (en) * 2020-10-28 2021-01-29 东南大学 Camera for profile measurement and adjustment method of projector
CN112361989A (en) * 2020-09-30 2021-02-12 北京印刷学院 Method for calibrating parameters of measurement system through point cloud uniformity consideration
CN112945090A (en) * 2020-12-11 2021-06-11 深圳市菲森科技有限公司 Calibration device and calibration method of three-dimensional measurement system
CN113251951A (en) * 2021-04-26 2021-08-13 黄淮学院 Calibration method of line structured light vision measurement system based on single calibration surface mapping
CN113298886A (en) * 2021-07-27 2021-08-24 光量信息科技(宁波)有限公司 Calibration method of projector
CN113566709A (en) * 2021-08-26 2021-10-29 苏州小优智能科技有限公司 Calibration method and device of structured light measurement system and electronic equipment
CN114463422A (en) * 2022-04-14 2022-05-10 北京深度奇点科技有限公司 Method and system for image measurement correction
CN115526941A (en) * 2022-11-25 2022-12-27 海伯森技术(深圳)有限公司 Calibration device and calibration method for telecentric camera
US11549805B2 (en) 2019-12-09 2023-01-10 Industrial Technology Research Institute Projecting apparatus and projecting calibration method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002086420A1 (en) * 2001-04-19 2002-10-31 Dimensional Photonics, Inc. Calibration apparatus, system and method
CN101697233A (en) * 2009-10-16 2010-04-21 长春理工大学 Structured light-based three-dimensional object surface reconstruction method
CN103985121A (en) * 2014-05-13 2014-08-13 北京航空航天大学 Method for calibrating underwater projector
CN104657982A (en) * 2015-01-15 2015-05-27 华中科技大学 Calibration method for projector
CN105528770A (en) * 2015-12-31 2016-04-27 河北工业大学 Projector lens distortion correcting method
CN106989695A (en) * 2017-04-28 2017-07-28 广东工业大学 A kind of projector calibrating method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002086420A1 (en) * 2001-04-19 2002-10-31 Dimensional Photonics, Inc. Calibration apparatus, system and method
CN101697233A (en) * 2009-10-16 2010-04-21 长春理工大学 Structured light-based three-dimensional object surface reconstruction method
CN103985121A (en) * 2014-05-13 2014-08-13 北京航空航天大学 Method for calibrating underwater projector
CN104657982A (en) * 2015-01-15 2015-05-27 华中科技大学 Calibration method for projector
CN105528770A (en) * 2015-12-31 2016-04-27 河北工业大学 Projector lens distortion correcting method
CN106989695A (en) * 2017-04-28 2017-07-28 广东工业大学 A kind of projector calibrating method

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
SHUJUN HUANG等: "Accurate projector calibration method by using an optical coaxial camera", 《APPLIED OPTICS》 *
SHUJUN HUANG等: "Projector calibration method based on optical coaxial camera", 《PROCEEDINGS OF SPIE - THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING》 *
王衡等: "一种用于结构光测量系统的投影仪标定技术", 《信息技术》 *
龚春园等: "投影仪全参数平面线性估计的高精度标定方法", 《西安交通大学学报》 *

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108132473A (en) * 2017-12-25 2018-06-08 湖南卫导信息科技有限公司 A kind of 3D methods of exhibiting of the navigation terminal test scene based on OpenGL
CN109003308A (en) * 2018-06-27 2018-12-14 浙江大学 A kind of special areas imaging camera calibration system and method based on phase code
CN108827187A (en) * 2018-07-28 2018-11-16 西安交通大学 A kind of measuring system for workpiece progress measuring three-dimensional profile
CN108827187B (en) * 2018-07-28 2019-10-11 西安交通大学 A kind of measuring three-dimensional profile system
CN109194780B (en) * 2018-08-15 2020-08-25 信利光电股份有限公司 Rotation correction method and device of structured light module and readable storage medium
CN109194780A (en) * 2018-08-15 2019-01-11 信利光电股份有限公司 The rotation AA method, apparatus and readable storage medium storing program for executing of structure optical mode group
CN109343076A (en) * 2018-10-30 2019-02-15 合肥泰禾光电科技股份有限公司 A kind of distance calibration method and range unit
CN109343076B (en) * 2018-10-30 2020-06-19 合肥泰禾光电科技股份有限公司 Distance calibration method and distance measuring device
CN109712232A (en) * 2018-12-25 2019-05-03 东南大学苏州医疗器械研究院 A kind of profiling object surface three-D imaging method based on light field
CN109712232B (en) * 2018-12-25 2023-05-09 东南大学苏州医疗器械研究院 Object surface contour three-dimensional imaging method based on light field
CN110060301A (en) * 2019-03-18 2019-07-26 盎锐(上海)信息科技有限公司 Calibration system and method for projection grating modeling
CN110060301B (en) * 2019-03-18 2023-02-10 盎锐(上海)信息科技有限公司 Calibration system and method for projection grating modeling
CN110118762B (en) * 2019-05-14 2021-08-31 哈尔滨工业大学 Flame CH group and NO molecule synchronous or selective excitation measuring device and method
CN110118762A (en) * 2019-05-14 2019-08-13 哈尔滨工业大学 Flame CH base is synchronous with NO molecule or selective excitation measuring device and method
WO2020237418A1 (en) * 2019-05-24 2020-12-03 深圳市速腾聚创科技有限公司 Coordinate correction method and apparatus, and computing device and computer storage medium
CN110398199A (en) * 2019-07-05 2019-11-01 内蒙古能建数字信息科技有限公司 A kind of track clearance detection method
CN110415303A (en) * 2019-07-29 2019-11-05 华天慧创科技(西安)有限公司 Scaling method is imaged in a kind of camera 3D imaging caliberating device and 3D
US11549805B2 (en) 2019-12-09 2023-01-10 Industrial Technology Research Institute Projecting apparatus and projecting calibration method
CN111397537B (en) * 2020-04-03 2021-01-19 西安交通大学 Principal point pixel coordinate solving method for projection system
CN111397537A (en) * 2020-04-03 2020-07-10 西安交通大学 Principal point pixel coordinate solving method for projection system
CN112361989A (en) * 2020-09-30 2021-02-12 北京印刷学院 Method for calibrating parameters of measurement system through point cloud uniformity consideration
CN112284295B (en) * 2020-10-28 2022-05-10 东南大学 Camera and projector adjusting method for contour measurement
CN112284295A (en) * 2020-10-28 2021-01-29 东南大学 Camera for profile measurement and adjustment method of projector
CN112945090A (en) * 2020-12-11 2021-06-11 深圳市菲森科技有限公司 Calibration device and calibration method of three-dimensional measurement system
CN113251951A (en) * 2021-04-26 2021-08-13 黄淮学院 Calibration method of line structured light vision measurement system based on single calibration surface mapping
CN113251951B (en) * 2021-04-26 2024-03-01 湖北汽车工业学院 Calibration method of line structured light vision measurement system based on single calibration surface mapping
CN113298886A (en) * 2021-07-27 2021-08-24 光量信息科技(宁波)有限公司 Calibration method of projector
CN113566709A (en) * 2021-08-26 2021-10-29 苏州小优智能科技有限公司 Calibration method and device of structured light measurement system and electronic equipment
CN114463422A (en) * 2022-04-14 2022-05-10 北京深度奇点科技有限公司 Method and system for image measurement correction
CN114463422B (en) * 2022-04-14 2022-08-16 北京深度奇点科技有限公司 Method and system for image measurement correction
CN115526941A (en) * 2022-11-25 2022-12-27 海伯森技术(深圳)有限公司 Calibration device and calibration method for telecentric camera

Also Published As

Publication number Publication date
CN107462184B (en) 2019-01-22

Similar Documents

Publication Publication Date Title
CN107462184A (en) The parameter recalibration method and its equipment of a kind of structured light three-dimensional measurement system
CN107003109B (en) Calibrating installation, calibration method, Optical devices, camera, projection arrangement, measuring system and measurement method
CN100489446C (en) Method for measuring three-dimensional contour based on phase method
CN107167093B (en) A kind of the combined type measuring system and measurement method of laser line scanning and shadow Moire
CN102364299B (en) Calibration technology for multiple structured light projected three-dimensional profile measuring heads
CN104240262B (en) Calibration device and calibration method for outer parameters of camera for photogrammetry
CN110285827B (en) Distance-constrained photogrammetry high-precision target positioning method
CN105716542B (en) A kind of three-dimensional data joining method based on flexible characteristic point
WO2016138758A1 (en) Calibration method of telecentric imaging three-dimensional shape measurement system
CN110207614B (en) High-resolution high-precision measurement system and method based on double telecentric camera matching
CN110375648A (en) The spatial point three-dimensional coordinate measurement method that the single camera of gridiron pattern target auxiliary is realized
WO2018196303A1 (en) Projector calibration method and apparatus based on multi-directional projection
CN110260822B (en) High-precision calibration method for multi-view structured light system
CN103994732B (en) A kind of method for three-dimensional measurement based on fringe projection
CN108020175A (en) A kind of more optical grating projection binocular vision tongue body surface three dimension entirety imaging methods
CN104568963A (en) Online three-dimensional detection device based on RGB structured light
CN111047586B (en) Pixel equivalent measuring method based on machine vision
WO2020199439A1 (en) Single- and dual-camera hybrid measurement-based three-dimensional point cloud computing method
CN107941153A (en) A kind of vision system of laser ranging optimization calibration
CN114331924B (en) Large workpiece multi-camera vision measurement method
CN112489109B (en) Three-dimensional imaging system method and device and three-dimensional imaging system
CN109919856A (en) Bituminous pavement construction depth detection method based on binocular vision
TWI388797B (en) Three - dimensional model reconstruction method and its system
CN110146032A (en) Synthetic aperture camera calibration method based on optical field distribution
CN110986760B (en) Three-dimensional reconstruction-based method and system for checking size of special-shaped structure

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 210009 No. 87 Dingjiaqiao, Gulou District, Nanjing City, Jiangsu Province

Applicant after: Southeast University

Address before: No. 2, four archway in Xuanwu District, Nanjing, Jiangsu

Applicant before: Southeast University

GR01 Patent grant
GR01 Patent grant