CN101986098B - Tricolor projection-based Fourier transform three-dimensional measuring method - Google Patents

Tricolor projection-based Fourier transform three-dimensional measuring method Download PDF

Info

Publication number
CN101986098B
CN101986098B CN2010102902257A CN201010290225A CN101986098B CN 101986098 B CN101986098 B CN 101986098B CN 2010102902257 A CN2010102902257 A CN 2010102902257A CN 201010290225 A CN201010290225 A CN 201010290225A CN 101986098 B CN101986098 B CN 101986098B
Authority
CN
China
Prior art keywords
component
phase
value
fourier transform
frequency
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2010102902257A
Other languages
Chinese (zh)
Other versions
CN101986098A (en
Inventor
达飞鹏
黄昊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Haian Shenling Electrical Appliance Manufacturing Co., Ltd.
Original Assignee
Southeast University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southeast University filed Critical Southeast University
Priority to CN2010102902257A priority Critical patent/CN101986098B/en
Publication of CN101986098A publication Critical patent/CN101986098A/en
Application granted granted Critical
Publication of CN101986098B publication Critical patent/CN101986098B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a new tricolor raster projection-based Fourier transform three-dimensional measuring method, which mainly aims to accurately work out the phase distribution of raster images, and then obtain the three-dimensional topography information of objects according to the phase distribution. The method is implemented through the steps of setting the gray values of R and G components in a projected raster to follow a sinusoidal variation regulation with two different frequencies, and setting a B component as the average value of the R component or the G component, and forming a color raster image to be projected on an object to be measured; and separating the three components of an acquired deformed color raster image, then processing the separated three gray images, meanwhile, restraining background components and high-frequency noises when the Fourier transform is used to calculate relative phases, and carrying out comparison and calibration on the three gray images with the relative phase values under the two frequencies when the phases are unwrapped so as to achieve the purpose of precisely calculating absolute phases containing height information. Only one raster image is required to be projected in the whole measuring process, therefore, the method of the invention is good in real-time.

Description

Fourier transform three-dimensional measurement method based on three coloured light projections
Technical field
The invention belongs to the field of three-dimensional information reconstruct.Based on the chromatic grating projection, adopt fourier transform method to analyze the deformed grating image and find the solution relative phase, adopt dual-frequency method to carry out phase unwrapping, obtain the process of accurate absolute phase.
Background technology
Three-dimensional feature that the three-dimensional measurement technology can be described object and the three-dimensional information that obtains body surface have a wide range of applications at product detection and machining control, medical field, historical relic's protection field, aerospace field, culture field etc.In numerous three-dimensional measurement technology, the optical three-dimensional measurement technology becomes prevailing three-dimensional measurement technology with characteristics such as its non-cpntact measurement, real-time are better.
The optical three-dimensional measurement technology is to be the basis with the contemporary optics, melts optoelectronics, Computer Image Processing, and graphics, science such as signal Processing are the modern surveying technology of one.The entity that it detects optical imagery and store as information obtains the three-dimensional measurement information needed from image.With respect to other three-dimensional information measuring method, high-speed, high-precision characteristics that optical measuring technique has since the sixties in last century, have obtained extensive studies and application.Three-dimensional measurement technology based on the encode grating projection is the most representative, uses the most extensive.
Three-dimensional measurement based on optical grating projection projects to the measured object surface with raster pattern exactly, obtains the raster image of distortion by video camera, and determines the elevation information on testee relative reference plane by phase place and relation of height.When optical grating projection was to body surface, periodically the phase place of grating just received the modulation of body surface height profile, formed deformed grating, had the three-dimensional information of object in the deformed grating.The PHASE DISTRIBUTION of accurately obtaining the deformed grating image plays key effect in whole three-dimensional measurement process.
The method of obtaining PHASE DISTRIBUTION mainly contains phase-shift method, fourier transform method, wavelet analysis method.The Fourier transform mensuration is a kind of contactless method for three-dimensional measurement commonly used; It is through carrying out overall Fourier transform to an amplitude variation shape raster image; Extraction comprises the fundamental component of phase information, inverse Fourier transform, and then the relative phase value of acquisition raster image.Than traditional phase-shifting technique, only need to gather an amplitude grating image in the fourier methods measuring process, real-time is high, the real measurement that realizes dynamic object.But because the useful information that in Fourier transform, really needs to extract is a fundamental component, the frequency spectrum of background component and high fdrequency component can be overlapped with the frequency spectrum of fundamental component, causes spectral aliasing, had a strong impact on the measuring accuracy of Fourier transform three-dimensional measurement method.The measure of the inhibition spectral aliasing that adopts usually is to take the stripe pattern that two width of cloth have the π phase shift, through subtracting each other of two width of cloth images, can suppress background component effectively.But, influenced measured real-time property owing to need to gather two width of cloth images.
Because the phase value that fourier transform method obtains obtains absolute phase values between 0-2 π so need carry out phase unwrapping.But because Fourier transform has in the process that the phase place of height saltus step and relatively gentle slope object finds the solution in solution error can appear; The error of any can influence the phase unwrapping precision of next pending point when phase unwrapping; So produce continuous mistake, i.e. backguy phenomenon in the time of can causing phase unwrapping.Directly launch the scanning line method rapid speed of phase place, but robustness a little less than, very easily produce the backguy phenomenon.Dual-frequency method contains the sinusoidal grating of two kinds of frequency components through projection; Through Fourier transform filtering; Obtain two kinds of phase values under the frequency, with the phase value that obtains under the phase value correction high frequency that obtains under the low frequency, thus the improper value at the discontinuous place of phase place that obtains under the correction high frequency.But because dual-frequency method also is to find the solution initial phase with Fourier transform, so also exist two kinds of problem between the frequency component.
Summary of the invention
Technical matters:, the objective of the invention is to not influence the influence of eliminating the spectral aliasing in the Fourier transform three-dimensional measurement method under the prerequisite of measuring real-time and the precision that improves the phase unwrapping process to the spectral aliasing and the not high problem of phase unwrapping process robustness that exist in the Fourier transform three-dimensional measurement method.This method only needs projection one amplitude grating image, has improved measured real-time property, can realize kinetic measurement, and can overcome factors such as testee surface reflectivity difference and surface noise, reaches measuring accuracy preferably, has robustness preferably.
Technical scheme: a kind of measuring three-dimensional morphology method based on tricolor grating projection and Fourier transform, concrete steps are following:
Step 1: design a width of cloth colour projection raster image, and raster image is projected to the object under test surface, said colour projection raster image is provided with as follows:
f(m,n)=a r+b rcos(2πf 0m)+a g+b gcos(4πf 0m)+a b
Wherein, a r, a gBe R, the background light intensity of G component, b r, b gBe R, the reflectivity of G component, a bBe set to R, the mean value of G two components, f 0Be the frequency of R component sine streak, (frequency of G component sine streak is 2 times of R component sine streak for m, the n) two-dimensional coordinate of representation raster image,
Step 2: use colored CCD that body surface to be measured is taken, obtain an amplitude variation shape grating fringe image:
g(x,y)=r r(x,y)[a r+b rcos(2πf 0x+φ 1(x,y))]+
r g(x,y)[a g+b gcos(4πf 0x+φ 2(x,y))]+r b(x,y)a b
Wherein, r r(x, y), r b(x, y), r g(x, y) be object to different colours reflection of light rate, reflectivity is a constant, φ 1(x, y), φ 2(x y) is the PHASE DISTRIBUTION of low frequency and high frequency to be asked, (and x, the y) two-dimensional coordinate of expression deformed grating stripe pattern,
Step 3: from the deformed grating stripe pattern, separate R, G, the B component of the coloured image obtain, and from R, G component gray-scale map, remove background component, obtain removing the R component low frequency standard grayscale figure R after the background component 1(x, y), remove the G component high frequency standard grayscale figure G after the background component 1(x, y),
Adopt following method from R component gray-scale map, to remove background component:
Step 3.1.1: the mean value m that at first asks for R component pixel gray-scale value rWith variance d r, the mean value m of B component pixel gray-scale value bWith variance d bUse following formula to revise each grey scale pixel value of R component:
r 1(x,y)=r(x,y)+m b-m r
R ( x , y ) = [ r 1 ( x , y ) - m r 1 ] d b d r + m r 1
Wherein (x y) is the R component intensity profile after proofreading and correct, r to R 1(x y) is intermediate variable,
Figure GSB00000394982000032
Be r 1(x, mean value y),
Contain the sinusoidal phase modulation signal R component of object height information after obtaining proofreading and correct and represent the B component of background component can be expressed as as follows:
R(x,y)=a(x,y)+b(x,y)cos[2πf 0x+φ 1(x,y)];
B(x,y)=a(x,y);
Step 3.1.2: to R (x, y), ((x, y) (x y) deducts in two kinds of components B, is not contained the grey-scale raster images R of background and high fdrequency component from R with B then for x, y) filtering 1(x, y):
R 1(x,y)=R(x,y)-B(x,y)
=b(x,y)cos[2πf 0x+φ 1(x,y)];
Adopt following method from G component gray-scale map, to remove background component:
Step 3.2.1: the mean value m that at first asks for G component pixel gray-scale value gWith variance d g, the mean value m of B component pixel gray-scale value bWith variance d bUse following formula to revise each grey scale pixel value of G component:
g 1(x,y)=g(x,y)+m b-m g
G ( x , y ) = [ g 1 ( x , y ) - m g 1 ] d b d g + m g 1
Wherein (x y) is the G component intensity profile after proofreading and correct, g to G 1(x y) is intermediate variable,
Figure GSB00000394982000034
Be g 1(x, mean value y),
Obtaining proofreading and correct the back representative contains the double frequency sinusoidal phase modulation signal G component of object height information and represents the B component of background component can be expressed as as follows:
G(x,y)=a(x,y)+b(x,y)cos[2πf 0x+φ 2(x,y)];
B(x,y)=a(x,y);
Step 3.2.2: to G (x, y), ((x, y) (x y) deducts in the component B, is not contained the grey-scale raster images G of background and high fdrequency component from G with B then for x, y) filtering 1(x, y):
G 1(x,y)=R(x,y)-B(x,y)
=b(x,y)cos[2πf 0x+φ 2(x,y)]。
Step 4: to the R component low frequency standard grayscale figure R after the removal background component 1(x, y), remove the G component high frequency standard grayscale figure G after the background component 1(x y) does Fourier transform, and obtain the relative phase distribution of R component and the relative phase of G component respectively and distribute,
To low frequency standard grayscale figure R 1(x y) does Fourier transform, and it is following to obtain the process that the relative phase of R component distributes:
Step 4.1.1: with R 1(x y) is expressed as exponential form:
R 1 ( x , y ) = r r ( x , y ) Σ n = - ∞ n = + ∞ A n expi [ 2 πn f 0 x + n φ 1 ( x , y ) ]
Wherein, when n=0, A n=0,
Figure GSB00000394982000042
Expression imaginary unit,
Step 4.1.2: looking y is constant, adopts 1 dimension fast fourier transform algorithm to low frequency standard grayscale figure R 1(x, every row y) carries out Fourier transform, and conversion process is:
R f ( f , y ) = ∫ - ∞ + ∞ R 1 ( x , y ) exp ( - 2 πifx ) dx
The expression formula that obtains frequency domain is:
R f ( f , y ) = Σ n = - ∞ n = + ∞ Q n ( f - n f 0 , y )
Wherein, Q n(f-nf 0, y) be A nr r(x, y) exp [in φ 1(x, y)] accordingly in the expression formula of frequency domain, f representes the variable of frequency domain,
Step 4.1.3: to Q n(f-nf 0, y) carry out filtering and extract Q 1(f-f 0, y), again to Q 1(f-f 0, y) carry out inverse Fourier transform, obtain containing the A of phase information 1r r(x, y) exp [i φ 1(x, y)], calculate A 1r r(x, y) exp [i φ 1(x, y)] angle value can obtain containing the R component relative phase value φ of object height information 1(x, y), the phase value that obtains is between 0-2 π;
To high frequency standard grayscale figure G 1(x y) does Fourier transform, and it is following to obtain the process that the relative phase of G component distributes:
Step 4.2.1: with G 1(x y) is expressed as exponential form:
G 1 ( x , y ) = r g ( x , y ) Σ n = - ∞ n = + ∞ B n expi [ 2 πn f 0 x + n φ 2 ( x , y ) ]
Wherein, when n=0, B n=0,
Figure GSB00000394982000046
Expression imaginary unit,
Step 4.2.2: looking y is constant, adopts 1 dimension fast fourier transform algorithm to low frequency standard grayscale figure R 1(x, every row y) carries out Fourier transform, and conversion process is:
G f ( f , y ) = ∫ - ∞ + ∞ G 1 ( x , y ) exp ( - 2 πifx ) dx
The expression formula that obtains frequency domain is:
G f ( f , y ) = Σ n = - ∞ n = + ∞ P n ( f - n f 0 , y )
Wherein, P n(f-nf 0, y) be B nr g(x, y) exp [in φ 1(x, y)] accordingly in the expression formula of frequency domain, f representes the variable of frequency domain,
Step 4.2.3: to P n(f-nf 0, y) carry out filtering and extract P 1(f-f 0, y), again to P 1(f-f 0, y) carry out inverse Fourier transform, obtain containing the B of phase information 1r g(x, y) exp [i φ 2(x, y)], calculate B 1r g(x, y) exp [i φ 2(x, y)] angle value can obtain containing the G component relative phase value φ of object height information 2(x, y), the phase value that obtains is between 0-2 π;
Step 5:
Step 5.1: the relative phase value φ that adopts the R component that obtains in the direct deployment step 4 of scanning Beam Method 1(x, y) promptly through following formula point by point scanning, in PHASE DISTRIBUTION, do not have till the saltus step greater than π:
Wherein,
Figure GSB00000394982000054
Be the low frequency absolute phase after launching, φ 1(x y) is relative phase, Δ φ 1Be the phase difference value between adjacent 2,
Step 5.2: the relative phase value φ that adopts the G component that obtains in the direct deployment step 4 of scanning Beam Method 2(x, y) promptly through following formula point by point scanning, in PHASE DISTRIBUTION, do not have till the saltus step greater than π:
Figure GSB00000394982000055
Wherein,
Figure GSB00000394982000056
Be the high frequency absolute phase after launching, φ 2(x y) is relative phase, Δ φ 2Be the phase difference value between adjacent 2
Figure GSB00000394982000057
Step 6: calculate and accurately launch phase value,
Step 6.1: Read to get the low-frequency absolute phase
Figure GSB00000394982000058
and high absolute phase
Figure GSB00000394982000059
Step 6.2: traversal
Figure GSB000003949820000510
is calculated difference degree between the two, promptly obtains following parameter distributions:
Figure GSB00000394982000061
Ceil representes the function that rounds up in the following formula,
If Q ≠ 0; Then use Q that high frequency absolute phase
Figure GSB00000394982000062
is proofreaied and correct, that is:
is the accurate expansion phase value that obtains.
Step 7: read final expansion phase result
Figure GSB00000394982000065
according to classical optical grating projection by launching phase result
Figure GSB00000394982000066
to object height h (x; Y) conversion formula; Finally try to achieve the three-dimensional information of Measuring Object, described conversion formula is:
Wherein, l, d are the geometric parameters of measuring system, and l is the distance of projector to measurement plane, and d is the distance of CCD camera to projector,
Figure GSB00000394982000068
The expression phase changing capacity, Be the expansion phase result,
Figure GSB000003949820000610
Be initial phase result, ω 0Angular frequency for projection grating.
Beneficial effect: compared with prior art; The present invention has following advantage: at first; Make full use of the RGB3 kind component of coloured image, the sinusoidal grating of two kinds of frequencies is enrolled two kinds of components of RG, the B component is set to the mean value of RG component; Greatly reduce the number of the required projection grating image of three-dimensional measurement, improved measuring speed.Because the present invention only needs projection one amplitude grating image, can realize the quick measurement to dynamic object.Secondly; Fourier transform three-dimensional measurement method than the projection of Traditional use gray level image; The present invention is owing to use the B component to be set to the mean value of RG component in projection grating; When deformed grating is handled, can when the RG component is done Fourier transform, suppress 0 frequency component, reduce the influence of spectral aliasing measuring accuracy through separating 0 frequency component that the B component obtains RG component gray level image.At last; In the phase unwrapping process; The present invention adopts and represents the RG component relative phase value of height frequency to launch method of correcting then respectively, compares traditional scanning line method, can avoid since object contain big height saltus step and noise generation separate phase error and propagation of error phenomenon.To sum up, the present invention can realize the three-dimensional information of dynamic object is measured fast and accurately, obtains accurate absolute phase distribution plan, has good real-time performance and accuracy.
Description of drawings
Fig. 1 is the process flow diagram of whole process of the present invention.
Fig. 2 is the three-dimension measuring system that the present invention adopts.
Fig. 3 is the process flow diagram that step 3 of the present invention is separated 3 kinds of components of images acquired and removal background.
Fig. 4 is that step 6 of the present invention adopts dual-frequency method correction absolute phase to obtain the process flow diagram of precise phase value.
Fig. 5 (a) is that (x, y), Fig. 5 (b)-(d) removes the gray level image G of the RGB3 kind component of background to the colour distortion raster image g that collects when adopting the inventive method to measure the motorcycle backplate 1(x, y), R 1(x, y), B (x, y).
Fig. 6 (a) is that (x, y) the 400th line frequency spectrum are that (x, y) the 400th line frequency spectrum (before unfiltered) (c) is low frequency standard grayscale figure R to the B component image B that represents background component (b) to R component image R before subtracting each other 1(x, y) the 400th line frequency spectrum (d) is high frequency standard grayscale figure G 1(x, y) the 400th line frequency spectrum.Fig. 7 is the relative phase figure under the two kinds of frequencies of height that obtain.
Fig. 8; (a) be high frequency absolute phase after launching; (b) be high frequency absolute phase
Figure GSB00000394982000072
after launching
Fig. 9 is the absolute phase figure
Figure GSB00000394982000073
that adopts the inventive method finally to obtain
Figure 10 is the motorcycle backplate three-dimensional point cloud design sketch that finally obtains.
Figure 11 is the geometric representation of the three-dimension measuring system that adopts of the present invention.
Embodiment
Further specify below in conjunction with the accompanying drawing specific embodiments of the invention.Under windows operating system, select for use VC++6.0, the deformed grating image that CCD collects is handled as programming tool.This instance adopts the motorcycle backplate as testee, finally obtains the more accurate whole audience absolute phase that contains the backplate three-dimensional information and distributes.
Fig. 1 is the process flow diagram of whole process of the present invention.
Fig. 2 is the three-dimension measuring system that the present invention adopts.With projector the tricolor grating image projection is arrived testee, adopt colored CCD to gather the deformed grating image, transfer in the computing machine through graph card and handle.
Fig. 3 is the process flow diagram that step 3 of the present invention is separated 3 kinds of components of images acquired and removal background.
Fig. 4 is that step 6 of the present invention adopts dual-frequency method correction absolute phase to obtain the process flow diagram of precise phase value.
The present invention utilizes three kinds of components of RGB of coloured image to solve spectral aliasing and the Phase unwrapping that exists in the Fourier transform mensuration.With two kinds of components of sinusoidal variations rule modulation RG of two kinds of frequencies, the B component is set to the mean value of the gray scale of R, G component, forms a color image frame and projects body surface.Use CCD to gather the deformed grating image that receives the modulation of testee height.Through separating 3 kinds of components in this image, B component gray level image is deducted from RG component gray level image respectively, adopt Fourier transform analysis to find the solution then and obtain two kinds of relative phase values under the frequency.Phase unwrapping is carried out in distribution to relative phase, at first adopts scanning line method to launch the high and low frequency absolute phase respectively, proofreaies and correct the high frequency absolute phase to eliminate error with the low frequency absolute phase then, obtains the higher whole audience absolute phase values of precision.Then according to the phase place of classical optical grating projection to the height conversion formula, finally obtain the three-dimensional information of Measuring Object.
The present invention is based on the Fourier transform three-dimensional measurement method of three coloured light projections, detailed step is following:
Step 1: design a width of cloth colour projection raster image, and raster image is projected to the object under test surface, said colour projection raster image is provided with as follows:
f(m,n)=a r+b rcos(2πf 0m)+a g+b gcos(4πf 0m)+a b
Wherein, a r, a gBe R, the background light intensity of G component, b r, b gBe R, the reflectivity of G component, a bBe set to R, the mean value of G two components, f 0Be the frequency of R component sine streak, (frequency of G component sine streak is 2 times of R component sine streak for m, the n) two-dimensional coordinate of representation raster image.
Step 2: use colored CCD that body surface to be measured is taken, obtain an amplitude variation shape grating fringe image:
g(x,y)=r r(x,y)[a r+b rcos(2πf 0x+φ 1(x,y))]+
r g(x,y)[a g+b gcos(4πf 0x+φ 2(x,y))]+r b(x,y)a b
Wherein, r r(x, y), r b(x, y), r g(x is that object is to different colours reflection of light rate, φ y) 1(x, y), φ 2(x y) is the PHASE DISTRIBUTION of low frequency and high frequency to be asked, (and x, the y) two-dimensional coordinate of expression deformed grating stripe pattern,
Because surround lighting is constant, so can be with reflectivity r r(x, y), r b(x, y), r g(x y) is regarded as constant.
Practical distortion grating fringe image is shown in Fig. 5 (a).
Step 3: from the deformed grating stripe pattern, separate R, G, the B component of the coloured image that obtains, and from R, G component gray-scale map, remove background component, obtain low frequency standard grayscale figure R 1(x, y), high frequency standard grayscale figure G 1(x, y),
3 kinds of components of RGB in the deformed grating image that receives testee height modulation that CCD is collected separate; Because object is different to the reflectivity of every kind of component of RGB; So need the value of averaging with variance correction make every kind of component background component contrast identical so that do further processing.With the B component is benchmark, with the mean value of G component and R component and contrast correction to identical with the B component.
Adopt following method from R component gray-scale map, to remove background component:
Step 3.1.1: the mean value m that at first asks for R component pixel gray-scale value rWith variance d r, the mean value m of B component pixel gray-scale value bWith variance d bUse following formula to revise each grey scale pixel value of R component:
r 1(x,y)=r(x,y)+m b-m r
R ( x , y ) = [ r 1 ( x , y ) - m r 1 ] d b d r + m r 1
Wherein (x y) is the R component intensity profile after proofreading and correct, r to R 1(x y) is intermediate variable, Be r 1(x, mean value y),
Contain the sinusoidal phase modulation signal R component of object height information after obtaining proofreading and correct and represent the B component of background component can be expressed as as follows:
R(x,y)=a(x,y)+b(x,y)cos[2πf 0x+φ 1(x,y)];
B(x,y)=a(x,y);
Step 3.1.2: to R (x, y), ((x, y) (x y) deducts in two kinds of components B, is not contained the grey-scale raster images R of background and high fdrequency component from R with B then for x, y) filtering 1(x, y):
R 1(x,y)=R(x,y)-B(x,y)
=b(x,y)cos[2πf 0x+φ 1(x,y)];
Adopt following method from G component gray-scale map, to remove background component:
Step 3.2.1: the mean value m that at first asks for G component pixel gray-scale value gWith variance d g, the mean value m of B component pixel gray-scale value bWith variance d bUse following formula to revise each grey scale pixel value of G component:
g 1(x,y)=g(x,y)+m b-m g
G ( x , y ) = [ g 1 ( x , y ) - m g 1 ] d b d g + m g 1
Wherein (x y) is the G component intensity profile after proofreading and correct, g to G 1(x y) is intermediate variable, Be g 1(x, mean value y),
Obtaining proofreading and correct the back representative contains the double frequency sinusoidal phase modulation signal G component of object height information and represents the B component of background component can be expressed as as follows:
G(x,y)=a(x,y)+b(x,y)cos[2πf 0x+φ 2(x,y)];
B(x,y)=a(x,y);
Step 3.2.2: to G (x, y), ((x, y) (x y) deducts in the component B, is not contained the grey-scale raster images G of background and high fdrequency component from G with B then for x, y) filtering 1(x, y):
G 1(x,y)=R(x,y)-B(x,y)
=b(x,y)cos[2πf 0x+φ 2(x,y)]°
Actual high frequency standard grayscale figure G 1(x, y), low frequency standard grayscale figure R 1(x, y) as Fig. 5 (b) (c) shown in.Fig. 5 (d) for the B of representative background component (x, y).Fig. 6 (a) is that (x, y) the 400th line frequency spectrum are that (x, y) the 400th line frequency spectrum (before unfiltered) (c) is low frequency standard grayscale figure R to the B component image B that represents background component (b) to R component image R before subtracting each other 1(x, y) the 400th line frequency spectrum (d) is high frequency standard grayscale figure G 1(x, y) the 400th line frequency spectrum.Can find out by spectrogram, through the processing of step 3, low frequency standard grayscale figure R 1(x, y) the 400th line frequency spectrum and high frequency standard grayscale figure G 1(x, y) background component (i.e. near frequency component 0 frequency) is suppressed fully in the 400th line frequency spectrum.
Step 4: to low frequency standard grayscale figure R 1(x, y), high frequency standard grayscale figure G 1(x y) does Fourier transform, and obtain the relative phase distribution of R component and the relative phase of G component respectively and distribute,
To low frequency standard grayscale figure R 1(x y) does Fourier transform, and it is following to obtain the process that the relative phase of R component distributes:
Step 4.1.1: with R 1(x y) is expressed as exponential form:
R 1 ( x , y ) = r r ( x , y ) Σ n = - ∞ n = + ∞ A n expi [ 2 πn f 0 x + n φ 1 ( x , y ) ]
Wherein, when n=0, A n=0, Expression imaginary unit,
Step 4.1.2: looking y is constant, adopts 1 dimension fast fourier transform algorithm to low frequency standard grayscale figure R 1(x, every row y) carries out Fourier transform, and conversion process is:
R f ( f , y ) = ∫ - ∞ + ∞ R 1 ( x , y ) exp ( - 2 πifx ) dx
The expression formula that obtains frequency domain is:
R f ( f , y ) = Σ n = - ∞ n = + ∞ Q n ( f - n f 0 , y )
Wherein, Q n(f-nf 0, y) be A nr r(x, y) exp [in φ 1(x, y)] accordingly in the expression formula of frequency domain, f representes the variable of frequency domain,
Step 4.1.3: to Q n(f-nf 0, y) carry out filtering and extract Q 1(f-f 0, y), again to Q 1(f-f 0, y) carry out inverse Fourier transform, obtain containing the A of phase information 1r r(x, y) exp [i φ 1(x, y)], calculate A 1r r(x, y) exp [i φ 1(x, y)] angle value can obtain containing the R component relative phase value φ of object height information 1(x, y), the phase value that obtains is between 0-2 π;
To high frequency standard grayscale figure G 1(x y) does Fourier transform, and it is following to obtain the process that the relative phase of G component distributes:
Step 4.2.1: with G 1(x y) is expressed as exponential form:
G 1 ( x , y ) = r g ( x , y ) Σ n = - ∞ n = + ∞ B n expi [ 2 πn f 0 x + n φ 2 ( x , y ) ]
Wherein, when n=0, B n=0,
Figure GSB00000394982000106
Expression imaginary unit,
Step 4.2.2: looking y is constant, adopts 1 dimension fast fourier transform algorithm to low frequency standard grayscale figure R 1(x, every row y) carries out Fourier transform, and conversion process is:
G f ( f , y ) = ∫ - ∞ + ∞ G 1 ( x , y ) exp ( - 2 πifx ) dx
The expression formula that obtains frequency domain is:
G f ( f , y ) = Σ n = - ∞ n = + ∞ P n ( f - n f 0 , y )
Wherein, P n(f-nf 0, y) be B nr g(x, y) exp [in φ 1(x, y)] accordingly in the expression formula of frequency domain, f representes the variable of frequency domain,
Step 4.2.3: to P n(f-nf 0, y) carry out filtering and extract P 1(f-f 0, y), again to P 1(f-f 0, y) carry out inverse Fourier transform, obtain containing the B of phase information 1r g(x, y) exp [i φ 2(x, y)], calculate B 1r g(x, y) exp [i φ 2(x, y)] angle value can obtain containing the G component relative phase value φ of object height information 2(x, y), the phase value that obtains is between 0-2 π;
Fig. 7 is the R component relative phase value φ that obtains 1(x, y), G component relative phase value φ 2(x, relative phase figure y);
Step 5:
Step 5.1: the relative phase value φ that adopts the R component that obtains in the direct deployment step 4 of scanning Beam Method 1(x, y) promptly through following formula point by point scanning, in PHASE DISTRIBUTION, do not have till the saltus step greater than π:
Figure GSB00000394982000111
Wherein,
Figure GSB00000394982000112
Be the low frequency absolute phase after launching, φ 1(x y) is relative phase, Δ φ 1Be the phase difference value between adjacent 2,
Step 5.2: the relative phase value φ that adopts the G component that obtains in the direct deployment step 4 of scanning Beam Method 2(x, y) promptly through following formula point by point scanning, in PHASE DISTRIBUTION, do not have till the saltus step greater than π:
Figure GSB00000394982000113
Wherein,
Figure GSB00000394982000114
Be the high frequency absolute phase after launching, φ 2(x y) is relative phase, Δ φ 2Be the phase difference value between adjacent 2
Figure GSB00000394982000115
Fig. 8; (a) be high frequency absolute phase
Figure GSB00000394982000116
after launching; (b) be high frequency absolute phase
Figure GSB00000394982000117
after launching
Step 6: by the absolute phase values under two kinds of frequencies that obtain in the step 5, adopt dual-frequency method to proofread and correct the high frequency absolute phase values, eliminate error, obtain final expansion phase result.
Adopt scanning line method in the step 5,, can make can make mistakes in the absolute phase values subregion under the high frequency because the shade of some sheer face can block the mistake transmission of whole cycle and big noise spot.Obtain absolute phase value under the low frequency because fringe period is enough big; The phase unwrapping mistake that shade produces is able to avoid; But because striped underfrequency; Measuring accuracy is the absolute phase values as obtaining under the high frequency scarcely, so the absolute phase values
Figure GSB00000394982000122
that adopts the absolute phase values
Figure GSB00000394982000121
under the low frequency to proofread and correct under the high frequency can be eliminated the zone errors in
Figure GSB00000394982000123
when not reducing the phase place solving precision.
Step 6.1: Read to get the low-frequency absolute phase
Figure GSB00000394982000124
and high absolute phase
Figure GSB00000394982000125
Step 6.2: traversal is calculated difference degree between the two, promptly obtains following parameter distributions:
Figure GSB00000394982000127
Ceil representes the function that rounds up in the following formula,
If Q ≠ 0; Then use Q that high frequency absolute phase
Figure GSB00000394982000128
is proofreaied and correct, that is:
Figure GSB00000394982000129
Figure GSB000003949820001210
is the accurate expansion phase value that obtains.Phase diagram is as shown in Figure 9.
Step 7: read final expansion phase result
Figure GSB000003949820001211
according to the phase place of classical optical grating projection to the height conversion formula, finally try to achieve the three-dimensional information of Measuring Object.
The geometric representation of measuring system is shown in figure 11; By launch phase result
Figure GSB000003949820001212
to object height h (x, formula y) is following:
Figure GSB000003949820001213
Wherein, l, d are the geometric parameters of measuring system, and l is the distance of projector to measurement plane, and d is the distance of CCD camera to projector,
Figure GSB000003949820001214
The expression phase changing capacity,
Figure GSB000003949820001215
Be the expansion phase result,
Figure GSB000003949820001216
Be the initial phase result, by the decision of witness mark face, ω 0Be the angular frequency of projection grating, can get by system calibrating.
The point cloud chart of expression motorcycle backplate three-dimensional information is shown in figure 10.

Claims (3)

1. measuring three-dimensional morphology method based on tricolor grating projection and Fourier transform is characterized in that concrete steps are following:
Step 1: design a width of cloth colour projection raster image, and raster image is projected to the object under test surface, said colour projection raster image is provided with as follows:
f(m,n)=a r+b rcos(2πf 0m)+a g+b gcos(4πf 0m)+a b
Wherein, a r, a gBe R, the background light intensity of G component, b r, b gBe R, the reflectivity of G component, a bBe set to R, the mean value of the background light intensity of G two components, f 0Be the frequency of R component sine streak, (frequency of G component sine streak is 2 times of R component sine streak, step 2 for m, the n) two-dimensional coordinate of representation raster image: use colored CCD that body surface to be measured is taken, obtain an amplitude variation shape grating fringe image:
g(x,y)=r r(x,y)[a r+b rcos(2πf 0x+φ 1(x,y))]+
r g(x,y)[a g+b gcos(4πf 0x+φ 2(x,y))]+r b(x,y)a b
Wherein, r r(x, y), r b(x, y), r g(x, y) be object to different colours reflection of light rate, reflectivity is a constant, φ 1(x, y), φ 2(x y) is the PHASE DISTRIBUTION of low frequency and high frequency to be asked, (and x, the y) two-dimensional coordinate of expression deformed grating stripe pattern,
Step 3: from the deformed grating stripe pattern, separate R, G, the B component of the coloured image obtain, and from R, G component gray-scale map, remove background component, obtain removing the R component low frequency standard grayscale figure R after the background component 1(x, y), remove the G component high frequency standard grayscale figure G after the background component 1(x, y),
Step 4: to R component low frequency standard grayscale figure R 1(x, y), G component high frequency standard grayscale figure G 1(x y) does Fourier transform, obtains the relative phase distribution of R component and the relative phase of G component respectively and distributes, to the R component low frequency standard grayscale figure R after the removal background component 1(x y) does Fourier transform, and it is following to obtain the process that the relative phase of R component distributes:
Step 4.1.1: with R 1(x y) is expressed as exponential form:
Figure FSB00000676319700011
Wherein, when n=0, A n=0,
Figure FSB00000676319700012
Expression imaginary unit,
Step 4.1.2: looking y is constant, adopts 1 dimension fast fourier transform algorithm to low frequency standard grayscale figure R 1(x, every row y) carries out Fourier transform, and conversion process is:
Figure FSB00000676319700021
The expression formula that obtains frequency domain is:
Figure FSB00000676319700022
Wherein, Q n(f-nf 0, y) be A nr r(x, y) exp [in φ 1(x, y)] accordingly in the expression formula of frequency domain, f representes the variable of frequency domain,
Step 4.1.3: to Q n(f-nf 0, y) carry out filtering and extract Q 1(f-f 0, y), again to Q 1(f-f 0, y) carry out inverse Fourier transform, obtain containing the A of phase information 1r r(x, y) exp [i φ 1(x, y)], calculate A 1r r(x, y) exp [i φ 1(x, y)] angle value can obtain containing the R component relative phase value φ of object height information 1(x, y), the phase value that obtains is between 0-2 π;
To the G component high frequency standard grayscale figure G after the removal background component 1(x y) does Fourier transform, and it is following to obtain the process that the relative phase of G component distributes:
Step 4.2.1: with G 1(x y) is expressed as exponential form:
Figure FSB00000676319700023
Wherein, when n=0, B n=0, Expression imaginary unit,
Step 4.2.2: looking y is constant, adopts 1 dimension fast fourier transform algorithm to low frequency standard grayscale figure R 1(x, every row y) carries out Fourier transform, and conversion process is:
Figure FSB00000676319700025
The expression formula that obtains frequency domain is:
Figure FSB00000676319700026
Wherein, P n(f-nf 0, y) be B nr g(x, y) exp [in φ 1(x, y)] accordingly in the expression formula of frequency domain, f representes the variable of frequency domain,
Step 4.2.3: to P n(f-nf 0, y) carry out filtering and extract P 1(f-f 0, y), again to P 1(f-f 0, y) carry out inverse Fourier transform, obtain containing the B of phase information 1r g(x, y) exp [i φ 2(x, y)], calculate B 1r g(x, y) exp [i φ 2(x, y)] angle value can obtain containing the G component relative phase value φ of object height information 2(x, y), the phase value that obtains is between 0-2 π;
Step 5:
Step 5.1: the relative phase value φ that adopts the R component that obtains in the direct deployment step 4 of scanning Beam Method 1(x, y) promptly through following formula point by point scanning, in PHASE DISTRIBUTION, do not have till the saltus step greater than π:
Wherein,
Figure FSB00000676319700032
Be the low frequency absolute phase after launching, φ 1(x y) is relative phase, Δ φ 1Be the phase difference value between adjacent 2,
Step 5.2: the relative phase value φ that adopts the G component that obtains in the direct deployment step 4 of scanning Beam Method 2(x, y) promptly through following formula point by point scanning, in PHASE DISTRIBUTION, do not have till the saltus step greater than π:
Figure FSB00000676319700033
Wherein,
Figure FSB00000676319700034
Be the high frequency absolute phase after launching, φ 2(x y) is relative phase, Δ φ 2Be the phase difference value between adjacent 2,
Step 6: adopt dual-frequency method to proofread and correct high frequency absolute phase high frequency absolute phase
Figure FSB00000676319700037
by low frequency absolute phase that obtains in the step 5
Figure FSB00000676319700035
and high frequency absolute phase and eliminate error, obtain final expansion phase result
Step 7: read final expansion phase result
Figure FSB00000676319700039
according to classical optical grating projection by launching phase result
Figure FSB000006763197000310
to object height h (x; Y) conversion formula; Finally try to achieve the three-dimensional information of Measuring Object, described conversion formula is:
Figure FSB000006763197000311
Wherein, l, d are the geometric parameters of measuring system, and l is the distance of projector to measurement plane, and d is the distance of CCD camera to projector, The expression phase changing capacity,
Figure FSB000006763197000313
Be the expansion phase result,
Figure FSB000006763197000314
Be initial phase result, ω 0Angular frequency for projection grating.
2. the measuring three-dimensional morphology method based on chromatic grating projection and Fourier transform according to claim 1 is characterized in that,
Adopt following method from R component gray-scale map, to remove background component:
Step 3.1.1: the mean value m that at first asks for R component pixel gray-scale value rWith variance d r, the mean value m of B component pixel gray-scale value bWith variance d bUse following formula to revise each grey scale pixel value of R component:
r 1(x,y)=r(x,y)+m b-m r
Wherein (x y) is the R component intensity profile after proofreading and correct, r to R 1(x y) is intermediate variable,
Figure FSB00000676319700042
Be r 1(x, mean value y),
Contain the sinusoidal phase modulation signal R component of object height information after obtaining proofreading and correct and represent the B component of background component can be expressed as as follows:
R(x,y)=a(x,y)+b(x,y)cos[2πf 0x+φ 1(x,y)];
B(x,y)=a(x,y);
Step 3.1.2: to R (x, y), ((x, y) (x y) deducts in two kinds of components B, is not contained the R component low frequency standard grayscale figure R of background and high fdrequency component from R with B then for x, y) filtering 1(x, y):
R 1(x,y)=R(x,y)-B(x,y)
=b(x,y)cos[2πf 0x+φ 1(x,y)];
Adopt following method from G component gray-scale map, to remove background component:
Step 3.2.1: the mean value m that at first asks for G component pixel gray-scale value gWith variance d g, the mean value m of B component pixel gray-scale value bWith variance d bUse following formula to revise each grey scale pixel value of G component:
g 1(x,y)=g(x,y)+m b-m g
Figure FSB00000676319700043
Wherein (x y) is the G component intensity profile after proofreading and correct, g to G 1(x y) is intermediate variable, Be g 1(x, mean value y),
Obtaining proofreading and correct the back representative contains the double frequency sinusoidal phase modulation signal G component of object height information and represents the B component of background component can be expressed as as follows:
G(x,y)=a(x,y)+b(x,y)cos[2πf 0x+φ 2(x,y)];
B(x,y)=a(x,y);
Step 3.2.2: to G (x, y), ((x, y) (x y) deducts in the component B, is not contained the G component high frequency standard grayscale figure G of background and high fdrequency component from G with B then for x, y) filtering 1(x, y):
G 1(x,y)=R(x,y)-B(x,y)
=b(x,y)cos[2πf 0x+φ 2(x,y)]。
3. the measuring three-dimensional morphology method based on chromatic grating projection and Fourier transform according to claim 1 is characterized in that dual-frequency method is in the step 6:
Step 6.1: Read to get the low-frequency absolute phase?
Figure FSB00000676319700051
and high absolute phase?
Step 6.2: traversal
Figure FSB00000676319700053
is calculated difference degree between the two, promptly obtains following parameter distributions:
Figure FSB00000676319700054
Ceil representes the function that rounds up in the following formula,
If Q ≠ 0; Then use Q that high frequency absolute phase
Figure FSB00000676319700055
is proofreaied and correct, that is:
Figure FSB00000676319700056
Figure FSB00000676319700057
is the accurate expansion phase value that obtains.
CN2010102902257A 2010-09-21 2010-09-21 Tricolor projection-based Fourier transform three-dimensional measuring method Expired - Fee Related CN101986098B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010102902257A CN101986098B (en) 2010-09-21 2010-09-21 Tricolor projection-based Fourier transform three-dimensional measuring method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010102902257A CN101986098B (en) 2010-09-21 2010-09-21 Tricolor projection-based Fourier transform three-dimensional measuring method

Publications (2)

Publication Number Publication Date
CN101986098A CN101986098A (en) 2011-03-16
CN101986098B true CN101986098B (en) 2012-02-22

Family

ID=43710463

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010102902257A Expired - Fee Related CN101986098B (en) 2010-09-21 2010-09-21 Tricolor projection-based Fourier transform three-dimensional measuring method

Country Status (1)

Country Link
CN (1) CN101986098B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111879257A (en) * 2020-07-21 2020-11-03 南昌航空大学 High dynamic range real-time three-dimensional measurement method based on Fourier transform profilometry

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102322822B (en) * 2011-08-08 2013-04-17 西安交通大学 Three-dimensional measurement method for triple-frequency color fringe projection
CN102525034B (en) * 2011-11-22 2015-04-15 中国科学院合肥物质科学研究院 Foot type parameter measuring device and measuring method
CN104160241B (en) * 2012-03-14 2017-06-30 独立行政法人产业技术总合研究所 Using the phase distribution analysis method of the stripe pattern of higher-dimension monochrome information, device and its program
CN102620685B (en) * 2012-03-23 2014-11-26 东南大学 Improved window Fourier three-dimensional measurement method based on Stockwell transform
CN102607466B (en) * 2012-03-29 2014-10-01 天津大学 Grating projection rapid non-contact measurement method and device for high-reflectance free-form curved-surface parts
CN103575234B (en) * 2012-07-20 2016-08-24 德律科技股份有限公司 3-dimensional image measurement apparatus
CN102818535B (en) * 2012-08-16 2014-11-05 哈尔滨理工大学 Electromagnetic positioning splicing apparatus and method for coded light three-dimensional measurement
CN102980527B (en) * 2012-10-18 2015-09-09 北京航空航天大学 A kind of three-dimension sensor real time high-speed data handling system based on CMOS
CN102944192B (en) * 2012-10-18 2015-08-12 北京航空航天大学 A kind of based on real time high-speed three-dimensional reproduction method on the sheet of FPGA
CN103727895B (en) * 2014-01-16 2017-02-22 电子科技大学 Single-frame color composite grating stripe reflection mirror surface three-dimensional surface shape measuring method
CN103968782B (en) * 2014-05-23 2018-06-05 四川大学 A kind of real-time three-dimensional measuring method based on colored sinusoidal structured pumped FIR laser
CN104299211B (en) * 2014-09-25 2020-12-29 苏州笛卡测试技术有限公司 Free-moving type three-dimensional scanning method
CN104315996B (en) * 2014-10-20 2018-04-13 四川大学 The method that Fourier transform profilometry is realized with binary coding strategy
CN104504735B (en) * 2015-01-15 2017-03-01 中南大学 A kind of material distribution detection method based on phase recovery
CN106289109A (en) * 2016-10-26 2017-01-04 长安大学 A kind of three-dimensional reconstruction system based on structure light and method
CN106682473A (en) * 2016-12-20 2017-05-17 深圳芯启航科技有限公司 Method and device for identifying identity information of users
TWI676781B (en) * 2018-08-17 2019-11-11 鑑微科技股份有限公司 Three-dimensional scanning system
CN109581518A (en) * 2019-01-22 2019-04-05 中北大学 One kind is without synchronizing current acquisition transmission and the acquisition of frequency domain measurement SIP data and processing method
CN112361992B (en) * 2020-11-10 2022-03-25 齐鲁工业大学 Grating projection three-dimensional measurement method and device
CN112781522A (en) * 2020-12-25 2021-05-11 复旦大学 Remove highlight contourgraph based on colored phase shift structured light
CN113327317B (en) * 2021-08-04 2022-02-08 浙江清华柔性电子技术研究院 Three-dimensional point cloud picture acquisition method and device, electronic equipment and storage medium
CN116485690B (en) * 2023-06-20 2023-09-05 中国科学院苏州生物医学工程技术研究所 Method and device for calibrating moire fringe drift of X-ray grating imaging

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101451826B (en) * 2008-12-17 2010-06-09 中国科学院上海光学精密机械研究所 Object three-dimensional contour outline measuring set and measuring method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111879257A (en) * 2020-07-21 2020-11-03 南昌航空大学 High dynamic range real-time three-dimensional measurement method based on Fourier transform profilometry

Also Published As

Publication number Publication date
CN101986098A (en) 2011-03-16

Similar Documents

Publication Publication Date Title
CN101986098B (en) Tricolor projection-based Fourier transform three-dimensional measuring method
CN107607060B (en) A kind of phase error compensation method applied in the measurement of grating tripleplane
CN105783775B (en) A kind of minute surface and class minute surface object surface appearance measuring device and method
CN104061879B (en) A kind of structural light three-dimensional face shape vertical survey method continuously scanned
US8411284B2 (en) Method for simultaneous hue phase-shifting and system for 3-D surface profilometry using the same
CN102155924B (en) Four-step phase shifting method based on absolute phase recovery
CN101881605B (en) Optical three-dimensional measuring method based on phase coding technology
JP5252820B2 (en) 3D measurement method and 3D shape measurement apparatus using the same
CN109974625B (en) Color object structured light three-dimensional measurement method based on hue optimization gray scale
CN104655051A (en) High-speed structured light three-dimensional surface shape vertical measurement method
CN109631798A (en) A kind of 3 d shape vertical measurement method based on π phase shifting method
CN102620685A (en) Improved window Fourier three-dimensional measurement method based on Stockwell transform
CN103267496A (en) Improved window Fourier three-dimensional measuring method based on wavelet transform
CN102519393A (en) Method for realizing rapid modulation degree profilometry by use of two orthogonal sinusoidal gratings
CN113506348B (en) Gray code-assisted three-dimensional coordinate calculation method
CN107014313B (en) Method and system for weighted least square phase unwrapping based on S-transform ridge value
CN108332684A (en) A kind of measuring three-dimensional profile method based on Structured Illumination microtechnic
CN106091978B (en) The joining method of interference fringe image in inclined in type measurements by laser interferometry
CN114688995A (en) Phase error compensation method in fringe projection three-dimensional measurement
Mohammadi et al. Single-frame digital phase-shifting 3D shape measurement using pixel-wise moiré-wavelength refinement
CN110375675A (en) Binocular optical grating projection measurement method based on space phase expansion
CN116608794B (en) Anti-texture 3D structured light imaging method, system, device and storage medium
Xu et al. Realtime 3D profile measurement by using the composite pattern based on the binary stripe pattern
García-Isáis et al. One shot profilometry using phase partitions
CN114739322B (en) Three-dimensional measurement method, equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: SOWTHEAST UNIV.

Effective date: 20131018

Owner name: SHENLING ELECTRIC MANUFACTURING CO., LTD., HAIAN

Free format text: FORMER OWNER: SOWTHEAST UNIV.

Effective date: 20131018

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 210096 NANJING, JIANGSU PROVINCE TO: 226600 NANTONG, JIANGSU PROVINCE

TR01 Transfer of patent right

Effective date of registration: 20131018

Address after: 226600 Haian, Jiangsu province Haian Zhenhai Road, No. 88, South Road, No.

Patentee after: Haian Shenling Electrical Appliance Manufacturing Co., Ltd.

Patentee after: Southeast University

Address before: 210096 Jiangsu city Nanjing Province four pailou No. 2

Patentee before: Southeast University

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120222

Termination date: 20190921