CN107726996A - A kind of object dimensional surface shape measurement system and method based on fringe projection principle - Google Patents
A kind of object dimensional surface shape measurement system and method based on fringe projection principle Download PDFInfo
- Publication number
- CN107726996A CN107726996A CN201710903975.9A CN201710903975A CN107726996A CN 107726996 A CN107726996 A CN 107726996A CN 201710903975 A CN201710903975 A CN 201710903975A CN 107726996 A CN107726996 A CN 107726996A
- Authority
- CN
- China
- Prior art keywords
- mobile phone
- under test
- phase
- image
- projection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/2433—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures for measuring outlines by shadow casting
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
A kind of object dimensional surface shape measurement system and method based on fringe projection principle, belongs to technical field of object three-dimensional measurement.The present invention on mobile phone flashlight cover by fixing micro-optical projection element, so that sine streak optical grating projection when opening flash lamp built in optics projection element is in object under test surface, the deforming stripe that smart mobile phone collection simultaneously obtains after object under test surface modulation, and the 3 d shape information that screen display object can be shown in smart mobile phone is handled by data processing module.This measuring system has economic, portable advantage, and measuring method also has advantage simple to operate, measuring speed is fast, is advantageous to the application of three dimension profile measurement system in daily life compared with the existing three dimension profile measurement system based on fringe projection.
Description
Technical field
The invention belongs to technical field of object three-dimensional measurement, more particularly to a kind of object dimensional based on fringe projection principle
Surface shape measurement system and method.
Background technology
As precision optical machinery processed, automobile making, precision optics processing, semicon industry, precision instrument manufacture, mould are set
The fast development in the fields such as meter, reverse-engineering, traditional two-dimensional measurement equipment can not meet the life for modernizing, automating increasingly
Production requires that three-dimensional measurement technology is arisen at the historic moment.Mainly have to the three dimension profile measurement of object at present Contacting three coordinates measurement instrument,
Optical scanner, interferometer etc..But contact three coordinate machine time of measuring is considerably long (more than usual a few hours), and may
Object under test surface is destroyed, interferometer is typically only capable to measure class plane or sphere object, can not measure free form surface object, and survey
Amount condition, environmental requirement are harsh, and measurement range is very small.
Method for three-dimensional measurement based on fringe projection becomes the three dimension profile measurement method that people in recent years pay close attention to the most
One of.Because this method has, quick, precision is higher, system cost is low, test condition requires low advantage, in industry
Precision parts are processed to be risen with fields such as manufacture, the detection of mobile model, the detection of semiconductor circuit crudy, reverse-engineerings
Very important effect.Structural light stripes figure is projected in object under test surface by this method generally by projecting apparatus, so
Afterwards by the deformation pattern on object under test surface under cameras record, then through steps such as phase demodulatings obtain the phase point of deforming stripe
Cloth, calculates the three-dimensional height information of testee, therefore with speed is fast, precision is high, non-contact, easy-operating feature.So
And tradition based on the three-dimension measuring system of fringe projection due to needing the equipment such as camera, projecting apparatus and computer, can not realize just
Take, and operating process is more complicated so that its application is extremely limited to, and can not be promoted in the vast consumer group.Meanwhile companion
With the development of electric business industry and growing personalized customization demand, ordinary consumer user wants to use simple
Three dimension profile measurement device, such as：Rough three-dimensional measurement is carried out to face, hand, pin, and then to personalized customization spectacle-frame
The objects such as gloves, leather shoes are chosen on frame, line reference is provided.Portability and behaviour of the consumer for object dimensional surface shape measurement system
The demand for making simplification seems more and more important.Therefore, current three dimension profile measurement system presence can be solved by needing searching one kind badly
The method of portability difference and complex operation.
The content of the invention
The technical problems to be solved by the invention are：The present invention using one with flash lamp smart camera cellphone and
Micro-optical lantern projection element on mobile phone flashlight builds to obtain economic, portable object dimensional face shape information survey
Amount system, and also there is advantage simple to operate, measuring speed is fast with this measuring system acquisition 3 d shape information,
Be advantageous to the application of three dimension profile measurement system in daily life.
In order to solve the above-mentioned technical problem, the present invention provides following technical scheme：
On the one hand the present invention provides a kind of object dimensional surface shape measurement system based on fringe projection principle, and its feature exists
In：Including the smart mobile phone with flash lamp function, image collecting function and data processing function, also have on the smart mobile phone
There is micro-optical lantern projection element, micro-optical lantern projection element comprises at least lens and transparent film, described
There is sine streak image, micro-optical lantern projection element is close on mobile phone flashlight cover, opens flash lamp on gelatin foil
Enable to sine stripe projection and be completely covered on object under test surface, image capture module can gather object under test surface
The deforming stripe image obtained after modulation, handled through data processing module can show that screen display measures in smart mobile phone
To the 3 d shape information of body surface.Further, object under test surface, optical projection element and mobile phone camera are in space
On position meet reflection law.
On the other hand the present invention also provides a kind of method based on fringe projection measurement object dimensional face shape, and its feature exists
In comprising the following steps：
Step A：Assemble measuring system；
Smart mobile phone of the selection with flash lamp function, image collecting function and data processing function, dodges in smart mobile phone
Optics lantern projection element is installed on light lampshade, micro-optical lantern projection element comprises at least lens and transparent film,
There is sine streak image on the transparent film；
Step B：Gather image；
Adjustment mobile phone location causes the positive measuring targets surface of camera, define mobile phone camera and object under test surface it
Between distance be L, the distance for defining mobile phone camera center and flash lamp center is d；Opening flash lamp causes miniature magic lantern to close
Projection element is learned by its interior sine stripe projection to object under test surface, then collects what is obtained after surface modulation to be measured
Deforming stripe image；
Step C：Image real time transfer；
The phase of deforming stripe is obtained by the progress phase demodulating of smartphone data processing module and carries out phase unwrapping,
Height value is tried to achieve according to Phase-height mapping relation, you can obtain the 3 d shape information of body surface.
Further, image real time transfer is specific as follows in the present invention：
The expression formula of sine streak is as follows in the step B：
I0(x, y)=A+Bcos (2 π f0x)
In formula：A represents background light intensity, and B represents modulation degree distribution, f0Represent the frequency of carrier frequency；
The use of deforming stripe image expression formula is then collected to be expressed as below：
In formula：A represents background light intensity, and B represents modulation degree distribution, f0The frequency of carrier frequency is represented,Represent through to be measured
The additive phase introduced after body surface modulation；
Deforming stripe phase is reconciled using Fourier transformation and obtains following expression：
In formula：For the deforming stripe phase demodulated, ImExpression takes imaginary-part operation to accord with, F*(x, y) is F's (x, y)
Conjugation, then carry out phase unwrapping and can obtain Phase-height mapping relational expression as follows：
In formula：L is the distance between mobile phone camera and object under test surface, and d is mobile phone camera center and flash lamp
The distance at center,Represent the additive phase introduced after object under test surface modulation；So far the three-dimensional of object is obtained
Face shape information.
Compared with prior art, the beneficial effects of the present invention are：
The present invention provides the portable object three dimension profile measurement system based on smart mobile phone, by mobile phone flashlight cover
Sine streak optical grating projection when upper fixed optical projection element to open flash lamp built in optics projection element is in determinand
Body surface face, while the deforming stripe that smart mobile phone collection obtains after object under test surface modulation, and pass through data processing module
Processing can show the 3 d shape information of screen display object in smart mobile phone.It can thus be seen that provided by the invention three
Dimension surface shape measurement system has miniaturization, operates simple, economic, portable advantage, is advantageous to three dimension profile measurement system in day
The often application in life；And system provided by the invention only needs a two field picture to complete to measure, with traditional multistep phase shift method
Measurement object dimensional face shape is compared, and more time cost is low and the fast advantage of measuring speed.
Brief description of the drawings
Fig. 1 is a kind of flow chart based on smart camera cellphone measurement object dimensional face shape provided in an embodiment of the present invention.
Fig. 2 is optical projection element and mobile phone camera in object dimensional surface shape measurement system provided in an embodiment of the present invention
With the position view of flash lamp；In figure：1 is smart mobile phone, and 2 be mobile phone camera, and 3 be miniature magic lantern optical projection element,
31 be lens, and 32 be sine streak grating, and 4 be mobile phone flashlight.
Fig. 3 is a kind of system and determinand based on fringe projection measurement object dimensional face shape provided in an embodiment of the present invention
Structural representation between body surface face；In figure：1 is smart mobile phone, and 2 be mobile phone camera, and 3 be miniature magic lantern optical projection member
Part, 4 be mobile phone flashlight, and 5 be reference planes.
Fig. 4 is that optical projection including components therein is printed with just in object dimensional surface shape measurement system provided in an embodiment of the present invention
The transparent film of string bar graph.
Fig. 5 is that mobile phone camera is photographed through object table in object dimensional surface shape measurement system provided in an embodiment of the present invention
The deforming stripe figure of face face shape modulation.
Fig. 6 is to obtain the 3 d shape hum pattern of face mask surface through the embodiment of the present invention.
Embodiment
The principle and characteristic of the present invention are described in detail with reference to Figure of description and specific embodiment：
Embodiment：
In the present embodiment so that people's face has as an example, by using three dimension profile measurement systematic survey provided by the invention
The 3 d shape information of face mask.
It is the operational flowchart of the specific embodiment of the invention as shown in Figure 1, specific measuring process is as follows：
S1：Measuring system as shown in Figure 3 is built, measuring system includes：Smart mobile phone 1 with image capture module,
It has mobile phone flashlight 4, it is characterised in that：Also include：Micro-optical lantern projection member on mobile phone flashlight cover
Part 3, micro-optical lantern projection element 3 are built-in with lens 31 and transparent film, and the transparent film is printed with sinusoidal bar
Line grating 32；
S2：Then object under test is placed in reference planes 5, by the face face mask of mobile phone camera 2, opens mobile phone and dodge
Light lamp 4 causes miniature magic lantern that sine streak grating 32 is projected into object under test surface, and adjustment mobile phone location makes whole people's face
Tool is in the field range of mobile phone camera 2, and the sine streak figure being projected out can be covered with whole face mask, such as Fig. 5 institutes
Show；As shown in Fig. 2 now the distance between mobile phone camera 2 and object under test surface are L for definition, define in mobile phone camera 2
The heart and the distance at the center of mobile phone flashlight 4 are d；
S3：Mobile phone camera 2 gathers the deforming stripe image obtained after object under test surface modulation；Pass through cell-phone camera
The deforming stripe figure that first 2 collection is modulated through object under test surface face shape, its light intensity expression are：
In formula：A represents background light intensity, and B represents modulation degree distribution, f0The frequency of carrier frequency is represented,Represent with it is to be measured
The related phase of body surface face shape, i.e., the additive phase introduced through object under test surface modulation；
S4：Mobile phone camera collection is placed on reference planes high scale chi image and carries out simple laterally demarcation, concrete operations
It is as follows：
Face mask is removed, and a graduated scale is placed in parallel in reference planes 5, mobile phone camera gathers a width and carved
Chi image is spent, the physical size shown by graduated scale and its pixel number included in the picture obtain single pixel point representative
Physical size, equivalent to easy laterally demarcation, single pixel point physical size is multiplied with pixel number can try to achieve object length and width
Value.Assuming that graduated scale scale part is L0, be M comprising pixel number, then single pixel point represent physical size dim as：
S5：Image real time transfer；
Image real time transfer is carried out in mobile phone terminal：
Assuming that the pixel number that object length and width include is respectively N1, N2, then object length value H and width value W are respectively：
Deforming stripe phase is demodulated using based on fourier transform method, Fourier transformation is carried out to deforming stripe light intensity first
Its frequency spectrum is obtained, is then extracted a fundamental component in frequency spectrum by bandpass filter, then to this fundamental component
Inverse Fourier transform is carried out, the matrix after inverse Fourier transform is F (x, y), then the phase of deforming stripe is used and is expressed as below：
In formula：For the deforming stripe phase demodulated, Im represents to take imaginary-part operation to accord with, F*(x, y) is F (x, y)
Conjugation；
Because the phase demodulated is blocked, it is therefore desirable to carries out phase unwrapping to it；Phase unwrapping operation is ability
Domain common knowledge, the present invention will not be repeated here；
Thus can obtain Phase-height mapping relational expression is：
In formula：D is distance of the mobile phone camera to reference planes, and L is mobile phone flashlight center and camera lens center
Spacing,To try to achieve the phase difference between the phase and fixed phase related to body surface face shape, obtained by the formula
Height value, so far it can obtain object dimensional face shape information as shown in Figure 6.
Embodiments of the invention are the foregoing is only, are not intended to limit the scope of the invention, it is every to utilize this hair
The equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.The present invention is carried out above by specific embodiment
Illustrate, but the present invention is not limited to these specific embodiments.It will be understood by those skilled in the art that the present invention can also be done
Various modifications, equivalent substitution, change etc., these conversion, all should be in the protections of the present invention without departing from the spirit of the present invention
Within the scope of.
Claims (4)
- A kind of 1. object dimensional surface shape measurement system based on fringe projection principle, it is characterised in that：Including with flash lamp work( Can, the smart mobile phone of image collecting function and data processing function, also there is micro-optical lantern projection on the smart mobile phone Element, micro-optical lantern projection element comprise at least lens and transparent film, have sinusoidal bar on the transparent film Print image, micro-optical lantern projection element are close on mobile phone flashlight cover, are opened flash lamp and are enabled to sine streak to throw Shadow is simultaneously completely covered on object under test surface, and image capture module can gather the modified strip obtained after object under test surface modulation Print image, handled through data processing module can show that screen display measurement obtains the three-dimensional surface of body surface in smart mobile phone Shape information.
- 2. a kind of object dimensional surface shape measurement system based on fringe projection principle according to claim 1, its feature exist In object under test surface, the position of micro-optical lantern projection element and mobile phone camera spatially meet reflection law.
- 3. a kind of object dimensional surface shape measurement method based on fringe projection principle, it is characterised in that comprise the following steps：Step A：Assemble measuring system；Smart mobile phone of the selection with flash lamp function, image collecting function and data processing function, in smart mobile phone flash lamp Optics lantern projection element is installed, micro-optical lantern projection element comprises at least lens and transparent film, described on cover There is sine streak image on transparent film；Step B：Gather image；Adjustment mobile phone location causes the positive measuring targets surface of mobile phone camera, define mobile phone camera and object under test surface it Between distance be L, the distance for defining mobile phone camera center and flash lamp center is d；Opening flash lamp causes miniature magic lantern to close Projection element is learned by its interior sine stripe projection to object under test surface, then collects what is obtained after surface modulation to be measured Deforming stripe image；Step C：Image real time transfer；The phase of deforming stripe is obtained by the progress phase demodulating of smartphone data processing module and carries out phase unwrapping, according to Phase-height mapping relation tries to achieve height value, you can tries to achieve the 3 d shape information of body surface.
- 4. a kind of object dimensional surface shape measurement method based on fringe projection principle according to claim 1, its feature exist In image real time transfer is specific as follows：The expression formula of sine streak is as follows in the step B：I0(x, y)=A+Bcos (2 π f0x)In formula：A represents background light intensity, and B represents modulation degree distribution, f0Represent the frequency of carrier frequency；The use of deforming stripe image expression formula is then collected to be expressed as below：In formula：A represents background light intensity, and B represents modulation degree distribution, f0The frequency of carrier frequency is represented,Represent through determinand body surface The additive phase introduced after the modulation of face；Deforming stripe phase is reconciled using Fourier transformation and obtains following expression：In formula：For the deforming stripe phase demodulated, ImExpression takes imaginary-part operation to accord with, F*(x, y) is being total to for F (x, y) Yoke, then carry out phase unwrapping and can obtain Phase-height mapping relational expression as follows：In formula：L is the distance between mobile phone camera and object under test surface, and d is mobile phone camera center and flash lamp center Distance,Represent the additive phase introduced after object under test surface modulation；So far the 3 d shape of object is obtained Information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710903975.9A CN107726996A (en) | 2017-09-29 | 2017-09-29 | A kind of object dimensional surface shape measurement system and method based on fringe projection principle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710903975.9A CN107726996A (en) | 2017-09-29 | 2017-09-29 | A kind of object dimensional surface shape measurement system and method based on fringe projection principle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107726996A true CN107726996A (en) | 2018-02-23 |
Family
ID=61208831
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710903975.9A Pending CN107726996A (en) | 2017-09-29 | 2017-09-29 | A kind of object dimensional surface shape measurement system and method based on fringe projection principle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107726996A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111006599A (en) * | 2019-10-30 | 2020-04-14 | 东北大学 | Object surface micro-scale measurement method based on pixel grating and computer vision |
| CN112033304A (en) * | 2020-08-10 | 2020-12-04 | 上海应用技术大学 | System and method for detecting three-dimensional surface shape of mirror surface object based on stripe deflection |
| CN113358191A (en) * | 2021-06-04 | 2021-09-07 | 四川大学 | Global flood water level real-time monitoring method based on stripe projection structured light |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184566A (en) * | 2011-04-28 | 2011-09-14 | 湘潭大学 | Micro projector mobile phone platform-based portable three-dimensional scanning system and method |
| CN103487441A (en) * | 2013-09-24 | 2014-01-01 | 电子科技大学 | Method for defect detection and surface measurement of silicon wafer |
| CN104279980A (en) * | 2014-10-20 | 2015-01-14 | 电子科技大学 | Mirror surface three-dimensional-surface-shape measuring system based on intelligent photographing mobile phone |
| CN106595523A (en) * | 2016-12-23 | 2017-04-26 | 四川大学 | Portable three-dimensional morphology measurement system and portable three-dimensional morphology measurement system based on smart phone |
-
2017
- 2017-09-29 CN CN201710903975.9A patent/CN107726996A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184566A (en) * | 2011-04-28 | 2011-09-14 | 湘潭大学 | Micro projector mobile phone platform-based portable three-dimensional scanning system and method |
| CN103487441A (en) * | 2013-09-24 | 2014-01-01 | 电子科技大学 | Method for defect detection and surface measurement of silicon wafer |
| CN104279980A (en) * | 2014-10-20 | 2015-01-14 | 电子科技大学 | Mirror surface three-dimensional-surface-shape measuring system based on intelligent photographing mobile phone |
| CN106595523A (en) * | 2016-12-23 | 2017-04-26 | 四川大学 | Portable three-dimensional morphology measurement system and portable three-dimensional morphology measurement system based on smart phone |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111006599A (en) * | 2019-10-30 | 2020-04-14 | 东北大学 | Object surface micro-scale measurement method based on pixel grating and computer vision |
| CN111006599B (en) * | 2019-10-30 | 2021-07-20 | 东北大学 | Object surface micro-scale measurement method based on pixel grating and computer vision |
| CN112033304A (en) * | 2020-08-10 | 2020-12-04 | 上海应用技术大学 | System and method for detecting three-dimensional surface shape of mirror surface object based on stripe deflection |
| CN113358191A (en) * | 2021-06-04 | 2021-09-07 | 四川大学 | Global flood water level real-time monitoring method based on stripe projection structured light |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106599897B (en) | Readings of pointer type meters recognition methods and device based on machine vision | |
| CN109166147A (en) | Garment dimension measurement method and device based on picture | |
| CN107726996A (en) | A kind of object dimensional surface shape measurement system and method based on fringe projection principle | |
| CN111536904A (en) | Three-dimensional measurement method and system based on structural illumination and storage medium | |
| Kang et al. | Learning efficient illumination multiplexing for joint capture of reflectance and shape. | |
| CN106595523B (en) | A kind of Portable three-dimensional shape measurement system based on smart phone | |
| CN105627952B (en) | A kind of object three-dimensional profile measuring method and apparatus using single pixel detector | |
| CN105841925B (en) | A kind of image rebuilding method obtained based on detector pixel response Fourier spectrum | |
| CN112614085A (en) | Object detection method and device and terminal equipment | |
| CN103217108B (en) | A kind of spectacle frame geometric parameter detection method | |
| Skydan et al. | Technique for phase measurement and surface reconstruction by use of colored structured light | |
| Willomitzer et al. | Hand-guided qualitative deflectometry with a mobile device | |
| CN102721471B (en) | Method for conversion of spectrum into chromaticity | |
| CN110378367B (en) | Acquisition method, device and system of generative countermeasure network for phase unwrapping | |
| CN102243103A (en) | Method for quickly measuring colors and three-dimensional profile of object | |
| CN115797359B (en) | Detection method, equipment and storage medium based on solder paste on circuit board | |
| CN108764407A (en) | Product traceability method, apparatus, system and computer storage media | |
| CN108303038A (en) | Reflection-type surface shape measurement method and device based on two-dimension optical dot matrix | |
| CN106931905B (en) | A kind of digital Moiré patterns phase extraction method based on nonlinear optimization | |
| CN102998026A (en) | Automatic detection device for liquid glass thermometers | |
| CN112051920B (en) | Sight line falling point determining method and device | |
| CN110020991A (en) | Mobile device and image treatment method | |
| CN108427110A (en) | Distance measuring method, device and electronic equipment | |
| Shi et al. | Depth sensing with coding-free pattern based on topological constraint | |
| Zhang et al. | Reading recognition of pointer meter based on pattern recognition and dynamic three-points on a line |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190128 Address after: 611731 No. 2006 West Yuan Road, Chengdu high tech Zone (West District), Sichuan Applicant after: UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY Address before: 610000 No. 1, No. 6, No. 1, Unit 1002, Shuangqing South Road, Qingyang District, Chengdu City, Sichuan Province Applicant before: Liu Danji Applicant before: UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180223 |
|
| RJ01 | Rejection of invention patent application after publication |