KR101173668B1 - method and apparatus for measuring depth of three dimensional object with multiple spatial frequencies - Google Patents
method and apparatus for measuring depth of three dimensional object with multiple spatial frequencies Download PDFInfo
- Publication number
- KR101173668B1 KR101173668B1 KR1020100008088A KR20100008088A KR101173668B1 KR 101173668 B1 KR101173668 B1 KR 101173668B1 KR 1020100008088 A KR1020100008088 A KR 1020100008088A KR 20100008088 A KR20100008088 A KR 20100008088A KR 101173668 B1 KR101173668 B1 KR 101173668B1
- Authority
- KR
- South Korea
- Prior art keywords
- depth
- projector
- spatial frequency
- dimensional object
- light
- Prior art date
Links
Images
Abstract
In the depth measuring method of a 3D object using a multi-spatial frequency, a light pattern having an arbitrary spatial frequency is projected onto a 3D object by using a projector, and an object is photographed by using a digital camera. Since patterns with arbitrary spatial frequencies show different bends and shapes depending on the depth at the surface of the object, the shape, or depth, of the object is measured using geometric variables for specific bends and shapes depending on the depth.
Description
The present invention relates to a method for measuring the depth of a three-dimensional object, and more particularly, to a method and apparatus for measuring the depth of a three-dimensional object using multiple spatial frequencies.
As a method of measuring the depth of a three-dimensional object, there is a method using Moir technology. Moirre technology is a method of extracting the depth of the object in the form of different bends and shapes appearing on the surface of the object by projecting the pattern of the grid pattern on the surface of the object using a variety of light sources.
However, the conventional method requires an additional algorithm called an unwrapping algorithm in extracting the depth of a 3D object from an image captured through experiments. Specifically, a light signal projected on the surface of a 3D object has a trigonometric function, and an unwrapping algorithm is required to convert the signal into a signal having depth information. However, because the unwrapping algorithm is very complex, it takes a lot of time to perform it and in some cases errors are easy to occur.
In addition, existing methods have limitations in extracting the depth of a plurality of discontinuous objects.
In addition, the conventional method extracts the depth of the three-dimensional object from the image using only the position of the projector, the position of the digital camera and the view-angle, so that an error is likely to occur in the depth of the extracted object.
The technical problem to be achieved by the present invention is to more simply provide a method and apparatus for measuring the depth of a three-dimensional object.
Another object of the present invention is to provide a method and apparatus for measuring a depth of a three-dimensional object more simply and accurately using a multi-spatial frequency pattern.
Another object of the present invention is to provide a method and apparatus for measuring the depth of a three-dimensional object more simply and accurately without performing an unwrapping algorithm.
Depth measuring device according to a feature of the present invention is a device for measuring the depth of a three-dimensional object, and projecting the corresponding light according to a multi-spatial frequency pattern including a pattern according to at least two or more spatial frequencies to the three-dimensional object A projector; A photographing unit which photographs an image of the 3D object on which the light is projected and outputs a digital image signal corresponding thereto; And a measuring unit calculating a depth of the object based on the digital image signal.
In addition, the depth measuring method according to another aspect of the present invention, a method for measuring the depth of a three-dimensional object, generating a multi-spatial frequency pattern comprising a pattern according to at least two or more spatial frequencies with the three-dimensional object ; Using a projector, the corresponding light is projected onto the three-dimensional object while the phase is shifted in steps of setting the pattern according to the spatial frequency constituting the multi-spatial frequency pattern, and each time the light is projected using the photographing unit, the 3 Photographing an image of a dimensional object; And calculating a depth of the object from the photographed image.
According to an embodiment of the present invention, the depth of a three-dimensional discontinuous object can be efficiently measured without performing an additional algorithm for calculating the depth of the three-dimensional object. As a result, errors and time waste caused by the depth measurement can be reduced.
1 is a structural diagram of a depth measuring apparatus using multiple frequencies according to an embodiment of the present invention.
2 is a flowchart illustrating a depth measuring method using multiple frequencies according to an exemplary embodiment of the present invention.
3 is a graph showing a spatial frequency pattern according to an embodiment of the present invention.
4 is a diagram illustrating a result of projecting light having a spatial frequency pattern onto an object according to an exemplary embodiment of the present invention.
5 is a diagram illustrating a concept for measuring a depth of an object in a depth measuring apparatus according to an exemplary embodiment of the present disclosure.
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.
Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise.
Embodiments of the present invention will now be described with reference to the accompanying drawings.
1 is a structural diagram of a depth measuring apparatus using multiple frequencies according to an embodiment of the present invention.
As shown in FIG. 1, a depth measuring device (hereinafter, referred to as a depth measuring device for convenience of description) according to an embodiment of the present invention includes a
The
The photographing
The
Next, a depth measurement method of a three-dimensional object using multiple frequencies according to an embodiment of the present invention will be described.
Depth measurement method according to an embodiment of the present invention is obtained based on such an object scanning method, while providing an object scanning method with local illumination, to project the light to the object based on a phase shift method using a pattern having a multi-space frequency Depth information of the object is extracted based on the image of the 3D object. In other words, when light having an arbitrary spatial frequency is projected onto an object, the pattern shows different bends and shapes depending on the depth at the surface of the object. Extract.
The depth measuring method according to the embodiment of the present invention may be referred to as a phase shift profile by using a multi-spatial frequency.
2 is a flowchart illustrating a depth measuring method using multiple frequencies according to an exemplary embodiment of the present invention.
According to an embodiment of the present invention, in order to extract the depth of a 3D object, a multi-spatial frequency having a luminance amount equal to or greater than a set value to distinguish an arbitrary point from a domain photographed by the photographing
To this end, as shown in FIG. 2, first, a multi-frequency pattern is generated (S100).
In an exemplary embodiment of the present invention, a pattern having an arbitrary spatial frequency projecting a point on the x-axis of the domain including the object as the strongest light may be represented by
Here, s represents the position where the function value is largest on the x-axis of the domain. For example, if the domain is defined from 1 to 1024, when s has a value of 512, it has an impulse signal having a vertex at a point that becomes 512 on the x-axis. n represents the coefficient of the spatial frequency.
The spatial frequency f n can be expressed as
The spatial frequency of the pattern can be defined as a function using the coefficients of the Fourier expansion.
One pattern with arbitrary spatial frequency is phase shifted in four steps, respectively, by a phase-shifting method. For example, phases are shifted for each of four stages of 0, π / 2, π, and 3π / 2, so that a total of four patterns may be generated for one spatial frequency.
In an embodiment of the present invention, a plurality of spatial frequency patterns are generated by performing a phase shift having a set number of steps for each spatial
3 is a graph showing a spatial frequency pattern according to an embodiment of the present invention. In particular, FIG. 3 is a graph for estimating how many frequencies are synthesized in using a pattern having multiple spatial frequencies in an embodiment of the present invention.
The multi-spatial frequency pattern according to an embodiment of the present invention may be defined as impulse signals obtained by synthesizing the spatial frequencies. For example, when one screen is regarded as an area that can be photographed using the photographing
3 (a) shows that a single spatial frequency
Figure 3 shows the impulse signal, and Figure 3 (b) shows the impulse signals when two spatial frequencies are synthesized. In this case, the spatial frequencies are Wow to be.3 (c) shows impulse signals when two spatial frequencies are synthesized as in FIG. 3 (b), but spatial frequencies are different. Where the spatial frequency is
Wow to be.3 (d) shows impulse signals when nine spatial frequencies are synthesized. In this case, the synthesized spatial frequencies
, ,… , to be.Referring to the graphs of (a) to (d) of FIG. 3, when a plurality of spatial frequencies, such as 9, are synthesized as shown in (d) of FIG. 3, compared to other cases ((a) to (c)) It can be seen that the most sharp impulse signals are generated.
Therefore, in the embodiment of the present invention, the projection
Next, the
For example, when nine spatial frequencies are used, phase shifts are performed in four stages for each spatial frequency, and the optical signals of the patterns according to phase shifts are projected onto the object, and the projected object is photographed. As the projection and photographing process is performed in phase shifting steps for each spatial frequency, a total of 36 image signals are obtained. Through a series of calculations through the 36 images obtained through this process, it has the same effect as scanning the vertical light for a single object from a predetermined direction.
In more detail, when the light of one pattern is projected onto the surface of the three-dimensional object, the two patterns overlap on one object due to the projected pattern and the quantization characteristics of the digital camera used for photographing. do. This phenomenon generates an arbitrary characteristic scattering pattern depending on the curvature and shape of the object on the surface of the object. In particular, since the pattern projected by the
Specifically,
The first pattern having a spatial frequency of is photographed by projecting on an object, and the image is successively photographed while moving the first pattern in a phase shifting manner. The phase shift method according to the embodiment of the present invention includes four step methods, and includes steps of 0, π / 2, π, and 3π / 2.As described above, one spatial frequency pattern is projected while phase shifting in four stages, so that four images are acquired for one spatial frequency pattern. Accordingly, according to an embodiment of the present invention, when nine spatial frequencies are used as shown in FIG. 3 (d), a total of 36 images are acquired. Properly calculating the coefficient of Fourier expansion based on these images allows us to find the combination of frequency and phase shifting stages at which each point of the object will shine brightest, and trace the combination back to the geometry at that time. Apply a variable to extract the depth.
4 is a diagram illustrating a result of projecting light having a spatial frequency pattern onto an object according to an exemplary embodiment of the present invention.
4A is a diagram illustrating a case in which a pattern having a spatial frequency lower than a set frequency is projected onto an object, and FIG. 4B is a case of projecting a pattern having a spatial frequency higher than a set frequency to an object. Drawing. Referring to FIGS. 4A and 4B, it can be seen that the curvature and shape of the pattern are different depending on the depth of the object.
In addition, Figure 4 (c) is a view showing a case in which the local illumination in a pattern using a multi-spatial frequency in accordance with an embodiment of the present invention to scan the object, Figure 4 (d) is in accordance with an embodiment of the present invention When the multi-spatial frequency pattern is projected using a projector, the diagram shows the intensity of light projected onto the surface of an object. Referring to FIGS. 4C and 4D, since the left object is positioned in front of the right object, the intensity of light on the surface of the left object is greater than the intensity of light on the surface of the right object.
As such, different curvature and shape patterns appear according to the surface curvature and the surface shape of the 3D object, and thus the light intensity is different. In an embodiment of the present invention, the photographing
5 is a diagram illustrating a concept for measuring a depth of an object in a depth measuring apparatus according to an exemplary embodiment of the present disclosure.
The measuring
In an embodiment of the present invention, the light pattern is not projected onto the object in the form of dots, but is projected in a vertical line pattern, for example, to measure the depth of the object using x and z for the object.
First, the coordinates x 'and z' obtained from the obtained image signal may be expressed as follows.
Here, x CCD and z CCD represent positions of the
Since the photographing
In addition, when the amount of light projected at any one point on the x-axis of the domain is the largest, the angle (or first angle) with respect to the point measured by the imaging unit among the viewing angles of the imaging unit is defined as θ Detect , and the viewing angle of the projector angle (or second angle) with respect to the point that the projector and the projection θ of the Local It is defined as.
Geometrical variables according to an embodiment of the present invention are x CCD , z CCD , x PRJ , z PRJ , θ Detect , θ Local ,
, It includes, and the geometric meaning of each variable is as shown in FIG. These variables are values that the depth measuring device knows before measuring the object shape. In addition, in FIG. Is the field of view of the photographing part, Indicates the field of view of the projector.Based on the equations (3) and (4), in order to obtain the position (x, z) of the object to be measured, the following equation can be obtained by canceling x 'and z'.
Also for the position of the
By arranging
The measuring
According to the exemplary embodiment of the present invention, the depth of the 3D object is determined by using geometric parameters preset from the light patterns using the multi-spatial frequency, the phase shift of the light patterns, and the images acquired according to the phase shift of the light patterns. By extracting, a separate algorithm (e.g., an unwrapping algorithm) for calculating the depth of the object is not required, thereby saving time and arithmetic errors that may occur in performing additional calculations. As a result, the depth of the three-dimensional object can be extracted more efficiently.
In addition, since the position coordinates x and z of the object measured according to the embodiment of the present invention are absolute coordinates, the depth of the discontinuous surface of the object may be easily extracted.
The embodiments of the present invention are not limited to the above-described apparatuses and / or methods, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention, a recording medium on which the program is recorded And such an embodiment can be easily implemented by those skilled in the art from the description of the embodiments described above.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.
10: projector, 20: photographing unit, 30: measuring unit
Claims (10)
A projector for projecting light corresponding to a multi-spatial frequency pattern including a pattern according to at least two or more spatial frequencies to the three-dimensional object;
A photographing unit which photographs an image of the 3D object on which the light is projected and outputs a digital image signal corresponding thereto;
A measuring unit for calculating the depth of the object based on the digital image signal
Including,
The projector
Apparatus for depth measurement of a three-dimensional object using a multi-spatial frequency to project the corresponding light to the three-dimensional object while the phase shifted each step of setting the pattern according to the spatial frequency constituting the multi-space frequency pattern.
The photographing unit
Acquire images of the three-dimensional object from which the corresponding light is projected while at least two or more spatial frequencies are phase shifted from the projector according to the multi-spatial frequency pattern,
And overlapping the obtained images to output a digital image signal in which the intensity of light of each part of the three-dimensional object is different from each other.
The measurement unit may include the inclination angle of the viewing angle of the photographing unit inclined based on the position of the photographing unit, the position of the projector, the vertical reference line set with respect to the object, the inclination angle of the viewing angle of the projector with respect to the vertical reference line, from the digital image signal. And a depth of the object is calculated based on an angle of the photographing unit corresponding to a set point of a digital image signal and an angle of the projector corresponding to the set point.
And the set point is a point where the intensity of light is the greatest in the digital image signal.
Generating a multi-spatial frequency pattern including the pattern according to at least two or more spatial frequencies with the three-dimensional object;
Using a projector, each phase of the pattern according to the spatial frequency constituting the multi-spatial frequency pattern, the corresponding light is projected to the three-dimensional object while the phase is shifted, and each time the light is projected using the imaging unit Photographing an image of a three-dimensional object; And
Calculating a depth of the object from the captured image
Depth measurement method of the three-dimensional object using a multi-spatial frequency comprising a.
The photographing step,
Acquire images of the three-dimensional object from which the corresponding light is projected while at least two or more spatial frequencies are phase shifted from the projector according to the multi-spatial frequency pattern, and overlapping the obtained images, Depth measurement method of a three-dimensional object using a multi-spatial frequency to obtain a digital image showing different light intensity.
The calculating may include the inclination angle of the viewing angle of the photographing unit inclined based on the position of the photographing unit, the position of the projector, the vertical reference line set with respect to the object, the inclination angle of the viewing angle of the projector with respect to the vertical reference line, from the digital image. And calculating a depth of the object based on an angle of the photographing unit corresponding to a set point of the digital image signal and an angle of the projector corresponding to the set point.
The depth of the object is calculated based on the following conditions, depth measurement method of a three-dimensional object using a multi-spatial frequency.
x CCD , z CCD : location of image
x PRJ , z PRJ : Projector Position
: Tilt angle of the viewing part's viewing angle with respect to the vertical reference line set with respect to the object
The angle of inclination of the viewing angle of the projector relative to the vertical reference line set for the object.
θ Detect : of domain In the case where the amount of light projected at any one point on the axis is the largest, the angle with respect to the point measured by the imaging unit of the viewing angles of the imaging unit
θ Local : of domain If the amount of light projected at any one point on the axis is largest, the angle of the projector's field of view relative to that point projected by the projector
The method of defining the spatial frequency is a method of measuring the depth of a three-dimensional object using a multi-space frequency, using the coefficient of Fourier expansion.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020100008088A KR101173668B1 (en) | 2009-10-27 | 2010-01-28 | method and apparatus for measuring depth of three dimensional object with multiple spatial frequencies |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020090102498 | 2009-10-27 | ||
KR20090102498 | 2009-10-27 | ||
KR1020100008088A KR101173668B1 (en) | 2009-10-27 | 2010-01-28 | method and apparatus for measuring depth of three dimensional object with multiple spatial frequencies |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20110046222A KR20110046222A (en) | 2011-05-04 |
KR101173668B1 true KR101173668B1 (en) | 2012-08-20 |
Family
ID=44241140
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020100008088A KR101173668B1 (en) | 2009-10-27 | 2010-01-28 | method and apparatus for measuring depth of three dimensional object with multiple spatial frequencies |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101173668B1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111473745A (en) * | 2020-06-23 | 2020-07-31 | 南京理工大学智能计算成像研究院有限公司 | Light-emitting surface microscopic three-dimensional measurement method based on multi-frequency phase shift scheme |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101434026B1 (en) * | 2012-09-11 | 2014-08-26 | 제주대학교 산학협력단 | Apparatus and method for measuring three-dimension |
US20140307055A1 (en) | 2013-04-15 | 2014-10-16 | Microsoft Corporation | Intensity-modulated light pattern for active stereo |
US9158161B2 (en) | 2013-10-01 | 2015-10-13 | Kyungpook National University Industry-Academic Cooperation Foundation | Pattern generator using liquid crystal and method thereof |
KR102365721B1 (en) * | 2016-01-26 | 2022-02-22 | 한국전자통신연구원 | Apparatus and Method for Generating 3D Face Model using Mobile Device |
KR101842141B1 (en) * | 2016-05-13 | 2018-03-26 | (주)칼리온 | 3 dimensional scanning apparatus and method therefor |
KR102317278B1 (en) * | 2017-07-06 | 2021-10-26 | 엘지이노텍 주식회사 | Depth information acquiring method for three dimensional object |
TWI676781B (en) * | 2018-08-17 | 2019-11-11 | 鑑微科技股份有限公司 | Three-dimensional scanning system |
-
2010
- 2010-01-28 KR KR1020100008088A patent/KR101173668B1/en active IP Right Grant
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111473745A (en) * | 2020-06-23 | 2020-07-31 | 南京理工大学智能计算成像研究院有限公司 | Light-emitting surface microscopic three-dimensional measurement method based on multi-frequency phase shift scheme |
Also Published As
Publication number | Publication date |
---|---|
KR20110046222A (en) | 2011-05-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101173668B1 (en) | method and apparatus for measuring depth of three dimensional object with multiple spatial frequencies | |
JP5029618B2 (en) | Three-dimensional shape measuring apparatus, method and program by pattern projection method | |
US9322643B2 (en) | Apparatus and method for 3D surface measurement | |
JP4480488B2 (en) | Measuring device, computer numerical control device, and program | |
US20120176478A1 (en) | Forming range maps using periodic illumination patterns | |
US20120176380A1 (en) | Forming 3d models using periodic illumination patterns | |
JP6016912B2 (en) | 3D measuring device and 3D measuring method | |
US9441959B2 (en) | Calibration method and shape measuring apparatus | |
JP6598673B2 (en) | Data processing apparatus and method | |
CN110692084B (en) | Apparatus and machine-readable storage medium for deriving topology information of a scene | |
JP6418884B2 (en) | Three-dimensional measuring apparatus, three-dimensional measuring method and program | |
JP2011064482A (en) | Device and method of high-speed three-dimensional measurement | |
JP4255865B2 (en) | Non-contact three-dimensional shape measuring method and apparatus | |
WO2017175341A1 (en) | Measurement method, measurement device, measurement program, and computer-readable recording medium having measurement program recorded thereon | |
JP2008185370A (en) | Three-dimensional shape measuring device and method | |
Guo et al. | 3-D shape measurement by use of a modified Fourier transform method | |
KR101592405B1 (en) | Method for obtaining three-dimensional image, apparatus and computer-readable recording medium using the same | |
JP5822463B2 (en) | Three-dimensional measuring apparatus, three-dimensional measuring method, and program | |
JP2012083233A5 (en) | ||
JP5611875B2 (en) | Information display device, information display method, and program | |
KR101465996B1 (en) | Method for measurement of high speed 3d shape using selective long period | |
Marrugo et al. | Fourier transform profilometry in labview | |
JP6229134B2 (en) | Measuring device | |
Li et al. | Binary defocusing technique based on complementary decoding with unconstrained dual projectors | |
JP6923915B2 (en) | A computer-readable recording medium that records measurement methods, measuring devices, and measurement programs that can simultaneously acquire the three-dimensional shape of a color object and color information. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant | ||
FPAY | Annual fee payment |
Payment date: 20150730 Year of fee payment: 4 |
|
FPAY | Annual fee payment |
Payment date: 20160212 Year of fee payment: 5 |
|
FPAY | Annual fee payment |
Payment date: 20170724 Year of fee payment: 6 |
|
FPAY | Annual fee payment |
Payment date: 20190902 Year of fee payment: 8 |