CN101347332A - Measurement method and equipment of digitized measurement system of human face three-dimensional surface shape - Google Patents
Measurement method and equipment of digitized measurement system of human face three-dimensional surface shape Download PDFInfo
- Publication number
- CN101347332A CN101347332A CNA2008101420635A CN200810142063A CN101347332A CN 101347332 A CN101347332 A CN 101347332A CN A2008101420635 A CNA2008101420635 A CN A2008101420635A CN 200810142063 A CN200810142063 A CN 200810142063A CN 101347332 A CN101347332 A CN 101347332A
- Authority
- CN
- China
- Prior art keywords
- face
- striations
- dimensional
- phase
- composite construction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Length Measuring Devices By Optical Means (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a human face three-dimensional shape digital measuring system and a method thereof. The method is based on a composite structure light projection technology. Composite structure light striation consists of a plurality of carrier frequencies of different frequencies which are modulated respectively to be piled with a plurality of frames of sine striations with phase difference at the direction vertical to the carrier frequencies; only one frame of human face modulated composite structure light striation raster image is required to be collected, and a plurality of frames of simple sine striations with phase shift can be taken out from one frame of composite striation by two-dimensional Fourier transformation, frequency domain two-dimensional bandpass filtering and inverse Fourier transformation; then a target human face three-dimensional shape is rebuilt by the traditional phase shifting technology in the phase measuring figure technology. The method can conveniently obtain the exact digital three-dimensional figure of human face, provides the novel measuring method and evaluating measure for human face plastic surgery and promotes the digital development of medical cosmetology.
Description
Technical field
The invention belongs to Information Optics, image processing field, relate to a kind of digitized measurement system of human face three-dimensional surface shape and method thereof based on composite construction optical projection technology.
Background technology
Along with the progress and the growth in the living standard of society, people had higher requirement to quality of life, and are particularly remarkable day by day to the pursuit of U.S..Shaping and beauty is the new industry that is forming in the world market scope, and U.S.'s shaping is consumed average annual 40000000000 dollars, and Japan, Korea S's plastic operation ratio are about the twice of China.Along with the formation of holistic health idea, the development of Chinese medicine beauty treatment is with fast lifting.Present national shaping and beauty target consumer group Estimate of Total Number is 13,970 ten thousand people, accounts for 22% of national women's sum.These data with the maturation of market and consumer spending idea with cumulative year after year.
Because the raising of the aesthetic level of people is had higher requirement to the effect of medical science shaping and beauty.In plastic surgery, people still adopt traditional manual measurement method to obtain the shape characteristic of people's face mostly, and certainty of measurement is not high, and are also inconvenient, and easily people's face skin brought damage.Arrival along with digital times, people crave for a kind of noncontact, measuring method is obtained digitized people's face three-dimensional appearance fast and accurately, and wish to simulate and to design the shaping scheme of facial cosmetic and test effect or the like by state-of-the-art technology means such as general purpose computer Aided Design, be about to the medical science shaping and beauty and be advanced to the digitized stage.Based on this, the present invention proposes a kind of digitized measurement system of human face three-dimensional surface shape based on composite construction optical projection technology.
At present, people's face three-D profile digitizing solution based on medical cosmetology has obtained extensive and deep research, and people propose the 3 d shape that various ways are rebuild human face: 1. volume the 2nd phase 79-82 page or leaf proposes to utilize the CT technology to carry out the research of the visual and cranial and facial surgery shaping analogue simulation of cranium face structure three-dimensional " Chinese medical beauty treatment magazine " calendar year 2001 the 7th; 2. give chapter and verse two two dimensional images of appearance front of " West China stomatology magazine " 1991 the 5th volume the 3rd phase 263-265 page or leaf, " computer engineering " 2007 the 33rd volumes the 14th phase 1-3 page or leaf are set up the computer-aided analysis system of appearance soft tissue, by selecting the key feature point, thereby obtain the three-dimensional grid model of specific people's face; 3. " the realizing the methods that fast human-face model is rebuild by a width of cloth direct picture " of Chinese patent application number 200610088857.9 " based on the fast human face model building and systems of single photo " that propose and Chinese patent application number 200610024720.7 propositions only uses direct picture wherein to carry out the reconstruction of people's face three-D profile, is to method a kind of simplification 2.; 4. " image and vision are calculated " 2000 the 18th volume the 4th phase 337-343 pages or leaves have proposed a kind of three-dimensional face modeling method based on stereoscopic vision, need to calculate the corresponding relation of left and right sides image; 5. " the merging the method for building up of the human face three-dimensional model of various visual angles, multi thread two-dimensional signal " of Chinese patent application 02146278.X proposition at first progressively forwards lateral video sequence to demarcating good stereo camera shooting people face from the front, therefrom extracts people's face three-dimensional information then; 6. " electronic surveying and instrument journal " 2007 the 21st volumes the 3rd phase 9-14 page or leaf has proposed a kind of method of measuring the three-dimensional face curved surface by grid light from two two dimensional images; 7. it is right that Chinese patent application number 200710023778.4 " based on the stereo vision three-dimensional human face modeling methods of virtual image correspondence " that propose are utilized the axonometric chart of the good left and right cameras collection tested person face of demarcation, utilizes its corresponding relation to rebuild the 3 d shape of people's face; 8. " Chinese medicine image technology " 2005 the 21st volumes the 10th phase 1616-1618 page or leaf, " Journal of US-ChinaMedical Science " 2006 the 3rd volumes the 2nd phase 13-18 page or leaf all propose to use phase measuring profilometer (the Phase Measuring Profilometry based on phase shift numeric structure optical projection, be called for short PMP) obtain the reconstruction of people's face three-D profile digitized, and be used in reference to living computer-aided design and the recruitment evaluation of carrying out plastic and aesthetic surgery of guiding doctor.9. (author: Yuan Fanglin) proposition utilizes phase measuring profilometer to rebuild human face three-dimensional model to Ji'nan University's master thesis " application of people's face three-dimension measuring system in medical measurement " in 2006, and carries out the face-lifting design according to people's face aesthetic features on this basis.
From above these methods as can be seen, roughly can be divided three classes at present: the 1. three-dimensional reconstruction based on the CT technology of representative based on people's face three-D profile digitizing solution of medical cosmetology; 2., 3., 4., 5., 6., the 7. three-dimensional reconstruction based on passive optical three-dimensional sensing method of representative; 8., the 9. three-dimensional reconstruction based on the active optics three-dimensional sensing method of phase measuring profilometer of representative.The people's face 3 d shape digitizing solution based on composite construction optical projection technology that the present invention proposes also is to belong to active optics three-dimensional sensing technology, but than 8., 9. the phase measuring profilometer of representative has certain optimization and improvement.
In medical science cosmetic plastic surgery operation, be vital to the accurate extraction of people's face three-dimensional appearance feature.Mature methods is based on the three-dimensional measurement of CT technology at present, mainly is the shaping analysis at osseous tissue, is difficult to obtain the three-dimensional appearance feature of people's softhearted tissue surface; The general people's face two dimensional image taken from different visual angles that adopts of three dimensional analysis method based on stereoscopic vision is handled, be subjected to easily ambient light, background, visual angle and people's face attitude, the influence of unfavorable factor such as express one's feelings, block, thereby its certainty of measurement has been difficult to further raising; All bring very big inconvenience for patient and doctor based on traditional manual measurement method, and certainty of measurement is not high.Therefore, press for seek a kind of noncontact, fast, accurately, measuring method is extracted the three-dimensional appearance feature of people's face easily, to improve the success rate and the effect of medical science plastic and aesthetic surgery.
In the prior art, 1. the three-dimensional rebuilding method based on the CT technology of representative can only be used more at the distortion of osseous tissue or damaged situation at aspects such as shaping of cranium face and jaw abnormity orthopedicses.The soft tissue surfaces form is directly perceived, the most convictive form of expression of shaping and beauty effect, and the CT technology is rebuild relatively difficulty for the three-D profile of soft tissue surfaces, and especially the three-dimensional reconstruction for people's face portion appearance of more complicated is difficult to realize.
2., 3., 4., 5., 6., 7. the passive optical three-dimensional sensing method of representative adopts non-structured illumination mode, determines range information from the two dimensional image that one or more camera systems are obtained, formation 3 d shape data.When determining range information the two dimensional image that obtains from a camera system, if prioris such as the form of the relevant object of necessary dependence, illumination condition are the not enough mistake that just may produce in the calculating of priori; Determine range information the two dimensional image of the different visual directions of obtaining from two or more camera systems, need carry out a large amount of computings such as relevant or coupling, and need accurately demarcate several video cameras.In addition, people's face based on two dimensional image is measured, unavoidably be subjected to ambient light, background, visual angle and people's face attitude, the influence of unfavorable factor such as express one's feelings, block, thereby its certainty of measurement has been difficult to further raising, and this makes and adopts application product of single two dimensional image people face measuring technique to be difficult to reach practical level.Therefore, passive optical three-dimensional sensing method usually is used for identification, understanding and position and the morphological analysis to objective, and great majority are measured as the purpose three-dimensional sensing system with 3 d shape and generally all adopt active optics three-dimensional sensing mode.
Active optics three-dimensional sensing method adopts the Structured Illumination mode, has characteristics such as noncontact, high measurement accuracy.Because 3 d shape is modulated the time or the space of light field, from the observation light field that carries 3 d shape information, obtains the 3 d shape data by suitable method demodulation.Phase measuring profilometer (PMP) is a kind of important active optics three-dimensional sensing method, it adopts projection sinusoidal grating and phase-shifting technique, the time sequence information of phase shift striped in spatial information by obtaining whole audience striped and the fringe period is rebuild the three-D profile of body surface.But phase measuring profilometer demodulation one width of cloth three-D profile data need to take three width of cloth phase shift stripeds at least, influenced the real-time of measuring, and the minute movement or the expression shape change of target people face in the measuring process, all can directly influence demodulation result, thereby cause bigger reconstruction error.8., 9. proposed to adopt the quick phase-shifting technique of digital raster projection, though can be at very short time inner projection and take some width of cloth phase shift stripeds, but the phase shift striped is when fast by turns projection/shooting, the image that the CCD camera photographs is easy to produce phenomenons such as hangover, distortion, thereby causes bigger measurement error easily.
Thereby prior art awaits to improve and improve.
Summary of the invention
The objective of the invention is to utilize the 3 d shape that comes to measure accurately, easily people's face based on the active optics three-dimensional sensing method of composite construction optical projection technology, thereby realize the digitized of people's face three-D profile.
Technical scheme of the present invention comprises:
A kind of measuring method of digitized measurement system of human face three-dimensional surface shape, wherein, it may further comprise the steps:
Form a frame composite construction striations with the simple structure striations according to certain rule stack;
Utilize digital projector projection composite construction striations to target people face, and utilize ccd video camera to gather a frame to be subjected to the compound striped of the synthetic distortion of people's face elevation information;
Calculate the two-dimensional Fourier transform of the compound striped of distortion, and, therefrom extract the deforming stripe that two frames have the π phase contrast by sport technique segments such as two-dimentional bandpass filtering, inverse Fourier transform, gray scale calibrations;
The phase shift striped that utilization obtains extracts and is subjected to the synthetic phase information of target people face contouring, and obtains the three-dimensional elevation information of target people face by demodulation techniques, realizes that the digitized of people's face contouring is rebuild;
The three-dimensional face data are carried out characteristic point analysis, utilize the color information of texture mapping technology reduction face, make it to approach the color of real human face.
Described method, wherein: the formation method of described composite construction striations comprises:
Choose the same frequency sine streak grating that two frames have the π phase contrast;
Modulate respectively and vertical above-mentioned two width of cloth sine streaks of its direction with the carrier frequency of two different frequencies, form the structural light stripes after two frames are modulated;
The stack of encoding of two frame structure striations after will modulating with general purpose computer generates a frame of digital composite construction striations.
Described method, wherein: the sine streak grating that described two frames have the π phase contrast is:
G
n=c+cos(2πf
φy+nπ) (1)
In the following formula, c is the projection constant; N=0,1 is phase shift factor, n π represents the initial phase of striped; Y is the phase place change direction, is called for short phase directional; f
φFundamental frequency for sinusoidal grating.
Described method, wherein: described single frames composite construction striations is:
I(x,y)=a+b{[c+cos(2πf
φy)]cos(2πf
1x)
+[c+cos(2πf
φy+π)]cos(2πf
2x)} (2)
Wherein a and b are the projection constant; X is perpendicular to phase directional, is called for short vertical direction.
Described method, wherein: described digital projector projection composite construction striations to the step of target people face of utilizing is:
By adjusting the suitable projection constant a and the b of related parameter choosing of general computer program, the strength range of composite construction striations and the strength range of projector are reached an agreement;
Utilize general purpose computer control figure projector that the composite construction striations is projected target people face.
Described method, wherein: the described compound striped of the synthetic distortion of people's face elevation information that is subjected to of ccd video camera collection that utilizes is:
Wherein r (x y) is the non-homogeneous reflectance of body surface,
Expression is subjected to the synthetic phase information of object height.
Described method, wherein: the two-dimensional Fourier transform of compound striped is out of shape in described calculating, and (3) formula is carried out two-dimensional Fourier transform and abbreviation gets:
Wherein F (ξ, η), A (ξ, η), B (ξ-f
1, η) and ψ (ξ, η) be respectively P in (2-6) formula (x, y), ar (x, y), bcr (x, y) and
Two-dimentional Fourier spectrum, the η correspondence the phase directional in the time domain, i.e. the direction at fundamental frequency place; The ξ correspondence the vertical direction in the time domain, i.e. the direction at carrier frequency place.
Described method, wherein: described by sport technique segments such as two-dimentional bandpass filtering, inverse Fourier transform, gray scale calibrations, therefrom extract the deforming stripe that two frames have the π phase contrast; The light distribution of described deforming stripe is:
Wherein (x for through the non-homogeneous reflectance after the gray scale calibration, is one group of constant matrix y) to r '.
Described method, wherein: the phase shift striped that described utilization obtains extracts and is subjected to the synthetic phase information of target people face contouring, and by the three-dimensional elevation information concrete steps of demodulation techniques acquisition target people face is:,
Obtain after two formulas in (5) are subtracted each other
Following formula is carried out one-dimensional Fourier transform along the y direction, and its spectrum distribution is expressed as:
G(x,η)=ψ(x,η-f
0)+ψ*(x,η+f
0) (7)
Select suitable spectral window that fundamental component is leached, it is carried out inverse Fourier transform and through the demodulation computing, obtains the bits of modulation phase information
Described method, wherein: determine reference plane at the measurement target rear; Utilize above-mentioned described method to obtain the bits of modulation phase information of reference plane in advance
The true three-dimension height that obtains target people face distributes:
Wherein (x y) represents the digitized three-dimensional elevation information of target people face to h;
Represent the angle parameter between ccd video camera and the digital projector (DLP), be also referred to as the systematic parameter of this optical measuring device.
Described method, wherein: described method can be used for the 3 d shape digitized measurement at other position of human body, comprises the 3 d shape digitized measurement to human breast.
A kind of equipment of digitized measurement system of human face three-dimensional surface shape, wherein, it comprises:
The composite construction light generating device in order to produce the simple structure striations, is sent to general purpose computer modulation overlap-add procedure, forms the composite construction striations;
Digital projector is used for the composite construction striations is projected target people face and reference plane;
Ccd video camera is used to gather compound striped of distortion after the modulation of people's face elevation information and the composite construction striped on the reference plane;
General purpose computer is used for the simple structure striations is handled formation composite construction striations; The compound striped of the distortion of ccd video camera collection is carried out two-dimensional Fourier transform, two-dimentional bandpass filtering, inverse Fourier transform, gray scale calibration, extract two frames and have the deforming stripe of π phase contrast, calculate and be subjected to the synthetic phase information of target people face contouring; Demodulation obtains the three-dimensional height distributed intelligence of target people face shape;
Reference plane are used to obtain the bits of modulation phase information of reference plane;
Be connected by communication interface between described general purpose computer and described composite construction light generating device, described digital projector, the described ccd video camera.
Described equipment, wherein: it also comprises the texture mapping device, is connected with general purpose computer, is used to reduce face's chrominance signal.
Described equipment, wherein: the camera lens of described digital projector and ccd video camera is provided with the near-infrared filter plate.
Noncontact provided by the present invention, fast, accurately, easily based on the digitized measurement system of human face three-dimensional surface shape of composite construction optical projection technology, the operation of behaviour face cosmetic plastic surgery brings new measuring method and evaluation measures, promote the digitized process of medical science shaping and beauty, and be that later three-dimensional face research and application lays the first stone.
Description of drawings
Fig. 1 is the formation figure of composite construction striations of the present invention;
When Fig. 2 projects target people face for the present invention with the composite construction striations, the continuous light distribution P on people's face surface (x, two-dimensional Fourier transform F y) (ξ, 2-d spectrum distribution vertical view η);
The frame that Fig. 3 finally extracts from the composite construction striations for the present invention contains the striped g of phase modulation information, and (x is y) along one-dimensional Fourier transform G (x, frequency spectrum profile η) of y direction (phase directional);
Fig. 4 measures flow chart for the present invention;
Fig. 5 measures index path for the present invention;
Fig. 6 measures block diagram for the present invention;
The composite construction striations sketch map that projects to reference plane that Fig. 7 photographs for the present invention;
Fig. 8 is subjected to the synthetic distressed structure striations of people's face 3 d shape sketch map for the present invention;
Fig. 9 is a PHASE DISTRIBUTION sketch map of the present invention;
Figure 10 to Figure 13 is a preliminary test design sketch of the present invention.
The specific embodiment
Below in conjunction with accompanying drawing embodiment, the active optics three-dimensional sensing method of the utilization of the present invention's proposition based on composite construction optical projection technology is described, come to measure accurately, easily the 3 d shape of people's face, thereby realize the method for digitizing of people's face three-D profile, specific implementation is as follows:
Composite construction optical projection technology adopts a frame composite construction striations to replace traditional simple shape projection, only needs projection/compound striped of shooting one frame can rebuild people's face three-D profile.The composite construction light generating device is in order to generation simple structure striations, is sent to general purpose computer modulation overlap-add procedure, formation composite construction striations.Described composite construction striations adopts the carrier frequency of two different frequencies to modulate respectively to have the sine streak and the stack of π phase contrast with vertical two frames of its direction and forms.The sinusoidal grating that two wherein modulated frames have the π phase contrast is:
G
n=c+cos(2πf
φy+nπ) (1)
In the following formula, c is the projection constant; N=0,1 is phase shift factor, n π represents the initial phase of striped; Y is the phase place change direction, is called for short phase directional (Phase); f
φFundamental frequency for sinusoidal grating.Can find out that by (1) formula the sine streak that this two frame has the π phase contrast has identical frequency f
φ
Carrier frequency f with two different frequencies
1With f
2Respectively the two frame sine streaks of (1) formula are modulated, promptly carried out multiplying; Striped after the two frames modulation that will obtain then superposes, and promptly carries out additive operation, as shown in Figure 1, can obtain a frame composite construction striations:
I(x,y)=a+b{[c+cos(2πf
φy)]cos(2πf
1x)
+[c+cos(2πf
φy+π)]cos(2πf
2x)} (2)
Wherein a and b are the projection constant; X is perpendicular to phase directional, is called for short vertical direction (Orthogonal).
The specific implementation of composite construction striations: adopt general purpose computer to encode and generate the digital complex striped by above-mentioned principle.
Select suitable projection constant a and b, the strength range of the strength range of composite construction striations and projector is reached an agreement (realizing) by the relevant parameter of adjusting computer program.Utilize general purpose computer control figure projector (DLP), when the composite construction striations was projected target people face, the continuous light distribution on people's face surface can be expressed as:
Wherein r (x y) is the non-homogeneous reflectance of body surface,
Expression is subjected to the synthetic phase information of object height.
This is the compound striped of the synthetic distortion of people's face elevation information that video camera photographs.
(3) formula is carried out two-dimensional Fourier transform and abbreviation gets:
Wherein F (ξ, η), A (ξ, η), B (ξ-f
1, η) and ψ (ξ, η) be respectively P in (2-6) formula (x, y), ar (x, y), bcr (x, y) and
Two-dimentional Fourier spectrum, the η correspondence the phase directional in the time domain, i.e. the direction at fundamental frequency place; The ξ correspondence the vertical direction in the time domain, i.e. the direction at carrier frequency place.Its spectrum distribution such as Fig. 2 show.
Utilize Hanning window that two carrier frequency frequency spectrums are carried out two-dimentional bandpass filtering respectively, during the frequency spectrum that leaches is moved respectively after, carry out inverse Fourier transform more respectively, get its mould, obtain the sine streak figure that two frames have the π phase contrast.This two frames bar graph is carried out the gray scale calibration, obtains following light distribution:
Wherein (x for through the non-homogeneous reflectance after the gray scale calibration, is one group of constant matrix y) to r '.After subtracting each other, two formulas obtain
Following formula is carried out one-dimensional Fourier transform along y direction (phase directional), and its spectrum distribution is expressed as follows:
G(x,η)=ψ(x,η-f
0)+ψ*(x,η+f
0) (7)
Wherein G (x, η), ψ (x, η) be respectively g (x, y),
The one dimension Fourier spectrum.Its spectrum distribution such as Fig. 3 show.
Select suitable spectral window that the fundamental component shown in the dash area among the figure is leached, it is carried out inverse Fourier transform and through the demodulation computing, obtains the bits of modulation phase information
In order to determine the true three-dimension information of target people face, need determine reference plane at the measurement target rear.Can utilize said method to obtain the bits of modulation phase information of reference plane in advance
The true three-dimension height that so just can obtain target people face distributes:
Wherein (x y) represents the digitized three-dimensional elevation information of target people face to h;
Represent the angle parameter between ccd video camera and the digital projector (DLP), be also referred to as the systematic parameter of this optical measuring device.
According to above-mentioned measuring principle, workflow can be described as: 1) generate a frame composite construction striations by a few frame simple sinusoidal stripeds, project target people face through optical projection system (digital projector); 2) position of composite construction striations (carrier signal) is subjected to the modulation of target people face 3 d shape height distribution (modulation signal) mutually, obtains being out of shape the composite construction light field; 3) imaging system (ccd video camera) the distortion composite construction light field that will collect is sent general-purpose computer processes; 4) general purpose computer carries out a series of calculation process to the information of gained, obtains phase information; 5) according to position and the modulation relation that highly distributes, the height that demodulates target people face 3 d shape distributes.Its workflow as shown in Figure 4.
What Fig. 5 represented is to measure index path, and wherein d is the distance between ccd video camera and the digital projector, L
0Be that ccd video camera is to the distance between the reference plane.Fig. 6 represents to measure block diagram.Fig. 7, Fig. 8 represent the measuring device pictorial diagram simplified, promptly adopt general purpose computer control projector projects composite construction striations, utilize the collection of CCD commercial measurement camera to be subjected to the synthetic distortion composite construction of people's face 3 d shape striations.
For the effectiveness of people's face 3 d shape digitizing solution that the present invention proposes is described, we have done a preliminary simulation experiment.The Panasonic liquid crystal projection apparatus is adopted in experiment, and model is PT-P2500, and resolution is 1024 * 768.Image capture device is Canadian Prosilica colored CCD industrial camera, and model is EC1350C, and resolution is 1360 * 1024, and the Pixel Dimensions size is 4.65um * 1.65um, and wherein the CCD model is Sony ICX205AK, is of a size of 1/2 "; Camera lens adopts Japanese KOWA industrial lens, and model is LM12JCM, and focal length is 12mm; 1394 integrated circuit boards that connect CCD camera and general purpose computer adopt Taiwan KEC, and model is 1582T; Reference plane are a blank.The geometric parameter of measuring system is L
0=73mm, d=18mm.
Adopt the desk-top general purpose computer of association to carry out programming and date processing.Utilize general purpose computer to encode when generating the composite construction striations two carrier frequency f
1And f
2Be given as 3/40line/pixel, 6/40line/pixel respectively, fundamental frequency f
φBe 32/600line/pixel.The composite construction striations that generates projects on the reference white plate by digital projector, utilizes bar graph that the CCD camera photographs as shown in Figure 7.
Target people's face that experiment is adopted is people's face mould of a white, and Fig. 8 is the synthetic distressed structure striations of 3 d shape that is subjected to people's face mould.The image information that collects is by general-purpose computer processes, and the effect data figure of the digitized people face 3 d shape that obtains sees Fig. 8, shown in Figure 9.
The invention also discloses the equipment of a digitized measurement system of human face three-dimensional surface shape, it comprises: described composite construction light generating device, in order to produce the simple structure striations, be sent to general purpose computer modulation overlap-add procedure, and form the composite construction striations; Described digital projector is used for the composite construction striations is projected target people face and reference plane; Described ccd video camera is used to gather compound striped of distortion after the modulation of people's face elevation information and the composite construction striped on the reference plane; And described general purpose computer, be used for the simple structure striations is handled formation composite construction striations; The compound striped of the distortion of ccd video camera collection is carried out two-dimensional Fourier transform, two-dimentional bandpass filtering, inverse Fourier transform, gray scale calibration, extract two frames and have the deforming stripe of π phase contrast, calculate and be subjected to the synthetic phase information of target people face contouring; Demodulation obtains the three-dimensional height distributed intelligence of target people face shape.
Also be used to obtain the reference plane of the bits of modulation phase information of reference plane in the equipment of the present invention.Be connected by communication interface between described general purpose computer and described composite construction light generating device, described digital projector, the described ccd video camera.
People's face digitized 3 d shape of different angles distributes shown in Figure 10 to 13.The present invention can also be provided with the texture mapping device, by the three-dimensional face data are carried out characteristic point analysis, utilizes the color information of texture mapping device reduction face, makes it to approach the color of real human face.
From the preliminary experiment design sketch, the method that proposes by the present invention can obtain digitized 3 d shape information more convenient, accurately, and with low cost.From now on we will be by the adjustment system parameter, improve methods such as experimental situation and further improve its certainty of measurement.
The present invention proposes to adopt the 3 d shape that comes to measure accurately, easily people's face based on the active optics three-dimensional sensing method of composite construction optical projection technology, thereby lays the first stone for the digital applications of people's face three-dimensional appearance.In this technology, we adopt general purpose computer control projector projects composite construction striations, and projector can be regarded as white light source.Consider that white light projects the discomfort that people's face may bring human body, we can replace near infrared light with white light source, specific implementation is: add a slice near-infrared filter plate before digital projector and ccd video camera camera lens respectively, so just can projection and shooting under the near infrared light environment, eliminate the discomfort that white light brings.
On the basis of people's face 3 d shape measuring system that the present invention proposes, can develop the digital beautifying device of a cover at the shaping of people's face, comprise optical measuring device and digitized people face shaping and beauty general purpose computer aided design system software.This numeral beautifying device is with series of function modules such as integrated optics measurement, date processing, Data Structure Design, the demonstration of three-dimensional face stereo-picture and man-machine interactive operation, curved surface editor, face-lifting conceptual design, three-dimensional face database foundation.Improving of the systemic-function of numeral beautifying device will bring great convenience for doctor and patient, for the operation of people's face cosmetic plastic surgery brings new measuring method and evaluation measures, promotes the digitized process of medical science shaping and beauty.
The present invention is except can be applicable to the beauty treatment of people's face numeral, the shaping and beauty at some other position of health can realize equally, shaping and beauty such as breast, specific implementation is: utilize the method for three-dimensional measurement that proposes among the present invention accurately to obtain the digitized three-dimensional information of breast, utilize systems soft ware of the present invention to carry out the shaping design then, thereby realize the digitized shaping and beauty of breast, and then instruct the doctor to implement operation, better reach the effect of Mammaplasty beauty treatment, can greatly reduce operation risk.
Should be understood that above-mentioned description at specific embodiment is comparatively detailed, can not therefore think the restriction to scope of patent protection of the present invention, scope of patent protection of the present invention should be as the criterion with claims.
Claims (14)
1, a kind of measuring method of digitized measurement system of human face three-dimensional surface shape is characterized in that, it may further comprise the steps:
Form a frame composite construction striations with the simple structure striations according to certain rule stack;
Utilize digital projector projection composite construction striations to target people face, and utilize ccd video camera to gather a frame to be subjected to the compound striped of the synthetic distortion of people's face elevation information;
Calculate the two-dimensional Fourier transform of the compound striped of distortion, and, therefrom extract the deforming stripe that two frames have the π phase contrast by sport technique segments such as two-dimentional bandpass filtering, inverse Fourier transform, gray scale calibrations;
The phase shift striped that utilization obtains extracts and is subjected to the synthetic phase information of target people face contouring, and obtains the three-dimensional elevation information of target people face by demodulation techniques, realizes that the digitized of people's face contouring is rebuild;
The three-dimensional face data are carried out characteristic point analysis, utilize the color information of texture mapping technology reduction face, make it to approach the color of real human face.
2, the method for claim 1 is characterized in that: the formation method of described composite construction striations comprises:
Choose the same frequency sine streak grating that two frames have the π phase contrast;
Modulate respectively and vertical above-mentioned two width of cloth sine streaks of its direction with the carrier frequency of two different frequencies, form the structural light stripes after two frames are modulated;
The stack of encoding of two frame structure striations after will modulating with general purpose computer generates a frame of digital composite construction striations.
3, method as claimed in claim 2 is characterized in that, the sine streak grating that described two frames have the π phase contrast is:
G
n=c+cos(2πf
φy+nπ)(1)
In the following formula, c is the projection constant; N=0,1 is phase shift factor, n π represents the initial phase of striped; Y is the phase place change direction, is called for short phase directional; f
φFundamental frequency for sinusoidal grating.
4, method as claimed in claim 2 is characterized in that: described single frames composite construction striations is:
I(x,y)=a+b{[c+cos(2πf
φy)]cos(2πf
1x)
+[c+cos(2πf
φy+π)]cos(2πf
2x)} (2)
Wherein a and b are the projection constant; X is perpendicular to phase directional, is called for short vertical direction.
5, the method for claim 1 is characterized in that, described digital projector projection composite construction striations to the step of target people face of utilizing is:
By adjusting the suitable projection constant a and the b of related parameter choosing of general computer program, the strength range of composite construction striations and the strength range of projector are reached an agreement;
Utilize general purpose computer control figure projector that the composite construction striations is projected target people face.
6, the method for claim 1 is characterized in that: the described compound striped of the synthetic distortion of people's face elevation information that is subjected to of ccd video camera collection that utilizes is:
7, method as claimed in claim 6 is characterized in that, the two-dimensional Fourier transform of compound striped is out of shape in described calculating, and (3) formula is carried out two-dimensional Fourier transform and abbreviation gets:
Wherein F (ξ, η), A (ξ, η), B (ξ-f
1, η) and ψ (ξ, η) be respectively P in (2-6) formula (x, y), ar (x, y), bcr (x, y) and
Two-dimentional Fourier spectrum, the η correspondence the phase directional in the time domain, i.e. the direction at fundamental frequency place; The ξ correspondence the vertical direction in the time domain, i.e. the direction at carrier frequency place.
8, method as claimed in claim 7 is characterized in that: described by sport technique segments such as two-dimentional bandpass filtering, inverse Fourier transform, gray scale calibrations, therefrom extract the deforming stripe that two frames have the π phase contrast; The light distribution of described deforming stripe is:
Wherein (x for through the non-homogeneous reflectance after the gray scale calibration, is one group of constant matrix y) to r '.
9, method as claimed in claim 8 is characterized in that: the phase shift striped that described utilization obtains extracts and is subjected to the synthetic phase information of target people face contouring, and by the three-dimensional elevation information concrete steps of demodulation techniques acquisition target people face is:,
Obtain after two formulas in (5) are subtracted each other
Following formula is carried out one-dimensional Fourier transform along the y direction, and its spectrum distribution is expressed as:
G(x,η)=ψ(x,η-f
0)+ψ*(x,η+f
0)(7)
Wherein G (x, η), ψ (x, η) be respectively g (x, y),
The one dimension Fourier spectrum;
10, method as claimed in claim 9 is characterized in that: determine reference plane at the measurement target rear; Utilize above-mentioned described method to obtain the bits of modulation phase information of reference plane in advance
The true three-dimension height that obtains target people face distributes:
11, the method for claim 1 is characterized in that: described method can be used for the 3 d shape digitized measurement at other position of human body, comprises the 3 d shape digitized measurement to human breast.
12, a kind of equipment of digitized measurement system of human face three-dimensional surface shape is characterized in that, it comprises:
The composite construction light generating device in order to produce the simple structure striations, is sent to general purpose computer modulation overlap-add procedure, forms the composite construction striations;
Digital projector is used for the composite construction striations is projected target people face and reference plane;
Ccd video camera is used to gather compound striped of distortion after the modulation of people's face elevation information and the composite construction striped on the reference plane;
General purpose computer is used for the simple structure striations is handled formation composite construction striations; The compound striped of the distortion of ccd video camera collection is carried out two-dimensional Fourier transform, two-dimentional bandpass filtering, inverse Fourier transform, gray scale calibration, extract two frames and have the deforming stripe of π phase contrast, calculate and be subjected to the synthetic phase information of target people face contouring; Demodulation obtains the three-dimensional height distributed intelligence of target people face shape;
Reference plane are used to obtain the bits of modulation phase information of reference plane;
Be connected by communication interface between described general purpose computer and described composite construction light generating device, described digital projector, the described ccd video camera.
13, equipment as claimed in claim 12 is characterized in that: it also comprises the texture mapping device, is connected with general purpose computer, is used to reduce face's chrominance signal.
14, equipment as claimed in claim 12 is characterized in that: the camera lens of described digital projector and ccd video camera is provided with the near-infrared filter plate.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNA2008101420635A CN101347332A (en) | 2008-08-22 | 2008-08-22 | Measurement method and equipment of digitized measurement system of human face three-dimensional surface shape |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNA2008101420635A CN101347332A (en) | 2008-08-22 | 2008-08-22 | Measurement method and equipment of digitized measurement system of human face three-dimensional surface shape |
Publications (1)
Publication Number | Publication Date |
---|---|
CN101347332A true CN101347332A (en) | 2009-01-21 |
Family
ID=40266435
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNA2008101420635A Pending CN101347332A (en) | 2008-08-22 | 2008-08-22 | Measurement method and equipment of digitized measurement system of human face three-dimensional surface shape |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101347332A (en) |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102253590A (en) * | 2010-05-20 | 2011-11-23 | 鸿富锦精密工业(深圳)有限公司 | Contour detector, contour detection method and electronic device |
CN102261896A (en) * | 2011-04-19 | 2011-11-30 | 长春东瑞科技发展有限公司 | Method and system for measuring three-dimensional shape of object based on phase measurement |
CN103385710A (en) * | 2012-05-10 | 2013-11-13 | 赵平 | Projection grating measurement and image processing device applied to mamma |
CN103697834A (en) * | 2013-12-26 | 2014-04-02 | 南京理工大学 | Automatic identification and elimination method for invalid points in dynamic scene during real-time optical three-dimensional measurement |
CN103793915A (en) * | 2014-02-18 | 2014-05-14 | 上海交通大学 | Low-cost mark-free registration system and method in neurosurgery navigation |
CN104156716A (en) * | 2014-08-15 | 2014-11-19 | 山东大学 | Phase extraction-based no-color difference three-dimensional character image processing method |
CN105761243A (en) * | 2016-01-28 | 2016-07-13 | 四川川大智胜软件股份有限公司 | Three-dimensional full face photographing system based on structured light projection and photographing method thereof |
CN106289109A (en) * | 2016-10-26 | 2017-01-04 | 长安大学 | A kind of three-dimensional reconstruction system based on structure light and method |
CN106778474A (en) * | 2016-11-14 | 2017-05-31 | 深圳奥比中光科技有限公司 | 3D human body recognition methods and equipment |
CN106901697A (en) * | 2017-03-03 | 2017-06-30 | 哈尔滨理工大学 | A kind of method for testing three-dimensional Fourier transform chest and abdomen surface measurement means |
CN106991405A (en) * | 2017-04-10 | 2017-07-28 | 广东金杭科技股份有限公司 | A kind of dynamic portrait storehouse method for building up |
CN107343151A (en) * | 2017-07-31 | 2017-11-10 | 广东欧珀移动通信有限公司 | image processing method, device and terminal |
CN107622433A (en) * | 2017-08-09 | 2018-01-23 | 广东欧珀移动通信有限公司 | Glasses recommend method and apparatus |
CN107644680A (en) * | 2017-08-09 | 2018-01-30 | 广东欧珀移动通信有限公司 | Method for detecting health status, device and terminal device |
CN109903376A (en) * | 2019-02-28 | 2019-06-18 | 四川川大智胜软件股份有限公司 | A kind of the three-dimensional face modeling method and system of face geological information auxiliary |
CN110072433A (en) * | 2016-09-19 | 2019-07-30 | 莱雅公司 | The systems, devices and methods of three dimensional analysis for eye pouch |
CN110555812A (en) * | 2019-07-24 | 2019-12-10 | 广州视源电子科技股份有限公司 | image adjusting method and device and computer equipment |
CN110763150A (en) * | 2018-07-26 | 2020-02-07 | 王东 | Face contour measuring method |
CN110767288A (en) * | 2018-07-26 | 2020-02-07 | 王东 | Virtual face contour adjusting method |
WO2020087573A1 (en) * | 2018-10-29 | 2020-05-07 | 罗俭富 | Beauty assistance system, three-dimensional coordinate information acquisition method based thereon, and beauty method thereof |
CN111222472A (en) * | 2020-01-09 | 2020-06-02 | 西安知象光电科技有限公司 | Face recognition method based on structural optical frequency domain features |
CN111597880A (en) * | 2020-04-03 | 2020-08-28 | 浙江工业大学 | Multi-view three-dimensional fingerprint acquisition method based on single fringe projection |
CN113066164A (en) * | 2021-03-19 | 2021-07-02 | 河南工业大学 | Phase shift profilometry-based three-dimensional reconstruction method for single-stripe moving object |
CN113108719A (en) * | 2021-03-23 | 2021-07-13 | 南京理工大学 | High-precision three-dimensional face measurement method based on near-infrared fringe projection |
CN114396886A (en) * | 2021-12-29 | 2022-04-26 | 湖北大学 | Three-dimensional measurement method based on space division multiplexing coding |
-
2008
- 2008-08-22 CN CNA2008101420635A patent/CN101347332A/en active Pending
Cited By (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102253590B (en) * | 2010-05-20 | 2014-11-05 | 鸿富锦精密工业(深圳)有限公司 | Contour detector, contour detection method and electronic device |
CN102253590A (en) * | 2010-05-20 | 2011-11-23 | 鸿富锦精密工业(深圳)有限公司 | Contour detector, contour detection method and electronic device |
CN102261896A (en) * | 2011-04-19 | 2011-11-30 | 长春东瑞科技发展有限公司 | Method and system for measuring three-dimensional shape of object based on phase measurement |
CN103385710A (en) * | 2012-05-10 | 2013-11-13 | 赵平 | Projection grating measurement and image processing device applied to mamma |
CN103385710B (en) * | 2012-05-10 | 2015-08-05 | 赵平 | A kind of projection gate for breast is measured and image processing apparatus |
CN103697834A (en) * | 2013-12-26 | 2014-04-02 | 南京理工大学 | Automatic identification and elimination method for invalid points in dynamic scene during real-time optical three-dimensional measurement |
CN103793915B (en) * | 2014-02-18 | 2017-03-15 | 上海交通大学 | Inexpensive unmarked registration arrangement and method for registering in neurosurgery navigation |
CN103793915A (en) * | 2014-02-18 | 2014-05-14 | 上海交通大学 | Low-cost mark-free registration system and method in neurosurgery navigation |
CN104156716A (en) * | 2014-08-15 | 2014-11-19 | 山东大学 | Phase extraction-based no-color difference three-dimensional character image processing method |
CN105761243A (en) * | 2016-01-28 | 2016-07-13 | 四川川大智胜软件股份有限公司 | Three-dimensional full face photographing system based on structured light projection and photographing method thereof |
CN110072433B (en) * | 2016-09-19 | 2022-04-05 | 莱雅公司 | System, device and method for three-dimensional analysis of bags under the eyes |
CN110072433A (en) * | 2016-09-19 | 2019-07-30 | 莱雅公司 | The systems, devices and methods of three dimensional analysis for eye pouch |
CN106289109A (en) * | 2016-10-26 | 2017-01-04 | 长安大学 | A kind of three-dimensional reconstruction system based on structure light and method |
CN106778474A (en) * | 2016-11-14 | 2017-05-31 | 深圳奥比中光科技有限公司 | 3D human body recognition methods and equipment |
CN106901697A (en) * | 2017-03-03 | 2017-06-30 | 哈尔滨理工大学 | A kind of method for testing three-dimensional Fourier transform chest and abdomen surface measurement means |
CN106991405A (en) * | 2017-04-10 | 2017-07-28 | 广东金杭科技股份有限公司 | A kind of dynamic portrait storehouse method for building up |
CN107343151A (en) * | 2017-07-31 | 2017-11-10 | 广东欧珀移动通信有限公司 | image processing method, device and terminal |
CN107343151B (en) * | 2017-07-31 | 2019-07-19 | Oppo广东移动通信有限公司 | Image processing method, device and terminal |
CN107644680A (en) * | 2017-08-09 | 2018-01-30 | 广东欧珀移动通信有限公司 | Method for detecting health status, device and terminal device |
CN107622433A (en) * | 2017-08-09 | 2018-01-23 | 广东欧珀移动通信有限公司 | Glasses recommend method and apparatus |
CN110763150B (en) * | 2018-07-26 | 2021-05-25 | 王东 | Face contour measuring method |
CN110767288B (en) * | 2018-07-26 | 2024-05-31 | 王东 | Virtual face contour adjustment method |
CN110763150A (en) * | 2018-07-26 | 2020-02-07 | 王东 | Face contour measuring method |
CN110767288A (en) * | 2018-07-26 | 2020-02-07 | 王东 | Virtual face contour adjusting method |
WO2020087573A1 (en) * | 2018-10-29 | 2020-05-07 | 罗俭富 | Beauty assistance system, three-dimensional coordinate information acquisition method based thereon, and beauty method thereof |
CN109903376B (en) * | 2019-02-28 | 2022-08-09 | 四川川大智胜软件股份有限公司 | Face geometric information assisted three-dimensional face modeling method and system |
CN109903376A (en) * | 2019-02-28 | 2019-06-18 | 四川川大智胜软件股份有限公司 | A kind of the three-dimensional face modeling method and system of face geological information auxiliary |
CN110555812A (en) * | 2019-07-24 | 2019-12-10 | 广州视源电子科技股份有限公司 | image adjusting method and device and computer equipment |
CN111222472A (en) * | 2020-01-09 | 2020-06-02 | 西安知象光电科技有限公司 | Face recognition method based on structural optical frequency domain features |
CN111222472B (en) * | 2020-01-09 | 2023-12-15 | 西安知象光电科技有限公司 | Face recognition method based on structural light frequency domain characteristics |
CN111597880A (en) * | 2020-04-03 | 2020-08-28 | 浙江工业大学 | Multi-view three-dimensional fingerprint acquisition method based on single fringe projection |
CN113066164A (en) * | 2021-03-19 | 2021-07-02 | 河南工业大学 | Phase shift profilometry-based three-dimensional reconstruction method for single-stripe moving object |
CN113108719A (en) * | 2021-03-23 | 2021-07-13 | 南京理工大学 | High-precision three-dimensional face measurement method based on near-infrared fringe projection |
CN114396886A (en) * | 2021-12-29 | 2022-04-26 | 湖北大学 | Three-dimensional measurement method based on space division multiplexing coding |
CN114396886B (en) * | 2021-12-29 | 2023-05-09 | 湖北大学 | Three-dimensional measurement method based on space division multiplexing coding |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101347332A (en) | Measurement method and equipment of digitized measurement system of human face three-dimensional surface shape | |
Tzou et al. | Comparison of three-dimensional surface-imaging systems | |
CN101739719B (en) | Three-dimensional gridding method of two-dimensional front view human face image | |
CN107358648B (en) | Real-time full-automatic high quality three-dimensional facial reconstruction method based on individual facial image | |
CN105300316B (en) | Optical losses rapid extracting method based on grey scale centre of gravity method | |
CN103971409A (en) | Measuring method for foot three-dimensional foot-type information and three-dimensional reconstruction model by means of RGB-D camera | |
CN101755288B (en) | Method and apparatus for realistic simulation of wrinkle aging and de-aging | |
CN104126989B (en) | A kind of based on the foot surfaces 3 D information obtaining method under multiple stage RGB-D pick up camera | |
Douglas | Image processing for craniofacial landmark identification and measurement: a review of photogrammetry and cephalometry | |
CN106802138A (en) | A kind of 3 D scanning system and its scan method | |
CN106780619A (en) | A kind of human body dimension measurement method based on Kinect depth cameras | |
CN108734776A (en) | A kind of three-dimensional facial reconstruction method and equipment based on speckle | |
CN107481228A (en) | Human body back scoliosis angle measurement method based on computer vision | |
CN109242954A (en) | Multi-view angle three-dimensional human body reconstruction method based on template deformation | |
CN109671505B (en) | Head three-dimensional data processing method for medical diagnosis and treatment assistance | |
CN103826032B (en) | Depth map post-processing method | |
CN101398886A (en) | Rapid three-dimensional face identification method based on bi-eye passiveness stereo vision | |
CN1330928C (en) | Method and apparatus for measuring profile of object by double wavelength structural light | |
CN104794728A (en) | Method for reconstructing real-time three-dimensional face data with multiple images | |
CN104680534B (en) | Object depth information acquisition methods based on single frames composite shuttering | |
CN201299570Y (en) | Digital measuring system in shape of human face three-dimensional surface | |
CN108376421A (en) | A method of human face three-dimensional model is generated based on shape from shading method | |
CN103679816A (en) | Criminology-oriented computer-assisted facial reconstruction method for skulls of unknown body sources | |
CN104661585B (en) | The method for characterizing skin volume | |
CN103454276A (en) | Textile form and style evaluation method based on dynamic sequence image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Open date: 20090121 |