CN104361131B - The method for building up of four-dimensional faceform's database - Google Patents

The method for building up of four-dimensional faceform's database Download PDF

Info

Publication number
CN104361131B
CN104361131B CN201410742423.0A CN201410742423A CN104361131B CN 104361131 B CN104361131 B CN 104361131B CN 201410742423 A CN201410742423 A CN 201410742423A CN 104361131 B CN104361131 B CN 104361131B
Authority
CN
China
Prior art keywords
dimensional
face
faceform
image
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410742423.0A
Other languages
Chinese (zh)
Other versions
CN104361131A (en
Inventor
王英丽
刘昱
马宏斌
王瑶
白雪
李嵩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing jianyipeihong Technology Co.,Ltd.
Original Assignee
Heilongjiang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Heilongjiang University filed Critical Heilongjiang University
Priority to CN201410742423.0A priority Critical patent/CN104361131B/en
Publication of CN104361131A publication Critical patent/CN104361131A/en
Application granted granted Critical
Publication of CN104361131B publication Critical patent/CN104361131B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/04Indexing scheme for image data processing or generation, in general involving 3D image data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)

Abstract

The method for building up of four-dimensional faceform's database, belongs to technical field of image processing.In order to solve the problems, such as existing to be easily tampered using the database of three-dimensional face model.The method includes:Step 1:Current time is taken to be used as with reference to amount, settling time axis;Step 2:According to input facial image, space two-dimensional coordinate system is established, two-dimensional image information extraction is carried out to the facial image and face characteristic extracts;Step 3:Structure and the fusion of 3-D view are carried out according to the two-dimensional image information of acquisition and face characteristic;Step 4:According to the 3-D view after fusion, 3 d space coordinate system is established, forms three-dimensional face model, extracts the three-dimensional image information of three-dimensional face model;Step 5:Each pixel of three-dimensional face model with the time of time shaft established is corresponded, four-dimensional faceform is formed, four-dimensional image information is extracted to four-dimensional faceform, is stored into database, form four-dimensional faceform's database.The present invention is used for face identification system.

Description

The method for building up of four-dimensional faceform's database
Technical field
The invention belongs to technical field of image processing.
Background technology
Current face identification system is to capture face video stream or two dimensional image by photographic device, two dimensional image again with Benchmark two dimensional image in database is compared, and judges whether to meet.The three-dimensional that existing this database generally all uses The database of faceform, if database is distorted by people's malice, face identification system still using the database after distorting into There is very high danger in row identification.
Invention content
The purpose of the present invention is to solve existing the problem of being easily tampered using the database of three-dimensional face model, sheets Invention provides a kind of method for building up of four-dimensional faceform's database.
The method for building up of four-dimensional faceform's database of the present invention, described method includes following steps:
Step 1:Current time is taken to be used as with reference to amount, settling time axis;
Step 2:According to the facial image of input, space two-dimensional coordinate system is established, X-Y scheme is carried out to the facial image As information extraction and face characteristic are extracted;
Step 3:Structure and the fusion of 3-D view are carried out according to the two-dimensional image information of acquisition and face characteristic;
Step 4:According to the 3-D view after fusion, 3 d space coordinate system is established, forms three-dimensional face model, extraction The three-dimensional image information of three-dimensional face model;
Step 5:Each pixel of three-dimensional face model with the time of time shaft established is corresponded, forms four Faceform is tieed up, four-dimensional image information is extracted to four-dimensional faceform, is stored into database, forms four-dimensional faceform's data Library.
In the step 2, according to the facial image of input, space two-dimensional coordinate system is established, the facial image is carried out Two-dimensional image information extracts and the method for face characteristic extraction includes:
The facial image of input is pre-processed, chooses the center of facial image two after pretreatment as origin, X Axis passes through the center of two, and horizontal is to the right positive direction, and Y-axis is straight up positive direction, completes building for space two-dimensional coordinate system It is vertical;
The scanning of Pixel-level is carried out to the two dimensional image after foundation, obtains the coordinate position and gray value of each pixel, Two dimensional image textural characteristics are formed, and obtain the color value of each pixel by clustering method, the color value is with RGB come table Show;
The division of face face structure is carried out to the two dimensional image after foundation;
Characteristics of image edge detection and enhancing are carried out to the two dimensional image after foundation, it, will according to the face structure after division Image is divided into each separate unit, then carries out feature extraction to each separate unit.
In the step 2, being divided into for face face structure is carried out to the image after foundation:
Forehead, eyebrow, upper eyelid, eyelash, fissura palpebrae, commissura palpebrarum medialis area, association area, endocanthion, outer canthus, nose on the outside of eyelid Root, nose, bridge of the nose, nose bottom, nostril, nose pillar, the wing of nose, nasal surface ditch, labial surface ditch, nasolabial groove, infraorbital region zygomatic region, schistostoma, bicker, Lip is red, prolabium, lip bow, people midpoint, lip peak, lip pearl, philtrum ridge, buccal region, chin labial groove, gnathion, zygomatic region, Nie Mian areas, ear, Parotideomasseteric region, hair and beard.
The facial image of the input includes face direct picture, face orthogonal image and face side image.
In the step 4, according to the 3-D view after fusion, 3 d space coordinate system is established, forms three-dimensional face mould Type, the method for extracting the three-dimensional image information of three-dimensional face model include:
To the 3-D view after fusion, the center for choosing face two is origin, and X-axis passes through the center of two, from Front sees to be positive direction from left to right;Y-axis is positive direction straight up;Z axis passes through head center outside, is from front to back pros To, the foundation of completion 3 d space coordinate system, then based on CANDIDE-3 models, establish three-dimensional face model;
The scanning of Pixel-level is carried out to the three-dimensional face model of foundation, obtains the coordinate position and gray scale of each pixel Value forms 3-D view textural characteristics, and obtain the color value of each pixel, the color value RGB by clustering method To represent.
In the step 5, extraction four-dimensional image information includes coordinate position, textural characteristics, color value and time.
The beneficial effects of the present invention are, four-dimensional faceform's database of the invention include using current settling time as The time shaft of reference time, when someone changes the four-dimensional faceform's database established, because of modification time and settling time pair Should not on, and forbid being changed, so four-dimensional faceform's database security higher there is provided time shaft.
Description of the drawings
Fig. 1 is the flow diagram of the method for building up of four-dimensional faceform's database in specific embodiment.
Specific embodiment
The present embodiment will be described with reference to Fig. 1, the method for building up of four-dimensional faceform's database described in present embodiment,
Step 1:Current time is taken to be used as with reference to amount, settling time axis;
Step 2:According to the facial image of input, space two-dimensional coordinate system is established, X-Y scheme is carried out to the facial image As information extraction and face characteristic are extracted;
In the step 2, according to the facial image of input, space two-dimensional coordinate system is established, the facial image is carried out Two-dimensional image information extracts and the method for face characteristic extraction includes:
The facial image of input is pre-processed, chooses the center of facial image two after pretreatment as origin, X Axis passes through the center of two, and horizontal is to the right positive direction, and Y-axis is straight up positive direction, completes building for space two-dimensional coordinate system It is vertical;
The scanning of Pixel-level is carried out to the two dimensional image after foundation, obtains the coordinate position and gray value of each pixel, Two dimensional image textural characteristics are formed, and obtain the color value of each pixel by clustering method, the color value is with RGB come table Show;
The division of face face structure is carried out to the two dimensional image after foundation;
Characteristics of image edge detection and enhancing are carried out to the two dimensional image after foundation, it, will according to the face structure after division Image is divided into each separate unit, then carries out feature extraction to each separate unit.
1 two-dimensional image information of table
Attribute Coordinate Texture Color
Value (X,Y) (U,V) (R,G,B)
In the step 2, being divided into for face face structure is carried out to the image after foundation:
Forehead, eyebrow, upper eyelid, eyelash, fissura palpebrae, commissura palpebrarum medialis area, association area, endocanthion, outer canthus, nose on the outside of eyelid Root, nose, bridge of the nose, nose bottom, nostril, nose pillar, the wing of nose, nasal surface ditch, labial surface ditch, nasolabial groove, infraorbital region zygomatic region, schistostoma, bicker, Lip is red, prolabium, lip bow, people midpoint, lip peak, lip pearl, philtrum ridge, buccal region, chin labial groove, gnathion, zygomatic region, Nie Mian areas, ear, Parotideomasseteric region, hair and beard.
The facial image of the input includes face direct picture, face orthogonal image and face side image.
The division of above-mentioned face face structure is by division methods medically, using drawing for this face face structure Point, then carry out feature extraction respectively, resolution higher, and then in recognition of face, no matter identified face which angle, all very It is easily identified, present embodiment sensitivity higher.
Step 3:Structure and the fusion of 3-D view are carried out according to the two-dimensional image information of acquisition and face characteristic;
The structure of 3-D view is Viola Face datections, base based on Adaboost algorithm with merging in present embodiment It is realized in the interpolation algorithm of CANDIDE-3 models three-dimensional modeling, the image filtering based on Sobel operators and non-characteristic point.It is described Method is all technical means commonly used by such a person skilled in the art;
Because the variation of frame can cause the picture of every frame to change, therefore in dynamic picture in the 3-D view of structure It can cause the background of picture or the spatial position of personage and characteristic value that a variation occurs, so needing to melt this series of images It closes, present embodiment is mainly using current integration technology, such as pyramid fusion or Wavelet Transform Fusion technology progress image Mixing operation.
Step 4:According to the 3-D view after fusion, 3 d space coordinate system is established, forms three-dimensional face model, extraction The three-dimensional image information of three-dimensional face model;
In the step 4, according to the 3-D view after fusion, 3 d space coordinate system is established, forms three-dimensional face mould Type, the method for extracting the three-dimensional image information of three-dimensional face model include:
To the 3-D view after fusion, the center for choosing face two is origin, and X-axis passes through the center of two, from Front sees to be positive direction from left to right;Y-axis is positive direction straight up;Z axis passes through head center outside, is from front to back pros To, the foundation of completion 3 d space coordinate system, then based on CANDIDE-3 models, establish three-dimensional face model;
The scanning of Pixel-level is carried out to the three-dimensional face model of foundation, obtains the coordinate position and gray scale of each pixel Value forms 3-D view textural characteristics, and obtain the color value of each pixel, the color value RGB by clustering method To represent.
2 three-dimensional image information of table
Attribute Coordinate Texture Color
Value (X,Y,Z) (U,V) (R,G,B)
Step 5:Each pixel of three-dimensional face model with the time of time shaft established is corresponded, forms four Faceform is tieed up, four-dimensional image information is extracted to four-dimensional faceform, is stored into database, forms four-dimensional faceform's data Library.
In the step 5, extraction four-dimensional image information includes coordinate position, textural characteristics, color value and time.
The relation schema of four-dimension faceform's database includes face space three-dimensional relation schema, time dimension relationship mould Formula and other characteristic relation patterns;
In the acquisition of information of threedimensional model, need to add in time dimension in each pixel, formed one it is four-dimensional Faceform, four-dimensional image information are as shown in table 3:
Table 3:Four-dimensional image information
Attribute Coordinate Texture Color Time
Value (X,Y,Z) (U,V) (R,G,B) T
It is that textural characteristics are described according to the matrix of the grey level histogram of pixel in present embodiment.

Claims (5)

1. a kind of method for building up of four-dimension faceform's database, which is characterized in that described method includes following steps:
Step 1:Current time is taken to be used as with reference to amount, settling time axis;
Step 2:According to the facial image of input, space two-dimensional coordinate system is established, two dimensional image letter is carried out to the facial image Breath extraction and face characteristic extraction;
Step 3:Structure and the fusion of 3-D view are carried out according to the two-dimensional image information of acquisition and face characteristic;
Step 4:According to the 3-D view after fusion, 3 d space coordinate system is established, forms three-dimensional face model, extraction is three-dimensional The three-dimensional image information of faceform;
Step 5:Each pixel of three-dimensional face model with the time of time shaft established is corresponded, forms four-dimensional people Face model extracts four-dimensional image information to four-dimensional faceform, is stored into database, forms four-dimensional faceform's database;
In the step 5, extraction four-dimensional image information includes coordinate position, textural characteristics, color value and time.
2. the method for building up of four-dimension faceform's database according to claim 1, which is characterized in that the step 2 In, according to the facial image of input, establish space two-dimensional coordinate system, to the facial image carry out two-dimensional image information extraction and The method of face characteristic extraction includes:
The facial image of input is pre-processed, the center for choosing facial image two after pre-processing is origin, and X-axis is worn The center of two is crossed, horizontal is to the right positive direction, and Y-axis is straight up positive direction, completes the foundation of space two-dimensional coordinate system;
The scanning of Pixel-level is carried out to the two dimensional image after foundation, the coordinate position and gray value of each pixel is obtained, passes through Clustering method forms two dimensional image textural characteristics, and obtains the color value of each pixel, and the color value is represented with RGB;
The division of face face structure is carried out to the two dimensional image after foundation;
Characteristics of image edge detection and enhancing are carried out to the two dimensional image after foundation, according to the face structure after division, by image Each separate unit is divided into, then feature extraction is carried out to each separate unit.
3. the method for building up of four-dimension faceform's database according to claim 2, which is characterized in that the step 2 In, being divided into for face face structure is carried out to the image after foundation:
Forehead, eyebrow, upper eyelid, eyelash, fissura palpebrae, commissura palpebrarum medialis area, association area, endocanthion, outer canthus, the nasion, nose on the outside of eyelid Point, bridge of the nose, nose bottom, nostril, nose pillar, the wing of nose, nasal surface ditch, labial surface ditch, nasolabial groove, infraorbital region zygomatic region, schistostoma, bicker, lip be red, Prolabium, lip bow, people midpoint, lip peak, lip pearl, philtrum ridge, buccal region, chin labial groove, gnathion, zygomatic region, Nie Mian areas, ear, the parotid gland Masseter area, hair and beard.
4. the method for building up of four-dimensional faceform's database according to claim 1 or 3, which is characterized in that the input Facial image include face direct picture, face orthogonal image and face side image.
5. the method for building up of four-dimension faceform's database according to claim 4, which is characterized in that the step 4 In, according to the 3-D view after fusion, 3 d space coordinate system is established, forms three-dimensional face model, extracts three-dimensional face model The method of three-dimensional image information include:
To the 3-D view after fusion, the center for choosing face two is origin, and X-axis passes through the center of two, from front See to be positive direction from left to right;Y-axis is positive direction straight up;Z axis passes through head center outside, is from front to back positive direction, The foundation of 3 d space coordinate system is completed, then based on CANDIDE-3 models, establishes three-dimensional face model;
The scanning of Pixel-level is carried out to the three-dimensional face model of foundation, the coordinate position and gray value of each pixel is obtained, leads to It crosses clustering method and forms 3-D view textural characteristics, and obtain the color value of each pixel, the color value is with RGB come table Show.
CN201410742423.0A 2014-12-08 2014-12-08 The method for building up of four-dimensional faceform's database Active CN104361131B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410742423.0A CN104361131B (en) 2014-12-08 2014-12-08 The method for building up of four-dimensional faceform's database

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410742423.0A CN104361131B (en) 2014-12-08 2014-12-08 The method for building up of four-dimensional faceform's database

Publications (2)

Publication Number Publication Date
CN104361131A CN104361131A (en) 2015-02-18
CN104361131B true CN104361131B (en) 2018-06-15

Family

ID=52528391

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410742423.0A Active CN104361131B (en) 2014-12-08 2014-12-08 The method for building up of four-dimensional faceform's database

Country Status (1)

Country Link
CN (1) CN104361131B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106485186B (en) * 2015-08-26 2020-02-18 阿里巴巴集团控股有限公司 Image feature extraction method and device, terminal equipment and system
WO2017064709A1 (en) * 2015-10-15 2017-04-20 P.C.O.A.Devices Ltd Image recognition-based dosage form dispensers
CN105989363B (en) * 2016-04-29 2017-04-12 李鑫 Establishing method for multi-angle face image library
CN108520230A (en) * 2018-04-04 2018-09-11 北京天目智联科技有限公司 A kind of 3D four-dimension hand images data identification method and equipment
CN109191393B (en) * 2018-08-16 2021-03-26 Oppo广东移动通信有限公司 Three-dimensional model-based beauty method
CN110658156B (en) * 2019-10-12 2022-03-11 安徽大学 Near infrared spectrum feature extraction method and device
CN113033254A (en) * 2019-12-24 2021-06-25 深圳市万普拉斯科技有限公司 Body appearance recognition method, device, terminal and computer readable storage medium
CN111260369A (en) * 2020-01-10 2020-06-09 深圳市五联云科技有限公司 Butt joint method of face brushing payment equipment and merchant cash register and payment equipment
CN112581520A (en) * 2021-01-29 2021-03-30 秒影工场(北京)科技有限公司 Facial shape expression model construction method based on frame continuous four-dimensional scanning

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7542624B1 (en) * 2005-06-08 2009-06-02 Sandia Corporation Window-based method for approximating the Hausdorff in three-dimensional range imagery
CN101916367A (en) * 2010-08-19 2010-12-15 西北工业大学 Three-dimensional face intrinsic attribute description method
CN104077804A (en) * 2014-06-09 2014-10-01 广州嘉崎智能科技有限公司 Method for constructing three-dimensional human face model based on multi-frame video image

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7542624B1 (en) * 2005-06-08 2009-06-02 Sandia Corporation Window-based method for approximating the Hausdorff in three-dimensional range imagery
CN101916367A (en) * 2010-08-19 2010-12-15 西北工业大学 Three-dimensional face intrinsic attribute description method
CN104077804A (en) * 2014-06-09 2014-10-01 广州嘉崎智能科技有限公司 Method for constructing three-dimensional human face model based on multi-frame video image

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于三维重构的人脸识别;徐华;《中国优秀硕士学位论文全文数据库信息科技辑》;20091115;第43页 *
计算机取证技术研究;徐少强;《中国优秀硕士学位论文全文数据库信息科技辑》;20051015;第34-48页 *

Also Published As

Publication number Publication date
CN104361131A (en) 2015-02-18

Similar Documents

Publication Publication Date Title
CN104361131B (en) The method for building up of four-dimensional faceform's database
CN108765273B (en) Virtual face-lifting method and device for face photographing
CN105046219B (en) A kind of face identification system
CN110309782B (en) Living body face detection method based on infrared and visible light binocular system
CN107316333B (en) A method of it automatically generates and day overflows portrait
TWI383325B (en) Face expressions identification
CN105205480B (en) Human-eye positioning method and system in a kind of complex scene
Sablatnig et al. Hierarchical classification of paintings using face-and brush stroke models
TWI394093B (en) An image synthesis method
CN106909875A (en) Face shape of face sorting technique and system
CN105956552B (en) A kind of face blacklist monitoring method
CN107330371A (en) Acquisition methods, device and the storage device of the countenance of 3D facial models
CN111046763B (en) Portrait cartoon method and device
Iga et al. A gender and age estimation system from face images
CN102054306B (en) Method and system for detecting pedestrian flow by adopting deformable two-dimensional curves
Singh et al. Face detection and eyes extraction using sobel edge detection and morphological operations
CN105447432A (en) Face anti-fake method based on local motion pattern
Wei et al. Head pose estimation using gabor eigenspace modeling
CN110688962B (en) Face image processing method, user equipment, storage medium and device
CN109685892A (en) A kind of quick 3D face building system and construction method
Sheu et al. Automatic generation of facial expression using triangular geometric deformation
CN105184273B (en) A kind of dynamic image front face reconstructing system and method based on ASM
CN104573628A (en) Three-dimensional face recognition method
CN109448093A (en) A kind of style image generation method and device
JP7107380B2 (en) Estimation device, estimation method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20210812

Address after: 100089 614, floor 6, No. 9, North Fourth Ring West Road, Haidian District, Beijing

Patentee after: Beijing jianyipeihong Technology Co.,Ltd.

Address before: 300110 1-1-505-1, Xindu building, southwest of the intersection of Weijin road and wandezhuang street, Nankai District, Tianjin

Patentee before: HUIJIAWANG (TIANJIN) TECHNOLOGY Co.,Ltd.

Effective date of registration: 20210812

Address after: 300110 1-1-505-1, Xindu building, southwest of the intersection of Weijin road and wandezhuang street, Nankai District, Tianjin

Patentee after: HUIJIAWANG (TIANJIN) TECHNOLOGY Co.,Ltd.

Address before: 150080 No. 74, Xuefu Road, Nangang District, Heilongjiang, Harbin

Patentee before: Heilongjiang University