KR20170029957A

KR20170029957A - Method for representing face using dna phenotyping, recording medium and device for performing the method

Info

Publication number: KR20170029957A
Application number: KR1020150127180A
Authority: KR
Inventors: 김익재; 이아림; 조정현
Original assignee: 한국과학기술연구원
Priority date: 2015-09-08
Filing date: 2015-09-08
Publication date: 2017-03-16

Abstract

The method for estimating a face using DNA information includes: modeling a correlation between a facial shape and single nucleotide polymorphism (SNP) information from facial image information and DNA information; Analyzing DNA of the obtained biological sample; Extracting SNP information from analysis information of the DNA; And estimating a face shape based on the SNP information. Accordingly, it is possible to estimate an objective and accurate face using a genetic material and create a montage.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a method for estimating a face using DNA information,

The present invention relates to a face estimation method using DNA information, a recording medium and an apparatus for performing the same, and more particularly, to a method and a device for modeling a relationship between a face feature and DNA information, And a recording medium and an apparatus for performing the method.

A montage for criminal face estimation is a method for resolving criminal cases. It identifies characteristics and similarities of suspects based on the memories of those who witnessed the faces of suspects, and applies various approaches to predict the faces of suspects .

The existing montage generation techniques are based on the eyewitness' s statement, and the human face is drawn directly by hand, or recently, the computer is used to access the parts or the overall impression to combine or synthesize the faces. All of these methods could be created only if a witness statement about the appearance of the montage object or a clue through the CCTV screen was given.

On the other hand, the use of DNA information in criminal investigations has been used only in DNA assessments to detect genuine criminals by comparing the DNA of suspects arrested and the DNA left on the scene of the crime. Therefore, there was a limit to utilizing DNA information in a situation where the suspect was not covered.

KR 10-2014-0059076 A

SUMMARY OF THE INVENTION Accordingly, the present invention has been made in view of the above problems, and it is an object of the present invention to provide a method for estimating a criminal's face using DNA information as a direct evidence of a suspect left on a crime scene.

It is another object of the present invention to provide a recording medium on which a computer program for performing a face estimation method using the DNA information is recorded.

It is still another object of the present invention to provide an apparatus for performing a face estimation method using the DNA information.

In order to achieve the object of the present invention, a method for estimating a face using DNA information according to an embodiment of the present invention includes: correlating face shape and SNP (single nucleotide polymorphism) information from face image information and DNA information Modeling; Analyzing DNA of the obtained biological sample; Extracting SNP information from analysis information of the DNA; And estimating the form of the offender's face based on the SNP information.

In an embodiment of the present invention, modeling the correlation between facial features and SNP information from the facial image information and DNA information may include: collecting facial image information and DNA information; Extracting a feature component related to a face shape from the face image information; Extracting SNP information related to the face type from the DNA information; And analyzing and modeling the correlation between the facial shape and the SNP information.

In the embodiment of the present invention, the step of analyzing DNA of the obtained biological sample may include extracting at least one of gender, race, and pedigree information from the DNA, and extracting at least one of sex, race, And estimating the face shape.

In an embodiment of the present invention, the method for estimating a face using DNA information may further include estimating an attribute value of each face part classified from the SNP information.

In an embodiment of the present invention, the method of estimating a face using the DNA information may further include applying a weight to an attribute value of the estimated face part in the initial face shape.

In an embodiment of the present invention, the method of estimating a face using the DNA information may further include a step of compensating a shape of a facial part estimated based on a witness statement or CCTV image information.

In the embodiment of the present invention, the criminal's face estimation method using the DNA information may further include the step of quantifying and providing the reliability of the estimated face shape.

According to another aspect of the present invention, there is provided a computer-readable storage medium storing a computer program for performing a method of estimating a criminal's face using DNA information.

According to another aspect of the present invention, there is provided an apparatus for estimating a criminal's face using DNA information, the apparatus comprising: means for detecting a facial shape and SNP (single nucleotide polymorphism) An offline part for modeling the correlation; A DNA analysis unit for analyzing the DNA of the obtained biological sample; An SNP extracting unit for extracting SNP information from analysis information of the DNA; And a face shape estimating unit for estimating a shape of a criminal's face based on the SNP information.

In an embodiment of the present invention, the off-line unit includes a collecting unit for collecting facial image information and DNA information; A face feature extraction unit for extracting a feature component related to a face shape from the face image information; An SNP analyzer for extracting SNP information related to a facial shape from the DNA information; And a modeling unit for analyzing and modeling the correlation between the facial shape and the SNP information.

In an embodiment of the present invention, the DNA analyzing unit may include a base estimating unit that extracts at least one of sex, race, and lineage information from the DNA, and estimates an initial face shape based on at least one of the sex, race, .

In an embodiment of the present invention, the face shape estimating unit may estimate an attribute value for each face part classified from the SNP information.

In an embodiment of the present invention, the face shape estimation unit may apply a weight to the estimated attribute values of the face parts in the initial face shape.

In an embodiment of the present invention, the face estimating apparatus using the DNA information may further include a complementary unit for supplementing a shape of a facial part estimated based on a witness statement or CCTV image information.

In an embodiment of the present invention, the face estimation apparatus using the DNA information may further include a reliability display unit for quantifying and providing reliability of the estimated face shape.

According to the method of estimating the face using the DNA information, unlike the method of the existing witness statement based on the montage, or the indirect approach to the suspect who creates the montage by referring to the image of the CCTV, , It can be said that it is a direct approach to create a montage by estimating the facial appearance by utilizing the biometric information of the suspect. By estimating the face with a fundamentally different approach to the existing montage creation method, it is possible to objectively create a montage that will give new clues to resolve the case, avoiding disadvantages such as a witness's misrepresentation or subjectively biased statement.

1 is a block diagram of a face estimation apparatus using DNA information according to an embodiment of the present invention.
2 is a block diagram of an online part of a face estimation apparatus using DNA information according to another embodiment of the present invention.
3 is a block diagram of an online part of a face estimation apparatus using DNA information according to another embodiment of the present invention.
4 is a block diagram of an online part of a face estimating apparatus using DNA information according to still another embodiment of the present invention.
5 is a flowchart of a face estimation method using DNA information according to an embodiment of the present invention.
FIG. 6 is a detailed flowchart of a step of modeling the correlation between facial shape and SNP information from the image information of the face and DNA information of FIG. 5.
Fig. 7 is an example of a classification criterion for an attribute of a facial region.
FIG. 8 is an example in which the eyebrows among the face regions are classified in stages.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

1 is a block diagram of a face estimation apparatus using DNA information according to an embodiment of the present invention.

The face estimating apparatus 10 using DNA information according to the present invention is a computer-based method for estimating a face based on genetic material left on the spot when a suspect is not given clue to a criminal face through a witness or a CCTV at a crime scene Creates a montage.

Referring to FIG. 1, an apparatus 10 according to the present invention includes an off-line unit 100 for modeling a correlation between face type and SNP (single nucleotide polymorphism) information from face image information and DNA information in an off- And an on-line unit 300 for estimating a face from a biological sample obtained on-site as an on-line process.

The offline unit 100 may include a collecting unit 110, a facial feature extracting unit 130, an SNP analyzing unit 150, and a modeling unit 170.

The collecting unit 110 collects facial image information and DNA information. Specifically, the collecting unit 110 may include a database for storing various facial images by race, age, region, and country, and a database for storing DNA information corresponding to the facial images.

The facial feature extraction unit 130 extracts a feature component related to the facial shape from the facial image information. Specifically, the facial shape is divided into regions, and the regions are classified according to the feature criteria. The attribute of the facial feature can be determined as shown in the example of FIG. 7, and each attribute value can be expressed step by step as shown in FIG. Here, it should be understood that the attribute value of the rendered face can be changed variably.

The SNP analyzer 150 extracts SNP information that affects facial features from the DNA information. A genetic change or mutation showing a difference in one nucleotide sequence (A, T, G, C) in a DNA sequence is called a SNP (single nucleotide polymorphism) and is referred to as a SNP. The location where two or more alleles that occur at a frequency of 1% or more occur in a population group is called a SNP. When alleles are present at a frequency of 5% or more, they are called common polymorphism. If they are classified as rare polymorphism.

SNPs are used to analyze DNA fingerprints because they show many variations in each individual. In the present invention, facial features are estimated through statistical analysis of SNP data based on SNPs affecting facial appearance.

The modeling unit 170 models the correlation through a statistical analysis between attribute values and SNP information of each face related to the facial features classified by the facial feature extracting unit 130. Modeling can be expressed as a relational expression between facial shape and SNP information.

When the correlation between the face type and the SNP information is modeled in the modeling unit 170, the face using the DNA information can be estimated from the biological sample input in real time on the online unit 300 as a subsequent online process.

1, the on-line unit 300 may include a DNA analysis unit 310, an SNP extraction unit 330, and a face shape estimation unit 350. [

The DNA analysis unit 310 analyzes the DNA of the obtained biological sample. At this time, it is possible to extract at least one of information such as sex, race, bloodline, etc. from the DNA. The SNP extracting unit 330 may extract SNP information from the DNA analysis information.

The face shape estimating unit 350 estimates the face shape of the montage based on the SNP information. That is, the facial shape estimating unit 350 inputs the SNP information extracted by the SNP extracting unit 330 to the analysis model of the correlation between the facial shape and the SNP information generated by the modeling unit 170, Can estimate the shape of the face by predicting which attribute value is associated with each attribute classified by the face feature extraction unit 130. [

Meanwhile, as shown in FIG. 2, the on-line unit 301 according to another embodiment may further include a base estimator 340 for estimating an initial face shape before estimating a face shape. In this case, the face shape estimating unit 350 may apply the weight to the estimated initial face, and add the shape of the face part.

The base estimator 340 may estimate an initial face shape based on at least one of sex, race, and pedigree information extracted by the DNA analyzer 310. [ Alternatively, the base estimator 340 may estimate an initial face shape from the SNP information.

The base estimator 340 can estimate various face types based on databases collected by many races and regions, and it can be updated according to environment change and time flow.

3, the on-line unit 303 according to another exemplary embodiment may further include a supplement unit 370 that compensates for the shape of the face part estimated based on the eyewitness's statement or the CCTV image information .

Accordingly, the face of the offender estimated using biometric information, which is direct evidence of the suspect, can be supplemented by indirect evidence such as a witness or a CCTV. In this case, even if the information of the eyewitness or the CCTV is incomplete, it can be used as a supplementary data of the montage generated according to the present invention, thereby increasing the accuracy of the montage.

As shown in FIG. 4, the on-line unit 305 according to another embodiment may further include a reliability indicator unit 390 for quantifying and providing reliability of the estimated face shape.

Accordingly, the user can recognize to what extent the estimated montage can be trusted according to the present invention, and can partially correct the low-reliability region.

The offline unit 100 and the on-line unit 300 may be implemented by software (application) for performing face estimation using DNA information, and the device 10 And the face information of the face of the user.

The device 10 may be a separate terminal or some module of the terminal. In addition, each of the off-line unit 100 and the on-line unit 300 may be formed of an integrated module or one or more modules. However, conversely, each configuration may be a separate module.

The device 10 may be mobile or stationary. The device 10 may be in the form of a server or an engine and may be a device, an apparatus, a terminal, a user equipment (UE), a mobile station (MS) a wireless device, a handheld device, and the like.

The device 10 may execute or produce various software based on an operating system (OS), i.e., a system. The operating system is a system program for allowing software to use the hardware of a device. The operating system includes a mobile computer operating system such as Android OS, iOS, Windows Mobile OS, Sea OS, Symbian OS, Blackberry OS, MAC, AIX, and HP-UX.

5 is a flowchart of a face estimation method using DNA information according to an embodiment of the present invention. FIG. 6 is a detailed flowchart of a step of modeling the correlation between facial shape and SNP information from the image information of the face and DNA information of FIG. 5.

The method of estimating a face using DNA information according to the present embodiment can be performed in substantially the same configuration as the apparatus 10 of FIG. Therefore, the same constituent elements as those of the apparatus 10 of FIG. 1 are denoted by the same reference numerals, and repeated description is omitted. In addition, the face estimation method using DNA information according to the present embodiment can be executed by software (application) for performing face estimation using DNA information.

The method for estimating a face using DNA information according to the present embodiment includes an offline step and an online step. In the off-line step, a step of extracting a feature component relating to a partial or total form of a facial image and a step of analyzing and modeling the correlation between sex, race, lineage, and SNP are performed. In the online stage, the SNP is analyzed through the DNA obtained from the actual field, and then the basic face image is first created through sex, race, and lineage, and the face is inferred based on the analyzed SNP to generate a montage. These steps summarize the relationship between facial features and DNA information, and allow them to infer the montage.

Referring to FIG. 5, the face estimation method using DNA information according to the present embodiment is a step of firstly taking an offline phase, and comparing the facial shape and SNP (single nucleotide polymorphism) information from the face image information and DNA information (Step S10).

The step of modeling the correlation between face image and SNP information from the face image information and the DNA information (step S10) will be described in detail with reference to FIG.

Referring to FIG. 6, the step of modeling the correlation between facial features and SNP information from the face image information and the DNA information (step S10) includes collecting facial image information and DNA information (step S11) Extracting SNP information related to the face type from the DNA information (step S13), and analyzing the correlation between the face type and the SNP information (step S13) And modeling (step S14).

Then, as an on-line step, DNA of the obtained biological sample is analyzed (step S30). In this case, the method may further include extracting at least one of information such as sex, race, and bloodline from the DNA, and estimating an initial face shape based on at least one of the information such as sex, race, and pedigree.

SNP information is extracted from the analysis information of the DNA (step S50). At this time, it may further include estimating an initial face shape from the SNP information (step S70).

Then, the face shape of the montage is estimated based on the SNP information (step S90). At this time, weights can be applied to the initial face shape by face region.

As another embodiment of the present invention, the method may further include a step of supplementing the shape of the facial region estimated based on the eyewitness's statement or the CCTV image information, and the reliability of the estimated facial region type may be quantified The method comprising the steps of:

Such a face estimation method using DNA information can be implemented in an application or in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination.

The program instructions recorded on the computer-readable recording medium may be ones that are specially designed and configured for the present invention and are known and available to those skilled in the art of computer software.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like.

Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the present invention as defined by the following claims. You will understand.

According to the present invention, even if there is no indirect evidence such as a witness or a CCTV using the biometric information, which is direct evidence of a suspect, a montage can be created by estimating the facial appearance. Therefore, it provides the possibility of effective application of montage in criminal investigation.

10: Facial estimation device using DNA information
100: Offline part
300, 301, 303, 305: On-line department
110: collecting section
130: Facial feature extraction unit
150: SNP analysis section
170: Modeling unit
310: DNA analysis section
330: SNP extracting unit
350: facial shape estimating unit
340:
370: Complementary part
390: Reliability indicator

Claims

Modeling the correlation between facial shape and single nucleotide polymorphism (SNP) information from facial image information and DNA information;
Analyzing DNA of the obtained biological sample;
Extracting SNP information from analysis information of the DNA; And
And estimating a face shape based on the SNP information.

2. The method of claim 1, wherein modeling the correlation between facial shape and SNP information from the facial image information and the DNA information comprises:
Collecting facial image information and DNA information;
Extracting a feature component related to a face shape from the face image information;
Extracting SNP information related to the face type from the DNA information; And
And analyzing and modeling the correlation between the facial shape and the SNP information.

The method of claim 1, wherein analyzing the DNA of the obtained biological sample comprises:
Extracting at least one of sex, race, and pedigree information from the DNA,
Further comprising the step of estimating an initial face shape based on at least one of the sex, race, and pedigree information.

The method of claim 3,
Further comprising the step of estimating an attribute value of each face part classified from the SNP information.

5. The method of claim 4,
And applying a weight to the estimated attribute value of the face part in the initial face shape.

The method according to claim 1,
Further comprising a step of compensating for the shape of the facial region estimated based on the eyewitness's statement or the CCTV image information.

The method according to claim 1,
Further comprising the step of quantifying and providing reliability for the estimated form of each facial feature.

A computer-readable recording medium on which a computer program is recorded, for carrying out a method for estimating a face using DNA information according to any one of claims 1 to 7.

An offline part for modeling the correlation between facial shape and single nucleotide polymorphism (SNP) information from facial image information and DNA information;
A DNA analysis unit for analyzing the DNA of the obtained biological sample;
An SNP extracting unit for extracting SNP information from analysis information of the DNA; And
And a face shape estimating unit for estimating a face shape based on the SNP information.

The apparatus according to claim 9, wherein the off-
A collection unit for collecting facial image information and DNA information;
A face feature extraction unit for extracting a feature component related to a face shape from the face image information;
An SNP analyzer for extracting SNP information related to a facial shape from the DNA information; And
And a modeling unit for analyzing and modeling the correlation between the facial shape and the SNP information.

10. The method of claim 9,
The DNA analysis unit extracts at least one of sex, race, and bloodline information from the DNA,
And a base estimator for estimating an initial face shape based on at least one of the sex, race, and pedigree information.

12. The apparatus according to claim 11,
And estimating an attribute value for each facial part classified from the SNP information.

13. The apparatus according to claim 12,
And applying a weight to the estimated attribute values of the facial parts in the initial facial shape.

10. The method of claim 9,
Further comprising a complementary unit for supplementing the face shape estimated based on the eyewitness's statement or the CCTV image information.

10. The method of claim 9,
And a reliability display unit for quantifying and providing reliability of the estimated face shape.