WO2012138004A1 - Fingerprint authentication device using pca, and method therefor - Google Patents

Fingerprint authentication device using pca, and method therefor Download PDF

Info

Publication number
WO2012138004A1
WO2012138004A1 PCT/KR2011/002524 KR2011002524W WO2012138004A1 WO 2012138004 A1 WO2012138004 A1 WO 2012138004A1 KR 2011002524 W KR2011002524 W KR 2011002524W WO 2012138004 A1 WO2012138004 A1 WO 2012138004A1
Authority
WO
WIPO (PCT)
Prior art keywords
fingerprint
authentication
image
unit
feature
Prior art date
Application number
PCT/KR2011/002524
Other languages
French (fr)
Korean (ko)
Inventor
채승훈
곽근창
서창호
정용화
반성범
Original Assignee
조선대학교산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 조선대학교산학협력단 filed Critical 조선대학교산학협력단
Publication of WO2012138004A1 publication Critical patent/WO2012138004A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1365Matching; Classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features

Definitions

  • the present invention relates to a fingerprint authentication device using PCA (Principal Component Analysis) and its authentication method. More specifically, by performing two fingerprint comparison processes using the fingerprint feature point and the image information of the fingerprint, combining the results of the two methods enables more accurate authentication, and by using the PCA to calculate the amount of computation required in the image comparison
  • PCA Principal Component Analysis
  • the present invention relates to a fingerprint authentication device and a method for reducing the real-time processing.
  • biometrics are integrated into computer systems.
  • the biggest feature of these biometrics is that there is no fear of loss, theft, forgetting, or duplication by external factors under any circumstances.
  • the advantage is that it can be built completely.
  • the user authentication technology using a fingerprint has been actively commercialized in recent years, and the user authentication using such a fingerprint has a merit that it is easy to access and carry by authenticating a user by using a unique characteristic of a person.
  • Various studies are underway and many developments are being made.
  • a user's fingerprint is typically registered in a security token such as a smart card or a USB token, and the user is authenticated by comparing the fingerprint with the fingerprint in the security token without leaking the registration fingerprint. If only the result is transmitted to the outside, it is more secure than a system that manages fingerprint data with a central database or a system that transmits registered fingerprint data to perform external fingerprint comparison from an external device. By blocking the can ensure the stability of the biological data that can cause a big problem in the outflow.
  • fingerprint authentication methods are classified into image-based fingerprint authentication methods and feature-based fingerprint authentication methods.
  • Feature-based fingerprint authentication is a universal method that consists of two processes: minutiae extraction and matching.
  • image processing techniques such as smoothing, separation of foreground and background areas, binarization, and thinning Apply the spatial features of the extracted feature points. That is, the feature-based fingerprint authentication method is a method of comparing an authentication fingerprint and a registration fingerprint by using a feature point, and a method of checking similarity between two feature points is mainly used.
  • the image-based fingerprint authentication method uses ridge information.
  • the overall directionality of the fingerprint image is applied by applying techniques such as Gaber filter, Fast Fourier Transform (FFT), slope, directional histogram, and projection. It is one of the classic ways of using information.
  • FFT Fast Fourier Transform
  • the entire fingerprint area is divided into small areas, the direction value of the ridges existing in the small areas is extracted to complete the directional map of the fingerprint, and the two directional maps are convolved to determine the degree of similarity. .
  • the ridge-based fingerprint authentication method requires a lot of storage space for storing the image because the entire fingerprint image is used, and the performance of the fingerprint authentication process is slow.
  • the present invention was devised to solve the above problems, and after the two fingerprint comparison process using the fingerprint feature point and the image information of the fingerprint to combine the results of the two methods to enable more accurate authentication, and also PCA It is an object of the present invention to provide a fingerprint authentication device and a method for reducing the amount of calculation required for image comparison to enable real-time processing.
  • Fingerprint authentication device for achieving the above object, the database unit for storing the registered fingerprint image;
  • a fingerprint image input unit configured to receive a user fingerprint image from a user;
  • a feature point based fingerprint matching unit extracting a feature point from the user fingerprint image inputted through the fingerprint image input unit and the registered fingerprint image stored in the database unit, and performing a feature point based fingerprint matching based on the extracted feature point;
  • a PCA-based fingerprint matching unit performing fingerprint matching based on a principal component analysis (PCA) method based on feature points extracted from the user fingerprint image and the registered fingerprint image;
  • an authentication performing unit configured to perform fingerprint authentication based on fingerprint matching by the feature-point based fingerprint matching unit and fingerprint matching by the PCA-based fingerprint matching unit.
  • PCA principal component analysis
  • the fingerprint authentication device may further include a similarity coupling unit that combines the similarity by the feature-based fingerprint matching unit and the similarity by the PCA-based fingerprint matching unit.
  • the authentication performing unit performs fingerprint authentication when the similarity combined by the similarity combining unit is equal to or greater than a set value.
  • the fingerprint authentication apparatus may further include a hash table generator for generating a geometric hash table by extracting a region of interest (RoI) for extracting image feature information after applying geometric hashing to a feature point of the user fingerprint image.
  • a hash table generator for generating a geometric hash table by extracting a region of interest (RoI) for extracting image feature information after applying geometric hashing to a feature point of the user fingerprint image.
  • the fingerprint authentication apparatus may further include a feature point corrector configured to correct an authentication fingerprint by the authentication performer and a feature point of the registered fingerprint based on at least one of the detected position and the direction difference.
  • a feature point corrector configured to correct an authentication fingerprint by the authentication performer and a feature point of the registered fingerprint based on at least one of the detected position and the direction difference.
  • the fingerprint authentication method storing the registered fingerprint image; Receiving a user fingerprint image from a user; Extracting a feature point from the user fingerprint image input through the fingerprint image input unit and the registered fingerprint image stored in the database unit, and performing feature-point based fingerprint matching based on the extracted feature point; Performing fingerprint matching by a principal component analysis (PCA) method based on feature points extracted from the user fingerprint image and the registered fingerprint image; And performing fingerprint authentication based on fingerprint matching by the feature-point based fingerprint matching performing step and fingerprint matching by the PCA-based fingerprint matching performing step.
  • PCA principal component analysis
  • the fingerprint authentication method may further include combining the similarity by the feature-point based fingerprint matching step and the similarity by the PCA-based fingerprint matching step.
  • the fingerprint authentication performing step may perform fingerprint authentication when the similarity combined by the similarity combining step is equal to or greater than a set value.
  • the fingerprint authentication method may generate a geometric hash table by extracting a RoI for extracting image feature information after applying geometric hashing to a feature point of the user fingerprint image.
  • the fingerprint authentication method may correct feature points of the authentication fingerprint and the registration fingerprint by the authentication performing step based on at least one of the detected position and the direction difference.
  • FIG. 1 is a view schematically showing a fingerprint authentication device according to an embodiment of the present invention.
  • 2 is a diagram showing an example by bin accumulation as an example of feature point correction.
  • 3 is a diagram illustrating an example of applying a geometric hashing method to feature points.
  • FIG. 4 is a diagram illustrating an example of extracting RoI from a fingerprint.
  • FIG. 5 is a diagram illustrating an example of generating a RoI geometric hash table without requiring a correction process by using a hashing hash on a single fingerprint.
  • FIG. 6 is a flowchart illustrating the generation and excess of RoI geometric hash table in a fingerprint image.
  • FIG. 7 is a flowchart illustrating a fingerprint authentication method according to the present invention.
  • the fingerprint authentication apparatus 100 includes a database unit 110, a fingerprint image input unit 120, a feature point based fingerprint matching unit 130, a PCA based fingerprint matching unit 140, an authentication performing unit 150, The similarity combiner 160, a hash table generator 170, and a feature point corrector 180 may be included.
  • the database unit 110 stores the registered fingerprint image.
  • the database unit 110 may store the feature point information analyzed with respect to the registered fingerprint image and the image feature information of the fingerprint for PCA (Principal Component Analysis).
  • Principal component analysis in statistics is one of the techniques for analyzing data sets. Principal component analysis shows that when the data is mapped onto one axis, the axis with the largest variance comes to the first coordinate axis, the second largest axis comes second, the third largest axis comes third, and so on. Linearly transform the data into a new coordinate system. Thus, various applications are possible by placing the "most important" component of the data on each axis.
  • KLT Karhunen-Loeve transform
  • Harold Hotelling the Hotelling transform
  • a ridge which is a continuous ridge, an end that breaks in the middle, and a bifurcation where two or more ridges meet, which are called minutiae. do.
  • an average image of a region of interest (RoI) of a fingerprint and a collection of eigenvalues and eigenvectors, which are representable values and vectors of the RoI images are called image feature information.
  • RoI generally represents a data sample selected for another additional purpose within a series of data sets with a particular purpose.
  • a region of interest (RoI) may be designated for a fingerprint image, and filtering may be applied only to that region.
  • the RoI extracts some features from the input image to form an initial specific map, and then performs spatial feature analysis method that performs coordinate-centered calculation based on azimuth with respect to the configured specific map, and the current frame (t) and the previous one.
  • a temporal feature analysis method may be used to extract a motion vector from the image sequence using a block matching technique.
  • the database unit 110 analyzes the location and number of feature points on the fingerprint image obtained from the registered subscriber, extracts the image feature information, and then extracts the extracted image feature information from the database. Save it.
  • the fingerprint image input unit 120 receives a user fingerprint image from a user for authentication.
  • the feature point-based fingerprint matching unit 130 extracts the feature point and the image feature information from the fingerprint image of the user for authentication input through the fingerprint image input unit 120 and the registered fingerprint image stored in the database unit 110, and extracts the extracted feature point. A feature-based fingerprint matching is performed based on.
  • the fingerprint feature information used in the fingerprint recognition system uses an ending point through which the ridge passes and a bifurcation point where one ridge is divided in the fingerprint image.
  • One feature point extracted from the fingerprint image may have a coordinate of the feature point and type information of the feature point and may be represented by (x, y, ⁇ , type).
  • the coordinate value of the feature point is translated and the direction is rotated. In this way, all the feature points extracted from the two fingerprints can be identified based on the difference in position and direction, and all pairs of feature points determined to be similar can be found, or scores can be obtained based on the similarity to determine whether the threshold is greater than or equal to the threshold.
  • the feature point corrector 130 may be configured to calculate the position, direction, distance, and angle of each feature point extracted from the registered fingerprint image stored in the database unit 110 and the fingerprint image of the user input through the fingerprint image input unit 120. Correct the difference for at least one.
  • the feature point-based fingerprint matching unit 130 extracts feature point information for authentication from the user fingerprint image input through the fingerprint image input unit 120, and then stores the feature point information on the registered fingerprint image previously stored and registered in the database unit 110. Read and load the data into a memory to compare and analyze the registered feature information and the feature information of the user fingerprint image.
  • the feature point corrector 180 extracts a difference of at least one of a position, a direction, a distance, and an angle between the feature point information of the registered fingerprint loaded in the memory and the feature point information of the authentication fingerprint to correct the feature point. As shown in FIG.
  • an area for accumulating the difference between the position, the direction, and the distance between the two feature points may be set, and the positions bx1, by1, and the direction unit of each bin may be determined.
  • the unit of the initial bin with respect to the position and the direction may be set to be large and then reduced to the minimum unit while changing sequentially.
  • Range_X1 is associated with a detectable positional shift in the X direction to the first area of the X axis
  • Range_X2 is set to the area around the maximum bin at the first stage as the second area of the X axis
  • Range_Y1 Is associated with the detectable positional movement in the Y direction to the first region of the Y axis
  • Range_Y2 is the second region of the Y axis, set as the region around the maximum bin at the first stage.
  • bx1 is the first unit of the X-axis
  • bx2 is the second unit of the X-axis, smaller than bx1
  • by1 is the first unit of the Y-axis
  • by2 is the second unit of the Y-axis, which is smaller than by1.
  • ⁇ X is the amount of change in the X-axis of the pair of feature points
  • ⁇ Y is the amount of change in the Y-axis of the pair of feature points
  • B means a bin having a maximum value.
  • a bin means an area of each feature point expressed in binary.
  • the direction difference can be measured. In this case, by checking whether the direction difference between the two feature points is out of the allowable range, if the deviation is not out of the allowable range, the position difference and the distance difference between the two feature points may be measured.
  • the level of the specific bin of the set area corresponding to the obtained position, direction and distance difference is raised or accumulated, and all the feature points, ie, the direction.
  • the bin having the maximum level is obtained, and whether the unit for the position, direction, and distance of the bin is the minimum unit is determined. If the unit is the minimum unit, the difference in the position, direction, and distance corresponding to the maximum bin value, that is, the position, direction, and distance difference corresponding to B shown in FIG. 2B may be extracted.
  • the feature point corrector corrects the feature points of the authentication fingerprint and the enrolled fingerprint based on the detected position, direction, and distance difference, and then measures the similarity between the two corrected feature points, if the measured similarity is greater than the preset threshold. It is determined that this is the same, and the authentication process of the user is performed according to the determined result.
  • the PCA-based fingerprint matching unit 140 performs fingerprint matching by a principal component analysis (PCA) method based on feature points extracted from a user fingerprint image and a registered fingerprint image.
  • the fingerprint matching method based on principal component analysis calculates the eigenvalues and eigenvectors from the covariance matrix obtained by converting them into one-dimensional fingerprint vectors and calculates the eigenvectors corresponding to the eigenvalues arranged in size order.
  • the calculated eigenvectors are basis vectors representing one fingerprint image.
  • the fingerprint is recognized by comparing the feature vectors obtained by linearly transforming the input fingerprint image with the feature vectors obtained in advance.
  • ICA independent component analysis
  • Kemel PCA Kemel PCA based methods.
  • both ICA and Kemel PCA methods have a disadvantage in that the computational amount is larger than that of the PCA method.
  • Geometric hashing is a method of pre-forming a feature point table in which correction is completed by applying all correction values that can be generated by the extracted feature points as shown in FIG. 4.
  • the hash table generator 170 may apply the geometric hashing to the feature points of the user fingerprint image and then extract the RoI for extracting the image feature information to generate the geometric hash table.
  • the corrected feature point table is prepared in advance, fingerprint authentication is possible by only comparing the feature point tables without additional correction process.
  • RoI extraction for image feature information extraction is performed (340). Fingerprints are rotated and moved each time, so you cannot always get the same image. Therefore, as shown in FIG. 5, it is preferable to extract RoI using only a partial image around a feature point.
  • the RoI is extracted 340 using the corrected feature point through the geometric hashing 330, the same RoI is extracted from the image having the same feature point.
  • the geometric hashing table 330 and RoI extraction 340 generate a geometric hashing table as shown in FIG. 6.
  • n feature points are extracted from one fingerprint, the feature has n correction values in the geometric hashing process 330. Therefore, the n number of tables are generated RoI n.
  • the geometric hashing table as shown in FIG. 6 is applied to the PCA technique which is generally used for pattern recognition, an average image, an eigenvalue, and an eigenvector, which are image feature information, are generated. Since the PCA has a characteristic of converting high-dimensional information into low-dimensional information, the data size of the image characteristic information can be reduced.
  • the image feature jumbo generated in this manner is stored in the database unit 110 and fingerprint matching is performed by the PCA-based fingerprint matching unit 140 on the user fingerprint image input through the fingerprint image input unit 120.
  • the authentication performing unit 150 performs fingerprint authentication by two fingerprint comparison processes based on the fingerprint matching by the feature-based fingerprint matching unit 130 and the fingerprint matching by the PCA-based fingerprint matching unit 140.
  • the similarity of the fingerprints extracted from the feature point-based fingerprint matching unit 130 and the PCA-based fingerprint matching unit 140 may be combined in the similarity combining unit 160 to perform fingerprint authentication in the authentication performing unit 150.
  • the authentication performing unit 150 may be implemented to perform fingerprint authentication when the similarity combined by the similarity combining unit 160 is equal to or greater than a set value.
  • the similarity combiner 160 sets the similarity range of the feature-based fingerprint matching by the feature-based fingerprint matching unit 130 and the similarity range of the fingerprint matching by the PCA-based fingerprint matching unit 140, respectively.
  • Fingerprint matching may be performed by the authentication performing unit 150 by selecting a fingerprint matching that is included in the range of similarity by the fingerprint matching method.
  • the similarity range of the fingerprint registration by the feature-based fingerprint matching unit 130 is set to 90% to 100%, and the similarity range of the fingerprint matching by the PCA-based fingerprint matching unit 140 is 80% to 100%.
  • fingerprint authentication may be performed only for fingerprint matching having a similarity of 90% to 100%.
  • the similarity of the fingerprint matching determined by the feature point-based fingerprint matching unit 130 and the similarity of the fingerprint matching determined by the PCA-based fingerprint matching unit 140 may be used as judgment data for performing fingerprint authentication. have.
  • the feature-based fingerprint matching unit 130 when it is determined that the same fingerprint by the fingerprint matching is 1, if the similarity of the fingerprint authentication performance criteria by the authentication performing unit 150 is 1.8 to 2.2, the feature-based fingerprint matching unit 130 When the similarity determined by 0.9 and the similarity by the PCA-based fingerprint matching unit 140 are 0.93, the sum of the similarities by the two fingerprint matching methods is 1.83, so that fingerprint authentication by the authentication performing unit 150 may be performed. have.
  • FIG. 7 is a flowchart illustrating a fingerprint authentication method according to the present invention.
  • the database unit 110 stores a registered fingerprint image (S710).
  • the database unit 110 may store the feature point information analyzed with respect to the registered fingerprint image and the image feature information of the fingerprint for PCA (Principal Component Analysis).
  • the fingerprint image input unit 120 receives a user fingerprint image from the user for authentication (S720).
  • the feature point-based fingerprint matching unit 130 extracts the feature point and the image feature information from the fingerprint image of the user for authentication inputted through the fingerprint image input unit 120 and the registered fingerprint image stored in the database unit 110, and extracts the extracted feature points. Based on the feature point based fingerprint matching is performed (S730).
  • the PCA-based fingerprint matching unit 140 performs fingerprint matching by a principal component analysis (PCA) method based on the feature points extracted from the user fingerprint image and the registered fingerprint image (S740).
  • PCA principal component analysis
  • the similarity combiner 160 combines the similarity by the feature-based fingerprint matching unit 130 and the similarity by the PCA-based fingerprint matching unit 140 (S750).
  • the similarity combining unit 160 sets the similarity range of the feature-based fingerprint matching by the feature-based fingerprint matching unit 130 and the similarity range of the fingerprint matching by the PCA-based fingerprint matching unit 140, respectively.
  • the similarity range of the fingerprint registration by the feature-based fingerprint matching unit 130 is set to 90% to 100%
  • the similarity range of the fingerprint matching by the PCA-based fingerprint matching unit 140 is 80% to 100%. In this case, fingerprint authentication may be performed only for fingerprint matching having a similarity of 90% to 100%.
  • the similarity of the fingerprint matching determined by the feature point-based fingerprint matching unit 130 and the similarity of the fingerprint matching determined by the PCA-based fingerprint matching unit 140 may be used as judgment data for performing fingerprint authentication. have. For example, if it is determined that 1 is the same fingerprint by fingerprint matching, the similarity of the fingerprint authentication performance criteria by the authentication performing unit 150 is 1.8 to 2.2, the feature-based fingerprint matching unit 130 When the similarity determined by 0.9 and the similarity by the PCA-based fingerprint matching unit 140 are 0.93, the sum of the similarities by the two fingerprint matching methods is 1.83, so that fingerprint authentication by the authentication performing unit 150 may be performed. have.
  • the authentication performing unit 150 performs fingerprint authentication based on the fingerprint matching by the feature-based fingerprint matching unit 130 and the fingerprint matching by the PCA-based fingerprint matching unit 140.
  • the authentication performing unit 150 may be implemented to perform fingerprint authentication when the similarity combined by the similarity combining unit 160 is equal to or greater than a set value. That is, it is determined that the user fingerprint image and the registered fingerprint image are matched by the fingerprint matching by the feature point-based fingerprint matching unit 130 or the fingerprint matching by the PCA-based fingerprint matching unit 140, or the similarity coupling unit 160. It can be implemented to perform the fingerprint authentication when the similarity combined by the similarity within the error range with respect to the reference value.
  • all elements constituting the embodiments of the present invention are described as being combined or operating in combination, but the present invention is not necessarily limited to these embodiments.
  • all of the components may be selectively operated in combination with one or more.
  • each or some of the components of the program modules are selectively combined to perform some or all of the functions combined in one or a plurality of hardware It may be implemented as a computer program having a.
  • such a computer program may be stored in a computer readable medium such as a USB memory, a CD disk, a flash memory, and the like, and read and executed by a computer, thereby implementing embodiments of the present invention.
  • the storage medium of the computer program may include a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The present invention relates to a fingerprint authentication device, and to a fingerprint authentication method therefor. The fingerprint authentication device according to the present invention includes: a database unit for storing a registered fingerprint image; a unit for inputting a fingerprint image for receiving, from a user, an image of a fingerprint of the user; a feature-based fingerprint-matching unit for extracting a feature from the image of the fingerprint of the user inputted through the unit for inputting a fingerprint image and the registered fingerprint image stored in the database unit, and performing a feature-based fingerprint-matching operation on the basis of the extracted feature; a principal component analysis (PCA)-based fingerprint-matching unit for performing a fingerprint-matching operation through a PCA method on the basis of the feature extracted from the image of the fingerprint of the user and the registered fingerprint image; and an authenticating unit for performing a fingerprint authentication operation on the basis of the fingerprint-matching operation performed by the feature-based fingerprint-matching unit and the fingerprint-matching operation performed by the PCA-based fingerprint-matching unit.

Description

피씨에이를 이용한 지문인증 장치 및 그 방법Fingerprint authentication device using PCA and its method
본 발명은 PCA(Principal Component Analysis)를 이용한 지문인증 장치 및 그 인증방법에 관한 것이다. 보다 상세하게는, 지문 특징점 및 지문의 영상정보를 이용하여 두 번의 지문비교 과정을 거친 후 두 방법의 결과를 결합함으로써 보다 정확한 인증이 가능하도록 하며, 또한 PCA를 이용함으로써 영상 비교에서 요구되는 계산량을 감소시켜 실시간 처리가 가능하도록 하는 지문인증 장치 및 그 방법에 관한 것이다.The present invention relates to a fingerprint authentication device using PCA (Principal Component Analysis) and its authentication method. More specifically, by performing two fingerprint comparison processes using the fingerprint feature point and the image information of the fingerprint, combining the results of the two methods enables more accurate authentication, and by using the PCA to calculate the amount of computation required in the image comparison The present invention relates to a fingerprint authentication device and a method for reducing the real-time processing.
최근, 컴퓨터 시스템에 생체인식을 접목하는 시도가 증가하는 추세이다. 이러한 생체인식에서 가장 큰 특성은 어떠한 경우에도 외부 요인에 의한 분실, 도난, 망각, 복제의 염려가 없다는 것이며, 이러한 기법을 사용할 경우 보안 및 침해를 누가 하였는지 추적이 가능해지는 등 감사(audit) 기능이 완벽하게 구축될 수 있다는 장점이 있다.Recently, attempts have been made to incorporate biometrics into computer systems. The biggest feature of these biometrics is that there is no fear of loss, theft, forgetting, or duplication by external factors under any circumstances. The advantage is that it can be built completely.
특히, 지문을 이용한 사용자 인증기술은 최근 가장 활발히 상용화가 이뤄지고 있으며, 이와 같은 지문을 이용한 사용자 인증은 사람이 가지는 고유한 특징을 이용하여 사용자를 인증함으로써 접근 및 휴대가 용이하다는 장점을 가지기 때문에, 실제 다양한 연구가 진행되고 있고 또한 많은 발전을 거듭하고 있다.In particular, the user authentication technology using a fingerprint has been actively commercialized in recent years, and the user authentication using such a fingerprint has a merit that it is easy to access and carry by authenticating a user by using a unique characteristic of a person. Various studies are underway and many developments are being made.
지문을 이용한 인증기술의 경우, 통상적으로 스마트 카드, USB 토큰 등 보안 토큰 내에 사용자의 지문을 등록한 후, 등록 지문의 외부유출 없이 보안토큰 내에서 인증 지문과 등록 지문 간의 비교를 통해 사용자 인증을 수행하며 그 결과만을 외부로 전송하면, 중앙 데이터베이스를 두어 지문 데이터를 관리하는 시스템이나 지문 비교를 외부 장치에서 수행하기 위해 등록된 지문 데이터를 외부로 전송하는 시스템에 비하여 보안성이 뛰어나며, 생체 데이터의 외부 유출을 차단함으로써 외부유출시 큰 문제를 야기할 수 있는 생체 데이터의 안정성을 확보할 수 있다.In the case of authentication technology using a fingerprint, a user's fingerprint is typically registered in a security token such as a smart card or a USB token, and the user is authenticated by comparing the fingerprint with the fingerprint in the security token without leaking the registration fingerprint. If only the result is transmitted to the outside, it is more secure than a system that manages fingerprint data with a central database or a system that transmits registered fingerprint data to perform external fingerprint comparison from an external device. By blocking the can ensure the stability of the biological data that can cause a big problem in the outflow.
일반적으로 지문인증 방법은 영상 기반의 지문인증 방법과 특징 기반의 지문인증 방법으로 구분된다. 특징 기반의 지문인증 방법은 크게 특징 추출(minutiae extraction)과 정합(matching)의 두 과정으로 이루어지는 보편적인 방법으로서, 평활화, 전경과 배경 영역의 분리, 이진화, 및 세선화 등의 여러 가지 영상처리 기법을 적용하여 추출된 특징점들의 공간적인 특징을 이용한다. 즉, 특징 기반의 지문인증 방법은 특징점을 이용하여 인증 지문과 등록 지문을 비교하는 방법으로서, 두 특징점들 사이의 유사성을 확인하는 방법이 주를 이룬다. In general, fingerprint authentication methods are classified into image-based fingerprint authentication methods and feature-based fingerprint authentication methods. Feature-based fingerprint authentication is a universal method that consists of two processes: minutiae extraction and matching. Various image processing techniques such as smoothing, separation of foreground and background areas, binarization, and thinning Apply the spatial features of the extracted feature points. That is, the feature-based fingerprint authentication method is a method of comparing an authentication fingerprint and a registration fingerprint by using a feature point, and a method of checking similarity between two feature points is mainly used.
영상 기반의 지문인증 방법은 융선 정보를 이용한 방법으로서, 가버 필터(Gaber filter), 고속 푸리에 변환(FFT: Fast Fourier Transform), 기울기, 방향성 히스토그램, 및 투영 등의 기법을 적용하여 지문 영상의 전체적인 방향성 정보를 이용하는 고전적인 방법 중의 하나이다. 일반적인 융선 기반의 지문인증 방법은, 지문 전체 영역을 작은 영역으로 분할하고, 작은 영역 내에 존재하는 융선의 방향값을 추출하여 지문의 방향성 지도를 완성하며, 두 방향성 지도를 컨벌루션하여 유사 정도를 판정한다.The image-based fingerprint authentication method uses ridge information. The overall directionality of the fingerprint image is applied by applying techniques such as Gaber filter, Fast Fourier Transform (FFT), slope, directional histogram, and projection. It is one of the classic ways of using information. In a typical ridge-based fingerprint authentication method, the entire fingerprint area is divided into small areas, the direction value of the ridges existing in the small areas is extracted to complete the directional map of the fingerprint, and the two directional maps are convolved to determine the degree of similarity. .
그런데, 특징 기반의 지문인증 방법의 경우, 소실된 특징점으로 인하여 본인 지문에 대한 잘못된 거부가 발생할 수 있으며, 뿐만 아니라 소실 및 잘못 추출된 특징점으로 인하여 서로 다른 두 지문에서 추출된 특징점 분포가 유사하게 나타날 수도 있어 이로 인해 타인 지문에 대한 오인증이 발생할 수도 있기 때문에, FAR 등의 인식 성능에 한계가 있다는 문제점이 있다. However, in the case of the feature-based fingerprint authentication method, false rejection of a fingerprint may occur due to a missing feature point, as well as a feature point distribution extracted from two different fingerprints similarly due to the missing and incorrectly extracted feature point. Since this may cause a wrong authentication for another fingerprint, there is a problem that there is a limit in the recognition performance, such as FAR.
또한, 융선 기반의 지문인증 방법은, 지문 영상 전체를 이용하기 때문에 영상의 저장을 위해 저장공간이 많이 필요하며, 지문 인증과정의 수행속도가 느리다는 문제점이 있다.In addition, the ridge-based fingerprint authentication method requires a lot of storage space for storing the image because the entire fingerprint image is used, and the performance of the fingerprint authentication process is slow.
본 발명은 상기와 같은 문제점을 해결하기 위하여 창안된 것으로서, 지문 특징점 및 지문의 영상정보를 이용하여 두 번의 지문비교 과정을 거친 후 두 방법의 결과를 결합함으로써 보다 정확한 인증이 가능하도록 하며, 또한 PCA를 이용함으로써 영상 비교에서 요구되는 계산량을 감소시켜 실시간 처리가 가능하도록 하는 지문인증 장치 및 그 방법을 제공하는 것을 목적으로 한다.The present invention was devised to solve the above problems, and after the two fingerprint comparison process using the fingerprint feature point and the image information of the fingerprint to combine the results of the two methods to enable more accurate authentication, and also PCA It is an object of the present invention to provide a fingerprint authentication device and a method for reducing the amount of calculation required for image comparison to enable real-time processing.
상기의 목적을 달성하기 위한 본 발명에 따른 지문인증 장치는, 등록 지문 영상을 저장하는 데이터베이스부; 사용자로부터 사용자 지문 영상을 입력받는 지문 영상 입력부; 상기 지문 영상 입력부를 통해 입력된 상기 사용자 지문 영상과 상기 데이터베이스부에 저장된 상기 등록 지문 영상으로부터 특징점을 추출하며, 추출된 상기 특징점에 기초하여 특징점 기반 지문정합을 수행하는 특징점 기반 지문 정합부; 상기 사용자 지문 영상 및 상기 등록 지문 영상으로부터 추출된 특징점에 기초하여 주성분 분석(PCA: Principal Component Analysis) 방법에 의한 지문정합을 수행하는 PCA 기반 지문 정합부; 및 상기 특징점 기반 지문 정합부에 의한 지문정합 및 상기 PCA 기반 지문 정합부에 의한 지문정합에 기초하여 지문인증을 수행하는 인증 수행부를 포함하는 것을 특징으로 한다.Fingerprint authentication device according to the present invention for achieving the above object, the database unit for storing the registered fingerprint image; A fingerprint image input unit configured to receive a user fingerprint image from a user; A feature point based fingerprint matching unit extracting a feature point from the user fingerprint image inputted through the fingerprint image input unit and the registered fingerprint image stored in the database unit, and performing a feature point based fingerprint matching based on the extracted feature point; A PCA-based fingerprint matching unit performing fingerprint matching based on a principal component analysis (PCA) method based on feature points extracted from the user fingerprint image and the registered fingerprint image; And an authentication performing unit configured to perform fingerprint authentication based on fingerprint matching by the feature-point based fingerprint matching unit and fingerprint matching by the PCA-based fingerprint matching unit.
상기의 지문인증 장치는, 상기 특징점 기반 지문 정합부에 의한 유사도 및 상기 PCA 기반 지문 정합부에 의한 유사도를 결합하는 유사도 결합부를 더 포함할 수 있다. 이 경우, 상기 인증 수행부는 상기 유사도 결합부에 의해 결합된 유사도가 설정된 값 이상인 경우에 지문인증을 수행한다.The fingerprint authentication device may further include a similarity coupling unit that combines the similarity by the feature-based fingerprint matching unit and the similarity by the PCA-based fingerprint matching unit. In this case, the authentication performing unit performs fingerprint authentication when the similarity combined by the similarity combining unit is equal to or greater than a set value.
상기의 지문인증 장치는, 상기 사용자 지문 영상의 특징점에 대한 기하학적 해싱을 적용한 후 영상 특징정보의 추출을 위한 RoI(Region of Interest)를 추출하여 기하학적 해시 테이블을 생성하는 해시 테이블 생성부를 더 포함할 수 있다.The fingerprint authentication apparatus may further include a hash table generator for generating a geometric hash table by extracting a region of interest (RoI) for extracting image feature information after applying geometric hashing to a feature point of the user fingerprint image. have.
상기의 지문인증 장치는, 검출된 위치, 방향 차 중의 적어도 하나에 기초하여 상기 인증 수행부에 의한 인증 지문과 상기 등록 지문의 특징점을 보정하는 특징점 보정부를 더 포함할 수도 있다.The fingerprint authentication apparatus may further include a feature point corrector configured to correct an authentication fingerprint by the authentication performer and a feature point of the registered fingerprint based on at least one of the detected position and the direction difference.
한편, 본 발명에 따른 지문인증 방법은, 등록 지문 영상을 저장하는 단계; 사용자로부터 사용자 지문 영상을 입력받는 단계; 상기 지문 영상 입력부를 통해 입력된 상기 사용자 지문 영상과 상기 데이터베이스부에 저장된 상기 등록 지문 영상으로부터 특징점을 추출하며, 추출된 상기 특징점에 기초하여 특징점 기반 지문정합을 수행하는 단계; 상기 사용자 지문 영상 및 상기 등록 지문 영상으로부터 추출된 특징점에 기초하여 주성분 분석(PCA: Principal Component Analysis) 방법에 의한 지문정합을 수행하는 단계; 및 상기 특징점 기반 지문 정합 수행단계에 의한 지문정합 및 상기 PCA 기반 지문 정합 수행단계에 의한 지문정합에 기초하여 지문인증을 수행하는 단계를 포함하는 것을 특징으로 한다.On the other hand, the fingerprint authentication method according to the invention, storing the registered fingerprint image; Receiving a user fingerprint image from a user; Extracting a feature point from the user fingerprint image input through the fingerprint image input unit and the registered fingerprint image stored in the database unit, and performing feature-point based fingerprint matching based on the extracted feature point; Performing fingerprint matching by a principal component analysis (PCA) method based on feature points extracted from the user fingerprint image and the registered fingerprint image; And performing fingerprint authentication based on fingerprint matching by the feature-point based fingerprint matching performing step and fingerprint matching by the PCA-based fingerprint matching performing step.
상기의 지문인증 방법은, 상기 특징점 기반 지문 정합 수행단계에 의한 유사도 및 상기 PCA 기반 지문 정합 수행단계에 의한 유사도를 결합하는 단계를 더 포함할 수 있다. 이 경우, 상기 지문인증 수행단계는 상기 유사도 결합 단계에 의해 결합된 유사도가 설정된 값 이상인 경우에 지문인증을 수행할 수 있다.The fingerprint authentication method may further include combining the similarity by the feature-point based fingerprint matching step and the similarity by the PCA-based fingerprint matching step. In this case, the fingerprint authentication performing step may perform fingerprint authentication when the similarity combined by the similarity combining step is equal to or greater than a set value.
상기의 지문인증 방법은, 상기 사용자 지문 영상의 특징점에 대한 기하학적 해싱을 적용한 후 영상 특징정보의 추출을 위한 RoI를 추출하여 기하학적 해시 테이블을 생성할 수 있다.The fingerprint authentication method may generate a geometric hash table by extracting a RoI for extracting image feature information after applying geometric hashing to a feature point of the user fingerprint image.
상기의 지문인증 방법은, 검출된 위치, 방향 차 중의 적어도 하나에 기초하여 상기 인증 수행 단계에 의한 인증 지문과 상기 등록 지문의 특징점을 보정할 수도 있다.The fingerprint authentication method may correct feature points of the authentication fingerprint and the registration fingerprint by the authentication performing step based on at least one of the detected position and the direction difference.
본 발명에 따르면, 지문 특징점 및 지문 영상 정보를 이용하여 두 번의 지문비교 과정을 거침으로써 보다 정확한 인증이 가능하도록 하며, 또한 PCA를 이용함으로써 영상 비교에서 요구되는 계산량을 감소시켜 실시간 처리가 가능하게 된다.According to the present invention, more accurate authentication is possible by performing two fingerprint comparison processes using fingerprint feature points and fingerprint image information, and by using PCA, the computation amount required for image comparison is reduced, thereby enabling real-time processing. .
도 1은 본 발명의 일 실시예에 따른 지문인증 장치를 개략적으로 도시한 도면이다.1 is a view schematically showing a fingerprint authentication device according to an embodiment of the present invention.
도 2는 특징점 보정의 예로서 빈(bin) 누적에 의한 예를 나타낸 도면이다.2 is a diagram showing an example by bin accumulation as an example of feature point correction.
도 3은 특징점에 기하학적 해싱방법을 적용한 예를 나타낸 도면이다.3 is a diagram illustrating an example of applying a geometric hashing method to feature points.
도 4는 지문에서 RoI를 추출하는 예를 나타낸 도면이다.4 is a diagram illustrating an example of extracting RoI from a fingerprint.
도 5는 한 개의 지문에서 가하학적 해싱을 이용하여 보정과정이 필요없는 RoI 기하학적 해시 테이블을 생성하는 예를 나타낸 도면이다. FIG. 5 is a diagram illustrating an example of generating a RoI geometric hash table without requiring a correction process by using a hashing hash on a single fingerprint.
도 6은 지문영상에서 RoI 기하학적 해시 테이블의 생성 과증을 나타낸 흐름도이다.6 is a flowchart illustrating the generation and excess of RoI geometric hash table in a fingerprint image.
도 7은 본 발명에 따른 지문인증 방법을 나타낸 흐름도이다.7 is a flowchart illustrating a fingerprint authentication method according to the present invention.
이하, 첨부된 도면을 참조하여 본 발명의 실시예를 상세하게 설명한다. 이하의 설명에 있어서, 당업자에게 주지 저명한 기술에 대해서는 그 상세한 설명을 생략할 수 있다. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, the detailed description can be omitted for techniques well known to those skilled in the art.
또한, 본 발명의 구성 요소를 설명하는 데 있어서, 동일한 명칭의 구성 요소에 대하여 도면에 따라 다른 참조부호를 부여할 수도 있으며, 서로 다른 도면임에도 불구하고 동일한 참조부호를 부여할 수도 있다. 그러나, 이와 같은 경우라 하더라도 해당 구성 요소가 실시예에 따라 서로 다른 기능을 갖는다는 것을 의미하거나, 서로 다른 실시예에서 동일한 기능을 갖는다는 것을 의미하는 것은 아니며, 각각의 구성 요소의 기능은 해당 실시예에서의 각각의 구성요소에 대한 설명에 기초하여 판단하여야 할 것이다.In addition, in describing the components of the present invention, different reference numerals may be given to components having the same name according to the drawings, and the same reference numerals may be given even though they are different drawings. However, even in such a case, it does not mean that the corresponding components have different functions according to the embodiments, or does not mean that they have the same functions in different embodiments, and the functions of the respective components may be implemented. Judgment should be made based on the description of each component in the example.
또한, 본 발명의 실시예를 설명함에 있어, 관련된 공지 구성 또는 기능에 대한 구체적인 설명이 본 발명의 요지를 흐릴 수 있다고 판단되는 경우에는 그 상세한 설명은 생략할 수 있다.In addition, in describing the embodiments of the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description may be omitted.
또한, 어떤 구성 요소가 다른 구성요소에 "연결", "결합" 또는 "접속"된다고 기재된 경우, 그 구성 요소는 그 다른 구성요소에 직접적으로 연결되거나 접속될 수 있지만, 각 구성 요소 사이에 또 다른 구성 요소가 "연결", "결합" 또는 "접속"될 수도 있다고 이해되어야 할 것이다.In addition, if a component is described as being "connected", "coupled" or "connected" to another component, the component may be directly connected or connected to the other component, but there is another It is to be understood that the components may be "connected", "coupled" or "connected".
도 1은 본 발명의 일 실시예에 따른 지문인증 장치를 개략적으로 도시한 도면이다. 도면을 참조하면, 지문인증 장치(100)는 데이터베이스부(110), 지문 영상 입력부(120), 특징점 기반 지문 정합부(130), PCA 기반 지문 정합부(140), 인증 수행부(150), 유사도 결합부(160), 해시 테이블 생성부(170) 및 특징점 보정부(180)를 포함할 수 있다. 1 is a view schematically showing a fingerprint authentication device according to an embodiment of the present invention. Referring to the drawings, the fingerprint authentication apparatus 100 includes a database unit 110, a fingerprint image input unit 120, a feature point based fingerprint matching unit 130, a PCA based fingerprint matching unit 140, an authentication performing unit 150, The similarity combiner 160, a hash table generator 170, and a feature point corrector 180 may be included.
데이터베이스부(110)는 등록 지문 영상을 저장한다. 이때, 데이터베이스부(110)는 등록된 지문 영상에 대하여 분석된 특징점 정보와 PCA(Principal Component Analysis: 주성분 분석)를 위한 지문의 영상 특징정보를 저장할 수 있다. 통계학에서 주성분 분석은 데이터 집합을 분석하는 기법 가운데 하나이다. 주성분 분석은 데이터를 한 개의 축으로 사상시켰을 때 그 분산이 가장 커지는 축이 첫 번째 좌표축으로 오고, 두 번째로 커지는 축이 두 번째로 오며, 세 번째로 커지는 축이 세 번째 등과 같은 방법으로 차례로 놓이도록 새로운 좌표계로 데이터를 선형 변환한다. 이와 같이 각각의 축에 데이터의 "가장 중요한" 성분을 위치시킴으로써 여러 가지 응용이 가능하다. 주성분 분석은 카리 카루넨과 미셸 뢰브의 이름을 따서 이산 카루넨-뢰브 변환(Karhunen-Loeve transform 또는 KLT), 또는 해롤드 호텔링의 이름을 따서 호텔링 변환이라 불리기도 한다. 주성분 분석은 가장 큰 분산을 갖는 부분공간(subspace)을 보존하는 최적의 선형 변환이라는 특징을 갖는다. 그러나 이산 코사인 변환과 같은 다른 방법에 비해 더 많은 계산시간을 요구하는 단점이 있다. 다른 선형 변환과 달리 주성분 분석은 정해진 기저 벡터를 갖지 않으며, 기저 벡터는 데이터의 특성에 따라 달라진다. The database unit 110 stores the registered fingerprint image. In this case, the database unit 110 may store the feature point information analyzed with respect to the registered fingerprint image and the image feature information of the fingerprint for PCA (Principal Component Analysis). Principal component analysis in statistics is one of the techniques for analyzing data sets. Principal component analysis shows that when the data is mapped onto one axis, the axis with the largest variance comes to the first coordinate axis, the second largest axis comes second, the third largest axis comes third, and so on. Linearly transform the data into a new coordinate system. Thus, various applications are possible by placing the "most important" component of the data on each axis. Principal component analysis is sometimes referred to as the Karhunen-Loeve transform (KLT), named after Kari Karunen and Michelle Loeb, or the Hotelling transform, named after Harold Hotelling. Principal component analysis is characterized by an optimal linear transformation that preserves the subspace with the largest variance. However, there is a disadvantage in that it requires more computation time than other methods such as discrete cosine transform. Unlike other linear transformations, principal component analysis does not have a fixed basis vector, which depends on the nature of the data.
지문을 나타내는 하나의 지문 곡선을 융선(ridge)이라고 하는데, 융선은 연속되는 융선과 중간에 끊어지는 끝점(ending), 2개 이상의 융선이 만나는 분기점(bifurcation)으로 되어 있으며, 이들을 특징점(minutiae)이라고 한다. 그리고 PCA 기법을 적용하기 위해 지문의 RoI(Region of Interest)들의 평균영상과 RoI의 영상들의 표현할 수 있는 값과 벡터인 고유치와 고유벡터의 모음을 영상 특징정보라 한다. RoI는 일반적으로 특정 목적을 갖는 일련의 데이터 세트 내에서 다른 부가적인 목적을 위해 선택된 데이터 샘플을 나타낸다. 본 발명의 실시예에서는 지문영상에 대하여 관심영역(RoI)을 지정하고 그 영역에 대해서만 필터링을 적용할 수 있다. 이때, RoI는 입력된 영상에서 몇 가지 특징을 추출하여 초기 특정 맵을 구성한 후, 구성된 특정 맵에 대하여 방위에 따라 조율된 중심-주변 연산을 수행하는 공간특징 분석법, 및 현재 프레임(t)과 이전 프레임(t-1)으로 이루어져 있는 연속적인 명암도 영상 시퀀스를 입력받아 시간 특정인 모션정보를 추출한 후, 이 영상 시퀀스에서 블록매칭 기법을 사용하여 모션벡터를 추출하는 시간특징 분석법을 사용할 수 있다.One fingerprint curve representing a fingerprint is called a ridge, which is a continuous ridge, an end that breaks in the middle, and a bifurcation where two or more ridges meet, which are called minutiae. do. In order to apply the PCA technique, an average image of a region of interest (RoI) of a fingerprint and a collection of eigenvalues and eigenvectors, which are representable values and vectors of the RoI images, are called image feature information. RoI generally represents a data sample selected for another additional purpose within a series of data sets with a particular purpose. In an embodiment of the present invention, a region of interest (RoI) may be designated for a fingerprint image, and filtering may be applied only to that region. At this time, the RoI extracts some features from the input image to form an initial specific map, and then performs spatial feature analysis method that performs coordinate-centered calculation based on azimuth with respect to the configured specific map, and the current frame (t) and the previous one. After receiving a continuous contrast image sequence consisting of frames (t-1) and extracting time-specific motion information, a temporal feature analysis method may be used to extract a motion vector from the image sequence using a block matching technique.
특징점과 영상 특징정보는 사람마다 다르기 때문에, 데이터베이스부(110)는 등록된 가입자로부터 얻어진 지문 영상에 대하여 특징점의 위치와 개수를 분석하고 영상 특징정보를 추출한 후, 추출된 영상 특징정보를 데이터베이스화하여 저장한다.Since the feature point and the image feature information differ from person to person, the database unit 110 analyzes the location and number of feature points on the fingerprint image obtained from the registered subscriber, extracts the image feature information, and then extracts the extracted image feature information from the database. Save it.
지문 영상 입력부(120)는 인증을 하기 위한 사용자로부터 사용자 지문 영상을 입력받는다. The fingerprint image input unit 120 receives a user fingerprint image from a user for authentication.
특징점 기반 지문 정합부(130)는 지문 영상 입력부(120)를 통해 입력된 인증을 위한 사용자의 지문 영상과 데이터베이스부(110)에 저장된 등록 지문 영상으로부터 특징점과 영상 특징정보를 추출하며, 추출된 특징점에 기초하여 특징점 기반 지문 정합을 수행한다.The feature point-based fingerprint matching unit 130 extracts the feature point and the image feature information from the fingerprint image of the user for authentication input through the fingerprint image input unit 120 and the registered fingerprint image stored in the database unit 110, and extracts the extracted feature point. A feature-based fingerprint matching is performed based on.
일반적으로 지문인식 시스템에서 사용하는 지문특징 정보는 지문 영상에서 융선이 지나는 끝점(ending point)과 하나의 융선이 둘러 나뉘어지는 분기점(bifurcation point)을 사용한다. 그리고, 지문 영상으로부터 추출된 하나의 특징점은 특징점의 좌표, 특징점의 타입정보를 가지며 (x, y, θ, type)으로 표현될 수 있다. 한편, 동일인의 지문일지라도 지문 입력장치에 지문을 입력할 때마다 특징점의 좌표값이 이동(translation)되고 방향이 회전(rotation)된다. 이러한 방법으로 두 지문에서 추출된 모든 특징점에 대하여 위치와 방향의 차에 의거하여 유사하다고 판단되는 모든 특징점 쌍을 찾아내거나 유사도에 따라 스코어를 구하여 임계치 이상이 되는지 확인할 수 있다. 이것은 지문이 입력될 대동일한 위치, 동일한 방향으로 입력되었다는 것을 가정하여 절대적인 위상을 비교하는 방법으로, 위치와 방향 등의 유사성을 확인하기 이전에 두 지문이 동일한 기준을 갖도록 보정하는 과정이 필요하다. 즉, 동일한 특징점 쌍이더라도 입력하는 시점에 따라 절대적인 좌표값의 방향이 상이하여 두 지문이 변화된 양만큼 이동하고 회전하는 보정(alignment) 과정이 필수적으로 필요하다. 이를 위해 특징점 보정부(130)는 데이터베이스부(110)에 저장된 등록 지문 영상과 지문 영상 입력부(120)를 통해 입력된 사용자의 지문 영상으로부터 추출된 각각의 특징점에 대해 위치, 방향, 거리, 각도 중 적어도 하나에 대한 차이를 보정한다.In general, the fingerprint feature information used in the fingerprint recognition system uses an ending point through which the ridge passes and a bifurcation point where one ridge is divided in the fingerprint image. One feature point extracted from the fingerprint image may have a coordinate of the feature point and type information of the feature point and may be represented by (x, y, θ, type). On the other hand, even if the fingerprint of the same person every time the fingerprint is input to the fingerprint input device, the coordinate value of the feature point is translated and the direction is rotated. In this way, all the feature points extracted from the two fingerprints can be identified based on the difference in position and direction, and all pairs of feature points determined to be similar can be found, or scores can be obtained based on the similarity to determine whether the threshold is greater than or equal to the threshold. This is a method of comparing absolute phases assuming that fingerprints are input in the same position and the same direction to be input, and it is necessary to correct the two fingerprints to have the same criteria before checking the similarity of the position and the direction. That is, even in the same pair of feature points, an absolute coordinate value is different in direction according to the input time, and thus, an alignment process is required in which the two fingerprints are moved and rotated by a changed amount. To this end, the feature point corrector 130 may be configured to calculate the position, direction, distance, and angle of each feature point extracted from the registered fingerprint image stored in the database unit 110 and the fingerprint image of the user input through the fingerprint image input unit 120. Correct the difference for at least one.
특징점 기반 지문 정합부(130)는 지문 영상 입력부(120)를 통해 입력된 사용자 지문 영상으로부터 인증을 위한 특징점 정보를 추출한 후, 데이터베이스부(110)에 기 저장되어 등록된 등록 지문 영상에 대한 특징점 정보를 읽어와서 메모리에 로딩(loading)시켜 등록된 특징점 정보와 사용자 지문 영상의 특징점 정보를 비교 분석한다. 이때, 특징점 보정부(180)는 특징점의 보정을 위해, 메모리에 로딩된 등록 지문의 특징점 정보와 인증 지문의 특징점 정보 간의 위치, 방향, 거리, 각도 중 적어도 하나에 대한 차이를 추출하기 위해 도 2a 및 도 2b에 도시한 바와 같이, 두 특징점 사이의 위치, 방향, 거리의 차이를 누적하기 위한 영역을 설정하고 각 빈(bin)의 위치(bx1, by1) 및 방향 단위를 결정할 수 있다. 여기서, 위치 및 방향에 대한 최초 빈(bin)의 단위는 크게 설정한 후 순차적으로 변화시키면서 최소 단위로 줄여가도록 할 수 있다. 도 2a 및 도 2b에서 Range_X1은 X 축의 최초 영역으로 X 방향으로 검출 가능한 위치 이동과 연관되며, Range_X2는 X 축의 두 번째 영역으로 첫 번째 단계에의 최대 빈(bin) 주위의 영역으로 설정되고, Range_Y1은 Y 축의 최초 영역으로 Y 방향으로 검출 가능한 위치 이동과 연관되며, Range_Y2는 Y 축의 두 번째 영역으로 첫 번째 단계에의 최대 빈(bin) 주위이 영역으로 설정된다. 또한, bx1은 X 축의 최초 단위이며, bx2는 X 축의 두 번째 단위로 bx1보다 작은 단위이고, by1은 Y 축의 최초 단위이며, by2는 Y 축의 두 번째 단위로 by1보다 작은 단위이다. 또한, △X는 두 특징점 쌍의 X축 변화량이며, △Y는 두 특징점 쌍의 Y축 변화량이고, B는 최대 값을 갖는 빈(bin)을 의미한다. 또한, 빈(bin)은 바이너리로 표현된 각 특징점의 영역을 의미한다.The feature point-based fingerprint matching unit 130 extracts feature point information for authentication from the user fingerprint image input through the fingerprint image input unit 120, and then stores the feature point information on the registered fingerprint image previously stored and registered in the database unit 110. Read and load the data into a memory to compare and analyze the registered feature information and the feature information of the user fingerprint image. In this case, the feature point corrector 180 extracts a difference of at least one of a position, a direction, a distance, and an angle between the feature point information of the registered fingerprint loaded in the memory and the feature point information of the authentication fingerprint to correct the feature point. As shown in FIG. 2B, an area for accumulating the difference between the position, the direction, and the distance between the two feature points may be set, and the positions bx1, by1, and the direction unit of each bin may be determined. Here, the unit of the initial bin with respect to the position and the direction may be set to be large and then reduced to the minimum unit while changing sequentially. In FIGS. 2A and 2B, Range_X1 is associated with a detectable positional shift in the X direction to the first area of the X axis, Range_X2 is set to the area around the maximum bin at the first stage as the second area of the X axis, and Range_Y1 Is associated with the detectable positional movement in the Y direction to the first region of the Y axis, and Range_Y2 is the second region of the Y axis, set as the region around the maximum bin at the first stage. In addition, bx1 is the first unit of the X-axis, bx2 is the second unit of the X-axis, smaller than bx1, by1 is the first unit of the Y-axis, and by2 is the second unit of the Y-axis, which is smaller than by1. ΔX is the amount of change in the X-axis of the pair of feature points, ΔY is the amount of change in the Y-axis of the pair of feature points, and B means a bin having a maximum value. In addition, a bin means an area of each feature point expressed in binary.
인증을 위한 사용자 지문 영상의 특징점 정보와 로딩된 등록 지문 영상의 특징점 정보 간의 특징점들을 모두 고려하였는지 판단하며, 모든 특징점을 고려하지 않을 경우에는 인증지문 특징점과 등록지문 특징점의 쌍을 생성하여 두 특징점 간의 방향 차를 측정할 수 있다. 이때, 두 특징점 간의 방향 차가 허용 범위를 벗어났는지를 체크하여 허용 범위를 벗어나지 않을 경우에는 두 특징점 간의 위치 차이 및 거리 차이를 측정할 수 있다. 마찬가지로, 두 특징점 간의 위치 차이 및 거리 차이가 허용 범위를 벗어나지 않을 경우, 구해진 위치, 방향 및 거리 차에 해당하는 설정된 영역의 특정 빈(bin)의 레벨을 상승 또는 누적시키며, 모든 특징점 즉, 방향, 위치 및 거리 차의 특징점 쌍에 대한 고려가 끝나게 되면 최대 레벨을 갖는 빈(bin)을 구하고, 빈(bin)의 위치, 방향 및 거리에 대한 단위가 최소 단위인가를 체크하여, 빈(bin)의 단위가 최소 단위이면 최대 빈(bin) 값에 해당되는 위치, 방향 및 거리 차이 즉, 도 2b에 도시된 B에 해당되는 위치, 방향 및 거리 차를 추출할 수 있다. 이때, 특징점 보정부는 검출된 위치, 방향 및 거리 차를 바탕으로 인증 지문과 등록 지문의 특징점을 보정한 후, 보정된 두 특징점 사이의 유사도를 측정하여 측정된 유사도가 기 설정된 임계치보다 클 경우 두 지문이 동일하다고 판단하며, 판단된 결과에 따라 사용자의 인증 과정을 수행한다.It is determined whether all of the feature points between the feature point information of the user fingerprint image and the feature point information of the loaded registered fingerprint image are considered.If all feature points are not taken into consideration, a pair of authentication fingerprint feature points and a registration fingerprint feature point are generated. The direction difference can be measured. In this case, by checking whether the direction difference between the two feature points is out of the allowable range, if the deviation is not out of the allowable range, the position difference and the distance difference between the two feature points may be measured. Similarly, if the position difference and distance difference between the two feature points do not deviate from the allowable range, the level of the specific bin of the set area corresponding to the obtained position, direction and distance difference is raised or accumulated, and all the feature points, ie, the direction, After considering the feature point pairs of the position and distance difference, the bin having the maximum level is obtained, and whether the unit for the position, direction, and distance of the bin is the minimum unit is determined. If the unit is the minimum unit, the difference in the position, direction, and distance corresponding to the maximum bin value, that is, the position, direction, and distance difference corresponding to B shown in FIG. 2B may be extracted. At this time, the feature point corrector corrects the feature points of the authentication fingerprint and the enrolled fingerprint based on the detected position, direction, and distance difference, and then measures the similarity between the two corrected feature points, if the measured similarity is greater than the preset threshold. It is determined that this is the same, and the authentication process of the user is performed according to the determined result.
PCA 기반 지문 정합부(140)는 사용자 지문 영상 및 등록 지문 영상으로부터 추출된 특징점에 기초하여 주성분 분석(PCA) 방법에 의한 지문정합을 수행한다. 주성분 분석에 기반한 지문정합 방법은 1차원의 지문 벡터들로 변환하여 구한 공분산 행렬로부터 고유값과 고유벡터를 계산하고 크기 순서로 정렬된 고유값에 대응하는 고유벡터를 계산한다. 이렇게 계산한 고유벡터는 하나의 지문 영상을 나타내는 기저 벡터들이다. 실제 인식단계에서는 입력 지문 영상을 선형 변환하여 얻은 특징 벡터를 미리 구해놓은 특징 벡터들과 비교함으로써 지문을 인식하게 된다. 한편, PCA와 관련된 다른 방법들 예를 들어, ICA(Independent Component Analysis)와 Kemel PCA 기반의 방법을 이용할 수도 있다. Bartlett 등은 코사인이 유사도 척도로 사용될 때 PCA 보다 ICA가 우수함을 보였으며, Yang은 특징 추출과 인식을 위해 Kemel PCA를 사용하여 Kemel Eigenface 방법이 기존의 Eigenface 방법보다 우수함을 보여주었다. 하지만, ICA와 Kemel PCA 방법들은 모두 PCA 방법보다 계산량이 많아지는 단점이 있다.The PCA-based fingerprint matching unit 140 performs fingerprint matching by a principal component analysis (PCA) method based on feature points extracted from a user fingerprint image and a registered fingerprint image. The fingerprint matching method based on principal component analysis calculates the eigenvalues and eigenvectors from the covariance matrix obtained by converting them into one-dimensional fingerprint vectors and calculates the eigenvectors corresponding to the eigenvalues arranged in size order. The calculated eigenvectors are basis vectors representing one fingerprint image. In the actual recognition step, the fingerprint is recognized by comparing the feature vectors obtained by linearly transforming the input fingerprint image with the feature vectors obtained in advance. Meanwhile, other methods related to PCA may be used, for example, independent component analysis (ICA) and Kemel PCA based methods. Bartlett et al. Showed that ICA was superior to PCA when cosine was used as a similarity measure, and Yang showed that the Kemel Eigenface method is superior to the existing Eigenface method using Kemel PCA for feature extraction and recognition. However, both ICA and Kemel PCA methods have a disadvantage in that the computational amount is larger than that of the PCA method.
도 3은 PCA를 위해 영상 특징정보를 추출하는 과정을 보여준다. 영상 특징정보는 항상 동일한 RoI과 보정이 이루어진 영상이 필요하다. 따라서 지문입력과정(310)을 통해 입력된 지문에서 특징점 추출을 수행하고(320), 기하학적 해싱(330)을 이용하여 지문의 보정과정을 해결한다. 기하하적 해싱은 도 4와 같이 추출된 특징점들이 만들어 낼 수 있는 모든 보정값을 적용하여 보정이 완료된 특징점 테이블을 미리 만들어 놓는 방법이다. 이를 위해 해시 테이블 생성부(170)는 사용자 지문 영상의 특징점에 대한 기하학적 해싱을 적용한 후 영상 특징정보의 추출을 위한 RoI를 추출하여 기하학적 해시 테이블을 생성할 수 있다. 이와 같이 보정이 완료된 특징점 테이블을 미리 만들어 놓을 경우 추가의 보정과정이 필요없이 특징점 테이블끼리의 비교만으로 지문인증이 가능하다. 특징점에 대한 기하학적 해싱(330)을 적용한 후 영상 특징정보 추출을 위한 RoI 추출을 수행한다(340). 지문은 입력시마다 회전, 이동이 되므로 항상 동일한 영상을 얻을수 없다. 따라서 도 5와 같이 특징점 주변의 부분영상만을 이용하여 RoI을 추출하는 것이 바람직하다. 기하학적 해싱(330)을 통해 보정이 완료된 특징점을 이용하여 RoI를 추출(340)하면 동일한 특징점을 가진 영상은 동일한 RoI가 추출되게 된다. 기하학적 해싱(330)과 RoI 추출(340)을 거치게 되면 도 6과 같은 기하학적 해싱 테이블이 생성된다. 만약 한 개의 지문에서 n개의 특징점이 추출된다면 기하학적 해싱(330)과정에서 n개의 보정값을 가지게 된다. 따라서 n개의 RoI 테이블이 n개 생성되게 된다. 도 6과 같은 기하학적 해싱 테이블을 일반적으로 패턴인식에 사용되고 있는 PCA기법에 적용하면 영상 특징정보인 평균영상, 고유치, 고유벡터가 생성된다. PCA는 고차원 정보를 저차원 정보로 변환시키는 특성이 있기 때문에 영상 특징 정보의 데이터 크기를 감소시킬 수 있다.3 shows a process of extracting image feature information for PCA. The image feature information always needs the same RoI and the corrected image. Therefore, the feature point extraction is performed from the fingerprint input through the fingerprint input process 310 (320), and the correction process of the fingerprint is solved using the geometric hashing (330). Geometric hashing is a method of pre-forming a feature point table in which correction is completed by applying all correction values that can be generated by the extracted feature points as shown in FIG. 4. To this end, the hash table generator 170 may apply the geometric hashing to the feature points of the user fingerprint image and then extract the RoI for extracting the image feature information to generate the geometric hash table. In this way, if the corrected feature point table is prepared in advance, fingerprint authentication is possible by only comparing the feature point tables without additional correction process. After applying geometric hashing 330 to a feature point, RoI extraction for image feature information extraction is performed (340). Fingerprints are rotated and moved each time, so you cannot always get the same image. Therefore, as shown in FIG. 5, it is preferable to extract RoI using only a partial image around a feature point. When the RoI is extracted 340 using the corrected feature point through the geometric hashing 330, the same RoI is extracted from the image having the same feature point. The geometric hashing table 330 and RoI extraction 340 generate a geometric hashing table as shown in FIG. 6. If n feature points are extracted from one fingerprint, the feature has n correction values in the geometric hashing process 330. Therefore, the n number of tables are generated RoI n. When the geometric hashing table as shown in FIG. 6 is applied to the PCA technique which is generally used for pattern recognition, an average image, an eigenvalue, and an eigenvector, which are image feature information, are generated. Since the PCA has a characteristic of converting high-dimensional information into low-dimensional information, the data size of the image characteristic information can be reduced.
이와 같은 방법으로 생성된 영상 특징점보를 데이터베이스부(110)에 저장하고 지문 영상 입력부(120)를 통해 입력된 사용자 지문 영상에 대해 PCA 기반 지문 정합부(140)에서 지문정합을 수행하다. The image feature jumbo generated in this manner is stored in the database unit 110 and fingerprint matching is performed by the PCA-based fingerprint matching unit 140 on the user fingerprint image input through the fingerprint image input unit 120.
인증 수행부(150)는 특징점 기반 지문 정합부(130)에 의한 지문정합 및 PCA 기반 지문 정합부(140)에 의한 지문정합에 기초하여 두 번의 지문비교 과정에 의한 지문 인증을 수행한다.The authentication performing unit 150 performs fingerprint authentication by two fingerprint comparison processes based on the fingerprint matching by the feature-based fingerprint matching unit 130 and the fingerprint matching by the PCA-based fingerprint matching unit 140.
상기의 특징점 기반 지문 정합부(130)와 PCA 기반 지문 정합부(140)에서 추출된 지문의 유사도들을 유사도 결합부(160)에서 결합하여 인증 수행부(150)에서 지문인증을 수행할 수 있다. 이때, 인증 수행부(150)는 유사도 결합부(160)에 의해 결합된 유사도가 설정된 값 이상인 경우에 지문인증을 수행하도록 구현될 수도 있다. 이 경우, 유사도 결합부(160)는 특징점 기반 지문 정합부(130)에 의한 특징점 기반 지문정합의 유사도 범위 및 PCA 기반 지문 정합부(140)에 의한 지문정합의 유사도 범위를 각각 설정하고, 각각의 지문정합 방법에 의해 모두 유사도 범위에 포함되는 지문정합을 선택하여 인증 수행부(150)에 의한 지문인증이 수행되도록 할 수 있다. 예를 들어, 특징점 기반 지문 정합부(130)에 의한 지문정합의 유사도 범위는 90% 내지 100%로 설정되고, PCA 기반 지문 정합부(140)에 의한 지문정합의 유사도 범위는 80% 내지 100%로 설정될 수 있으며, 이 경우 90% 내지 100%의 유사도를 갖는 지문정합에 대해서만 지문인증이 수행되도록 할 수 있다. 또는, 특징점 기반 지문 정합부(130)에 의해 판단된 지문정합의 유사도와, PCA 기반 지문 정합부(140)에 의해 판단된 지문정합의 유사도를 결합하여 지문인증 수행을 위한 판단자료로 삼을 수 있다. 예를 들어, 지문정합에 의해 동일한 지문으로 판단된 경우를 1이라고 할 경우, 인증 수행부(150)에 의한 지문인증 수행기준의 유사도가 1.8 내지 2.2라고 하면, 특징점 기반 지문 정합부(130)에 의해 판단된 유사도가 0.9이고 PCA 기반 지문 정합부(140)에 의한 유사도가 0.93인 경우에 두 지문 정합법에 의한 유사도의 합산 값은 1.83이므로 인증 수행부(150)에 의한 지문인증이 수행될 수 있다.The similarity of the fingerprints extracted from the feature point-based fingerprint matching unit 130 and the PCA-based fingerprint matching unit 140 may be combined in the similarity combining unit 160 to perform fingerprint authentication in the authentication performing unit 150. In this case, the authentication performing unit 150 may be implemented to perform fingerprint authentication when the similarity combined by the similarity combining unit 160 is equal to or greater than a set value. In this case, the similarity combiner 160 sets the similarity range of the feature-based fingerprint matching by the feature-based fingerprint matching unit 130 and the similarity range of the fingerprint matching by the PCA-based fingerprint matching unit 140, respectively. Fingerprint matching may be performed by the authentication performing unit 150 by selecting a fingerprint matching that is included in the range of similarity by the fingerprint matching method. For example, the similarity range of the fingerprint registration by the feature-based fingerprint matching unit 130 is set to 90% to 100%, and the similarity range of the fingerprint matching by the PCA-based fingerprint matching unit 140 is 80% to 100%. In this case, fingerprint authentication may be performed only for fingerprint matching having a similarity of 90% to 100%. Alternatively, the similarity of the fingerprint matching determined by the feature point-based fingerprint matching unit 130 and the similarity of the fingerprint matching determined by the PCA-based fingerprint matching unit 140 may be used as judgment data for performing fingerprint authentication. have. For example, when it is determined that the same fingerprint by the fingerprint matching is 1, if the similarity of the fingerprint authentication performance criteria by the authentication performing unit 150 is 1.8 to 2.2, the feature-based fingerprint matching unit 130 When the similarity determined by 0.9 and the similarity by the PCA-based fingerprint matching unit 140 are 0.93, the sum of the similarities by the two fingerprint matching methods is 1.83, so that fingerprint authentication by the authentication performing unit 150 may be performed. have.
도 7은 본 발명에 따른 지문인증 방법을 나타낸 흐름도이다.7 is a flowchart illustrating a fingerprint authentication method according to the present invention.
도 1 및 도 7을 참조하면, 데이터베이스부(110)는 등록 지문 영상을 저장한다(S710). 이때, 데이터베이스부(110)는 등록된 지문 영상에 대하여 분석된 특징점 정보와 PCA(Principal Component Analysis: 주성분 분석)를 위한 지문의 영상 특징정보를 저장할 수 있다.1 and 7, the database unit 110 stores a registered fingerprint image (S710). In this case, the database unit 110 may store the feature point information analyzed with respect to the registered fingerprint image and the image feature information of the fingerprint for PCA (Principal Component Analysis).
지문 영상 입력부(120)는 인증을 하기 위한 사용자로부터 사용자 지문 영상을 입력받는다(S720). The fingerprint image input unit 120 receives a user fingerprint image from the user for authentication (S720).
특징점 기반 지문 정합부(130)는 지문 영상 입력부(120)를 통해 입력된 인증을 위한 사용자의 지문 영상과 데이터베이스부(110)에 저장된 등록 지문 영상으로부터 특징점과 영상 특징정보를 추출하며, 추출된 특징점에 기초하여 특징점 기반 지문 정합을 수행한다(S730).The feature point-based fingerprint matching unit 130 extracts the feature point and the image feature information from the fingerprint image of the user for authentication inputted through the fingerprint image input unit 120 and the registered fingerprint image stored in the database unit 110, and extracts the extracted feature points. Based on the feature point based fingerprint matching is performed (S730).
PCA 기반 지문 정합부(140)는 사용자 지문 영상 및 등록 지문 영상으로부터 추출된 특징점에 기초하여 주성분 분석(PCA) 방법에 의한 지문정합을 수행한다(S740). The PCA-based fingerprint matching unit 140 performs fingerprint matching by a principal component analysis (PCA) method based on the feature points extracted from the user fingerprint image and the registered fingerprint image (S740).
유사도 결합부(160)는 특징점 기반 지문 정합부(130)에 의한 유사도 및 PCA 기반 지문 정합부(140)에 의한 유사도를 결합한다(S750). 유사도 결합부(160)는 특징점 기반 지문 정합부(130)에 의한 특징점 기반 지문정합의 유사도 범위 및 PCA 기반 지문 정합부(140)에 의한 지문정합의 유사도 범위를 각각 설정하고, 각각의 지문정합 방법에 의해 모두 유사도 범위에 포함되는 지문정합을 선택하여 인증 수행부(150)에 의한 지문인증이 수행되도록 할 수 있다. 예를 들어, 특징점 기반 지문 정합부(130)에 의한 지문정합의 유사도 범위는 90% 내지 100%로 설정되고, PCA 기반 지문 정합부(140)에 의한 지문정합의 유사도 범위는 80% 내지 100%로 설정될 수 있으며, 이 경우 90% 내지 100%의 유사도를 갖는 지문정합에 대해서만 지문인증이 수행되도록 할 수 있다. 또는, 특징점 기반 지문 정합부(130)에 의해 판단된 지문정합의 유사도와, PCA 기반 지문 정합부(140)에 의해 판단된 지문정합의 유사도를 결합하여 지문인증 수행을 위한 판단자료로 삼을 수 있다. 예를 들어, 지문정합에 의해 동일한 지문으로 판단된 경우를 1이라고 할 경우, 인증 수행부(150)에 의한 지문인증 수행기준의 유사도가 1.8 내지 2.2라고 하면, 특징점 기반 지문 정합부(130)에 의해 판단된 유사도가 0.9이고 PCA 기반 지문 정합부(140)에 의한 유사도가 0.93인 경우에 두 지문 정합법에 의한 유사도의 합산 값은 1.83이므로 인증 수행부(150)에 의한 지문인증이 수행될 수 있다.The similarity combiner 160 combines the similarity by the feature-based fingerprint matching unit 130 and the similarity by the PCA-based fingerprint matching unit 140 (S750). The similarity combining unit 160 sets the similarity range of the feature-based fingerprint matching by the feature-based fingerprint matching unit 130 and the similarity range of the fingerprint matching by the PCA-based fingerprint matching unit 140, respectively. By selecting the fingerprint matching all included in the range of similarity by the fingerprint authentication by the authentication performing unit 150 may be performed. For example, the similarity range of the fingerprint registration by the feature-based fingerprint matching unit 130 is set to 90% to 100%, and the similarity range of the fingerprint matching by the PCA-based fingerprint matching unit 140 is 80% to 100%. In this case, fingerprint authentication may be performed only for fingerprint matching having a similarity of 90% to 100%. Alternatively, the similarity of the fingerprint matching determined by the feature point-based fingerprint matching unit 130 and the similarity of the fingerprint matching determined by the PCA-based fingerprint matching unit 140 may be used as judgment data for performing fingerprint authentication. have. For example, if it is determined that 1 is the same fingerprint by fingerprint matching, the similarity of the fingerprint authentication performance criteria by the authentication performing unit 150 is 1.8 to 2.2, the feature-based fingerprint matching unit 130 When the similarity determined by 0.9 and the similarity by the PCA-based fingerprint matching unit 140 are 0.93, the sum of the similarities by the two fingerprint matching methods is 1.83, so that fingerprint authentication by the authentication performing unit 150 may be performed. have.
인증 수행부(150)는 특징점 기반 지문 정합부(130)에 의한 지문 정합 및 PCA 기반 지문 정합부(140)에 의한 지문 정합에 기초하여 지문인증을 수행한다. 이때, 인증 수행부(150)는 유사도 결합부(160)에 의해 결합된 유사도가 설정된 값 이상인 경우에 지문인증을 수행하도록 구현될 수 있다. 즉, 특징점 기반 지문 정합부(130)에 의한 지문 정합 또는 PCA 기반 지문 정합부(140)에 의한 지문 정합에 의하여 사용자 지문 영상과 등록된 지문 영상이 일치하는 것으로 판단되거나, 유사도 결합부(160)에 의해 결합된 유사도가 기준값에 대하여 오차범위 이내로 유사한 경우에 지문인증을 수행하도록 구현될 수 있다.The authentication performing unit 150 performs fingerprint authentication based on the fingerprint matching by the feature-based fingerprint matching unit 130 and the fingerprint matching by the PCA-based fingerprint matching unit 140. In this case, the authentication performing unit 150 may be implemented to perform fingerprint authentication when the similarity combined by the similarity combining unit 160 is equal to or greater than a set value. That is, it is determined that the user fingerprint image and the registered fingerprint image are matched by the fingerprint matching by the feature point-based fingerprint matching unit 130 or the fingerprint matching by the PCA-based fingerprint matching unit 140, or the similarity coupling unit 160. It can be implemented to perform the fingerprint authentication when the similarity combined by the similarity within the error range with respect to the reference value.
이상에서, 본 발명의 실시예를 구성하는 모든 구성 요소들이 하나로 결합하거나 결합하여 동작하는 것으로 기재되어 있다고 해서, 본 발명이 반드시 이러한 실시예에 한정되는 것은 아니다. 즉, 본 발명의 목적 범위 안에서라면, 그 모든 구성 요소들이 하나 이상으로 선택적으로 결합하여 동작할 수도 있다. 또한, 그 모든 구성 요소들이 각각 하나의 독립적인 하드웨어로 구현될 수 있지만, 각 구성 요소들의 그 일부 또는 전부가 선택적으로 조합되어 하나 또는 복수 개의 하드웨어에서 조합된 일부 또는 전부의 기능을 수행하는 프로그램 모듈을 갖는 컴퓨터 프로그램으로서 구현될 수도 있다. 또한, 이와 같은 컴퓨터 프로그램은 USB 메모리, CD 디스크, 플래쉬 메모리 등과 같은 컴퓨터가 읽을 수 있는 저장매체(Computer Readable Media)에 저장되어 컴퓨터에 의하여 읽혀지고 실행됨으로써, 본 발명의 실시예를 구현할 수 있다. 컴퓨터 프로그램의 저장매체로서는 자기 기록매체, 광 기록매체, 캐리어 웨이브 매체 등이 포함될 수 있다.In the above description, all elements constituting the embodiments of the present invention are described as being combined or operating in combination, but the present invention is not necessarily limited to these embodiments. In other words, within the scope of the present invention, all of the components may be selectively operated in combination with one or more. In addition, although all of the components may be implemented as one independent hardware, each or some of the components of the program modules are selectively combined to perform some or all of the functions combined in one or a plurality of hardware It may be implemented as a computer program having a. In addition, such a computer program may be stored in a computer readable medium such as a USB memory, a CD disk, a flash memory, and the like, and read and executed by a computer, thereby implementing embodiments of the present invention. The storage medium of the computer program may include a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like.
또한, 기술적이거나 과학적인 용어를 포함한 모든 용어들은, 상세한 설명에서 다르게 정의되지 않는 한, 본 발명이 속하는 기술 분야에서 통상의 지식을 가진 자에 의해 일반적으로 이해되는 것과 동일한 의미를 갖는다. 사전에 정의된 용어와 같이 일반적으로 사용되는 용어들은 관련 기술의 문맥상의 의미와 일치하는 것으로 해석되어야 하며, 본 발명에서 명백하게 정의하지 않는 한, 이상적이거나 과도하게 형식적인 의미로 해석되지 않는다.In addition, all terms including technical or scientific terms have the same meaning as commonly understood by a person of ordinary skill in the art unless otherwise defined in the detailed description. Terms used generally, such as terms defined in a dictionary, should be interpreted to coincide with the contextual meaning of the related art, and shall not be interpreted in an ideal or excessively formal sense unless explicitly defined in the present invention.
이상의 설명은 본 발명의 기술 사상을 예시적으로 설명한 것에 불과한 것으로서, 본 발명이 속하는 기술 분야에서 통상의 지식을 가진 자라면 본 발명의 본질적인 특성에서 벗어나지 않는 범위에서 다양한 수정 및 변형이 가능할 것이다. 또한, 본 발명에 개시된 실시예들은 본 발명의 기술 사상을 한정하기 위한 것이 아니라 설명하기 위한 것이며, 이러한 실시예에 의하여 본 발명의 기술 사상의 범위가 한정되는 것은 아니다. 따라서, 본 발명의 보호 범위는 청구범위에 의하여 해석되어야 하며, 그와 균등한 범위 내에 있는 모든 기술 사상은 본 발명의 권리범위에 포함되는 것으로 해석되어야 할 것이다.The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. In addition, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. Therefore, the protection scope of the present invention should be interpreted by the claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Claims (8)

  1. 지문인증 장치에 있어서,In the fingerprint authentication device,
    등록 지문 영상을 저장하는 데이터베이스부;A database unit for storing a registered fingerprint image;
    사용자로부터 사용자 지문 영상을 입력받는 지문 영상 입력부;A fingerprint image input unit configured to receive a user fingerprint image from a user;
    상기 지문 영상 입력부를 통해 입력된 상기 사용자 지문 영상과 상기 데이터베이스부에 저장된 상기 등록 지문 영상으로부터 특징점을 추출하며, 추출된 상기 특징점에 기초하여 특징점 기반 지문정합을 수행하는 특징점 기반 지문 정합부; A feature point based fingerprint matching unit extracting a feature point from the user fingerprint image inputted through the fingerprint image input unit and the registered fingerprint image stored in the database unit, and performing a feature point based fingerprint matching based on the extracted feature point;
    상기 사용자 지문 영상 및 상기 등록 지문 영상으로부터 추출된 특징점에 기초하여 주성분 분석(PCA: Principal Component Analysis) 방법에 의한 지문정합을 수행하는 PCA 기반 지문 정합부; 및A PCA-based fingerprint matching unit performing fingerprint matching based on a principal component analysis (PCA) method based on feature points extracted from the user fingerprint image and the registered fingerprint image; And
    상기 특징점 기반 지문 정합부에 의한 지문정합 및 상기 PCA 기반 지문 정합부에 의한 지문정합에 기초하여 지문인증을 수행하는 인증 수행부An authentication performing unit for performing fingerprint authentication based on fingerprint matching by the feature point based fingerprint matching unit and fingerprint matching by the PCA based fingerprint matching unit.
    를 포함하는 것을 특징으로 하는 지문인증 장치.Fingerprint authentication device comprising a.
  2. 제 1항에 있어서,The method of claim 1,
    상기 특징점 기반 지문 정합부에 의한 유사도 및 상기 PCA 기반 지문 정합부에 의한 유사도를 결합하는 유사도 결합부A similarity combiner combining the similarity by the feature point based fingerprint matching unit and the similarity by the PCA based fingerprint matching unit
    를 더 포함하며,More,
    상기 인증 수행부는 상기 유사도 결합부에 의해 결합된 유사도가 설정된 값 이상인 경우에 지문인증을 수행하는 것을 특징으로 하는 지문인증 장치.And wherein the authentication performing unit performs fingerprint authentication when the similarity combined by the similarity combining unit is equal to or greater than a set value.
  3. 제 1항에 있어서,The method of claim 1,
    상기 사용자 지문 영상의 특징점에 대한 기하학적 해싱을 적용한 후 영상 특징정보의 추출을 위한 RoI를 추출하여 기하학적 해시 테이블을 생성하는 해시 테이블 생성부A hash table generator for generating a geometric hash table by extracting RoI for extracting feature information after applying geometric hashing to the feature points of the user fingerprint image.
    를 더 포함하는 것을 특징으로 하는 지문인증 장치.Fingerprint authentication device further comprising.
  4. 제 1항에 있어서,The method of claim 1,
    검출된 위치, 방향 차 중의 적어도 하나에 기초하여 상기 인증 수행부에 의한 인증 지문과 상기 등록 지문의 특징점을 보정하는 특징점 보정부A feature point corrector that corrects feature points of the authentication fingerprint and the registered fingerprint based on at least one of the detected position and the direction difference.
    를 더 포함하는 것을 특징으로 하는 지문인증 장치.Fingerprint authentication device further comprising.
  5. 지문인증 방법에 있어서,In the fingerprint authentication method,
    등록 지문 영상을 저장하는 단계;Storing the registered fingerprint image;
    사용자로부터 사용자 지문 영상을 입력받는 단계;Receiving a user fingerprint image from a user;
    입력된 상기 사용자 지문 영상과 저장된 상기 등록 지문 영상으로부터 특징점을 추출하며, 추출된 상기 특징점에 기초하여 특징점 기반 지문정합을 수행하는 단계; Extracting a feature point from the input user fingerprint image and the stored registered fingerprint image and performing a feature point-based fingerprint matching based on the extracted feature point;
    상기 사용자 지문 영상 및 상기 등록 지문 영상으로부터 추출된 특징점에 기초하여 주성분 분석(PCA: Principal Component Analysis) 방법에 의한 지문정합을 수행하는 단계; 및Performing fingerprint matching by a principal component analysis (PCA) method based on feature points extracted from the user fingerprint image and the registered fingerprint image; And
    상기 특징점 기반 지문 정합 수행단계에 의한 지문정합 및 상기 PCA 기반 지문 정합 수행단계에 의한 지문정합에 기초하여 지문인증을 수행하는 단계Performing fingerprint authentication based on fingerprint matching by the feature-point based fingerprint matching step and fingerprint matching by the PCA-based fingerprint matching step
    를 포함하는 것을 특징으로 하는 지문인증 방법.Fingerprint authentication method comprising a.
  6. 제 5항에 있어서,The method of claim 5,
    상기 특징점 기반 지문 정합 수행단계에 의한 유사도 및 상기 PCA 기반 지문 정합부에 의한 유사도를 결합하는 단계Combining the similarity by the feature-based fingerprint matching step and the similarity by the PCA-based fingerprint matching unit
    를 더 포함하며,More,
    상기 지문인증 수행단계는 상기 유사도 결합부에 의해 결합된 유사도가 설정된 값 이상인 경우에 지문인증을 수행하는 것을 특징으로 하는 지문인증 방법.The fingerprint authentication step may include performing fingerprint authentication when the similarity coupled by the similarity coupling unit is equal to or greater than a set value.
  7. 제 5항에 있어서,The method of claim 5,
    상기 사용자 지문 영상의 특징점에 대한 기하학적 해싱을 적용한 후 영상 특징정보의 추출을 위한 RoI를 추출하여 기하학적 해시 테이블을 생성하는 것을 특징으로 하는 지문인증 방법.And applying a geometric hashing to the feature point of the user fingerprint image and extracting a RoI for extracting the image feature information to generate a geometric hash table.
  8. 제 5항에 있어서,The method of claim 5,
    검출된 위치, 방향 차 중의 적어도 하나에 기초하여 상기 인증 수행단계에 의한 인증 지문과 상기 등록 지문의 특징점을 보정하는 것을 특징으로 하는 지문인증 방법.And a feature point of the authentication fingerprint and the registration fingerprint according to the authentication performing step based on at least one of the detected position and the direction difference.
PCT/KR2011/002524 2011-04-06 2011-04-11 Fingerprint authentication device using pca, and method therefor WO2012138004A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020110031680A KR101236040B1 (en) 2011-04-06 2011-04-06 Fingerprint verification apparatus and method therefor using PCA
KR10-2011-0031680 2011-04-06

Publications (1)

Publication Number Publication Date
WO2012138004A1 true WO2012138004A1 (en) 2012-10-11

Family

ID=46969378

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2011/002524 WO2012138004A1 (en) 2011-04-06 2011-04-11 Fingerprint authentication device using pca, and method therefor

Country Status (2)

Country Link
KR (1) KR101236040B1 (en)
WO (1) WO2012138004A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106022342A (en) * 2016-05-05 2016-10-12 南京邮电大学 Image feature extraction method based on KAZE algorithm
US10063541B2 (en) 2014-12-29 2018-08-28 Samsung Electronics Co., Ltd. User authentication method and electronic device performing user authentication
CN110490216A (en) * 2018-05-15 2019-11-22 由昉信息科技(上海)有限公司 A kind of self-study formula data sorting system and method
US20210209336A1 (en) * 2017-10-18 2021-07-08 Fingerprint Cards Ab Differentiating between live and spoof fingers in fingerprint analysis by machine learning
US11157657B2 (en) * 2016-12-22 2021-10-26 Liveramp, Inc. Mixed data fingerprinting with principal components analysis

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007140695A (en) * 2005-11-15 2007-06-07 Nippon Telegr & Teleph Corp <Ntt> Suspicious face detection system, suspicious face detection method and suspicious face detection program
KR100787114B1 (en) * 2006-06-20 2007-12-21 연세대학교 산학협력단 Method of transforming biometric data and verification system thereof
KR100940902B1 (en) * 2009-05-14 2010-02-08 동국대학교 산학협력단 The biometrics using finger geometry information
JP2010181970A (en) * 2009-02-03 2010-08-19 Sony Corp Equipment for biometric identification, biometric identification device, biometric identification system, discrimination reference determination method, biometric identification method, and program
KR20100102949A (en) * 2009-03-12 2010-09-27 한국전자통신연구원 Method and apparatus for face recognition based on block-unit

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100957073B1 (en) * 2008-11-19 2010-05-13 고려대학교 산학협력단 Apparatus and method for selective image compression based on quality of fingerprint image and apparatus for authentication using the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007140695A (en) * 2005-11-15 2007-06-07 Nippon Telegr & Teleph Corp <Ntt> Suspicious face detection system, suspicious face detection method and suspicious face detection program
KR100787114B1 (en) * 2006-06-20 2007-12-21 연세대학교 산학협력단 Method of transforming biometric data and verification system thereof
JP2010181970A (en) * 2009-02-03 2010-08-19 Sony Corp Equipment for biometric identification, biometric identification device, biometric identification system, discrimination reference determination method, biometric identification method, and program
KR20100102949A (en) * 2009-03-12 2010-09-27 한국전자통신연구원 Method and apparatus for face recognition based on block-unit
KR100940902B1 (en) * 2009-05-14 2010-02-08 동국대학교 산학협력단 The biometrics using finger geometry information

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10063541B2 (en) 2014-12-29 2018-08-28 Samsung Electronics Co., Ltd. User authentication method and electronic device performing user authentication
CN106022342A (en) * 2016-05-05 2016-10-12 南京邮电大学 Image feature extraction method based on KAZE algorithm
US11157657B2 (en) * 2016-12-22 2021-10-26 Liveramp, Inc. Mixed data fingerprinting with principal components analysis
US20210209336A1 (en) * 2017-10-18 2021-07-08 Fingerprint Cards Ab Differentiating between live and spoof fingers in fingerprint analysis by machine learning
US11580775B2 (en) * 2017-10-18 2023-02-14 Fingerprint Cards Anacatum Ip Ab Differentiating between live and spoof fingers in fingerprint analysis by machine learning
CN110490216A (en) * 2018-05-15 2019-11-22 由昉信息科技(上海)有限公司 A kind of self-study formula data sorting system and method

Also Published As

Publication number Publication date
KR101236040B1 (en) 2013-02-21
KR20120113972A (en) 2012-10-16

Similar Documents

Publication Publication Date Title
US9208375B2 (en) Face recognition mechanism
US9202104B2 (en) Biometric information correction apparatus, biometric information correction method and computer-readable recording medium for biometric information correction
Raghavendra et al. Scaling-robust fingerprint verification with smartphone camera in real-life scenarios
KR100950776B1 (en) Method of face recognition
Damer et al. Ear recognition using multi-scale histogram of oriented gradients
KR100972849B1 (en) Method of object recognition
Zhou et al. Histograms of categorized shapes for 3D ear detection
CN101189640A (en) Pattern collation method, pattern collation system, and pattern collation program
WO2012138004A1 (en) Fingerprint authentication device using pca, and method therefor
US11244143B2 (en) Method and apparatus for preprocessing fingerprint image
WO2012138086A2 (en) Apparatus and method for hierarchically verifying fingerprints using similarity distribution
Ouamane et al. A novel statistical and multiscale local binary feature for 2D and 3D face verification
El-Abed et al. Quality assessment of image-based biometric information
KR102558736B1 (en) Method and apparatus for recognizing finger print
Jayaraman et al. Use of geometric features of principal components for indexing a biometric database
CN108647640A (en) The method and electronic equipment of recognition of face
KR101072352B1 (en) Fingerprint verification apparatus and method therefor
JP2013218605A (en) Image recognition device, image recognition method, and program
CN106407942B (en) Image processing method and device
Jaswal et al. Finger knuckle image based personal authentication using DeepMatching
WO2013141439A1 (en) Device and method for authenticating a fingerprint
Agarwal et al. A utility of ridge contour points in minutiae-based fingerprint matching
Broadbent et al. 2.5 d facial expression recognition using photometric stereo and the area weighted histogram of shape index
Balti et al. Invariant and reduced features for Fingerprint Characterization
Chen et al. Fast match-on-card technique using in-matcher clustering with ISO minutia template

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11863149

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11863149

Country of ref document: EP

Kind code of ref document: A1