KR101803397B1 - System for relaying financial transaction with multiple safety function using face and finger-print or/and finger-vein at the same time and method for processing thereof - Google Patents

Abstract

A financial transaction relay system with a multi-safety lock function for scanning a face and a finger-print or/and a finger vein comprises a customer terminal, and a financial transaction relay server to relay a financial transaction between an electronic financial transaction system and electronic commerce systems by non-authentication access. The financial transaction relay server includes a middleware firewall and a multi-safety lock module to authenticate a user of the customer terminal using face authentication, fingerprint or/and finger vein authentication, password authentication, and phone number authentication. According to the present invention, when the customer terminal performs any one among an electronic financial transaction and an electronic commerce transaction, fingerprint or/and finger vein information and face information are received from the customer terminal to perform authentication to relay an electronic financial transaction system and an electronic commerce system to allow a financial transaction by non-authentication access. Since fingerprints or/and finger veins or faces are secondly authenticated for unidentifiable faces or fingerprints or/and finger veins, user authentication errors can be minimized.

Description

FIELD OF THE INVENTION [0001] The present invention relates to a financial transaction relay system having a plurality of safety lock functions for processing user authentication by scanning a face, a fingerprint and / or a fingerprint, and a processing method thereof. VEIN AT THE SAME TIME AND METHOD FOR PROCESSING THEREOF}

The present invention relates to a financial transaction relay system, in which a face, a fingerprint and a fingerprint are simultaneously scanned to prevent user authentication errors due to faces, fingerprints and fingerprints that can not be more specifically identified, A financial transaction relay system including a plurality of security lock functions for processing user authentication in order of a password, processing firewall password authentication and authentication of financial management middleware to enable unauthorized access for financial transactions, electronic commerce, etc., and a processing method thereof .

Recently, with the use of mobile phones, smart phones, and the rapid spread of wireless Internet, the proportion of banking and e-commerce processing using mobile devices is increasing.

Currently, mobile devices use chips issued by banks to perform financial transactions such as banking and e-commerce transactions in place of credit cards. To this end, the mobile device has a built-in chip, which is used for payment at a convenience store and a store where a dedicated terminal is installed. However, there is a limitation in the cost that can be settled, and payment can not be performed in a place without a dedicated terminal. In addition, there is a problem in that a chip built in a mobile device is difficult to immediately process payment at the time of account transfer or general commercial transaction.

 Generally, an individual protects an individual's financial transactions with an authorized certificate and a password in order to prevent personal injury which may occur as leakage or theft of personal information or password in an electronic financial transaction with a bank, Since banks rely solely on security technology, banks are not able to prevent or protect the personal injury caused by personal mistakes.

In order to solve these problems, biometrics technology has been applied to electronic financial transactions such as e-commerce transactions, bank transactions, insurance transactions, and securities transactions due to credit card settlement at an online shopping mall. Biometric technology refers to technology that identifies or identifies an individual using biometric information. To date, biometric techniques identify fingerprints and / or fingerprints, fingerprints and / or fingerprints, irises or voices to identify a person's identity.

Biometric technology refers to technology that identifies or identifies an individual using biometric information. To date, biometric techniques have used fingerprints, fingerprints, and / or fingerprints, irises, or voices to identify individuals.

The fingerprint recognition technology is small in recognition device and can be mass-produced at low cost. Also, it shows relatively good performance in terms of accuracy and speed of recognition. However, fingerprints are exposed outside the body and are likely to be stolen and deformed by sweat, which can affect recognition performance. There are also hygiene problems.

Iris recognition technology is the most reliable biometric technology in that recognition errors are unlikely and counterfeiting is difficult. However, most people are reluctant to shine directly in the eye for iris recognition, and iris recognition devices are large and expensive.

Fingerprint and / or fingerprint or voice recognition techniques have the advantage of being the most natural form of biometric information in identity recognition. However, it has a disadvantage in that it is less accurate than other technologies in terms of recognition accuracy.

In order to overcome and overcome the disadvantages of the biometric techniques described above, finger vein recognition technology has been developed. The finger vein recognition technology refers to a technique for identifying an individual using a finger vein pattern image acquired through infrared rays. Human veins are located in complex shapes directly beneath the skin. According to various studies, the pattern of the veins is different for each individual, and it is known that the pattern does not change with age. The fingerprint recognition technology has the following advantages. That is, since the vein is inside the body, there is little risk of theft or forgery, and the state of the finger surface has no effect on the recognition. In addition, it is possible to construct a noncontact type device with high convenience for the user by using infrared rays. Since the finger pattern can be stably and relatively clearly searched, a camera having a low resolution can be used to obtain a small fingerprint image have. That is, fingerprint recognition technology can provide balanced performance in terms of security and convenience.

Due to these advantages, the finger vein recognition technology recently has a higher security than the fingerprint, iris, fingerprint, and / or finger vein recognition technology, Is expected to be applied.

1 (a), a key technology of a smart phone can be displayed as an iris recognition technology on a top surface. FIG. 1 (b) shows a display in which an iris recognizer is attached to a smartphone , Which can be useful for commercial applications.

As shown in the figure, the smartphone bodies 500 and 600 are formed of conventional touch screens 510 and 610, and general signal display parts 520 and 620 are formed on one side, And iris recognition devices 530 and 630 are formed on the upper part.

Accordingly, when the user uses a signal to make a call or logs in to make a call, the user turns his / her eyes on the screen in a normal manner so that his or her eyes are close to the iris period 530 and 630, So that it can be used by the user.

In another method, when a user uses a signal to make a call or logs in to make a call, the user's eyes are close to the iris period 530 (630) without turning on the screen, So that it can be used by the user.

The iris recognition device using the camera for short range iris photography of a smart phone according to the related art includes an iris photographing camera, a key input unit, a storage unit, a control unit, an output unit, and a display lamp.

As shown in Korean Patent Laid-Open Publication No. 10-214-0133762, the iris photographing camera is provided with a prism having an inclined surface at the upper portion of the guide of the illumination IR LED 20 and having a concave / convex portion formed thereon to improve the brightness uniformity around the iris, And can prevent the static electricity from being transmitted to the internal device through the illumination IR LED, so that it can be formed in a small size.

2 is a diagram for explaining a method of normalizing binary data in an iris recognition method using a camera for a short distance iris of a smartphone according to an embodiment of the present invention.

As shown in the figure, the iris data is normalized with the binary data for each pixel of the imaged iris image, and the iris data is normalized to binary data indicating that there is no pattern irrespective of the increase of the iris pattern The amount of data can be reduced.

Therefore, the processing speed can be improved and the recognition speed can be improved. Also, the processing speed can be improved through the low-specification system, and the miniaturization and portability can be increased, and the influence of night and day and illumination can be minimized.

In addition, in the face recognition, as shown in Korean Patent Publication No. 10-1174103, FIGS. 3 and 4 according to an embodiment of the present invention are simplified diagrams of a face image input in the conventional invention, This is the key.

The detection of the eye and surrounding muscle information applied to the conventional invention can be performed by grasping the position of the frontal muscle, the upper limb muscle, the eye circumference muscle, and the eyebrow lowering muscle, which are muscle structures of the eye, The distance between the eyes and the mouth, the angle between the eyes and the nose, and the angle between the mouth and the nose) are detected, and the generated information is used as registration information or control data, and a preprocessing method .

Then, the conventional method includes a facial image normalization, a removal and statistical correction of the external illuminance component in the normalized facial image, and a preprocessing and feature extraction step of extracting features from the preprocessed facial image according to the eye position and the surrounding detail information.

At this time, the pre-processing and feature extraction steps applied to the present invention are used to compensate for changes in luminous intensity, posture, and external conditions of facial expression, and the luminance correction uses local variance normalization and local histogram smoothing.

The face recognition method of mathematical pattern analysis based on the upper musculoskeletal structure includes a face image input step of inputting an image input by a camera (USB includes CCD) or a video file or an image file image, A face detection step of detecting a position of the face, detecting a position of the face, detecting a face from the detected object (object) to determine a basic outline, and automatically detecting the position of the face; A step of detecting muscle information around the eyes and eyes detecting the details around the eyes, a step of normalizing the face image by the eye position and the surrounding details, a removal and statistical correction of the external illumination components in the normalized face image, A feature extraction step and a feature extraction step.

The present invention may be applied to the execution system of the present invention using the above-described conventional techniques.

Also in the face recognition authentication method, a system for registering and authenticating the face recognition authentication method has been developed in the Korean Patent Laid-Open Publication No. 10-2016-0084657.

These technologies were not applied to the financial settlement system, and only the functions of a simple lock were developed.

Also, in the authentication of fingerprints and fingerprints, the present inventor has provided many inventions in the form of a financial settlement method in patent applications 10-2015-109633 and 10-2015-0120087.

However, for the simultaneous recognition technique using fingerprint and finger pattern on the face and finger in fingerprint or / and finger vein among the human body information, the principle of the false recognition rate prevention is not found, The idea of sending only the signal to the bank side was done.

According to the present invention, a system for replacing a public certificate is not developed even if a public certificate is abolished by organically linking an electronic approval system using double security by simultaneous scanning of a face and a fingerprint or / and a finger vein, . However, it is a newly developed technique. However, the facial images taken by the face recognizer are processed by mathematical pattern analysis based on the musculoskeletal structure to improve the recognition speed by reducing the amount of data, Although the method of reducing the recognition rate has been improved, it is intended to provide research and development that can be applied to the financial transaction payment system.

Furthermore, it is an object of the present invention to provide a financial transaction relay system and a processing method thereof that simultaneously scan a face and a fingerprint and / or a fingerprint to process user authentication.

A financial transaction relay system comprising: a communication network; A customer terminal connected to the communication network and including a fingerprint recognizing fingerprint and / or fingerprint information of a customer and / or a finger recognizer and a face recognizer for extracting face information; Wherein the customer terminal is connected through the communication network and receives the face information, the fingerprint, and / or the fingerprint information from the customer terminal and registers the member as a member, and the customer terminal performs either electronic financial transaction or electronic commerce The fingerprint and / or fingerprint information from the customer terminal is received and authenticated so that an electronic financial transaction system for the electronic financial transaction or an electronic commercial transaction system for the electronic commercial transaction is performed so that the financial transaction is performed A financial transaction relay server for relaying the transaction; Wherein the financial transaction relay server comprises a face recognition processing unit for receiving face information from the customer terminal and comparing whether the face information matches the registered face information, an account password processing unit for registering an account password of the customer terminal, And a fingerprint and / or a fingerprint recognition processing unit for receiving the fingerprint information and comparing the fingerprint and / or the fingerprint information with the previously registered fingerprint and / or the fingerprint information, and a telephone number authentication processing unit for authenticating using the telephone number of the customer terminal A safety lock module; The fingerprint and / or the fingerprint information from the user terminal to process the user authentication using the face information, and if the user identification is not possible from the face information, the fingerprint and / If the fingerprint and / or the fingerprint information matches one of the fingerprint information using the fingerprint information, the user authentication is processed, and then the middleware firewall authentication is processed and the electronic financial transaction system for electronic financial transaction or the electronic commerce system for electronic commerce Wherein the authentication process is performed by scanning the face and the fingerprint and / or the fingerprint to process the user authentication.

In addition, the present invention provides a financial transaction relay system comprising: a communication network; A customer terminal connected to the communication network and including a fingerprint recognizing fingerprint and / or fingerprint information of a customer and / or a finger recognizer and a face recognizer for extracting face information; Wherein the customer terminal is connected through the communication network and receives the face information, the fingerprint, and / or the fingerprint information from the customer terminal and registers the member as a member, and the customer terminal performs either electronic financial transaction or electronic commerce The fingerprint and / or fingerprint information from the customer terminal is received and authenticated so that an electronic financial transaction system for the electronic financial transaction or an electronic commercial transaction system for the electronic commercial transaction is performed so that the financial transaction is performed A financial transaction relay server for relaying the transaction; Wherein the financial transaction relay server comprises a face recognition processing unit for receiving face information from the customer terminal and comparing whether the face information matches the registered face information, an account password processing unit for registering an account password of the customer terminal, And a fingerprint and / or a fingerprint recognition processing unit for receiving the fingerprint information and comparing the fingerprint and / or the fingerprint information with the previously registered fingerprint and / or the fingerprint information, and a telephone number authentication processing unit for authenticating using the telephone number of the customer terminal A safety lock module; Wherein the user authentication of the financial transaction relay system includes receiving the face information and the fingerprint and / or fingerprint information from the customer terminal, first processing the user authentication using the face information, and secondly using the fingerprint and / If one of the fingerprint and / or fingerprint information matches the MAC information, the user authentication is processed, and then the middleware firewall authentication is processed. Thus, the electronic financial transaction system for electronic financial transactions or the electronic commerce system for electronic commerce A fingerprint and / or a fingerprint of the face, and processes the user authentication by scanning the fingerprint and / or the fingerprint.

In the present invention, the fingerprint and / or finger vein recognizer is formed of an input / output integration module U1 for interlocking the fingerprint and the finger vein, and the integration module U1 includes a fingerprint module U2, U3) and a conversion module (U4). The fingerprint module (U2) scans a fingerprint image from an image sensor and compares the fingerprint image with a previously stored image. If there is a person with the same fingerprint image, Serial communication, or the finger vein module U3 transmits a finger through the infrared LED to scan a finger vein from a camera image sensor and compares it with a pre-stored finger vein image. If there is a person with the same image, And outputs the second serial communication output from the fingerprint module (U4) to the first module (U2), such that the second serial communication module And the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 are received by the integration module U1, A fingerprint authentication code output from the fingerprint module U2 and a fingerprint authentication code output from the fingerprint module U3 may be output from the fingerprint module U2, (U1), and when the fingerprint and the fingerprint authentication code coincide with each other, the corresponding authentication code can be output to the USB, and the fingerprint and / or the fingerprint are scanned to process the user authentication It is a financial transaction relay system with safety lock function.

In the present invention, the GND line 1 of the fingerprint module U2 is a (-) voltage circuit, the line RX2 is a serial data reception port, the line TX3 is a serial data transmission port, Line is a (+) voltage reference of the power supply circuit. When the fingerprint image is scanned by the image sensor and compared with a previously stored image, if the person of the same fingerprint image exists, the registered authentication code of the person is output by 232 communication And a fingerprint and / or a fingerprint to scan the fingerprint and / or the fingerprint to process the user authentication.

In the present invention, the GND line 1 of the finger vein module U3 is a (-) voltage reference, the A 2 line is a serial communication standard RS485 communication A port, the B 3 line is a serial communication standard RS485 communication B port, VCC line 4 is the (+) voltage reference of the power supply circuit, GND line 1 on the left side of the conversion module U4 is the reference of the negative voltage, A 2 line is the serial communication standard The line B 3 is a serial communication standard RS485 communication port B and the line VCC 4 is a (+) voltage reference, and the DI on the right side of the conversion module U 4 linked to the finger vein module U 3 is RS 485 communication A port, Line 5 is a serial 232 communication reception port, RE 6 line is a 485 communication control port, DE 7 line is a 485 communication control port, and RO 8 line is a serial 232 communication transmission port. Multiple security lock functions to scan for fingerprints and / or fingerprints to handle user authentication Trading is a relay system.

In the present invention, the D1 / TX1 line of the integration module U1 is a serial 232 communication transmission port, the D0 / RX2 line is a serial 232 communication reception port, and the GND line 4 is a (-) line. D2 is the serial 232 communication transmission line, D3 is the fingerprint module (U2) serial 232 communication reception line, and D8 11 is the communication module of the 485-232 communication conversion module D9 12 is a 485 communication control port of the 485-232 communication conversion module U4, and D10 13 is a serial 232 communication transmission port of the U4 communication module U4. 485 communication control port of 485-232 communication conversion module (U4), D11 line 14 is the serial 232 communication receiving port of 485-232 communication conversion module (U4), 5V line 27 is the (+) voltage 5V output pin , The GND line 29 is based on the (-) voltage and the VIN line 30 is based on the (+) voltage. These configurations are based on the fingerprint authentication And the finger vein authentication code output from the finger vein module U3 is converted into 232 communication from the conversion module U4 and received by the integration module U1. When the fingerprint and the finger vein authentication code coincide with each other, Wherein the authentication code is output by scanning the face and fingerprint and / or finger vein to process the user authentication.

In the present invention, the fingerprint and / or finger vein recognizer is formed of an integrated image capturing device 200a capable of capturing a fingerprint and a finger vein, and the scan panel 250 of the integrated image capturing device 200a is provided with a finger The finger placement unit 252 is formed of a finger finger contact part 250a on which a fingerprint authentication module 250an is formed and a finger finger noncontact part 250b on which a finger vein authentication module 250bn is formed, The scan panel 250 is formed in two lines so that two fingers can be authenticated side by side. The scan panel 250 is divided into two lines for registering the fingerprint and / And an identification processing unit for processing a face and a fingerprint and / or a finger vein to process user authentication.

In the customer terminal of the present invention, a magnetic card check part 1102 is formed on one side of a rectangular POS terminal, and an IC card check part 1101 is formed on a lower side. The power source part 1110 is turned on A POS terminal 1000 that is started by a data input unit 1120 and displays a settlement amount on an LCD display unit 1130 for a clerk and presses a final payment button, An electrical component cover 1150 is formed as a payment system for a customer and a fingerprint and fingertip authentication processor 1180 is formed on one side of the electrical component cover 1150 and on the other side, A customer LCD display unit is formed on the front surface of the electrical component cover 1150 so as to form a separate rectangular shape, , And a face information authentication processing unit (1196) is formed at the upper end of the LCD display unit for the customer, and a user authentication process is performed by scanning a face and / or a fingerprint or a finger vein .

The first serial communication of the fingerprint module U2 is output by the 232 communication and the second serial communication of the fingerprint module U3 is output by the 485 communication. Lock function of a multi-safety lock function that processes 485 communications output from the MAC module and converts it into 232 communication and outputs the scanned fingerprint and / or fingerprint to process user authentication.

The present invention provides a processing method of a financial transaction relay system, comprising the steps of: accessing a financial transaction relay server from a customer terminal having a fingerprint and / or finger vein recognizer and a face recognizer as one module, Acquiring fingerprint and / or finger vein information and face information by scanning from the fingerprint and / or the finger vein reader and the face recognizer, and transmitting the fingerprint and / or finger vein information and the face information via the communication network to the financial transaction relay Transmitting and registering to the server; When the financial transaction relay server receives the face information and the fingerprint and / or fingerprint information from the customer terminal when the customer terminal accesses the financial transaction relay server to perform electronic financial transaction and electronic commerce ; Receiving facial information from the customer terminal and determining whether the facial information is unique with the registered facial information; Determining whether the fingerprint and / or fingerprint information transmitted in the second order is identical to the registered fingerprint and / or fingerprint information if the face information transmitted from the customer terminal is not unique; And the fingerprint information and / or the fingerprint information transmitted from the customer terminal is identical to the fingerprint and / or the fingerprint information previously registered, the user terminal receives the user authentication processing signal from the customer terminal, Determining whether a match is found; Receiving a final authentication signal from the client terminal to process the middleware firewall authentication; And a fingerprint and / or finger vein scanning the fingerprint and / or the fingerprint to process user authentication.

In the present invention, the fingerprint and / or finger vein recognizer is formed of an input / output integration module U1 for interlocking the fingerprint and the finger vein, and the integration module U1 includes a fingerprint module U2, U3 and a conversion module U4. The fingerprint module U2 scans the fingerprint image from the image sensor and compares the fingerprint image with a previously stored image. If there is a person with the same fingerprint image, Or the finger vein module U3 transmits a finger through the infrared LED to scan a finger vein from a camera image sensor and compares it with a pre-stored finger vein image. If there is a person with the same image, And outputs the registered authentication code to the 485 serial communication. The conversion module (U4) receives the 485 serial communication output from the fingerprint module (232) And the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 are received by the integration module U1, Wherein the authentication code is output to the USB when the fingerprint authentication codes match with each other, and wherein the fingerprint and / or the fingerprint are scanned to process the user authentication. Processing method.

In the present invention, the user authentication processing signal in the next step after passing through the fingerprint and / or finger vein information discriminating step is any one of a password, a telephone number, an iris, a fingerprint and / or fingerprint information And processing a user authentication by scanning a face and a fingerprint or / and a fingerprint.

In the present invention, the financial transaction relay server is divided into a man 1401 and a woman 1402, and the man 1401 and the woman 1402 are divided into units of 10 years by generation, A fingerprint and / or a fingerprint of the face and / or the fingerprint of the fingerprint to process the user authentication.

Therefore, according to the present invention, a system capable of preventing the revocation of a public certificate is developed even if the public authentication certificate is abolished by organically linking the electronic approval system using double security by simultaneous scanning for face, fingerprint and / or fingerprint recognition In addition to improving the recognition speed by reducing the amount of data by processing the facial images taken by the face recognizer through mathematical pattern analysis based on the musculoskeletal structure, And the technology that can be applied to the financial transaction payment system by linking with the method that can reduce the false recognition rate through the system.

The false recognition rate of the fingerprint can be reduced by simultaneously authenticating the fingerprint and the fingerprint which can significantly improve the false recognition rate of the fingerprint of the present invention and the error of judging the similarity of the blood vessel to the finger vein can be reduced, Since only one can easily recognize, there is an effect that it can bring out the remarkable effect of the security that can substitute the authorized certificate.

Therefore, even if two fingers are used, the error range with respect to the recognition rate of the fingerprint or finger vein is narrowed to reduce the recognition rate of each finger, thereby determining whether or not the fingerprint or finger vein is authenticated by the form of the combination. And the error range is also reduced.

Furthermore, the present invention can be realized by developing an integrated module for simultaneously authenticating fingerprints and fingerprints.

In addition to these advantages and disadvantages, fingerprints and fingerprints that exist on both fingers that combine fingerprint authentication technology and fingerprints can be used to capture biometric information through a stereoscopic authentication device. Even when the end of the global village comes, We believe that biometrics information can be maintained.

The fingerprint and fingerprint authentication device is equipped with a fingerprint acquisition module on the front side of the upper part which authenticates the finger and a fingerprint acquisition module is installed from the first finger finger to the inside of the second finger finger, After acquiring the MAC information, the second and third or third and fourth fingers are naturally formed into an 11-character form, or a diaphragm portion is formed according to the interference of the infrared rays transmitted from the lower side to connect to the terminal in a V- If at any moment of the moment, simultaneous authentication is performed by the stereoscopic imaging technique, and all functions of the device are secured.

In addition, it is possible to request the human body information at the last step separately so that the financial transaction can not be performed unless it is human body information of the person.

As described above, when two fingers are used, the recognition accuracy of the fingerprint or the finger vein can be made accurate because the grounding angle is constant and the consistency and stability of the authentication part to be grounded becomes constant.

1 (a) and 1 (b) illustrate an outline structure of a smart phone to which an iris recognition method using a camera for a short distance iris image of a smartphone is applied according to an embodiment of the present invention, and an eye shape, It is an external structure.
FIG. 2 is a block diagram illustrating an iris recognition apparatus using a camera for short-range iris photography of a smartphone according to an embodiment of the present invention.
Fig. 3 is an explanatory view of the muscle structure of the eye of the prior art.
FIG. 4 is a simplified block diagram of a face image of the conventional invention, and is a diagram showing the position and the distance measuring method.
5 is a diagram showing an input / output integration module for linking algorithms of fingerprints and fingerprints.
FIG. 6 is a block diagram illustrating a configuration of a financial transaction relay system having multiple security lock functions using face authentication according to the present invention; FIG.
FIG. 7 is a block diagram showing the configuration of the financial transaction relay server shown in FIG. 6; FIG.
FIG. 8 is a block diagram illustrating a configuration of a customer terminal shown in FIG. 6; FIG.
FIG. 9 and FIG. 10 are flowcharts illustrating processing procedures of a financial transaction relay system having multiple security lock functions using face authentication according to an embodiment of the present invention, respectively. And
FIGS. 11 and 12 illustrate processing procedures of a financial transaction relay system having multiple security lock functions for simultaneously scanning a face and a fingerprint and / or a finger vein according to another embodiment of the present invention to process user authentication Fig.
Fig. 13 conceptually shows an image acquisition mechanism of the finger vein fingerprint of the fingerprint fingerprint authentication device 200a according to one embodiment of the present invention, and is an embodiment of a fingerprint placement portion for placing the upper finger.
Fig. 14 is a conceptual diagram showing an image acquisition mechanism of finger vein and finger vein for two fingers of authentication device 200a according to one embodiment of the present invention.
Fig. 15 is a conceptual illustration of a fingerprint image acquisition mechanism for two fingers of an authentication device 200a according to an embodiment of the present invention.
16 is a diagram showing an internal electronic configuration example of the authentication device 200a of the present invention.
Fig. 17 shows the fingertip face (a) and fingertip side (b) of the same finger taken by the finger vein image sensor and the finger fingerprint image sensor.
18 is a diagram showing a configuration example of the entire process of the authentication method using the authentication apparatus of the present invention.
FIG. 19 is a view showing fingerprints and finger vein images for two fingers of the present invention.
20 is a matrix table in which the fingerprint 1 and the fingerprint 2 of the present invention and the finger vein 1 and the finger vein 2 can represent a combination form.
Figs. 21 and 22 are flowcharts when fingerprint 1 and finger vein 1 of the present invention are recognized at the same time.
23 and 24 are flowcharts when fingerprint 2 and finger vein 2 of the present invention are recognized at the same time.
FIG. 25 shows an internal electronic configuration example of the fingerprint and / or finger vein authentication device 1200 according to a preferred embodiment of the present invention, and FIG. 26 is a generation unit classification register showing the server configuration of the present invention.
27 and 28 are perspective views schematically showing the configurations of the first and second embodiments of the integrated payment apparatus using the POS terminal of the present invention.

The embodiments of the present invention can be modified into various forms and the scope of the present invention should not be interpreted as being limited by the embodiments described below. The present embodiments are provided to enable those skilled in the art to more fully understand the present invention. Therefore, the shapes and the like of the components in the drawings are exaggerated in order to emphasize a clearer explanation.

The face technique will be applied using the developed technique as shown in Figs. 3 to 4.

An integrated module for linking fingerprints and fingerprint algorithms to implement the invention can be described as follows.

5 is a diagram showing an input / output integration module for linking algorithms of fingerprints and fingerprints.

As shown in FIG. 5, the input / output integration module U1 for simultaneously linking fingerprint and fingerprint algorithm comprises a fingerprint module U2, a fingerprint module U3, and a conversion module U4.

First, the fingerprint module U2 will be described.

The GND line 1 of the fingerprint module U2 functions as a 0V grounding function as a reference of the negative voltage circuit and the line RX 2 serves as a serial data receiving port to control the fingerprint module. Line is a serial data transmission port that reads the status of the fingerprint module and line 4 of VCC functions as a + 5V voltage input function based on the (+) voltage of the power supply circuit. When a fingerprint is scanned and compared with a previously stored image, if there is a person of the same fingerprint image, the registered authentication code of the person is output to the serial communication (here, 232 communication is applied as an embodiment).

Here, 232 communication is a serial communication standard.

Next, the finger vein module U3 will be described.

The GND line 1 of the finger vein module U3 has a 0V grounding function as a reference of a negative voltage and the A 2 line is a serial communication standard RS485 communication A port for data reception and transmission functions, Line 3 is a serial communication standard RS485 communication B port for receiving and transmitting data. VCC line 4 is a + (positive) voltage reference of the power supply circuit and functions as a + 5V voltage input. After transmitting a finger through an infrared LED, a vein is scanned by a camera image sensor and compared with a vein image stored in advance. When there is a person with the same image, the registered authentication code of the person is used for serial communication (herein, 485 communication is applied as an embodiment) .

Here, 485 communication is a serial communication standard.

The following describes the conversion module U4 of the 485-232 communication.

The GND line 1 on the left side of the conversion module U4 has a 0V grounding function as a reference of the negative voltage and the A 2 line is a serial communication standard RS485 communication A port for data reception and transmission functions, The line 3 is a serial communication standard RS485 communication B port, and functions as a data receiving and transmitting function. The line VCC 4 is a (+) voltage reference and functions as a voltage input of + 5V. And converts the received 485 communication into 232 communication.

The line DI5 on the right side of the conversion module U4 is a serial 232 communication reception port and receives data. RE6 line is a 485 communication control port, and controls the transmission / reception state of the 485 communication module The DE 7 line is a 485 communication control port and controls the transmission / reception state of the 485 communication module. The RO 8 line is a serial 232 communication transmission port, and functions to transmit a command. It is linked with the integration module U1.

Next, the fingerprint and fingerprint input and USB output integration module U1 will be described.

The D1 / TX1 line of the integration module U1 is a serial 232 communication transmission port and functions as a data transmission function to a computer. The D0 / RX2 line is a serial 232 communication reception port. , GND line 4 is the ground of 0V as a voltage reference and D2 line 5 is the serial 232 communication transmission line of the fingerprint module (U2). It sends the command to the fingerprint module and D3 Line is a fingerprint module (U2) serial 232 communication reception line, and receives the status value of the fingerprint module. D8 line 11 is a serial 232 communication transmission port of the 485-232 communication conversion module (U4) D9 line 12 is a 485 communication control port of the 485-232 communication conversion module U4 and functions to control the sending and receiving states of the 485 communication module and D10 13 line Is a 485 communication control port of the 485-232 communication conversion module U4, D11 Line 14 is the serial 232 communication receiving port of 485-232 communication conversion module (U4), and it reads the status of the finger vein module (U3) Line is a (+) voltage 5V output pin that supplies the 5V voltage of fingerprint module (U2), finger module (U3), 485 communication conversion module (U4) The VIN line 30 has a + 5V voltage input function as a voltage reference, and the VIN line 30 has a + 5V voltage input function. In the above configuration, the fingerprint authentication code output from the fingerprint module U2 And the finger vein authentication code (the unique number of the customer registered with the low vein) output from the finger vein module U3 is converted into 232 communication from the conversion module U4 and the integrated module U1 ), And when the fingerprint and the fingerprint authentication code coincide with each other, the corresponding authentication code is output through USB.

As a method of outputting another fingerprint and a fingerprint authentication code, a fingerprint authentication code output from the fingerprint module U2 and a fingerprint authentication code output from the fingerprint module U3 are received from the integration module U1 The fingerprint authentication module may output the fingerprint authentication code to the fingerprint module and the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3, And the fingerprint and finger vein authentication code are received by the integration module (U1), and when the fingerprint and the fingerprint authentication code coincide with each other, the corresponding authentication code is output via USB. It can be processed.

The fingerprint and fingerprint algorithm of this case invention can be expressed as follows.

int getfingerauthorization (int fingerprintcode, int fingerveincode)

{

    if (fingerprintcode> 0 && fingerveincode> 0 && fingerprintcode == fingerveincode))

    {

return fingerprintcode;

    }

    return 0;

}

The algorithm is an algorithm that accepts a fingerprint authentication code and a fingerprint authentication code from the integration module U1 and allows an authentication code only when the fingerprint and the low vein are the same person.

The following is a more detailed description.

The fingerprint module U2 retrieves a fingerprint and outputs the code number of the corresponding person when there is a person matching the fingerprint.

The finger vein module U3 searches for a finger vein and outputs the corresponding person's code number if there is a person matching the finger vein.

The fingerprint code of the fingerprint module U2 and the fingerprint code of the fingerprint module U3 are inputted into fingerprintcode and fingerveincode which are the arguments of the function name getfingerauthorization of the above algorithm so that both argument values are valid and also two registration The fingerprint and the finger vein integration module output the person's code only when the unique number of the customer is matched.

If other fingerprint code and fingerprint code are invalid or do not match, an error code of 0 is output.

In the present invention, the " simultaneous use of means such as face and fingerprint "means " simultaneous use of two kinds of authentication" and " , And "to pass the certification to the next one".

To describe this in more detail, when two identical faces are registered in the same bank at the time of face authentication as in the case of authenticating with the concept of two "and" and another authentication, Pass, and / or fingerprint authentication and / or fingerprint authentication, it is judged that there is no identical person among the two faces having the same face, so that the probability of false recognition can be extremely limited.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS.

FIG. 6 is a block diagram illustrating a configuration of a financial transaction relay system having multiple security lock functions using face authentication according to the present invention, FIG. 7 is a block diagram illustrating a configuration of a financial transaction relay server shown in FIG. 6 And FIG. 8 is a block diagram illustrating a configuration of a part of the customer terminal shown in FIG.

First, the present invention relates to a financial transaction relay system having multiple security lock functions and a processing method thereof, which is disclosed in Korean Patent Application No. 10-2014-0124035 filed on September 18, 2014 by the present applicant, Of Patent Application No. 10-2015-0004590, filed on January 13, 2015, entitled " Financial Transaction Relay System Having Multiple Safety Lock Functions Using Finger Authentication " will be.

Referring to Figures 6-8, the financial transaction relay system 2 of the present invention utilizes multiple security lock functions including face authentication, fingerprint and / or fingerprint authentication, password authentication, and / or phone number authentication Electronic transaction processing and e-commerce transactions are performed between the customer terminal 200 and the electronic financial transaction system 300 and the electronic commerce system 400 for the electronic financial transaction, the electronic commerce transaction, and the like.

To this end, the financial transaction relay system 2 of the present invention uses the middleware firewall 120 to transmit to the financial transaction relay server 100 at least one of face authentication, fingerprint and / or fingerprint authentication, The user terminal 200 is registered as a member and an unauthorized connection is made between the customer terminal 200 and the electronic financial transaction system 300 and the electronic commerce system 400 during financial transactions to relay electronic financial transactions and electronic commerce transactions do.

Specifically, the financial transaction relay system 2 of the present invention includes the communication networks 4 and 6, the customer terminal 200, the electronic financial transaction system 300, the electronic commerce system 400, and the financial transaction relay server 100).

The communication networks 4 and 6 are provided in a wired or wireless communication network or a mobile communication network and are connected to the customer terminal 200, the electronic financial transaction system 300, the financial transaction relay server 100, the customer terminal 200, System 400 and the financial transaction relay server 100 are connected to each other so that data communication is performed.

The customer terminal 200 is provided, for example, in a portable computer such as a smart phone, a tablet computer, a notebook computer, or a personal computer, and connects to the financial transaction relay server 100 through the communication network 4. To this end, the customer terminal 200 accesses the financial transaction relay server 100 using a web browser or a mobile application, accesses the electronic financial transaction system 300 and the electronic commerce system 400 through the financial transaction relay server 100, To conduct electronic financial transactions and electronic commerce.

The customer terminal 200 includes a fingerprint and / or finger vein recognizer 210 for obtaining fingerprint and / or finger vein information and a face recognizer 220 for extracting face information. The customer terminal 200 transmits the fingerprint and / or finger vein information obtained from the fingerprint or / and the finger vein recognizer 210 and the face information extracted from the face recognizer 220 to the financial transaction relay server 100). In this embodiment, the fingerprint and / or finger vein recognizer 210 and the face recognizer 220 are provided as one module 202, so that fingerprint and / or finger vein and face can be scanned at the same time during user authentication.

The customer terminal 200 accesses the financial transaction relay server 100 via the communication network 4 and registers the member as a member. At this time, the customer terminal 200 registers the fingerprint or / and the fingerprint information and the face information in the financial transaction relay server 100, and registers the password registered in the electronic financial transaction system 300 or the electronic commerce system 400 Register. Also, the customer terminal 200 can be additionally authenticated using the telephone number from the financial transaction relay server 100. The customer terminal 200 also includes a fingerprint reader and / or a fingerprint recognizer 210 and a face recognizer 220 for electronic financial transactions and electronic commerce with the electronic financial transaction system 300 and the electronic commerce system 400 The fingerprint and / or finger vein and the face are scanned at the same time, and the recognized fingerprint and / or finger vein information and face information are provided to the financial transaction relay server 100.

The customer terminal 200 of this embodiment is provided as a smart phone and connects to the financial transaction relay server 100 via the communication network 4 as shown in FIG. 8 to perform electronic financial transactions, financial transaction transactions for electronic commerce Downloads the app 202 and installs it inside. Also, the customer terminal 200 activates the financial transaction relaying application 202 to transmit the fingerprint and / or the fingerprint information and the face information at the same time through the fingerprint and / or the finger vein recognizer 210 and the face recognizer 220 Scan fingerprint and / or finger vein information and face information to the financial transaction relay server 100 through the communication network 4. [

The fingerprint of the customer terminal 200 and / or the finger vein reader 210 and the face recognizer 220 may be provided in the form of one module 202 of the customer terminal 200, Or may be provided as an independent device detachable from the customer terminal 200, as shown in FIG. This eliminates the economic burden of purchasing the fingerprint and / or finger vein recognizer 210 and the face recognizer 220 by the customer, and in order to positively encourage the use of the financial transaction relay app 202, The fingerprint or / and the finger vein recognizer 210 and the face recognizer 220 are provided to the commerce site at a service provider, an affiliate shop, or a credit card company of the relay server 100, and the fingerprint and / The user terminal 200 can be provided in a removable form.

The face recognizer 220 can extract the pattern of the customer's eyes and use it for personal authentication.

However, in the present invention, the facial information recognized by the face recognizer 220 is transmitted to the financial transaction relay server (not shown) If fingerprint information that is the same as or similar to the face information stored in the database 130 of the fingerprint recognition device 210 is difficult to identify, i.e., is not unique face information, the fingerprint and / To authenticate the user, that is, the customer.

Therefore, the financial transaction relay server 100 authenticates the user by using the face, and authenticates the user using the fingerprint and / or the fingerprint secondarily when an authentication error occurs.

Specifically, the face recognizer 220 of this embodiment includes a controller 212 for controlling all operations of the face recognizer 220, a scanner 214 for acquiring face information by scanning the customer's finger, A face image display unit 218 for displaying the face information scanned from the scanner 214 or displaying the process of the face recognizer 220, And an interface module 220 connected to the scanner 200 and providing face information obtained from the scanner 214 to the customer terminal 200.

The memory 216 stores a face pattern extraction program 230 for extracting a face pattern from the acquired face information. Thereafter, it is possible to judge whether or not the face pattern matches the face pattern of the customer according to the command of the face pattern program 230. [

Referring again to FIG. 6, the electronic financial transaction system 300 is provided in a partner bank, an insurance company, a securities company, and the like. The electronic financial transaction system 300 includes an electronic financial transaction according to the banking process performed online by the customer terminal 200, And deals with electronic financial transactions based on brokerage business. When the customer terminal 200 is approved as a multiple security lock function through the financial transaction relay server 100, the electronic financial transaction system 300 is connected without authentication.

The e-commerce system 400 may include, for example, an online shopping mall system such as a department store or a discount store, a passenger transportation reservation system for aviation or railroad, a lodging reservation system for a condo or a hotel, And a leisure reservation system. When the customer terminal 200 is approved as a multiple security lock function when using electronic commerce through the financial transaction relay server 100, the user terminal 200 is connected without authentication.

When the customer terminal 200 registers as a member, the financial transaction relay server 100 registers the member as a member through the multiple safety lock module 110 and transmits the electronic transaction information to the electronic financial transaction system 300 and the electronic commerce system 400 The fingerprint and / or fingerprint information from the customer terminal 200 at the same time, sequentially authenticates the user, authenticates the user through the password and the middleware firewall 120, If the electronic financial transaction system 300 and the electronic commerce system 400 are approved as multiple security lock functions in electronic financial transactions and electronic commerce transactions, the transaction is relayed so that the financial transactions can be performed through the unauthorized access. The financial transaction relay server 100 establishes a personal portal site for electronic financial transaction and electronic commerce.

7, the financial transaction relay server 100 includes a control unit 102, a communication unit 104, a multiple safety lock module 110, a middleware authentication processing unit 122, and a database 130 ). Although not shown in the figure, the financial transaction relay server 100 includes components of a typical computer system such as a central processing unit, a memory unit, an input / output unit, and a storage unit.

The control unit 102 controls and processes all operations of the financial transaction relay server 100. The control unit 102 may include, for example, hardware such as a central processing unit, a memory or a web server, as well as software such as an operating system program, a control program, and the like. The controller 102 controls the customer terminal 200 to transmit facial information, fingerprints and / or designations from the customer terminal 200 in electronic financial transactions and electronic commerce transactions in the electronic financial transaction system 300 and the electronic commerce system 400. [ MAC information, and password and phone number information, and processes the multiple safety lock module 110 so that the unauthorized connection is made to the electronic financial transaction system 300 and the electronic commerce system 400. [ At this time, if the user's face information is the same or similar to a plurality of face information among the face information stored in the database 130 and the user identification is impossible, the control unit 102 uses the fingerprint and / Thereby further controlling the user authentication.

The control unit 102 allows the client terminal 200 to process and authenticate the password through the face authentication, the fingerprint and / or the finger vein authentication, and the middleware firewall 120, and the middleware authentication processing unit 122 causes the multi- Function. At this time, the control unit 102 may process the user authentication using the telephone number instead of the password authentication, or may process the telephone number authentication together with the password.

The communication unit 104 connects the customer terminal 200 with the electronic financial transaction system 300 and the electronic commerce system 400 via the communication networks 4 and 6 and transmits the electronic financial transaction and electronic commerce And connects the terminal 200 to the financial transaction relay server 100.

The multiple security lock module 110 is provided with software, for example, and has a user authentication function of the customer terminal 200 in multiple stages. In this embodiment, the multiple safety lock module 110 receives face information and fingerprint information and / or fingerprint information from the customer terminal 200, sequentially compares the registered face information with fingerprint and / or fingerprint information A fingerprint and / or fingerprint recognition processing unit 112 (113) for processing the fingerprint and / or fingerprint information to identify the user if the face information can not be identified by the user, And a telephone number authentication processing unit 116 for authenticating using the telephone number of the customer terminal 200. The telephone number authentication processing unit 116 includes a telephone number registration unit 116,

The middleware firewall 120 includes a middleware authentication processing unit 122. The middleware authentication processing unit 122 is provided between the multiple safety lock module 110 and the database 130 and transmits the authenticated client terminal 200 authenticated by the multiple safety lock module 110 to the middleware firewall 120 And processes various information of the database 130 so as to be provided to the electronic financial transaction system 300 or the electronic commerce system 400. [

The database 130 stores various information according to the process of the multiple safety lock module 110 under the control of the control unit 102. In this embodiment, the database 130 is provided inside the financial transaction relay server 100, but may be provided as a separate database server.

Specifically, the database 130 stores member information 132, fingerprints and / or fingerprint information 134, face information 136, and financial information 138. The member information 132 includes information such as a name and an ID of the user terminal 200 when the customer terminal 200 registers as a member of the financial transaction relay server 100, , A password, a telephone number, an e-mail address, and the like. The member information 132 is matched with the fingerprint or / and the fingerprint information 134, the face information 136, and the financial information 138. The member information 132 is input when the customer terminal 200 activates the financial transaction relaying application 202 and registers it as a member.

The fingerprint and / or fingerprint information 134 is acquired from the fingerprint of the customer terminal 200 and / or the finger vein recognizer 210 when the user of the customer terminal 200 registers as a member of the financial transaction relay server 100 And fingerprint information and / or fingerprint information.

The face information 136 is registered in correspondence with the member information 132. The face information 136 is obtained from the face recognizer 220 of the customer terminal 200 and is provided from the customer terminal 200 to the financial transaction relay server 100 via the communication network 4. [ Therefore, the face information 136 registered in the financial transaction relay server 100 can be transmitted to one payment means (for example, a virtual payment means), or to a user authentication of a payment means (for example, a credit card, a transaction account, Is used as necessary information. The face information 136 is extracted as a face pattern and stored as information on the extracted face pattern.

The financial information 138 includes information on payment means such as a credit card, a debit card, a check card, and a transaction account issued by the customer terminal 200, and the electronic financial transaction system 300 or electronic A password of the passbook account registered in the commerce system 400 or a password for authentication of the middleware firewall 120. [

The financial transaction relay server 100 firstly authenticates the fingerprint and / or the fingerprint authentication based on the mobile application, that is, the financial transaction relaying application 202, secondly the firewall password authentication, the third face authentication, When a flat home for processing middleware authentication for financial management is constructed and finally passed through a firewall authentication line which is a final boundary line, it is connected to multiple security lock module 110, And the fingerprint and / or fingerprint information processing unit 112, the password processing unit 114 and the telephone number processing unit 116 and the membership information 132 associated with the database 130, the fingerprint and / Information 134, and financial information 138, and passing through the middleware approval processing unit 122 between the software and the hardware operating system, Requesting authorization information to be deployed approve the processing performed according to the operation of the final multi-safety lock module 110 in conjunction with middleware authorization processing unit 122.

Further, as the unique password of the consumer such as the biometric information at the end, the user authentication processing signal of the next stage after passing through the fingerprint and / or the fingerprint information discrimination step may be a password, a telephone number, a face, a fingerprint and / One can choose to ultimately authenticate financial security.

Therefore, the financial transaction relay system (2) of the present invention opens multiple security lock functions and is processed so that electronic financial transactions and electronic commerce can be safely and conveniently used through unauthorized access.

As described above, the financial transaction relay system 2 of the present invention uses the mobile application 202 of the customer terminal 200 to perform fingerprint authentication and / or fingerprint authentication, password authentication, face authentication, and middleware authentication processing Multiple authentication paths including a fingerprint and / or a fingerprint, a password, and a face and a multiple security lock function of the middleware authentication processing unit 122 are processed so that unauthenticated connection can be performed only after a multistage procedure of the middleware authentication process.

In the financial transaction relay system 2 of the present invention, the customer terminal 200 downloads a mobile application through a smart phone or a personal portal connection, and uses the downloaded application for financial transactions. At this time, the financial transaction relay server 100 recognizes the face at the moment when the customer brings the fingerprint or / and the finger vein face to the customer terminal 200 using the multiple safety lock module 110, And the authorized MAC address is recognized, and next, the middleware firewall 120 must pass the authentication process.

In the authentication process of the middleware firewall 120 of the present invention, the facial pattern is extracted through the unique facial scanning of each customer, and one of the plurality of facial information associated with the facial information of the database 130 is recognized. Then, at the moment of taking off the eyes, the information of the customer's own is removed, and the face pattern is newly extracted and recognized automatically every time the face is scanned. At this time, when the user is authenticated using the face (or the fingerprint and / or the fingerprint) as the primary key, if the user authentication error occurs, the user is authenticated using the fingerprint and / or fingerprint , The face and the fingerprint and / or the fingerprint are the same or similar, it is possible to minimize the user authentication error even when the user identification is difficult.

FIGS. 9 and 10 are flowcharts illustrating different processing procedures of a financial transaction relay system having multiple security lock functions using face authentication according to an embodiment of the present invention.

9, the financial transaction relay system 2 of the present invention accesses the financial transaction relay server 100 through the communication network 4 in step S150 and subscribes to the member in step S152 . At this time, the customer terminal 200 inputs customer's personal information such as a name, an ID, a password, a telephone number, and an e-mail address.

In step S154, the customer terminal 200 obtains the fingerprint and / or finger vein information and the face information through the fingerprint and / or the finger vein recognizer 210 and the face recognizer 220 and transmits the fingerprint and / And the finger information and the face information to the financial transaction relay server 100, the financial transaction relay server 100 registers the fingerprint and / or the fingerprint information and the face information in response to the customer terminal 200. At this time, the financial transaction relay server 100 stores the fingerprint or / and the fingerprint information 134 and the face information 136 in the database 130.

In step S156, the financial transaction relay server 100 firstly recognizes the face in order to perform the electronic financial transaction and the electronic commerce, and discriminates whether the face information matches the face information stored in the database in step S158, Authentication.

In step S160, the financial transaction relay server 100 receives the fingerprint information from the customer terminal 200 and determines whether the fingerprint information matches the fingerprint information stored in the database 130 in step S162. Fingerprint information stored in the database 130 is included in the member information 132. [ As a result of the determination, if the two pieces of information coincide with each other, the finger vein is recognized in a tertiary manner in step S164, and it is determined in step S166 whether the vein information coincides with the finger vein information stored in the database.

As a result of the determination, if the two pieces of fingerprint information match, the procedure proceeds to step S168, where the multiple safety lock module 110 sequentially transmits the database 130 of the financial transaction relay server 100 through the middleware approval processing unit 122, In step S170, the financial transaction relay server 100 accesses the electronic financial transaction system 300 or the electronic commerce system 400 without authentication and processes the transaction to relay the financial transaction.

However, if it is determined in step S158, step S162, and step S166 that the fingerprint or / or the fingerprint information and the face information do not match from the customer terminal 200, the financial transaction relay server 100 proceeds to step S172, And blocks the connection of the financial transaction relay server 100 to prevent transactions and e-commerce transactions from being processed.

Referring to FIG. 10, a step of inputting a password, which is the step S160, is omitted. In case of face recognition, since it is possible only in the living state, it can be done only by the user, so even if only the fingerprint is added, it can be a simple and accurate financial settlement system.

Since the other procedures are the same, the description of the overlapping process is omitted here.

11 and 12 illustrate different processing procedures of a financial transaction relay system having multiple security lock functions for simultaneously scanning a face and a fingerprint and / or a finger vein according to another embodiment of the present invention to process user authentication Fig.

In this embodiment, the face information and the fingerprint and / or fingerprint information are the same or similar to each other and are processed when the user identification is difficult. The first user authentication is processed by the face information, Secondly, user authentication is processed using fingerprint and / or fingerprint information.

11, the financial transaction relay system 2 of the present invention simultaneously prints fingerprints of the customer terminal 200 and / or the fingerprint recognizer 210 and the face recognizer 220 at step S180. Finger vein and / or finger vein information and face information to the financial transaction relay server 100 by scanning the finger vein and the face.

In step S182, the financial transaction relay server 100 recognizes the face information, the fingerprint and / or the fingerprint information, and in step S184, the face information is compared with the face information stored in the database 130 to determine whether it is unique.

As a result of the determination, if the face information is unique, the procedure proceeds to step S188. If it is not unique, that is, if the face information is the same or similar and the user identification is difficult, the fingerprint information is stored in the database 130 in step S186 It is compared with the information to determine whether it is unique.

As a result of the determination, if the fingerprint information is unique, the procedure advances to step S188 to recognize the fingerprint information and process the user authentication when the fingerprint information matches the fingerprint information stored in the database 130. [

In step S190, it is determined whether or not the fingerprint information matches the fingerprint information stored in the database 130. If the fingerprint information matches, the multiple safety lock module 110 in the middleware approval processing unit 122 in step S192, The financial transaction relay server 100 accesses the electronic financial transaction system 300 or the electronic commerce system 400 without authentication in step S194 to release the firewall 130 to open the database 130 of the server 100, .

However, if the user terminal 200 can not authenticate the user using the face information and the fingerprint or / and the fingerprint information in the steps S186 and S190, respectively, or if they are not identical, the flow advances to step S196 to perform electronic financial transactions and electronic commerce Thereby blocking the connection of the financial transaction relay server 100 from being processed.

Referring to FIG. 12, it is a flowchart for omitting the step of inputting the fingerprint information, which is the step S188. In the case of face recognition that recognizes the position of the pupil, it is possible only in the living state, so that it can be done only by the user. Therefore, even if the fingerprint is added, it can be a simple and accurate financial settlement system.

Hereinafter, the fingerprint and finger vein recognizer to which the present invention is applied will be described.

As shown in FIG. 13, the present invention is an integrated photographing authentication apparatus 200a capable of photographing a fingerprint and a finger vein. The object accommodating unit 201 includes a scan panel upper case 201a forming upper and lower finger seats, And a scan panel lower case 201b for accommodating a full-length part. A scan panel 250 for simultaneously photographing a fingerprint and a finger vein made of a transparent material such as glass or acrylic is installed on the upper part of the scan panel upper case 201a And the scan panel 250 is formed with fingerprint finger contact portions 250a and finger finger noncontact portions 250b at their front and rear ends.

Finger pad non-contact portion 250b of the scan panel 250 is formed at the edge of the groove side wall 251 so that the finger pad non-contact portion 250b can be formed as a groove, Is formed so as to be in balance with the fingerprint finger contact portion 250a.

The temperature sensor 275 for sensing the temperature of the flow of the finger is formed in front of the finger finger non-contact portion 250b so as to face the finger finger contact portion 250a of the scan panel 250, The temperature of the finger and the flow of the blood flow are sensed and the finger vein can be recognized by the detected temperature and flow.

In addition, on one side, an infrared side surface case portion 260 for receiving the infrared side surface emitting portion 260a is formed in a length so that the side surface can be photographed in order to photograph the vein more accurately.

The scan panel lower case 201b is formed as a space capable of accommodating electrical components.

Then, the finger restraint rim 253 on which the fingers can be accurately seated is formed.

Accordingly, in the first embodiment of the present invention, the user starts the finger vein authentication by placing the finger object on the scan panel 250, and when the finger vein authentication by the device is started, the infrared ray source unit 240 (241) Infrared rays toward the finger object.

In the first embodiment of the present invention, the integrated image sensing apparatus 200a has two image sensors 230 and 231 built therein. The finger vein image sensors 230 and 231 are built in the object accommodating unit 201 and take a finger vein of the object from the lower part toward the scan panel 250. [

The user of the present invention initiates finger vein authentication by placing a finger object on the scan panel 250. When the finger vein authentication by the device is started, the infrared ray source unit 240 (241) And the finger veins are photographed.

The fingerprint recognition method of the present invention is described below as a contact-type recognition method.

In one preferred embodiment of the present invention, the finger vein image sensors 230 and 231 and the finger fingerprint recognition module 250aa simultaneously capture both the finger vein fingerprint and the fingerprint fingerprint and use them as biometric information, In order to measure a Mac, the error range can be reduced to the maximum number of squares per day.

The finger vein and the finger fingerprint can be photographed at one time. The finger vein is captured at the side of the fingerprint face and the 90 degree side, and the fingerprint and the finger vein image are simultaneously obtained by one finger. Can be obtained. When shooting the side of your finger, roll your finger 90 degrees to the side of the scan panel with your fingers on the scan panel.

As shown in FIG. 13, a fingerprint recognition module 250aa is formed on the fingerprint finger contact portion 250a, and a fingerprint can be determined by touching the fingerprint.

The fingerprint recognition module 250aa has a multi-layer thin plate structure. A fingerprint recognition layer is formed on the upper layer of the fingerprint authentication module. A temperature and blood flow sensing authentication layer is formed on the fingerprint recognition module, It can be formed so as to start its operation afterwards.

Fig. 14 shows another embodiment of the present invention using a two finger fingerprint and finger vein. The same reference numerals and technical terms are used for the same technical constitution as the embodiment shown in Fig.

As shown in FIG. 14, the present invention is an integrated photographing authentication apparatus 200a capable of photographing a fingerprint and a finger vein. The object accommodating unit 201 includes a scan panel upper case 201a forming upper and lower finger seats, And a scan case lower case 201b for accommodating a full-length part. At the upper part of the upper case 201a of the scan panel, two scans for simultaneous photographing of two finger fingerprint and finger vein made of a transparent material such as glass or acrylic The panel 250n and 250r are provided so that the fingerprint finger contact parts 250an and 250ar and the finger finger noncontact parts 250bn and 250br are formed at the front and rear ends, .

The finger pad non-contact portion 250bn of one of the scan panels 250n is formed at the edge of the groove side wall 251 so as to be formed as a groove, (252) is formed to be flat with the fingerprint finger contact portion (250a).

The temperature sensor 275 for detecting the blood flow or temperature of the finger is formed in front of the finger finger non-contact portion 250bn opposite to the finger finger contact portion 250an of the scan panel 250, The finger is detected by detecting the temperature of the finger or the flow of the blood flow, and the finger vein can be recognized by the sensed temperature or flow.

In addition, a temperature sensor 205a or 205b for detecting the blood flow or temperature of the finger may be formed under the fingerprint finger contact portions 250aa and 250ab of the scan panel, or a temperature sensor 205a may be provided at any of the fingerprint authentication modules 250aa and 250ab A thin layer for authenticating the blood flow or temperature of the finger is formed on one layer so that the operation can not be performed when the living body does not authenticate at the same time.

That is, instead of the temperature sensor 275, a fingerprint recognition module 250an (250ar) may be formed, which has a multi-layered thin plate structure, a fingerprint recognition layer is formed on the upper layer of the fingerprint authentication module, A temperature and a blood flow sensing authentication layer may be formed on the blood pressure monitor to detect the temperature and the blood flow of the human body and then start the operation thereof.

In addition, on one side, an infrared side surface case portion 260 for receiving the infrared side surface emitting portion 260a is formed in a length so that the side surface can be photographed in order to photograph the vein more accurately.

When the finger vein authentication is started by the device, the infrared light source units 241 and 243 and the lower side (left and right) The infrared light source units 240 and 244 irradiate the infrared rays toward the finger object.

The left and right image sensors 231 and 232 and the lower image sensors 230 and 233 respectively take a finger vein of the irradiated finger.

The scan panel lower case 201b is formed as a space capable of accommodating electrical components.

In addition, a finger-seating edge 253 on which a finger can be seated is formed.

Therefore, in the fourth embodiment of the present invention, the user starts fingerprint authentication and finger vein authentication by placing a finger object on the scan panel 250n (250r), and when fingerprint authentication and finger vein authentication by the device are started, The light source units 240 and 244 irradiate the infrared rays toward the finger object.

The infrared light sources 241 and 243 formed on the left and right sides irradiate the infrared rays toward the finger object.

Also, the fingerprint authentication module 250an (250ar) is installed in the same object accommodating unit (201) almost at the same time to authenticate the fingerprint of the object.

In this case, as shown in the multifaceted stereoscopic photographing apparatus, if the two sides of the finger vein, two sides of the finger vein, two sides of the finger vein, and two fingerprints themselves are recognized, the 6D imaging apparatus can be described.

In a preferred embodiment of the present invention, both the finger vein fingerprint and finger fingerprint are simultaneously photographed and used as biometric information, so that the error range is reduced to a maximum square of that for each fingerprint or finger vein .

FIG. 15 shows another embodiment of the present invention using a two-fingerprint, and uses the same reference numerals and technical terms as those of the embodiments shown in FIGS. 13 and 14. FIG.

13 and 14, the fingerprint recognition modules 250aa and 250ab may be formed so that two fingerprints can be simultaneously authenticated by using only the fingerprint recognition part, Thereby providing a method for judging the fingerprint.

Here, in order to increase the probability of security, the temperature sensors 205a and 205b for detecting the temperature of the flow of the finger described above are formed in front of the fingerprint recognition modules 250aa and 250ab, And the finger vein can be recognized by the detected temperature and flow by sensing the flow of the blood flow.

Fingerprint recognition modules 250aa and 250ab may be formed in place of the temperature sensors 205a and 205b. The fingerprint recognition modules 250aa and 250ab may be formed in a multi-layer thin plate structure. A fingerprint recognition layer may be formed on the upper layer of the fingerprint authentication module. And a temperature and blood flow sensing authentication layer may be formed on the lower part to sense the temperature and blood flow of the human body and then start the operation thereof.

16 is an internal electronic configuration example of the finger vein photograph authentication apparatus 200a according to the preferred embodiment of the present invention.

The integrated imaging authentication apparatus 200a includes an infrared light source unit 1240, a finger vein image sensor 1230, a fingerprint image sensor 1220, a digital conversion unit 1290, a decryption algorithm unit 1260, A biometric information data storage 1270, and a display unit 1280.

Although not shown in the drawings, the power supply unit, the communication unit, and various I / O devices may be included.

The infrared light source unit 1240 irradiates infrared light toward the object accommodating unit. Preferably one or more LEDs emitting infrared light having a wavelength of 630 to 1,000 nm suitable for imaging the finger vein image. In addition, preferably, an optical filter is provided to remove the light noise.

In a preferred embodiment of the present invention, the finger vein image sensor 1230 (1231) acquires a finger vein image for one finger object on the bottom and sides.

In another preferred embodiment of the present invention, finger vein image sensor 1230 obtains a finger vein surface and a side vein image for one finger object.

As shown in Figs. 17 (a) and 17 (b), the angle at which the infrared rays are respectively photographed on the inner surface and the side of one finger.

Reference numeral 1a denotes a finger vein between finger segments, 1b denotes a node of the finger, and 1c denotes a fingerprint portion.

When the side image is photographed according to the number of finger vein image sensors 1230, the fingers of the side image 90 degrees side are moved to the side of the scan panel Contact. The order of photographing of the fingerprint face and the side face of the finger of the finger may be reversed.

Digital converter 1290 receives both the finger vein image and the finger fingerprint image and extracts the finger vein image and the finger fingerprint image. Digital converter 1290, the present invention obtains a finger vein fingerprint image and a fingerprint image file.

The control unit 1210 causes the digital conversion unit 1290 to transfer the converted image files to the matching algorithm unit 1260.

When the fingerprint and finger vein are simultaneously authenticated, the unauthorized identification processing unit 1265 divides the male information into "1" and the female information into "2".

The biometric information data store 1270 stores biometric information of a user stored in advance. In some embodiments of the present invention, the biometric information data store 1270 can be built in the authentication device 200a internal memory.

In another embodiment of the present invention, the data store 1270 is located in a repository external to the device and can be accessed via wired or wireless communication.

The biometric information data store 1270 can use a crypto-processor that can be protected from external hardware, software attack or theft.

The matching algorithm unit 1260 acquires the user data stored in the biometric information data storage 1270 and determines whether the user biometric information value acquired by the digital conversion unit 1290 matches the user biometric information value. If they match, the display unit 1280 can output a success message. If the decryption is unsuccessful, the authentication failure message may be output to the display unit 1280.

The control unit 1210 controls operations and functions of the authentication device 200a.

Particularly the finger vein image acquisition, processing, authentication calculation, and authentication result. Various software can be used in relation to the processing and calculation of acquired finger vein images.

For example, a Canny edge detector algorithm can be used. By applying a Gaussian filter, the noise of the original image can be removed as a whole. Edge the image through the Image Gradient. That is, a sketch line of the image is extracted. Apply non-maximum suppression to thin edges (sketch lines), apply double thresholds to classify dark edges as solid edges, and faint edges as noise and classify them as weak edges . Finally, the weak edges are deleted, only the definite edges are left, and finally the coronal images of the veins are output.

The authentication process embodiment of the authentication apparatus of the present invention is summarized again on the basis of the above detailed description as shown in FIG.

First, the person to be authenticated places his / her finger in the object accommodating portion of the authentication device in the waiting state. At this time, the authentication method is a method of photographing the bottom and / or side of the fingerprint surface and the finger vein of one finger.

In the embodiment in which only one finger is authenticated, the infrared rays, the line-of-sight capturing (S200), the finger vein fingerprinting (S210) on the fingerprint surface and the side of one finger are alternately performed 2 to 3 times do.

That is, S200 and S210 are performed on the fingerprint surface of one finger, and then S200 and S210 are performed on the side surface of the same finger. The captured finger vein fingerprint images are converted into digital images.

In step S215, the male and female customer information is registered in the male and female identification processor 265 while registering "1" for male and "2" for female at the time of registration.

If the customer information is registered in the customer client or the merchant client and the procedure for determining the same is made, the probability of false recognition of the present invention can be reduced to 1/2.

The customer information may include customer information such as a name, a man and a woman, an authorized mobile phone number, a contact, a secret number, and the like, which are input when a customer client activates the fingerprint and / Number, email address, and the like.

Next, the control unit extracts the photographed fingerprint and the finger vein image (S220). At this time, the finger fingerprint extracted from the finger fingerprint image and the two corrugations are extracted as shown in Figs. 17 (a) And can be processed as an edge image of the vein using the above-described Canny edge detection algorithm.

In step S225, the male and female customer information registered in the male and female identification processor 265 is divided into "1" for male and "2" for female to discriminate the information.

Then, the biometric data of the user stored in the biometric information data storage is compared with the fingerprint of the image-processed finger obtained "now" and the finger vein image to determine success of fingerprint authentication and finger vein authentication in case of a match, It is judged as a failure.

The authentication result is displayed through the display unit. It may be a result accompanied by a voice.

The following describes how to shoot two fingers.

First, the person to be authenticated places his / her finger in the object accommodating portion of the authentication device in the waiting state. At this time, the authentication method is a method of photographing the lower finger and / or the side of the fingerprint surface of the two fingers and the finger vein.

In the embodiment in which two fingers are used for authentication, infrared imaging (S200), finger vein fingerprinting (S210) on the fingerprint surface and the lower or side of the two fingers are alternately performed 2 to 3 times do.

That is, S200 and S210 are performed on the fingerprint surface of the two fingers, and then S200 and S210 are performed on the side surface of the same finger. The captured finger vein fingerprint images are converted into digital images.

Here, either the bottom or the side may be omitted depending on the design.

Next, the control unit extracts the photographed fingerprint and the finger vein image (S220). At this time, the finger fingerprint extracted from the finger fingerprint image and the two corrugations are extracted as shown in Figs. 17 (a) And can be processed as an edge image of the vein using the above-described Canny edge detection algorithm.

Then, the biometric data of the user stored in the biometric information data storage is compared with the fingerprint of the image-processed finger obtained "now" and the finger vein image to determine success of fingerprint authentication and finger vein authentication in case of a match, It is judged as a failure.

The authentication result is displayed through the display unit. It may be a result accompanied by a voice.

The authentication apparatus of the present invention can greatly reduce the false recognition rate by, for example, authenticating the fingerprint image of the finger and the fingerprint data at the same time.

The following explains how to use images that recognize fingerprints and fingerprints.

FIG. 19 is a view showing fingerprint and finger vein images of two fingers according to the present invention, and FIG. 20 is a view showing fingerprint 1 and fingerprint 2 of the present invention and finger vein 1 and finger vein 2 in combination Is a matrix table.

In this case, there are six cases in which a plurality of images of fingerprints and finger veins can be at least a plurality.

2) finger vein 1 (250bn) and finger vein 2 (250br); 3) fingerprint 1 (250an) and finger vein 1 (250bn); and 4) fingerprint 2 fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint fingerprint It is possible to cover the population of the earth with only two combinations.

The following is a description of how these fingerprints and fingerprints can be combined to relay financial transactions with unauthorized approval through middleware approval.

Figs. 21 and 22 are flowcharts when the fingerprint 1 and the finger vein 1 of the present invention are recognized at the same time, and Figs. 23 and 24 are flowcharts when the fingerprint 2 and the finger vein 2 of the present invention are recognized at the same time.

FIG. 21 is a flowchart illustrating the processing procedure of a financial transaction relay system having multiple security lock functions using fingerprint 1 authentication according to an embodiment of the present invention.

21, the financial transaction relay system 2 of the present invention accesses the financial transaction relay server 100 through the communication network 4 at step S150 and subscribes to the member at step S152 . At this time, the customer terminal 200 inputs customer's personal information such as a name, an ID, a password, a telephone number, and an e-mail address.

In step S154, the customer terminal 200 acquires finger vein 1 information and fingerprint 1 information through the finger vein 1 recognizer 210 and the fingerprint 1 recognizer 220, and transmits finger vein 1 information and fingerprint 1 through the communication network 4 The financial transaction relay server 100 registers the fingerprint 1 information and the fingerprint 1 information in response to the customer terminal 200. At this time, the financial transaction relay server 100 stores the fingerprint 1 information and the fingerprint 1 information in the database.

In step S156, the financial transaction relay server 100 firstly recognizes the fingerprint 1 in order to perform the electronic financial transaction and the electronic commerce, and discriminates whether the fingerprint 1 information matches the fingerprint 1 information stored in the database in step S158, Authenticate the user.

As a result of the determination, if the two pieces of information match, the finger vein 1 is recognized in step S164, and it is determined in step S166 whether the finger vein 1 information stored in the database matches.

As a result of the determination, if the two finger vein 1 information matches, the procedure proceeds to step S168 where the multiple safety lock module 110 firstly opens the database of the financial transaction relay server 100 through the middleware approval processing unit 120 In step S170, the financial transaction relay server 100 accesses the electronic financial transaction system 300 or the electronic commerce system 400 without authentication and processes the transaction so as to relay the financial transaction.

However, if the financial transaction relay server 100 does not match any of the fingerprint 1 information and the fingerprint 1 information from the customer terminal 200 in steps S158 and S166, the flow advances to step S172 to perform electronic financial transactions and electronic commerce Thereby blocking the connection of the financial transaction relay server 100 from being processed.

Since fingerprint 1 recognition is possible only in the living state, it is possible only by the user himself, and the security effect does not change even if the process of the additional password is omitted.

And FIG. 22 is a flowchart illustrating a process procedure of a financial transaction relay system having multiple security lock functions for simultaneously scanning a fingerprint 1 and a finger vein 1 according to another embodiment of the present invention to process user authentication . In this embodiment, the fingerprint 1 information and the fingerprint 1 information are processed in the case where the user identification is difficult, and the fingerprint 1 information is subjected to the primary user authentication. If the fingerprint 1 information is difficult to identify in the primary, And carries out the user authentication using the designated MAC 1 information by car.

22, the financial transaction relay system 2 of the present invention transfers the fingerprint 1 and the fingerprint 1 from the fingerprint 1 recognizer 210 and the fingerprint 1 recognizer 220 of the customer terminal 200 simultaneously And provides fingerprint 1 information and fingerprint 1 information to the financial transaction relay server 100.

In step S182, the financial transaction relay server 100 recognizes the fingerprint 1 information and the fingerprint 1 information. In step S184, the fingerprint 1 information is compared with the fingerprint 1 information stored in the database to determine whether the fingerprint 1 information is unique.

As a result of the determination, if the fingerprint 1 information is unique, the procedure proceeds to step S188. If it is not unique, that is, if the fingerprint 1 information is the same or similar and the user identification is difficult, the fingerprint 1 information is stored in the database And judges whether it is unique compared with the fingerprint 1 information.

As a result of the determination, if the finger vein 1 information is unique, the procedure advances to step S188 to process user authentication for firewall cancellation and blocking.

In step S192, the firewall is released so that the multiple security lock module 110 can open the database of the financial transaction relay server 100 through the middleware approval processing part 120. Then, in step S194, the financial transaction relay server 100 performs authentication And is connected to the electronic financial transaction system 300 or the electronic commerce system 400 so as to relay the financial transaction.

However, if it is determined in step S186 and step S190 that the user terminal 200 can not authenticate the user using fingerprint 1 information and fingerprint 1 information, the flow advances to step S196 to prevent the electronic financial transaction and the electronic commerce from being processed. (100).

FIG. 23 is a flowchart illustrating the processing procedure of a financial transaction relaying system having multiple security locking functions using fingerprint 2 authentication according to an embodiment of the present invention.

23, the financial transaction relay system 2 of the present invention accesses the financial transaction relay server 100 through the communication network 4 in step S150 and subscribes to the member in step S152 . At this time, the customer terminal 200 inputs customer's personal information such as a name, an ID, a password, a telephone number, and an e-mail address.

In step S154, the customer terminal 200 acquires fingerprint 2 information and fingerprint 2 information through the finger vein 2 recognizer 210 and the fingerprint 2 recognizer 220, and transmits the finger vein 2 information and the fingerprint 2 The financial transaction relay server 100 registers fingerprint 2 information and fingerprint 2 information in correspondence with the customer terminal 200. At this time, the financial transaction relay server 100 stores the fingerprint 2 information and fingerprint 2 information in the database.

In step S156, the financial transaction relay server 100 first recognizes the fingerprint 2 in order to perform the electronic financial transaction and the electronic commerce, and determines whether the fingerprint 2 matches the fingerprint 2 information stored in the database in step S158, Authenticate the user.

As a result of the determination, if the two pieces of information match, the fingerprint 2 is secondarily recognized in step S164, and it is determined in step S166 whether or not it coincides with the fingerprint 2 information stored in the database.

As a result of the determination, if the two fingerprint 2 information match, the procedure proceeds to step S168, where the multiple safety lock module 110 firstly opens the database of the financial transaction relay server 100 through the middleware approval processing unit 120 In step S170, the financial transaction relay server 100 accesses the electronic financial transaction system 300 or the electronic commerce system 400 without authentication and processes the transaction so as to relay the financial transaction.

However, if the financial transaction relay server 100 does not match any of the fingerprint 2 information and the fingerprint 2 information from the customer terminal 200 in steps S158 and S166, the flow advances to step S172 to perform electronic financial transactions and electronic commerce Thereby blocking the connection of the financial transaction relay server 100 from being processed.

In the case of fingerprint 2 recognition, since it is possible only in the living state, it is possible only by the user, and the security effect does not change even if the process of the additional password is omitted.

And FIG. 24 is a flowchart illustrating the processing procedure of a financial transaction relay system having multiple security lock functions for simultaneously scanning a fingerprint 2 and a fingerprint 2 according to another embodiment of the present invention . In this embodiment, the fingerprint 2 information is the same as or similar to the fingerprint 2 information and is processed in the case where the user identification is difficult. In this case, the fingerprint 2 information is used to process the primary user authentication. And carries out the user authentication using the designated MAC 2 information by car.

24, the financial transaction relay system 2 of the present invention transmits the fingerprint 2 and fingerprint 2 simultaneously from the fingerprint 2 recognizer 210 and the fingerprint 2 recognizer 220 of the customer terminal 200 at step S180. And provides fingerprint 2 information and fingerprint 2 information to the financial transaction relay server 100.

In step S182, the financial transaction relay server 100 recognizes the fingerprint 2 information and the fingerprint 2 information. In step S184, the fingerprint 2 information is compared with the fingerprint 2 information stored in the database to determine whether the fingerprint 2 information is unique.

As a result of the determination, if the fingerprint 2 information is unique, the procedure proceeds to step S188, and if it is not unique, that is, if the fingerprint 2 information is the same or similar and the user identification is difficult, the fingerprint 2 information is stored in the database And judges whether it is unique compared with the fingerprint 2 information.

As a result of the determination, if the finger vein 2 information is unique, the procedure proceeds to step S188 to process user authentication for firewall cancellation and blocking.

In step S192, the firewall is released so that the multiple security lock module 110 can open the database of the financial transaction relay server 100 through the middleware approval processing part 120. Then, in step S194, the financial transaction relay server 100 performs authentication And is connected to the electronic financial transaction system 300 or the electronic commerce system 400 so as to relay the financial transaction.

However, if it is determined in step S186 and step S190 that the user terminal 200 can not authenticate the user by using the fingerprint 2 information and the fingerprint 2 information, the flow proceeds to step S196 to prevent the electronic financial transaction and the electronic commerce from being processed. (100).

FIG. 25 shows an internal electronic configuration example of the fingerprint and / or finger vein authentication device 1200 according to a preferred embodiment of the present invention, and FIG. 26 shows a generation unit classification registration unit showing the server configuration of the present invention.

The integrated imaging authentication apparatus 1200 of the present invention includes an infrared light source unit 1240, a finger vein image sensor 1230, a fingerprint image sensor 1220, a digital conversion unit 1290, a decryption algorithm unit 1260, A male and female identification processing unit 1265a, a male and female identification processing unit 1265, a generation unit classification registration unit 1265b, a biometric information data storage 1270, and a display unit 1280.

Since the above configuration is mostly the same as that described in FIG. 16, the detailed signature is omitted.

Although not shown in the drawings, the power supply unit, the communication unit, and various I / O devices may be included.

As described above, the unauthorized identification processing unit 1265 registers the finger information and the finger vein by distinguishing "1" for male information and "2" for female information at the time of simultaneous authentication of the fingerprint and finger vein.

As shown in FIG. 26, the generation unit classification registration unit 1265b divides the man and woman generation division table 1400 into a man 1401 and a woman 1402, will be.

The server construction using the resident registration number is divided into the year, month, and day, and the server is constructed by dividing the household by the generation. The server is naturally constructed using the unique number of the person at the time of initial registration Therefore, the linkage effect between the server and the person's unique number in the financial settlement is manifested organically, and a remarkable effect is obtained.

If the storage of the iris, the fingerprint or the fingerprint information is separately stored for each bank, the capacity of the server is reduced, so that the speed of the present technology is remarkably increased.

As described above, the present invention can be implemented by a method using six metrics in conjunction with the above-described embodiment. Accordingly, by combining two or more as human body information, it is possible to escape the concern of imitation or hacking, Or it may be the only way to resolve the error of the finger.

Next, an integrated terminal implementing the above-described technology developed by the present inventor will be described.

27 and 28 are perspective views schematically showing the configurations of the first and second embodiments of the integrated payment apparatus using the POS terminal of the present invention.

27, a POS terminal 1000 used here is provided with a magnetic card check unit 1102 on one side and an IC card check unit 1101 on the lower side, as shown in FIG. 27, And the data input unit 1120 displays the payment amount on the LCD display unit 1130 for the clerk and starts the final settlement button after the power source unit 1110 is turned on.

In the front portion of the POS terminal 1000, an electronic component cover 1150 is formed as a payment system. One finger fingerprint and finger vein authentication processing unit 1180 is formed on one side, An information authentication processing unit 1190 is formed and the card information authentication processing unit 1190 includes an authentication card tag unit 1191 and a smartphone tag unit 1192. When their functions are the same or can be integrated Is designed for the purpose of conveying the meaning that an independent card can be used for two guide displays and the purpose of transmitting meaning that a card registered in a smart phone can be used.

An LCD display part 1199a for a customer is formed by a hinge (not shown) so that an angle can be adjusted according to a customer's position, and the LCD display part 1199a for a customer The payment amount of the customer and the indication of the audit are displayed, and the advertisement function is added to the operation.

An iris information authentication processing unit 1194 is formed at an upper end of the customer LCD display unit 1199a and is designed together with the iris information authentication processing unit 1194 to form a face information authentication processing unit 1196. [

For the technique of the face information authentication processing section 1196, the above-described technique described above is applied first.

An unexplained reference numeral 1182 denotes an infrared ray emitting unit which is further transmitted to the fingerprint and finger vein authentication processing unit 1180.

When the LCD display unit 1130 is not used normally or the settlement can be made only by the LCD display unit 1130 for a clerk, the customer LCD display unit 1199a is folded and used by using a hinge. In order to repair the internal computer equipment The electrical component cover 1150 can be opened around the hinge 1151.

As shown in FIG. 28, the POS terminal 1000 used in the second embodiment of the present invention is different from the first embodiment in that the POS terminal 1000 used here includes a recognition and suspension 1180a (1180b And the fingerprint and finger authentication processing unit 1180 corresponding to the fingerprint and finger authentication processing unit 1180 are formed on the LCD display unit 1199a and that the LCD display unit 1199a for the customer is inserted into the main body of the main body by the LCD display unit receiving unit 1150a, But it can be made in the same way.

In other words, the sliding type can be formed in a separate rectangular shape on the upper part of the electrical component cover 1150 and enter into the main body according to the side guide lines inside the main body, It is possible to check the amount.

While the present invention has been particularly shown and described with respect to a preferred embodiment thereof, it will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

2: financial transaction relay system, 4, 6: communication network
100: financial transaction relay server
110: Multiple safety lock module
112: face and fingerprint or / and finger vein recognition processor
114: Password processor
116: Telephone number authentication processing unit
120: Middleware firewall
122: middleware authentication processing unit
200: customer terminal, 202: module
210: fingerprint and / or fingerprint recognizer
220: face recognizer
300: Electronic financial transaction system
400: Electronic Commerce System
1000: POS terminal
1100:
1105: Electrical cover
1120: Data input unit
1130:
135: Advertising video originator
1140:
1150:
1160:
1170:
1180: fingerprint and finger vein authentication processing unit
1190: card information authentication processing unit
1194: Irregular information authentication processing unit
1196: Face information authentication processing unit

Claims (13)

A financial transaction relay system comprising:
A communication network;
A customer terminal connected to the communication network and including a fingerprint recognizing fingerprint and / or fingerprint information of a customer and / or a finger recognizer and a face recognizer for extracting face information;
Wherein the customer terminal is connected through the communication network and receives the face information, the fingerprint, and / or the fingerprint information from the customer terminal and registers the member as a member, and the customer terminal performs either electronic financial transaction or electronic commerce The fingerprint and / or fingerprint information from the customer terminal is received and authenticated so that an electronic financial transaction system for the electronic financial transaction or an electronic commercial transaction system for the electronic commercial transaction is performed so that the financial transaction is performed A financial transaction relay server for relaying the transaction;
Wherein the financial transaction relay server comprises a face recognition processing unit for receiving face information from the customer terminal and comparing whether the face information matches the registered face information, an account password processing unit for registering an account password of the customer terminal, And a fingerprint and / or a fingerprint recognition processing unit for receiving the fingerprint information and comparing the fingerprint and / or the fingerprint information with the previously registered fingerprint and / or the fingerprint information, and a telephone number authentication processing unit for authenticating using the telephone number of the customer terminal A safety lock module;
The fingerprint and / or the fingerprint information from the user terminal to process the user authentication using the face information, and if the user identification is not possible from the face information, the fingerprint and / If the fingerprint and / or the fingerprint information matches one of the fingerprint information using the fingerprint information, the user authentication is processed, and then the middleware firewall authentication is processed and the electronic financial transaction system for electronic financial transaction or the electronic commerce system for electronic commerce The fingerprint module and / or the finger vein recognizer is formed of an input / output integration module (U1) for interlocking the fingerprint and the finger vein, and the integration module (U1) comprises a fingerprint module (U2) A finger vein module U2, a finger vein module U3, and a conversion module U4, The finger vein module U3 can output the registered authentication code of the person in the first serial communication when there is a person of the same fingerprint image as compared with the pre-stored image, The image sensor scans the finger vein and compares it with a pre-stored finger vein image to output a registered authentication code of the person in the same serial image to the conversion module U4, The fingerprint module U2 is configured to receive the second serial communication and to convert the second serial communication into a first serial communication such as the fingerprint module U2, Receives the finger vein authentication code output from the integration module U1, and outputs either the fingerprint or the finger vein authentication code to the USB via the corresponding authentication code Or the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 are received by the integration module U1 so that the fingerprint and the fingerprint authentication code coincide with each other Wherein the fingerprint and / or the fingerprint is scanned to process the user authentication. The system of claim 1, wherein the fingerprint is fingerprinted.
A financial transaction relay system comprising:
A communication network;
A customer terminal connected to the communication network and including a fingerprint recognizing fingerprint and / or fingerprint information of a customer and / or a finger recognizer and a face recognizer for extracting face information;
Wherein the customer terminal is connected through the communication network and receives the face information, the fingerprint, and / or the fingerprint information from the customer terminal and registers the member as a member, and the customer terminal performs either electronic financial transaction or electronic commerce The fingerprint and / or fingerprint information from the customer terminal is received and authenticated so that an electronic financial transaction system for the electronic financial transaction or an electronic commercial transaction system for the electronic commercial transaction is performed so that the financial transaction is performed A financial transaction relay server for relaying the transaction;
Wherein the financial transaction relay server comprises a face recognition processing unit for receiving face information from the customer terminal and comparing whether the face information matches the registered face information, an account password processing unit for registering an account password of the customer terminal, And a fingerprint and / or a fingerprint recognition processing unit for receiving the fingerprint information and comparing the fingerprint and / or the fingerprint information with the previously registered fingerprint and / or the fingerprint information, and a telephone number authentication processing unit for authenticating using the telephone number of the customer terminal A safety lock module;
Wherein the user authentication of the financial transaction relay system includes receiving the face information and the fingerprint and / or fingerprint information from the customer terminal, first processing the user authentication using the face information, and secondly using the fingerprint and / If one of the fingerprint and / or fingerprint information matches the MAC information, the user authentication is processed, and then the middleware firewall authentication is processed. Thus, the electronic financial transaction system for electronic financial transactions or the electronic commerce system for electronic commerce The fingerprint module and / or the finger vein recognizer are formed of an input / output integration module (U1) for interlocking the fingerprint and the finger vein, and the integration module (U1) comprises a fingerprint module (U2) The fingerprint module U2 includes a finger vein module U3 and a conversion module U4. The fingerprint module U2 scans fingerprints The finger module U3 can output the registered authentication code of the person in the first serial communication when there is a person with the same fingerprint image as compared with the image stored in advance, The sensor is scanned and compared with a pre-stored finger image to output a registered authentication code of the person in the second serial communication when there is a person with the same image, and the conversion module (U4) The fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 can be output to the first serial communication unit, The fingerprint authentication code output from the integration module U1 is received by the integration module U1 so that the fingerprint and the fingerprint authentication code can be output to the USB via the corresponding authentication code Or the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 are received by the integration module U1 so that the fingerprint and the fingerprint authentication code coincide with each other Wherein the fingerprint and / or the fingerprint of the face and / or the fingerprint of the user are processed to process the user authentication.
delete The fingerprint module according to claim 1 or 2, wherein the GND line 1 of the fingerprint module U2 is a (-) voltage circuit, the line RX 2 is a serial data reception port, the line TX 3 is a serial data transmission port , VCC line 4 is the (+) voltage reference of the power supply circuit. When the fingerprint image is scanned by the image sensor and compared with the previously stored image, the registered authentication code of the person is output by 232 communication Wherein the user authentication is performed by scanning a face and a fingerprint or / and a finger vein.
The method of claim 1 or 2, wherein the GND line 1 of the finger vein module (U3) is a (-) voltage reference, the A 2 line is a serial communication standard RS485 communication A port, (+) Voltage reference of the power supply circuit, the GND line 1 on the left side of the conversion module U4 is the reference of the negative voltage, and the line A 2 is the The line B 3 is a serial communication standard RS485 communication port B and the line VCC 4 is a voltage reference and the conversion module U 4 linked with the finger vein module U 3 is connected to the RS- The DI 5 line on the right side is a serial 232 communication reception port, the RE 6 line is a 485 communication control port, the DE 7 line is a 485 communication control port, and the RO 8 line is a serial 232 communication transmission port Multiple face-to-face and / or fingerprint scanners to handle user authentication Financial transaction relay system.
The integrated module (U1) according to claim 1 or 2, wherein the D1 / TX1 line of the integration module (U1) is a serial 232 communication transmission port, the D0 / RX2 line is a serial 232 communication reception port, (U2) serial 232 communication reception line, and D8 11 line is 485-232 (D2), and D2 5 line is the fingerprint module (U2) serial 232 communication transmission line, D3 6 line is the fingerprint module D9 12 is a 485 communication control port of the 485-232 communication conversion module U4 and D10 13 is a serial port communication port of the communication conversion module U4. Line is the 485 communication control port of the 485-232 communication conversion module U4 and D11 14 is the serial 232 communication receiving port of the 485-232 communication conversion module U4 and the 5V line 27 is the (+) voltage 5V output pin, GND line 29 is based on the (-) voltage and VIN line 30 is based on the (+) voltage. These configurations are based on the fingerprint output from the fingerprint module (U2) And the finger vein authentication code output from the finger vein module U3 is converted into 232 communication from the conversion module U4 and is received by the integration module U1. When the fingerprint and the finger vein authentication code coincide with each other, And the corresponding authentication code is output. The system of claim 1, wherein the authentication code is a fingerprint and / or a fingerprint.
The fingerprint authentication system according to claim 1 or 2, wherein the fingerprint and / or finger vein recognizer is formed of an integrated imaging authentication device (200a) capable of capturing a fingerprint and a finger vein, and the scan panel The finger placement section 252 is formed with a finger finger contact section 250a in which a fingerprint authentication module 250an is formed and a finger finger noncontact section 250b in which a finger vein authentication module 250bn is formed, , And the scan panel 250 is formed in two lines so as to authenticate two fingers side by side. In registration of the fingerprint and / or finger vein, the male information is divided into '1' and the female information is divided into '2' And a male and female identification processing unit for registering the face and fingerprint and / or the finger vein.
The POS terminal of claim 1 or 2, wherein the customer terminal has a magnetic card check part (1102) formed on one side of a rectangular POS terminal, an IC card check part (1101) The POS terminal 1000 starts to be turned on by the data input unit 1120 and the settlement amount is displayed on the LCD display unit 1130 for the clerk by pressing the final settlement button. An electrical component cover 1150 is formed as a payment system for a customer and a fingerprint and fingertip authentication processing unit 1180 is formed on one side of the electrical component cover 1150 in the front part facing the LCD display unit 1130 for use, A card information authentication processing unit 1190 is formed so that an authentication process based on the card information of the customer can be performed and a customer LCD display unit for confirming the settlement amount is formed on the front surface of the electrical component cover 1150 in a different rectangular shape And a face information authentication processing unit (1196) is formed at an upper end of the LCD display unit for the customer. The fingerprint authentication system according to claim 1, Relay system.
3. The fingerprint module (U2) according to claim 1 or 2, wherein the first serial communication of the fingerprint module (U2) is output via 232 communication and the second serial communication of the finger vein module (U3) is output via 485 communication, (U4) receives the 485 communication output from the finger vein module, converts it into 232 communication, and outputs the converted communication. The multi-safety lock function of the multi-safety lock function, which processes the fingerprint and / Relay system.
A method of processing a financial transaction relay system comprising:
A user accesses a financial transaction relay server through a communication network from a customer terminal having a fingerprint or / and a fingerprint recognizer and a face recognizer as one module, subscribes as a member, and scans the fingerprint and / or finger vein recognizer and the face recognizer Acquiring fingerprint or / and fingerprint information and face information, transmitting the fingerprint and / or finger vein information and the face information to the financial transaction relay server through the communication network and registering the same;
When the financial transaction relay server receives the face information and the fingerprint and / or fingerprint information from the customer terminal when the customer terminal accesses the financial transaction relay server to perform electronic financial transaction and electronic commerce ;
Receiving facial information from the customer terminal and determining whether the facial information is unique with the registered facial information;
Determining whether the fingerprint and / or fingerprint information transmitted in the second order is identical to the registered fingerprint and / or fingerprint information if the face information transmitted from the customer terminal is not unique;
And the fingerprint information and / or the fingerprint information transmitted from the customer terminal is identical to the fingerprint and / or the fingerprint information previously registered, the user terminal receives the user authentication processing signal from the customer terminal, Determining whether a match is found;
Receiving a final authentication signal from the client terminal to process the middleware firewall authentication; , ≪ / RTI &
The fingerprint and / or finger vein recognizer is formed of an input / output integration module U1 for interlocking the fingerprint and the finger vein. The integration module U1 includes a fingerprint module U2, a finger vein module U3, The fingerprint module U2 scans the fingerprint image from the image sensor and compares the fingerprint image with a previously stored image to output a registered authentication code of the person using the 232 serial communication when there is a person with the same fingerprint image Alternatively, the finger vein module U3 transmits the registered authentication code of the person in the presence of a person having the same image by comparing it with a pre-stored finger vein image by scanning the finger vein from the camera image sensor after passing the finger through the infrared LED. The conversion module U4 receives the 485 serial communication output from the finger vein module and converts it into 232 serial communication such as the fingerprint module U2 And the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 are received by the integration module U1 so that the fingerprint and the fingerprint authentication code Wherein the authentication code is displayed on the USB when the fingerprint is matched with the fingerprint of the fingerprint and / or the fingerprint and / or the fingerprint of the fingerprint.
delete [Claim 11] The method according to claim 10, wherein the user authentication processing signal in the next step after passing through the fingerprint and / or finger vein information discriminating step is any one of a password, a phone number, a face, a fingerprint and / And processing the user authentication by scanning a fingerprint and / or a fingerprint.
The financial transaction relay server according to claim 10, wherein the financial transaction relay server is divided into a man (1401) and a woman (1402), and the man (1401) and the woman (1402) Wherein the fingerprint and / or the fingerprint of the face and / or the fingerprint are scanned to process the user authentication.

Images