KR101792008B1 - Electronic payment system using face and finger recognition and method for processing thereof - Google Patents

Abstract

The present invention relates to an electronic payment system using face and fingerprint recognition, comprising: a communication network; a customer client connected to the communication network, to acquire a first face and fingerprint information of a customer himself or herself by a face recognition processing unit for photographing, and a fingerprint reader; a member store client connected to the communication network to acquire a second face and fingerprint information of the customer from the customer client by the face recognition processing unit for photographing, and the fingerprint reader when a commercial transaction occurs; and a payment service server for receiving the first face and fingerprint information from the customer client through the communication network, registering the same corresponding to payment means, when the second face and fingerprint information are transmitted from the member store client, comparing the first face and fingerprint information with the second face and fingerprint information, processing authentication of the customer, and enabling payment through the payment means corresponding to the first face and fingerprint information.

Description

TECHNICAL FIELD [0001] The present invention relates to an electronic payment system and a method thereof, and more particularly, to an electronic payment system having a multiple security lock function for simultaneously scanning a face and a fingerprint in a wire /

The present invention relates to an electronic payment system and a method thereof, which have multiple security lock functions for simultaneously processing a face and a fingerprint in a wired / wireless network and processing user authentication, and more particularly to an electronic payment system and method using face and fingerprint and / or fingerprint recognition To an electronic payment system for replacing a credit card payment method and a method thereof.

Biometric technology refers to technology that identifies or identifies an individual using biometric information. Until now, biometrics have been using fingerprints, faces, irises or voices to identify individual identities.

The fingerprint recognition technology is small in recognition device and can be mass-produced at low cost. Also, it shows relatively good performance in terms of accuracy and speed of recognition. However, fingerprints are exposed outside the body and are likely to be stolen and deformed by sweat, which can affect recognition performance. There are also hygiene problems. Iris recognition technology is the most reliable biometric technology in that recognition errors are unlikely and counterfeiting is difficult. However, most people are reluctant to shine directly in the eye for iris recognition, and iris recognition devices are large and expensive. Face or voice recognition technology has the advantage of being the most natural form of biometric information in identity recognition. However, it has a disadvantage in that it is less accurate than other technologies in terms of recognition accuracy.

In order to overcome and overcome the disadvantages of the biometric techniques described above, finger vein recognition technology has been developed. The finger vein recognition technology refers to a technique for identifying an individual using a finger vein pattern image acquired through infrared rays. Human veins are located in complex shapes directly beneath the skin. According to various studies, the pattern of the veins is different for each individual, and it is known that the pattern does not change with age. The fingerprint recognition technology has the following advantages. That is, since the vein is inside the body, there is little risk of theft or forgery, and the state of the finger surface has no effect on the recognition. In addition, it is possible to construct a noncontact type device with high convenience for the user by using infrared rays. Since the finger pattern can be stably and relatively clearly searched, a camera having a low resolution can be used to obtain a small fingerprint image have. That is, fingerprint recognition technology can provide balanced performance in terms of security and convenience.

Due to these advantages, finger vein recognition technology is more difficult than fingerprint, iris, face and voice recognition technology for counterfeit modulation. Therefore, biometric authentication device with higher safety can be realized and miniaturization is possible. .

1 (a), a key technology of a smart phone can be displayed as an iris recognition technology on a top surface. FIG. 1 (b) shows a display in which an iris recognizer is attached to a smartphone , Which can be useful for commercial applications.

As shown in the figure, the smartphone bodies 500 and 600 are formed of conventional touch screens 510 and 610, and general signal display parts 520 and 620 are formed on one side, And iris recognition devices 530 and 630 are formed on the upper part.

Accordingly, when the user uses a signal to make a call or logs in to make a call, the user turns his / her eyes on the screen in a normal manner so that his or her eyes are close to the iris period 530 and 630, So that it can be used by the user.

In another method, when a user uses a signal to make a call or logs in to make a call, the user's eyes are close to the iris period 530 (630) without turning on the screen, So that it can be used by the user.

The iris recognition device using the camera for short range iris photography of a smart phone according to the related art includes an iris photographing camera, a key input unit, a storage unit, a control unit, an output unit, and a display lamp.

As shown in Korean Patent Laid-Open Publication No. 10-214-0133762, the iris photographing camera is provided with a prism having an inclined surface at the upper portion of the guide of the illumination IR LED 20 and having a concave / convex portion formed thereon to improve the brightness uniformity around the iris, And can prevent the static electricity from being transmitted to the internal device through the illumination IR LED, so that it can be formed in a small size.

FIG. 2 is an explanatory view of a muscle structure of the eye of the conventional invention, and FIG. 3 is a schematic view of the face image of the conventional invention, showing the position and the distance measuring method.

3 and 4 according to an embodiment of the present invention, as shown in Japanese Patent Laid-Open No. 10-1174103, also show a simplified structure of a face image inputted according to the prior art, This is the key.

The detection of the eye and surrounding muscle information applied to the conventional invention can be performed by grasping the position of the frontal muscle, the upper limb muscle, the eye circumference muscle, and the eyebrow lowering muscle, which are muscle structures of the eye, The distance between the eyes and the mouth, the angle between the eyes and the nose, and the angle between the mouth and the nose) are detected, and the generated information is used as registration information or control data, and a preprocessing method .

Then, the conventional method includes a facial image normalization, a removal and statistical correction of the external illuminance component in the normalized facial image, and a preprocessing and feature extraction step of extracting features from the preprocessed facial image according to the eye position and the surrounding detail information.

At this time, the pre-processing and feature extraction steps applied to the present invention are used to compensate for changes in luminous intensity, posture, and external conditions of facial expression, and the luminance correction uses local variance normalization and local histogram smoothing.

The face recognition method of mathematical pattern analysis based on the upper musculoskeletal structure includes a face image input step of inputting an image input by a camera (USB includes CCD) or a video file or an image file image, A face detection step of detecting a position of the face, detecting a position of the face, detecting a face from the detected object (object) to determine a basic outline, and automatically detecting the position of the face; A step of detecting muscle information around the eyes and eyes detecting the details around the eyes, a step of normalizing the face image by the eye position and the surrounding details, a removal and statistical correction of the external illumination components in the normalized face image, A feature extraction step and a feature extraction step.

The present invention may be applied to the execution system of the present invention using the above-described conventional techniques.

Also in the face recognition authentication method, a system for registering and authenticating the face recognition authentication method has been developed in the Korean Patent Laid-Open Publication No. 10-2016-0084657.

These technologies were not applied to the financial settlement system, and only the functions of a simple lock were developed.

FIG. 4 is a conceptual illustration of a finger vein fingerprint image acquisition mechanism of an authentication device according to an embodiment of the present invention, (A) and the finger side (b) of the same finger taken by the Mac image sensor and the fingerprint image sensor.

In the authentication of such fingerprints and fingerprints, the inventor of the present invention has been granted patentability as a means of payment by means of a patent application 10-2016-0046135. In the patent application 10-2015-109633 and 10-2015-0120087, It has provided many inventions as payment method.

In the following, by understanding the device capable of simultaneously recognizing fingerprints, fingerprints and / or fingerprints applied by the present inventor 10-2016-46135, a fingerprint and / or a finger vein pattern can be mounted on the card You will understand the technology.

Reference numeral 1a in FIG. 5 denotes a fingerprint between finger segments or / and a finger vein, 1b denotes a node of a finger, and 1c denotes a fingerprint portion.

An integrated image capturing apparatus 1200 capable of capturing a fingerprint, a fingerprint, and / or a finger vein, wherein the object accommodating unit 1201 includes a scan panel upper case 1201a forming upper and lower finger seats, And a scan panel 1250 for simultaneously photographing fingerprints and / or fingerprints made of a transparent material such as glass or acrylic on the upper part of the upper case 1201a of the scan panel, The scan panel 1250 is formed with a fingerprint finger contact portion 1250a and a fingerprint finger and / or finger finger non-contact portion 1250b at their front and rear ends.

The finger pad of the scan panel 1250 and / or the finger-finger non-contact portion 1250b are formed on the edge of the groove side wall 1251 so that the finger can be formed as a groove, The finger grip portion 1252 is formed to be in balance with the fingerprint finger contact portion 1250a.

Further, since the temperature sensor 1270 for sensing the temperature of the flow of the finger is formed in front of the fingerprint and / or finger vein finger non-contact portion 1250b against the fingerprint finger contact portion 1250a of the scan panel 1250, When the finger is landed, the temperature of the blood flow of the finger is sensed and the operation is enabled by the sensed temperature.

In addition, on one side, an infrared side surface case portion 1260 is formed in a length to accommodate the infrared side surface emitting portion 1260a so that the side surface can be photographed to more accurately capture the fingerprint and / or the vein.

The scan panel lower case 1201b is formed as a space capable of accommodating electrical components.

A finger resting rim 1253 on which a finger can be seated is formed.

Thus, in the first embodiment of the present invention, the user initiates a fingerprint or / and finger vein authentication by placing a finger object on this scan panel 1250, and when the fingerprint and / or vein authentication by the device is initiated, The infrared light source unit 1240 and the line-of-sight light source unit 1242 irradiate infrared rays and visible rays toward the finger object.

Then, a plurality of image sensors photograph fingerprints, fingerprints and / or finger veins of the irradiated finger, respectively.

In the embodiment of the present invention, the integrated image sensing apparatus 1200 includes three image sensors 1220, 1230 and 1231. The finger vein image sensors 1230 and 1231 are built in the object accommodating unit 1201 and take a finger vein of the object from the lower side and the side surface toward the scan panel 1250. [ At the same time, the fingerprint image sensor 1220 is installed in the same object accommodating portion 1201 to photograph the fingerprint of the object.

In one preferred embodiment of the present invention, the finger vein image sensor 1231 and the finger fingerprint image sensor 1220 simultaneously photograph finger vein finger vein fingerprints and use them as biometric information, , It is possible to reduce the error range to a maximum of the number of squares.

However, the iris authentication technology of the smart phone corresponds to switching that maintains the on-state of the smartphone by the security of the smart phone itself, and the face recognition technology is also kept on by the face recognition for security And the authentication technique of the last fingerprint and the fingerprint fingerprint authentication function as an off-line authenticator. However, the fingerprint and / or the fingerprint pattern on the face and the finger in the human body information are used for the simultaneous recognition technology There was no idea that the principle of being a square of the prevention of misrecognition could not be found, and the idea of simply sending a signal to the bank side merely serving as an on / off role to each bank.

Korean Registered Patent No. 10-0954776 (published on Apr. 28, 2010) Korean Patent Registration No. 10-1050301 (Bulletin issued on July 19, 2011) Korean Patent Laid-Open Publication No. 10-1025666 (Announcement on Mar. 30, 2011) Korean Patent Laid-Open Publication No. 10-1210750 (December 10, 2012)

SUMMARY OF THE INVENTION An object of the present invention is to provide an electronic payment system and method for simultaneously scanning a face and fingerprint (or fingerprint) recognition in order to replace a credit card payment method.

The present invention relates to a financial transaction electronic payment system for converting a user into a facial expression using a photographing device currently mounted on a smart phone and simultaneously scanning the same using a fingerprint reader mounted on a smart phone to process user authentication The purpose is to provide.

Specifically, the face information is mounted on the smartphone by a digital signal, the face can be photographed and photographed by the photographing photographing device, and then the biometric authentication using the fingerprint can be performed on the fingerprint recognizer of the smartphone And to provide a financial transaction electronic settlement system that simultaneously scans and processes a user's authentication.

It is another object of the present invention to provide an electronic payment system and method using fingerprint recognition through a mobile application.

It is another object of the present invention to provide an electronic payment system and method using fingerprint and fingerprint recognition by developing a fingerprint and fingerprint recognition device.

In order to achieve the above objects, the electronic payment system using face and fingerprint recognition according to the present invention is characterized in replacing credit card payment through a mobile application. Such an electronic payment system using fingerprint and fingerprint recognition can provide security and convenience in electronic payment of a credit card or the like.

According to another aspect of the present invention, there is provided an electronic payment system using face and fingerprint recognition, comprising: a communication network; A customer client connected to the communication network and acquiring first face and fingerprint information of the customer himself / herself by a photo-recognition face recognition processor and a fingerprint reader; A merchant client connected to the communication network and acquiring second face and fingerprint information for the customer of the customer by the photographing face recognition processor and the fingerprint reader when the commerce occurs; The first face and the fingerprint information are received from the client client through the communication network and are registered in correspondence with the payment means, and when the second face and the fingerprint information are transmitted from the merchant client, the first face and the fingerprint information, And a payment service server that compares the fingerprint information with the first face and the fingerprint information to process the customer and process the settlement through the payment means corresponding to the first face and the fingerprint information. To simultaneously scan and authenticate the user and process the user authentication.

Further, in the present invention, the electronic settlement system may further include a credit card company server for authorizing the settlement from the settlement means, when the settlement means corresponds to a credit card, when the customer is authenticated It is an electronic payment system with multiple security lock functions that simultaneously scan faces and fingerprints in a wired / wireless network and process user authentication.

In the present invention, the customer client may include a first face and a fingerprint recognizer for obtaining first face and fingerprint information, and the merchant client may include a second face for acquiring a second face and fingerprint information, ; Wherein the first or second face and fingerprint recognizer comprises: A face recognition processor for photographing the face of the customer to obtain face information; A scanner that scans the finger of the customer to obtain first or second fingerprint information; A memory for storing first or second face information obtained from the photographing face recognition processing unit and first or second fingerprint information obtained from the scanner; An LCD for displaying first or second face information obtained from the photographic photographing face recognition processing unit and first or second fingerprint information scanned from the scanner or for displaying an operation state of the first or second face or the fingerprint recognizer, Wow; An interface that is connected to the customer client or the merchant client and provides the first or second face information obtained from the photographing face recognition processing unit and the first or second fingerprint information obtained from the scanner to the client client or the merchant client Module and; And a controller for controlling all operations of the first or second face or the fingerprint recognizer. The electronic payment system having multiple safety lock functions for simultaneously scanning a face and a fingerprint in a wire / to be.

In the present invention, the first or second fingerprint reader may further comprise: A temperature sensor for sensing the temperature of the finger of the customer when the first or second fingerprint information is obtained from the scanner; Further comprising a blood flow recognition sensor for recognizing the flow of the blood flow of the finger of the customer; The first or second fingerprint recognizer recognizes the temperature and flow of the finger of the customer and if it is determined that there is no abnormality, the first or second fingerprint information is transmitted to the client client or the merchant client And a plurality of security lock functions for simultaneously scanning the face and the fingerprint in the wired / wireless network and processing the user authentication.

In the present invention, the fingerprint recognizer is formed of an input / output integration module U1 for interlocking the fingerprint and the finger vein. The integration module U1 includes a fingerprint module U2, a finger vein module U3, The fingerprint module U2 scans the fingerprint image from the image sensor and compares the fingerprint image with a previously stored image to output a registered authentication code of the person to the first serial communication when there is a person with the same fingerprint image Or the finger vein module U3 transmits a finger to the infrared LED, and after the finger is scanned by the camera image sensor, the finger image is compared with a pre-stored finger image, and if there is a person having the same image, And outputs the second serial communication output from the fingerprint module to the first serial communication such as the fingerprint module U2 The fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 are received from the integration module U1 and fingerprints and fingerprint authentication Code of the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 to the integration module U1 ), And when the fingerprint and the fingerprint authentication code are identical to each other, the corresponding authentication code can be output to the USB. The fingerprint authentication device according to claim 1, This system is an electronic payment system with multiple security lock functions that simultaneously scan faces and fingerprints in wired and wireless networks and process user authentication.

In the present invention, the GND line 1 of the fingerprint module U2 is a (-) voltage circuit, the line RX2 is a serial data reception port, the line TX3 is a serial data transmission port, Line is a (+) voltage reference of the power supply circuit. When the fingerprint image is scanned by the image sensor and compared with a previously stored image, if the person of the same fingerprint image exists, the registered authentication code of the person is output by 232 communication Is an electronic payment system having multiple security lock functions for simultaneously scanning a face and a fingerprint in a wired / wireless network to process user authentication.

In the present invention, the GND line 1 of the finger vein module U3 is a (-) voltage reference, the A 2 line is a serial communication standard RS485 communication A port, the B 3 line is a serial communication standard RS485 communication B port, VCC line 4 is the (+) voltage reference of the power supply circuit, GND line 1 on the left side of the conversion module U4 is the reference of the negative voltage, A 2 line is the serial communication standard The line B 3 is a serial communication standard RS485 communication port B and the line VCC 4 is a (+) voltage reference and the DI on the right side of the conversion module U 4 linked to the finger vein module U 3 is RS 485 communication A port, Line 5 is a serial 232 communication reception port, RE 6 line is a 485 communication control port, DE 7 line is a 485 communication control port, and RO 8 line is a serial 232 communication transmission port. Multiple safety locks that simultaneously scan faces and fingerprints to handle user authentication It is an electronic payment system with features.

In the present invention, the D1 / TX1 line of the integration module U1 is a serial 232 communication transmission port, the D0 / RX2 line is a serial 232 communication reception port, and the GND line 4 is a (-) line. D2 is the serial 232 communication transmission line, D3 is the fingerprint module (U2) serial 232 communication reception line, and D8 11 is the communication module of the 485-232 communication conversion module D9 12 is a 485 communication control port of the 485-232 communication conversion module U4, and D10 13 is a serial 232 communication transmission port of the U4 communication module U4. 485 communication control port of 485-232 communication conversion module (U4), D11 line 14 is the serial 232 communication receiving port of 485-232 communication conversion module (U4), 5V line 27 is the (+) voltage 5V output pin , The GND line 29 is based on the (-) voltage and the VIN line 30 is based on the (+) voltage. These configurations are based on the fingerprint authentication And the finger vein authentication code output from the finger vein module U3 is converted into 232 communication from the conversion module U4 and received by the integration module U1. When the fingerprint and the finger vein authentication code coincide with each other, And an authentication code is output. The electronic settlement system has multiple security lock functions for simultaneously scanning a face and a fingerprint in a wire / wireless network to process user authentication.

In the present invention, the first serial communication of the fingerprint module U2 outputs 232 communication, the second serial communication of the finger vein module U3 outputs 485 communication, And an electronic settlement system having multiple safety lock functions for processing user authentication by simultaneously scanning face and fingerprint in a wired / wireless network, which receives the 485 communication output from the finger vein module and converts it into 232 communication .

The authentication device 4100 for acquiring fingerprint information by the fingerprint recognizer of the present invention includes a fingerprint and fingertip authentication device 4100 that is inserted into the smartphone main body side part 4400 from the lower right corner of the right front side A fingerprint recognition module 4310 is formed on the upper side of the authentication device unit 4100 and a blank finger imaging groove 4410 is formed on the lower side of the authentication device subspace 4500, An image sensor 4510a, an infrared ray transmitting unit 4520a, and a recognition circuit electrical part for controlling the image sensor 4510a and the infrared ray transmitting unit 4520a are formed in the authentication device space 4500, Is an electronic payment system equipped with multiple security lock functions for simultaneously scanning face and fingerprint in a wired / wireless network to process user authentication.

The present invention provides a method of processing an electronic payment system using face and fingerprint recognition, the method comprising: providing a face and fingerprint payment app to a face and fingerprint payment service server of the electronic payment system; Accessing a fingerprint settlement service server, downloading the face and fingerprint payment app and installing it inside the fingerprint payment service server; Acquiring first face and fingerprint information of the customer through the first face and the fingerprint recognizer of the client client, activating the face and fingerprint payment app installed in the customer client, Providing to the face and fingerprint payment service server through a communication network; The face and fingerprint settlement service server stores and registers first face and fingerprint information provided from the client client in a database and transmits first face and fingerprint information to the credit card company server through the communication network; Matching the first face and fingerprint information transmitted from the face and fingerprint settlement service server to the payment means of the registered customer and registering the same; The second face and the fingerprint information of the customer are recognized from the second face and the fingerprint recognizer of the merchant client connected to the communication network and the second face and the fingerprint information and the payment information corresponding to the occurrence of the transaction are transmitted to the face and the fingerprint Sending the payment request to the payment service server to request payment approval; Comparing the second face and fingerprint information transmitted from the merchant client with the first face and fingerprint information registered in the database to determine the customer authentication; If it is determined that the registered first face and fingerprint information matches the second face and fingerprint information, the face and fingerprint service server transmits the credit Requesting payment authorization to the card issuer server; And a step of informing the merchant client and the face and fingerprint settlement service server that the settlement has been approved when payment is approved through the payment means of the customer corresponding to the first face and fingerprint information for which payment was requested by the credit card company server Wherein the face and the fingerprint are simultaneously scanned in a wire / wireless network to process user authentication.

In the present invention, the first and second fingerprint information obtained through the first fingerprint recognizer of the client client and the second fingerprint recognizer of the merchant client may be transmitted to the face and fingerprint payment service server To provide; Wherein the first fingerprint information and the second fingerprint information are provided to the fingerprint settlement service server when the temperature and flow of the finger of the customer are further detected and there is no abnormality. And an electronic payment system having multiple safety lock functions for processing authentication.

As described above, the electronic payment system using the fingerprint and finger vein recognition of the present invention provides an electronic payment service using simultaneous authentication of face and fingerprint to replace credit card payment through a mobile application, It is possible to provide security and convenience at the time of electronic payment.

Further, in the electronic payment system using the fingerprint and finger vein recognition of the present invention, the customer client and the merchant client can register their face, fingerprint, and fingerprint information by using their recognizers in a smart phone, User authentication is possible.

Further, the electronic payment system using the fingerprint and finger vein recognition of the present invention can provide convenience to the user because the face having high security and fingerprint or finger vein information can be utilized as a payment means.

In the present invention, facial information is mounted on a smart phone by a digital signal, the face can be photographed and photographed by a photographing photographing device, and then a fingerprint biometric authentication can be performed on a fingerprint recognizer of a smart phone The present invention provides a financial transaction electronic settlement system that simultaneously scans and processes a user's authentication, thereby allowing the existing photo shooter or fingerprint recognition technology to be used as it is.

It is another object of the present invention to provide a secure electronic settlement in a financial transaction using fingerprint recognition through a mobile application.

Moreover, the convergence technology that can authenticate the face and the fingerprint at the same time is completed, so that there is more perfect security effect.

1 (a) and 1 (b) illustrate an outline structure of a smart phone to which an iris recognition method using a camera for a short distance iris image of a smartphone is applied according to an embodiment of the present invention, and an eye shape, It is an external structure.
Fig. 2 is an explanatory view of the muscle structure of the eye of the prior art. Fig.
FIG. 3 is a schematic configuration diagram of a face image of the conventional invention, and is a configuration diagram showing each position and a distance measuring method.
FIG. 4 is a conceptual illustration of a finger vein fingerprint image acquiring mechanism of an authentication device according to an embodiment of the present invention, which is patented by the present applicant, and is an embodiment of a seating part for placing an upper finger.
FIG. 5 shows a fingerprint side (a) and a finger side (b) of the same finger taken by a general finger image sensor and a fingerprint image sensor.
FIG. 6 is a schematic front view of an electronic payment system having multiple security lock functions for processing user authentication by simultaneously scanning a face and a fingerprint in a wired / wireless network of the present invention and a smartphone displaying the method.
7 shows an internal electronic configuration example of a face, fingerprint and / or vein imaging authentication device according to a preferred embodiment of the present invention.
8 is a block diagram illustrating a network configuration of an electronic payment system for providing fingerprint and / or fingerprint settlement services according to the present invention.
FIG. 9 is a block diagram showing the configuration of the client client shown in FIG. 8
FIG. 10 is a block diagram showing the configuration of the fingerprint and / or fingerprint settlement service server shown in FIG. 8
11 is a flowchart showing the processing procedure of the electronic settlement system according to the present invention.
Fig. 12 shows a circuit diagram of fingerprint authentication and / or finger vein authentication according to the present invention.
13 and 14 are flowcharts illustrating processing procedures of a financial transaction relay system having multiple security lock functions using face authentication according to an embodiment of the present invention, respectively; And
FIGS. 15 and 16 illustrate processing procedures of a financial transaction relay system having multiple security lock functions for simultaneously scanning a face and a fingerprint and / or a finger vein according to another embodiment of the present invention to process user authentication Fig.
17 is a schematic perspective view of a fingerprint and finger vein authentication device of a smartphone according to an embodiment of the present invention.
18 is a perspective view of a corner of a fingerprint and finger vein authentication device of a smartphone according to an embodiment of the present invention.
FIG. 19 is a schematic cross-sectional view of a corner of a fingerprint and finger vein authentication device of a smartphone according to an embodiment of the present invention
FIG. 20 is a schematic perspective view of a lower front edge of a smartphone installed with a fingerprint and finger vein authentication device of a smartphone according to an embodiment of the present invention.

The embodiments of the present invention can be modified into various forms and the scope of the present invention should not be interpreted as being limited by the embodiments described below. The present embodiments are provided to enable those skilled in the art to more fully understand the present invention. Therefore, the shapes and the like of the components in the drawings are exaggerated in order to emphasize a clearer explanation.

FIG. 6 is a schematic front view of a smartphone in which an electronic payment system having multiple security locking functions for processing user authentication by simultaneously scanning a face and a fingerprint in a wire / wireless network of the present invention and a smartphone in which the method is displayed. Fig. 4 shows an internal electronic configuration example of a face, a fingerprint and / or a finger vein authentication device according to a preferred embodiment.

As shown in the drawing, the smartphone 2200 has a smart phone screen 2210 formed in front, a face recognition processing unit 2230 for photographing is formed at the upper end, and a face image for a back face can be photographed. A fingerprint recognition processing unit 2240 is formed to detect the fingerprint of the user and perform user authentication processing.

A conversion display section 2250 is displayed on the right side of the smartphone screen before and after photographing, which is a selection switch that can be photographed in the front or back face at the time of photographing.

In the present invention, the face image display area 2260 can be displayed and operated in the center of the smart phone so that the face image 2270 can be standardized to compare the digitized face image stored in the database with the digitized face image previously stored in the database have.

As described above, the user can photograph the face of the user by using the conversion display unit 2250 before and after taking the picture with the smartphone, and photographs the face by the camera shutter 2265. Then, Then, the fingerprint identification processor determines the identity of the fingerprint using the fingerprint of the finger, and the user makes a financial settlement such as electronic commerce.

To implement this, the face and fingerprint and / or finger vein authentication device will be described.

Here, the actual practice of the present invention is to selectively explain the face and the fingerprint or, if necessary, the recognition of the finger vein.

Technically, in the case of a fingerprint, a contact type in which a finger is touched and a non-contact type in which a light source is irradiated are developed. In the case of a finger vein, Contact type or non-contact type may be separately selected.

7, the integrated photographic authentication apparatus 1200 of the present invention includes an infrared light source unit 1240, a finger vein image sensor 1230, a face image sensor 1220, a digital conversion unit 1290, a decryption algorithm unit 1260 A unit identification registering unit 1265b, a biometric information data storage unit 1270, and a display unit 1280. The display unit 1280 is a display unit for displaying the biometric information.

Although not shown in the drawings, the power supply unit, the communication unit, and various I / O devices may be included.

The infrared light source unit 1240 irradiates infrared light toward the object accommodating unit. Preferably one or more LEDs emitting infrared light having a wavelength of 630 to 1,000 nm suitable for imaging the finger vein image. In addition, preferably, an optical filter is provided to remove the light noise.

The line-of-sight light portion irradiates a visible ray toward the object accommodating portion. And may be constituted by one or more LEDs by emitting ultraviolet light of a suitable wavelength for photographing the fingerprint of the finger surface.

Further, in one embodiment of the present invention, one infrared light source unit 1240 and one line-of-sight light source unit for irradiating the infrared light and the visible light toward the object accommodating unit may be provided, respectively.

In a preferred embodiment of the present invention, the fingerprint and finger vein image sensor 1230 obtains a fingerprint image and a finger vein image for one finger object.

Digital converter 1290 accepts both the fingerprint image and / or the finger vein image and the face image, and the digital converter 1250 obtains the face image and the finger vein image file of the finger.

The control unit 1210 causes the digital conversion unit 1290 to transfer the converted image files to the matching algorithm unit 1260.

The biometric information data store 1270 stores biometric information of a user stored in advance. In some embodiments of the present invention, the biometric information data store 1270 may be constructed in the authentication device internal memory.

The biometric information data store 1270 can use a crypto-processor that can be protected from external hardware, software attack or theft.

The matching algorithm unit 1260 acquires the user data stored in the biometric information data storage 1270 and determines whether the user biometric information value acquired by the digital conversion unit 1290 matches the user biometric information value. If they match, the display unit 1280 can output a success message. If the decryption is unsuccessful, the authentication failure message may be output to the display unit 1280.

The control unit 1210 controls operations and functions of the authentication apparatus.

Particularly fingerprint and / or finger vein image acquisition, processing, authentication operations and authentication results. Various software may be used in connection with the processing and calculation of the acquired fingerprint and / or finger vein image.

For example, a Canny edge detector algorithm can be used. By applying a Gaussian filter, the noise of the original image can be removed as a whole. Edge the image through the Image Gradient.

That is, a sketch line of the image is extracted. Apply non-maximum suppression to thin edges (sketch lines), apply double thresholds to classify dark edges as solid edges, and faint edges as noise and classify them as weak edges . Finally, the weak edges are deleted, only the definite edges are left, and finally the coronal images of the veins are output.

The authentication apparatus of the present invention can greatly reduce the false recognition rate by authenticating the face, the fingerprint image of the finger, and the finger vein data at the same time, and by reducing the capacity of the server and speeding up the authentication, The inventor invented an invention that can be stored separately.

Although not shown in the drawings, the power supply unit, the communication unit, and various I / O devices may be included.

As described above, the unauthorized identification processing unit 1265 registers the finger information and the finger vein by distinguishing "1" for male information and "2" for female information at the time of simultaneous authentication of the fingerprint and finger vein.

The generation unit classification registration unit 1265b divides the men and women generation division table into male and female, and each family unit is divided into 10-year-old units and registered.

The server construction using the resident registration number is divided into the year, month, and day, and the server is constructed by dividing the household by the generation. The server is naturally constructed using the unique number of the person at the time of initial registration And the linkage effect between the server and the person's unique number in the financial settlement is manifested organically so that a remarkable effect is obtained as an invention.

If the storage of the iris, the fingerprint or the fingerprint information is separately stored for each bank, the capacity of the server is reduced, so that the speed of the present technology is remarkably increased.

As described above, the present invention can be implemented by a method using various metrics in conjunction with the above-described embodiments. Accordingly, by combining two or more as human body information, it is possible to escape the concern of imitation or hacking, It may be the only way to resolve the error part of the finger.

In the present invention, the " simultaneous use of means such as face and fingerprint "means " simultaneous use of two kinds of authentication" and " , And "to pass the certification to the next one".

To describe this in more detail, when two identical faces are registered in the same bank at the time of face authentication as in the case of authenticating with the concept of two "and" and another authentication, Pass, and / or fingerprint authentication and / or fingerprint authentication, it is judged that there is no identical person among the two faces having the same face, so that the probability of false recognition can be extremely limited.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 8 to 11 attached hereto.

FIG. 8 is a block diagram illustrating a network configuration of an electronic payment system for providing a face and fingerprint and / or a fingerprint settlement service according to the present invention.

Referring to FIG. 8, the electronic settlement system 2 using face and fingerprint and / or finger vein recognition according to the present invention can recognize faces, fingerprints and / or finger veins Or when electronic settlement such as a credit card, a debit card, a check card, or a bank transfer, which the customer has already provided, processes the identity of the customer so that the payment is made through face and fingerprint and / or finger vein authentication.

To this end, the electronic payment system 2 of the present invention includes a communication network 10, a face and fingerprint and / or fingerprint settlement service server 100, a plurality of customer clients 200, a credit card company server 300, And a plurality of merchant clients 400.

The face and fingerprint and / or fingerprint settlement service server 100 registers the face and fingerprint and / or fingerprint information of the customer from the customer client 200 and authenticates the face and fingerprint and / And a fingerprint and / or a fingerprint payment application 110 for making a payment through the communication network 10 between the customer client 200, the merchant client 400 and the credit card company server 300 So that mutual electronic settlement is performed.

The customer client 200 is provided as a mobile terminal that is easy to carry, such as a smart phone, a tablet computer, and the like. The customer client 200 includes a face recognizer 210a and a face recognizer 210a for registering or authenticating the face and fingerprint and / Fingerprint and / or finger vein recognizer 210. In this embodiment, the fingerprint and / or finger vein recognizer 210 is provided in a module form inside the customer client 200, but as shown in FIG. 9, the customer client 200 and the detachable independent device . The customer client 200 accesses the face and / or fingerprint service server 100 through the communication network 10 to download the face and / or fingerprint payment application 110 and installs the face and / or fingerprint payment application 110 therein .

The customer client 200 also activates the face and fingerprint and / or fingerprint payment application (202 of FIG. 9) to scan his / her fingerprint and / or fingerprint information via fingerprint and / or fingerprint recognizer 210 And provides the scanned fingerprint and / or fingerprint information to the face and fingerprint and / or fingerprint settlement service server 100 via the communication network 10 to provide a virtual payment means, such as a virtual Payment credit card, virtual payment account, and so on. Of course, the fingerprint and / or fingerprint information of the customer client 200 registered in the face and fingerprint or / and the fingerprint settlement service server 100 may be stored in the fingerprint and / or fingerprint information of the customer's credit card, debit card, It can be registered for identity verification and confirmation.

The credit card company server 300 issues a virtual payment means corresponding to the face and the fingerprint or / and the fingerprint information of the customer client 200 and discriminates whether or not the payment is approved by using the face and the fingerprint and / or the fingerprint information Face and fingerprint and / or fingerprint settlement service server 100 to provide the discrimination result. Of course, the credit card company server 300 may be used to authenticate and authenticate the face and fingerprint of the customer client 200 for identity verification and verification of other payment means, e.g., credit card, debit card, check card and transaction account information corresponding to the customer client 200 / And fingerprint information.

The merchant client 400 is equipped with a POS terminal, a personal computer (PC), or the like, which is provided in an affiliate store that sells a product or service through an on-off line. The merchant client 400 has a face and fingerprint and / or finger vein recognizer 410 for recognizing the face and fingerprint of the customer and / or the finger vein information. When the customer of the customer client 200 purchases a product or a service and the payment is made, the merchant client 400 receives the customer's face and / or fingerprint through the face and / or finger vein recognizer 410, And the fingerprint information, and transmits the scanned face and fingerprint and / or fingerprint information to the face and fingerprint and / or fingerprint settlement service server 100 through the communication network 10 to request payment approval. When the payment for the payment amount is approved from the credit card company server 300 (or another payment system), the merchant client 400 transmits a payment approval through the face and fingerprint and / or the fingerprint settlement service server 100 Check.

Specifically, FIG. 9 is a block diagram showing the configuration of the client client shown in FIG. 8, and FIG. 10 is a block diagram showing the configuration of the face and fingerprint and / or fingerprint settlement service server shown in FIG.

Referring to FIG. 9, a customer client (smartphone user) 200 of this embodiment is provided as a smart phone and has a face and fingerprint and / or fingerprint payment app 202 installed therein. The face and fingerprint and / or fingerprint payment app 202 are downloaded and installed from the face and fingerprint and / or fingerprint payment service server 100 through a communication network.

The smartphone 200 activates the face and fingerprint and / or fingerprint payment application 202 to send face and fingerprint information and / or fingerprint information to the face and / or fingerprint service server 100, . To this end, the smartphone 200 is attached to the face and / or finger vein recognizer 210. This eliminates the economic burden of the customer having to purchase the face recognizer 210a and the fingerprint and / or finger vein recognizer 210 and can positively use the face and fingerprint and / or fingerprint payment app 202 The facial recognition unit 210a and the fingerprint and / or finger vein recognizer 210 are provided to the commercial site in the face and fingerprint and / or the service provider, merchant or credit card company of the fingerprint settlement service server 100, And is provided in the form of being mounted on and detachable from the smartphone 200 when registering and using a payment means using a face and a fingerprint or / and a finger vein.

Here, the fingerprint and finger vein recognizer of FIG. 4 invented by the inventor can be used here.

The finger recognizer 210a can recognize the hemoglobin pattern of the vein by projecting the near infrared ray or the like on the vein of the finger which is easy to use among the veins of the customer, To acquire the fingerprint information.

That is, by using the fact that the vein of the finger absorbs near-infrared light and the portion other than the vein transmits near-infrared light, a near infrared ray is irradiated onto a finger and a finger having near infrared sensitivity, for example, The image of the vein can be extracted and used for personal authentication.

Specifically, the fingerprint and / or finger vein recognizer 210 may include a controller 212 for controlling all operations of the fingerprint and / or finger vein recognizer 210, a fingerprint scanner 210 for acquiring the fingerprint and / A memory 216 that stores fingerprints and / or fingerprint information obtained from the scanner 214, a fingerprint that is scanned from the scanner 214, and / or fingerprint information and / An LCD module 218 for displaying a processing procedure of the MAC recognizer 210 and an interface module 220 for providing the fingerprint and / or fingerprint information, which is connected to the smartphone 200 and acquired from the scanner 214, (220).

When acquiring the fingerprint and / or finger vein information from the scanner 214, the fingerprint and / or finger vein recognizer 210 may include a temperature sensor 222 for sensing the temperature of the finger and a blood flow recognition And a sensor 224. For example, the temperature sensor 222 and the blood flow recognition sensor 224 may use a fingerprint and / or a fingerprint image to complement and solve a problem that can scan the fingerprint and / The MAC recognizer 210 recognizes the temperature of the finger and the flow of the blood flow along with the fingerprint and / or finger vein information obtained from the scanner 214, and if the finger recognizes that there is no abnormality, the fingerprint obtained from the scanner 214 and / And processes the fingerprint information to be provided to the smartphone 200.

The configuration of the fingerprint and / or finger vein recognizer 210 is substantially similar to or the same as the fingerprint of the merchant client 400 and / or the vein recognizer 410. Therefore, the detailed description of the fingerprint and / or the finger vein recognizer 410 of the merchant client 400 will be omitted.

10, the face and fingerprint and / or fingerprint settlement service server 100 according to this embodiment includes a control unit 102, a communication unit 104, a fingerprint and / or FPC application 110 (Not shown), and a database 120. The database 120 includes a storage unit (not shown) In addition, the face and fingerprint and / or fingerprint settlement service server 100 includes components of a typical computer system, for example, a central processing unit, a memory unit, an input / output unit, a storage unit, etc. .

The communication unit 104 is connected to the customer client 200, the merchant client 400, the credit card company server 300 and the fingerprint and / or fingerprint settlement service server 100 via the communication network 10, .

The control unit 102 controls and processes all operations of the face and fingerprint and / or fingerprint settlement service server 100. The control unit 102 may include software such as an operating system program, a control program, etc., as well as hardware such as a central processing unit, a memory or a web server,

The control unit 102 processes the member registration from each of the customer client 200 and the merchant client 400 by using the fingerprint and / or the FPC application 110, The fingerprint and / or fingerprint information is registered. When the face and the fingerprint and / or the fingerprint information of the customer are transmitted from the merchant client 400, the fingerprint and / or the fingerprint information is compared with the registered face and / To authenticate the customer and process the settlement. The control unit 102 controls processes of the face and fingerprint and / or the FPCA 110. Details of the process will be described in detail with reference to FIG.

The face and fingerprint and / or fingerprint payment app 110 are stored in a storage unit (not shown) of the face and fingerprint and / or fingerprint payment service server 100 and are processed under the control of the control unit 102 , Various information is read from the database 120 or various information generated according to the process is stored in the database 120. The face and fingerprint and / or fingerprint payment app 110 are provided in the form of a mobile application in this embodiment and are installed in the customer client 200. Of course, the face and fingerprint and / or fingerprint payment app 110 may be provided in the form of a web browser.

In this embodiment, the face and fingerprint and / or fingerprint payment app 110 may include a face and fingerprint and / or a fingerprint registration module for processing to register the face and fingerprint and / or fingerprint information of the customer from the customer client 200 Fingerprint and / or fingerprint information is transmitted from the merchant client 400 and the face of the customer, fingerprint and / or fingerprint information from the merchant client 400, And / or a fingerprint and / or fingerprinting module 114 for processing to be performed.

Accordingly, the face and fingerprint and / or the FPC application 110 receive face and fingerprint information and / or fingerprint information from the customer client 200 and register them in the database 120, And the fingerprint information and / or the fingerprint information is compared with the fingerprint and / or fingerprint information of the customer registered in the database 120 to authenticate the customer, and the fingerprint and / or the fingerprint information And processes the settlement through the matched payment means.

The database 120 stores various information according to the process of the face and fingerprint and / or the FPC application 110 under the control of the control unit 102. In this embodiment, the database 120 is provided inside the face and fingerprint or / and fingerprint settlement service server 100, but may be provided as a separate database server.

The database 120 of this embodiment includes customer information 122, face and fingerprint and / or fingerprint information 124, financial and credit card matching information 126, payment information 128 and merchant information 130 ).

The customer information 122 includes information such as the name of the customer, the name of the customer, the authenticated mobile phone number (for example, Etc., a password, an e-mail address, and the like.

The customer information 122 may further include information on previously issued payment means, for example, a credit card, a debit card, a check card, and a transaction account.

The face and fingerprint and / or fingerprint information 124 are registered corresponding to the customer information 122. The face and fingerprint and / or fingerprint information 124 are obtained from the fingerprint of the customer client 200 and / or the finger vein recognizer 210 and are transmitted from the customer client 200 via the communication network 10 / RTI > and the fingerprint settlement service server 100, respectively. Therefore, the face and fingerprint and / or the fingerprint information 124 registered in the fingerprint settlement service server 100 correspond to one payment means (for example, virtual payment means) And is used as information necessary for user authentication of means (e.g., credit card, transaction account, etc.).

The financial and credit card matching information 126 may include one payment means (e.g., a virtual payment means) and / or a payment means for a fingerprint and / And matching information. The payment information 128 is used to store the fingerprint of the merchant client 400 and / or the fingerprint and / or fingerprint information transmitted from the fingerprint recognizer 410 to the face and fingerprint and / or fingerprint information registered from the customer client 200 The settlement date, the settlement amount, and the settlement details of the settlement request and the approved contents in the merchant client 400, if they match. The merchant information 130 includes member information on a face and a fingerprint and / or an affiliated store registered as a member in the PDA service server 100, for example, a merchant name, a contact address, and the like.

Therefore, the face and fingerprint and / or fingerprint payment service server 100 of the present invention receives the face and fingerprint and / or fingerprint information 124 from the client 200 through the communication network 10, And fingerprint and / or fingerprint information and settlement request are received from the merchant client 400, the fingerprint and / or fingerprint information is compared with the registered face and / or the fingerprint information, The payment request is requested to the credit card company server 300 so that settlement can be made with the payment method of the customer and when payment is approved by the credit card company server 300, payment is made to the customer client 200 and the merchant client 400 It tells you.

And FIG. 11 is a flowchart showing the processing procedure of the electronic settlement system according to the present invention. This procedure is a program to be processed by the face and fingerprint and / or fingerprint payment service server 100 according to the present invention, which is provided as face and fingerprint and / or fingerprint payment app, And a storage unit (not shown) of the fingerprint settlement service server 100, and is installed in the customer client 200. The face and fingerprint and / or fingerprint payment application 110 are associated with the customer client 200, the merchant client 400, the credit card company server 300 and the fingerprint and / or fingerprint settlement service server 100 .

11, the electronic payment system 2 of the present invention provides the face and fingerprint and / or fingerprint and / or fingerprint payment app 110 to the fingerprint settlement service server 100 in step S150 . In step S152, the customer 2 client 200 accesses the face and fingerprint and / or fingerprint settlement service server 100 through the communication network 10, downloads the face and fingerprint and / or fingerprint payment application 110 Install it inside.

In step S154, the customer client 200 activates the installed face and / or fingerprint and / or Fingerprint payment application 202, and transmits the fingerprint and / or fingerprint information of the customer through the fingerprint and / or fingerprint recognizer 210 And provides the obtained fingerprint and / or fingerprint information to the face and fingerprint and / or fingerprint settlement service server 100 via the communication network 10. In step S156, the face and fingerprint and / or the FMC service server 100 stores and registers the face and fingerprint and / or fingerprint information provided from the customer client 200 in the database 120. At this time, the face and fingerprint and / or fingerprint settlement service server 100 transmits face and fingerprint and / or fingerprint information to the credit card company server 300 through the communication network 10.

In step S158, the credit card company server 300 transmits the face and fingerprint and / or the fingerprint and / or fingerprint information transmitted from the fingerprint and / or fingerprint settlement service server 100 to the payment means of the customer registered in the credit card company server 300 Or by matching with the credit card company server 300 in correspondence with a credit card, a debit card, a check card, and a transaction account issued from the credit card company server 300.

Therefore, through the above-described steps S150 to S158, the customer client 200 is registered so as to enable the electronic settlement processing for the face and fingerprint and / or fingerprint information.

When a transaction occurs at the merchant in step S160, the fingerprint and / or fingerprint of the customer are recognized from the fingerprint of the merchant client 400 and / or the fingerprint and / or fingerprint information of the customer from the finger vein recognizer 410. In step S162, And transmits the MAC information and the payment information to the face and fingerprint and / or fingerprint settlement service server 100 to request payment approval according to the commercial transaction.

In step S164, the face and fingerprint and / or fingerprint payment service server 100 transmits the face and fingerprint and / or fingerprint information transmitted from the merchant client 400 to the face and fingerprint registered in the database 120 and / It compares and analyzes with Mac information to determine the authentication status of the customer. As a result of the determination, if the two faces and the fingerprint or / and the fingerprint information are matched, the face and fingerprint and / or the fingerprint settlement service server 100 in step S166 are registered in the credit card company server 300 If the two faces and the fingerprint or / and the fingerprint information do not coincide with each other, the franchisee client 400 is informed of the rejection and rejection reasons.

If the settlement is approved through the payment means corresponding to the face and the fingerprint and / or the fingerprint information requested by the credit card company server 300 in step S168, the face and fingerprint and / or the fingerprint settlement service And informs the server 100 that the payment has been approved. In step S170, the fingerprint and / or FSA service server 100 transmits a payment approval result to the customer client 200. In step S172, the franchise client 400 confirms that the payment has been approved. Then, in step S174, (200) confirms that the payment has been approved.

Accordingly, the electronic payment system 2 using the face and fingerprint and / or the fingerprint authentication of the present invention registers the face and the fingerprint and / or the fingerprint information of the customer on the face and the fingerprint and / or the fingerprint settlement service server 100 And fingerprint and / or fingerprint information at the time of occurrence of commerce from the merchant client 400, and processes the settlement through the payment means matched with the face and the fingerprint and / or the fingerprint information of the customer .

In order to realize the invention, the face technique will be described in the form of an example using the developed technique as shown in FIGS.

In addition, an integration module for linking fingerprints and fingerprint algorithms for implementing the present invention can be described as follows.

12 is a diagram showing an input / output integration module for linking fingerprint and fingerprint algorithm.

As shown in FIG. 12, the input / output integration module U1 for simultaneously linking fingerprint and fingerprint algorithm comprises a fingerprint module U2, a fingerprint module U3, and a conversion module U4.

First, the fingerprint module U2 will be described.

The GND line 1 of the fingerprint module U2 functions as a 0V grounding function as a reference of the negative voltage circuit and the line RX 2 serves as a serial data receiving port to control the fingerprint module. Line is a serial data transmission port that reads the status of the fingerprint module and line 4 of VCC functions as a + 5V voltage input function based on the (+) voltage of the power supply circuit. When a fingerprint is scanned and compared with a previously stored image, if there is a person of the same fingerprint image, the registered authentication code of the person is output to the serial communication (here, 232 communication is applied as an embodiment).

Here, 232 communication is a serial communication standard.

Next, the finger vein module U3 will be described.

The GND line 1 of the finger vein module U3 has a 0V grounding function as a reference of a negative voltage and the A 2 line is a serial communication standard RS485 communication A port for data reception and transmission functions, Line 3 is a serial communication standard RS485 communication B port for receiving and transmitting data. VCC line 4 is a + (positive) voltage reference of the power supply circuit and functions as a + 5V voltage input. After transmitting a finger through an infrared LED, a vein is scanned by a camera image sensor and compared with a vein image stored in advance. When there is a person with the same image, the registered authentication code of the person is used for serial communication (herein, 485 communication is applied as an embodiment) .

Here, 485 communication is a serial communication standard.

The following describes the conversion module U4 of the 485-232 communication.

The GND line 1 on the left side of the conversion module U4 has a 0V grounding function as a reference of the negative voltage and the A 2 line is a serial communication standard RS485 communication A port for data reception and transmission functions, The line 3 is a serial communication standard RS485 communication B port, and functions as a data receiving and transmitting function. The line VCC 4 is a (+) voltage reference and functions as a voltage input of + 5V. And converts the received 485 communication into 232 communication.

The line DI5 on the right side of the conversion module U4 is a serial 232 communication reception port and receives data. RE6 line is a 485 communication control port, and controls the transmission / reception state of the 485 communication module The DE 7 line is a 485 communication control port and controls the transmission / reception state of the 485 communication module. The RO 8 line is a serial 232 communication transmission port, and functions to transmit a command. It is linked with the integration module U1.

Next, the fingerprint and fingerprint input and USB output integration module U1 will be described.

The D1 / TX1 line of the integration module U1 is a serial 232 communication transmission port and functions as a data transmission function to a computer. The D0 / RX2 line is a serial 232 communication reception port. , GND line 4 is the ground of 0V as a voltage reference and D2 line 5 is the serial 232 communication transmission line of the fingerprint module (U2). It sends the command to the fingerprint module and D3 Line is a fingerprint module (U2) serial 232 communication reception line, and receives the status value of the fingerprint module. D8 line 11 is a serial 232 communication transmission port of the 485-232 communication conversion module (U4) D9 line 12 is a 485 communication control port of the 485-232 communication conversion module U4 and functions to control the sending and receiving states of the 485 communication module and D10 13 line Is a 485 communication control port of the 485-232 communication conversion module U4, D11 Line 14 is the serial 232 communication receiving port of 485-232 communication conversion module (U4), and it reads the status of the finger vein module (U3) Line is a (+) voltage 5V output pin that supplies the 5V voltage of fingerprint module (U2), finger module (U3), 485 communication conversion module (U4) The VIN line 30 has a + 5V voltage input function as a voltage reference, and the VIN line 30 has a + 5V voltage input function. In the above configuration, the fingerprint authentication code output from the fingerprint module U2 And the finger vein authentication code (the unique number of the customer registered with the low vein) output from the finger vein module U3 is converted into 232 communication from the conversion module U4 and the integrated module U1 ), And when the fingerprint and the fingerprint authentication code coincide with each other, the corresponding authentication code is output through USB.

As a method of outputting another fingerprint and a fingerprint authentication code, a fingerprint authentication code output from the fingerprint module U2 and a fingerprint authentication code output from the fingerprint module U3 are received from the integration module U1 The fingerprint authentication module may output the fingerprint authentication code to the fingerprint module and the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3, And the fingerprint and finger vein authentication code are received by the integration module (U1), and when the fingerprint and the fingerprint authentication code coincide with each other, the corresponding authentication code is output via USB. It can be processed.

The fingerprint and fingerprint algorithm of this case invention can be expressed as follows.

int getfingerauthorization (int fingerprintcode, int fingerveincode)

{

    if (fingerprintcode> 0 && fingerveincode> 0 && fingerprintcode == fingerveincode))

    {

return fingerprintcode;

    }

    return 0;

}

The algorithm is an algorithm that accepts a fingerprint authentication code and a fingerprint authentication code from the integration module U1 and allows an authentication code only when the fingerprint and the low vein are the same person.

The following is a more detailed description.

The fingerprint module U2 retrieves a fingerprint and outputs the code number of the corresponding person when there is a person matching the fingerprint.

The finger vein module U3 searches for a finger vein and outputs the corresponding person's code number if there is a person matching the finger vein.

The fingerprint code of the fingerprint module U2 and the fingerprint code of the fingerprint module U3 are inputted into fingerprintcode and fingerveincode which are the arguments of the function name getfingerauthorization of the above algorithm so that both argument values are valid and also two registration The fingerprint and the finger vein integration module output the person's code only when the unique number of the customer is matched.

If other fingerprint code and fingerprint code are invalid or do not match, an error code of 0 is output.

The following describes procedures for judging the identity of a face and a fingerprint or a finger vein in a smartphone.

13 and 14 are flowcharts illustrating different processing procedures of a financial transaction relay system having multiple security lock functions using face authentication according to an embodiment of the present invention.

13, the financial transaction relay system 2 of the present invention accesses the financial transaction relay server 100 through the communication network 4 in step S150 and subscribes to the member in step S152 . At this time, the customer terminal 200 inputs customer's personal information such as a name, an ID, a password, a telephone number, and an e-mail address.

In step S154, the customer terminal 200 obtains the fingerprint and / or finger vein information and the face information through the fingerprint and / or the finger vein recognizer 210 and the face recognizer 220 and transmits the fingerprint and / And the finger information and the face information to the financial transaction relay server 100, the financial transaction relay server 100 registers the fingerprint and / or the fingerprint information and the face information in response to the customer terminal 200. At this time, the financial transaction relay server 100 stores the fingerprint or / and the fingerprint information 134 and the face information 136 in the database 130.

In step S156, the financial transaction relay server 100 firstly recognizes the face in order to perform the electronic financial transaction and the electronic commerce, and discriminates whether the face information matches the face information stored in the database in step S158, Authentication.

In step S160, the financial transaction relay server 100 receives the fingerprint information from the customer terminal 200 and determines whether the fingerprint information matches the fingerprint information stored in the database 130 in step S162. Fingerprint information stored in the database 130 is included in the member information 132. [ As a result of the determination, if the two pieces of information coincide with each other, the finger vein is recognized in a tertiary manner in step S164, and it is determined in step S166 whether the vein information coincides with the finger vein information stored in the database.

As a result of the determination, if the two pieces of fingerprint information match, the procedure proceeds to step S168, where the multiple safety lock module 110 sequentially transmits the database 130 of the financial transaction relay server 100 through the middleware approval processing unit 122, In step S170, the financial transaction relay server 100 accesses the electronic financial transaction system 300 or the electronic commerce system 400 without authentication and processes the transaction so as to relay the financial transaction.

However, if it is determined in step S158, step S162, and step S166 that the fingerprint or / or the fingerprint information and the face information do not match from the customer terminal 200, the financial transaction relay server 100 proceeds to step S172, And blocks the connection of the financial transaction relay server 100 to prevent transactions and e-commerce transactions from being processed.

Referring to FIG. 14, in step S160, if only one of the fingerprint or fingerprint is recognized after the face recognition, the authentication is performed. In case of face recognition, since it is possible only in the living state, it can be done only by the user, so even if only the fingerprint is added, it can be a simple and accurate financial settlement system.

Since the other procedures are the same, the description of the overlapping process is omitted here.

15 and 16 illustrate different processing procedures of a financial transaction relay system having multiple security lock functions for simultaneously scanning a face and a fingerprint and / or a finger vein according to another embodiment of the present invention to process user authentication Fig.

In this embodiment, the face information and the fingerprint and / or fingerprint information are the same or similar to each other and are processed when the user identification is difficult. The first user authentication is processed by the face information, Secondly, user authentication is processed using fingerprint and / or fingerprint information.

15, the financial transaction relay system 2 of the present invention simultaneously prints fingerprints of the customer terminal 200 and / or the fingerprint recognizer 210 and the face recognizer 220 at step S180. Finger vein and / or finger vein information and face information to the financial transaction relay server 100 by scanning the finger vein and the face.

In step S182, the financial transaction relay server 100 recognizes the face information, the fingerprint and / or the fingerprint information, and in step S184, the face information is compared with the face information stored in the database 130 to determine whether it is unique.

As a result of the determination, if the face information is unique, the procedure proceeds to step S188. If it is not unique, that is, if the face information is the same or similar and the user identification is difficult, the fingerprint information is stored in the database 130 in step S186 It is compared with the information to determine whether it is unique.

As a result of the determination, if the fingerprint information is unique, the procedure advances to step S188 to recognize the fingerprint information and process the user authentication when the fingerprint information matches the fingerprint information stored in the database 130. [

In step S190, it is determined whether or not the fingerprint information matches the fingerprint information stored in the database 130. If the fingerprint information matches, the multiple safety lock module 110 in the middleware approval processing unit 122 in step S192, The financial transaction relay server 100 accesses the electronic financial transaction system 300 or the electronic commerce system 400 without authentication in step S194 to release the firewall 130 to open the database 130 of the server 100, .

However, if the user terminal 200 can not authenticate the user using the face information and the fingerprint or / and the fingerprint information in the steps S186 and S190, respectively, or if they are not identical, the flow advances to step S196 to perform electronic financial transactions and electronic commerce Thereby blocking the connection of the financial transaction relay server 100 from being processed.

Referring to FIG. 16, it is a flowchart for omitting the step of inputting the fingerprint information in step S188. In the case of face recognition that recognizes the position of the pupil, it is possible only in the living state, so that it can be done only by the user. Therefore, even if the fingerprint is added, it can be a simple and accurate financial settlement system.

The following describes authentication devices of fingerprint and finger vein applied to a smartphone.

FIG. 17 is a schematic perspective view of a fingerprint and finger vein authentication device of a smartphone according to an embodiment of the present invention, FIG. 18 is a perspective view of a fingerprint and finger vein authentication device of a smartphone according to an embodiment of the present invention, 19 is a schematic side cross-sectional view of a corner of a fingerprint and finger vein authentication device of a smartphone according to an embodiment of the present invention, and Fig. 20 is a cross- And the finger vein authentication device.

As shown in the figure, a smartphone is generally divided into a body upper part 2001 and a body lower part 2002 in a smartphone body 2000. The present invention is characterized in that a fingerprint and finger vein information And fingerprint authentication and finger vein authentication are performed here.

The authentication device 2100 for obtaining the fingerprint and finger vein information includes a space for authenticating the fingerprint and the finger vein at the bottom edge of the body side part 2400 of the smartphone, A substantial authentication device space 2500 into which the fingerprint and finger vein authentication device 2100 can enter can be formed at the corner in the form of a collimated light and a side groove frame 2200 is formed at the lower end of the side edge, The fingerprint recognition module 2310 is formed and the finger photographing groove 2410 is formed on the lower side to place the finger f in a noncontact manner so that the finger f can be recognized simultaneously.

In the finger photographing groove 2410, which is an empty space, a very thin finger-holding glass plate may be formed to prevent the entry of foreign dirt or the like.

In this case, the image sensor can be operated by attaching an infrared ray filtering film for blocking the visible ray using the finger support glass plate.

In addition, the finger-holding glass sheet may be formed so as to be formed at the front portion of the image sensor 2510a and the infrared ray transmitting portion 2520a in close proximity to the infrared ray filtering film.

The fingerprint recognition module 2310 uses a contact type recognition module, and a recognition portion 2320 for controlling the fingerprint recognition module 2310 is formed on the back side thereof.

Then, a blank finger photographing groove 2410 is formed on the lower side thereof to form the finger f easily.

The image sensor 2510a and the infrared ray transmitter 2520a are formed in parallel in the back authentication device subspace 2500 of the empty finger photographing groove 2410 and a recognition circuit 2530 for controlling the image sensor 2510a and the infrared ray transmitter 2520a is formed When recognizing finger vein patterns, they are activated to transmit various control signals.

When the image sensor 2510a and the infrared ray transmitter 2520a are designed so as not to be damaged, the empty finger photographing groove 2410 is designed to communicate with the authentication device space 2500 in a non- .

Reference numerals 2410a and 2410b shown in the finger photographing groove 2410 represent first and second photographing region portions, which are virtual regions in which the image sensor 2510a and the image sensor 2510b can be photographed.

Further, in the case of the image sensor 2510a, the range for recognizing the finger veins is different according to the size thereof. Therefore, when the finger f and the distance Ha are extended, When the distance is short, only a narrow range of finger vein pattern is recognized. Therefore, it should be designed and designed considering the relationship with the size of the internal electric field of the smartphone.

Reference numerals a and b denote areas of a fingerprint and a portion corresponding to a finger vein.

20, the smartphone is generally divided into a main body upper part 4001 and a lower main body part 4002 in the smartphone main body 4000. The present invention can be applied to the main body side part 4400 And an authentication device unit 4100 for acquiring fingerprint and finger vein information is formed at the lower right side of the right front side, where fingerprint authentication and finger vein authentication are performed.

The authentication device 4100 for acquiring the fingerprint and finger vein information includes a space for authenticating the fingerprint and the finger vein from the lower right corner of the right front side of the body side part 4400 of the smartphone, A substantial authentication device space 4500 into which the fingerprint and finger vein authentication device part 4100 can enter from the bottom edge of the front edge 4400 to the front edge, A fingerprint recognition module 4310 is formed on the upper side thereof, and a finger photographing groove 4410 is formed on the lower side thereof to place the fingers in a non-contact manner so that they can be simultaneously recognized.

In the finger photographing groove 4410, which is an empty space, a very thin finger-supporting glass plate may be formed to prevent the entry of foreign dirt or the like, or the surface may be covered by using the front glass of the conventional smart phone.

In this case, the image sensor can be operated by attaching an infrared ray filtering film for blocking the visible ray using the finger support glass plate.

In addition, the finger-holding glass sheet may be formed so as to be formed at the front portion of the image sensor 4510a and the infrared ray transmitting portion 4520a in close proximity to the infrared ray filtering film.

The fingerprint recognition module 4310 uses a contact-type recognition module, and a recognition portion 4320 for controlling the fingerprint recognition module 4310 is formed on a back surface thereof.

Then, a blank finger photographing groove 4410 is formed on the lower side thereof, and the finger is formed so as to be easily put on the finger.

An image sensor 4510a and an infrared ray transmitting portion 4520a are formed in parallel in the back authentication device subspace 4500 of the empty finger photographing groove 4410 and a recognition circuit front portion 4530 for controlling the image sensor 4510a and the infrared ray transmitting portion 4520a is formed When recognizing finger vein patterns, they are activated to transmit various control signals.

When the image sensor 4510a and the infrared ray emitting portion 4520a are designed to be free from damage, the empty finger photographing groove 4410 is formed to communicate with the authentication device space 4500 in a non-contact manner according to the surrounding conditions. .

As described above, the face recognition module for face recognition is formed in the smartphone, the recognition module for the fingerprint and the fingerprint is structurally or algorithmically described, and various methods for the authentication of the user can be selected .

Although the present invention has been described in connection with the preferred embodiments thereof with reference to the accompanying drawings, it is to be understood that the invention is not limited to the disclosed embodiments, Various changes and modifications can be made without departing from the scope of the present invention.

2: Electronic payment system
10: Network
100: face and fingerprint or / and fingerprint payment service server
110: Faces and fingerprints and / or fingerprinting apps
200: Customer Client
210: fingerprint and / or fingerprint recognizer
300: Credit card company server
400: Merchant client
410: fingerprint and / or fingerprint recognizer
1200: Integrated shot authentication device
1201:
1201a: scan panel upper case
1201b: scan panel lower case
1220, 1230, 1231: image sensor
1240, 1241: Infrared light source part
1242; Visible light source
1250: scan panel
1250a: fingerprint fingerprint
1250b: finger vein non-contact part
1260a: Infrared side transmitter
1260: Infrared side transmitter case

Claims (12)

An electronic payment system using face and fingerprint recognition, comprising:
A communication network;
A customer client connected to the communication network and acquiring first face and fingerprint information of the customer himself / herself by a photo-recognition face recognition processor and a fingerprint reader;
A merchant client connected to the communication network and acquiring second face and fingerprint information for the customer of the customer by the photographing face recognition processor and the fingerprint reader when the commerce occurs;
The first face and the fingerprint information are received from the client client through the communication network and are registered in correspondence with the payment means, and when the second face and the fingerprint information are transmitted from the merchant client, the first face and the fingerprint information, And a payment service server for comparing the fingerprint information with the payment information and processing the customer for authentication and processing for payment through the payment means corresponding to the first face and the fingerprint information, Output integration module U1 for interlocking the fingerprint module U1 and the fingerprint module U2 comprises a fingerprint module U2, a finger vein module U3 and a conversion module U4, When the fingerprint is scanned by the sensor and compared with the previously stored image, if there is a person with the same fingerprint image, the registered authentication code of the person is outputted to the first serial communication Or the finger vein module U3 transmits a finger to the infrared LED, and then the finger is scanned by the camera image sensor and compared with a pre-stored finger image. If there is a person having the same image, the registered fingerprint authentication And outputting the code to the second serial communication, wherein the conversion module U4 receives the second serial communication output from the finger vein module and converts the second serial communication into a first serial communication such as the fingerprint module U2, A fingerprint authentication code output from the fingerprint module U2 and a fingerprint authentication code output from the fingerprint module U3 are received by the integration module U1 so that either the fingerprint or the fingerprint authentication code is transferred to the USB Or the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 may be output as the integration (U1), and when the fingerprint and the fingerprint authentication code coincide with each other, the corresponding authentication code can be output to the USB. The fingerprint authentication method according to claim 1, Electronic payment system with lock function
The method according to claim 1,
The electronic payment system includes:
Further comprising a credit card company server for accepting payment from the payment means if the payment means is a means corresponding to a credit card. An electronic payment system having multiple safety lock functions for handling user authentication
3. The method according to claim 1 or 2,
The customer client having a first face and a fingerprint recognizer for obtaining first face and fingerprint information, the merchant client having a second face and a fingerprint recognizer for obtaining second face and fingerprint information,
Wherein the first or second face and fingerprint recognizer comprises:
A face recognition processor for photographing the face of the customer to obtain face information;
A scanner that scans the finger of the customer to obtain first or second fingerprint information;
A memory for storing first or second face information obtained from the photographing face recognition processing unit and first or second fingerprint information obtained from the scanner;
An LCD for displaying first or second face information obtained from the photographic photographing face recognition processing unit and first or second fingerprint information scanned from the scanner or for displaying an operation state of the first or second face or the fingerprint recognizer, Wow;
An interface that is connected to the customer client or the merchant client and provides the first or second face information obtained from the photographing face recognition processing unit and the first or second fingerprint information obtained from the scanner to the client client or the merchant client Module and;
And a controller for controlling all operations of the first or second face or the fingerprint recognizer. The electronic payment system having multiple safety lock functions for simultaneously scanning a face and a fingerprint in a wire /
The method of claim 3,
Wherein the first or second fingerprint recognizer comprises:
A temperature sensor for sensing the temperature of the finger of the customer when the first or second fingerprint information is obtained from the scanner;
Further comprising a blood flow recognition sensor for recognizing the flow of the blood flow of the finger of the customer;
The first or second fingerprint recognizer recognizes the temperature and flow of the finger of the customer and if it is determined that there is no abnormality, transmits the first or second fingerprint information obtained from the scanner to the client client or the merchant client And an electronic settlement system having multiple security lock functions for simultaneously scanning a face and a fingerprint in a wire / wireless network to process user authentication
delete The fingerprint module according to claim 1 or 2, wherein the GND line 1 of the fingerprint module U2 is a (-) voltage circuit, the line RX 2 is a serial data reception port, the line TX 3 is a serial data transmission port , VCC line 4 is the (+) voltage reference of the power supply circuit. When the fingerprint image is scanned by the image sensor and compared with the previously stored image, the registered authentication code of the person is output by 232 communication An electronic payment system having multiple security lock functions for simultaneously scanning a face and a fingerprint in a wired / wireless network and processing user authentication
The method of claim 1 or 2, wherein the GND line 1 of the finger vein module (U3) is a (-) voltage reference, the A 2 line is a serial communication standard RS485 communication A port, (+) Voltage reference of the power supply circuit, the GND line 1 on the left side of the conversion module U4 is the reference of the negative voltage, and the line A 2 is the The line B 3 is a serial communication standard RS485 communication port B and the line VCC 4 is a voltage reference and the conversion module U 4 linked with the finger vein module U 3 is connected to the RS- The DI 5 line on the right side is a serial 232 communication reception port, the RE 6 line is a 485 communication control port, the DE 7 line is a 485 communication control port, and the RO 8 line is a serial 232 communication transmission port A multi-security sleep that handles user authentication by simultaneously scanning faces and fingerprints in a wired and wireless network Electronic payment system with gold function
The integrated module (U1) according to claim 1 or 2, wherein the D1 / TX1 line of the integration module (U1) is a serial 232 communication transmission port, the D0 / RX2 line is a serial 232 communication reception port, (U2) serial 232 communication reception line, and D8 11 line is 485-232 (D2), and D2 5 line is the fingerprint module (U2) serial 232 communication transmission line, D3 6 line is the fingerprint module D9 12 is a 485 communication control port of the 485-232 communication conversion module U4 and D10 13 is a serial port communication port of the communication conversion module U4. Line is the 485 communication control port of the 485-232 communication conversion module U4 and D11 14 is the serial 232 communication receiving port of the 485-232 communication conversion module U4 and the 5V line 27 is the (+) voltage 5V output pin, GND line 29 is based on the (-) voltage and VIN line 30 is based on the (+) voltage. These configurations are based on the fingerprint output from the fingerprint module (U2) And the finger vein authentication code output from the finger vein module U3 is converted into 232 communication from the conversion module U4 and is received by the integration module U1. When the fingerprint and the finger vein authentication code coincide with each other, And an electronic settlement system having multiple security lock functions for simultaneously processing face authentication and fingerprint authentication in a wired / wireless network,
3. The fingerprint module (U2) according to claim 1 or 2, wherein the first serial communication of the fingerprint module (U2) is output via 232 communication and the second serial communication of the finger vein module (U3) is output via 485 communication, (U4) receives the 485 communication output from the finger vein module, converts it into 232 communication, and outputs the converted 232 communication. Payment System
The authentication device according to any one of claims 1 to 4, wherein the authentication device (4100) for acquiring fingerprint information by the fingerprint recognizer includes, in front of the lower front edge of the right front side of the smartphone body side part (4400) A fingerprint recognition module 4310 is formed on the upper side of the authentication device unit 4100 and a fingerprint recognition module 4310 is formed on the upper side of the authentication device unit 4100, An image sensor 4510a and an infrared ray transmitting unit 4520a which allow the finger to be photographed toward the finger, and a recognition circuit field 4510a for controlling the infrared sensor 4510a, And an electronic settlement system having a plurality of safety lock functions for simultaneously scanning a face and a fingerprint in a wire / wireless network to process user authentication
A method of processing an electronic payment system using face and fingerprint recognition, the method comprising:
A face and fingerprint payment application is provided to the face and fingerprint payment service server of the electronic payment system, a customer client accesses the face and fingerprint payment service server through a communication network, and the face and fingerprint payment application is downloaded ;
Acquiring first face and fingerprint information of the customer through the first face and the fingerprint recognizer of the client client, activating the face and fingerprint payment app installed in the customer client, Providing to the face and fingerprint payment service server through a communication network;
The face and fingerprint settlement service server stores and registers first face and fingerprint information provided from the client client in a database and transmits first face and fingerprint information to the credit card company server through the communication network;
Matching the first face and fingerprint information transmitted from the face and fingerprint settlement service server to the payment means of the registered customer and registering the same;
The second face and the fingerprint information of the customer are recognized from the second face and the fingerprint recognizer of the merchant client connected to the communication network and the second face and the fingerprint information and the payment information corresponding to the occurrence of the transaction are transmitted to the face and the fingerprint Sending the payment request to the payment service server to request payment approval;
Comparing the second face and fingerprint information transmitted from the merchant client with the first face and fingerprint information registered in the database to determine the customer authentication;
If it is determined that the registered first face and fingerprint information matches the second face and fingerprint information, the face and fingerprint service server transmits the credit Requesting payment authorization to the card issuer server;
And notifying the merchant client and the face and fingerprint settlement service server that the payment has been approved, if payment is approved through the payment means of the client corresponding to the first face and fingerprint information requested by the credit card company server ,
The fingerprint recognizer is formed of an input / output integration module U1 for linking a fingerprint and a finger vein, and the integration module U1 comprises a fingerprint module U2, a finger vein module U3 and a conversion module U4 , The fingerprint module U2 scans the fingerprint image from the image sensor and compares the fingerprint image with a previously stored image so as to output the registered authentication code of the person in the first serial communication when there is a person with the same fingerprint image, The Mac module (U3) transmits the finger through the infrared LED, and the camera image sensor scans the finger vein and compares it with the pre-stored finger image. If there is a person with the same image, the registered authentication code of the person is transmitted to the second serial communication And the second serial communication output from the fingerprint module is received by the conversion module U4 and converted into a first serial communication such as the fingerprint module U2, A fingerprint authentication code output from the fingerprint module U2 and a fingerprint authentication code output from the fingerprint module U3 are received by the integration module U1 and a fingerprint and a fingerprint authentication code Or the fingerprint authentication code output from the fingerprint module U2 and the fingerprint authentication code output from the fingerprint module U3 are received from the integration module U1, And the fingerprint authentication system, and when the fingerprint authentication code matches the fingerprint authentication code, the corresponding authentication code can be outputted through the USB. How to process
12. The method of claim 11,
Providing the first and second fingerprint information obtained through the first fingerprint recognizer of the customer client and the second fingerprint recognizer of the merchant client to the face and fingerprint payment service server through the communication network,
Wherein the first fingerprint information and the second fingerprint information are provided to the fingerprint settlement service server when the temperature and flow of the finger of the customer are further detected and there is no abnormality. PROCESSING METHOD FOR ELECTRONIC BILLING SYSTEM WITH MULTIPLE SAFETY LOCKING PROCESSING FOR AUTHENTICATION

Images