CN113344586A - Face recognition payment system facing mobile terminal - Google Patents

Face recognition payment system facing mobile terminal Download PDF

Info

Publication number
CN113344586A
CN113344586A CN202110757320.1A CN202110757320A CN113344586A CN 113344586 A CN113344586 A CN 113344586A CN 202110757320 A CN202110757320 A CN 202110757320A CN 113344586 A CN113344586 A CN 113344586A
Authority
CN
China
Prior art keywords
target
image
face recognition
face
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110757320.1A
Other languages
Chinese (zh)
Other versions
CN113344586B (en
Inventor
陈立平
陈炳舟
孙万林
王丽莎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tarim University
Original Assignee
Tarim University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tarim University filed Critical Tarim University
Priority to CN202110757320.1A priority Critical patent/CN113344586B/en
Priority claimed from CN202110757320.1A external-priority patent/CN113344586B/en
Publication of CN113344586A publication Critical patent/CN113344586A/en
Application granted granted Critical
Publication of CN113344586B publication Critical patent/CN113344586B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/38Payment protocols; Details thereof
    • G06Q20/40Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401Transaction verification
    • G06Q20/4014Identity check for transactions
    • G06Q20/40145Biometric identity checks

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Computer Security & Cryptography (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)

Abstract

The invention discloses a face recognition payment system facing a mobile terminal, which comprises: the system comprises a mobile terminal, a face recognition server and a payment server. The mobile terminal is used for acquiring a target image; the face recognition server is used for extracting a target foreground image and a target background image in the target image and taking the target foreground image as a target face image of the user; the system is also used for verifying the identity of the user according to the target background image and the target face image; and the payment server is used for performing online payment operation after the face recognition server passes the identity authentication. When the identity authentication is carried out, the invention not only authenticates the face image of the user, but also authenticates the background image except the face image. Because the environment of the real user is relatively fixed during mobile payment, the background image can play an auxiliary role in identifying the authenticity of the user. The system provided by the invention can fundamentally and greatly improve the security of mobile payment.

Description

Face recognition payment system facing mobile terminal
Technical Field
The invention relates to the technical field of mobile payment, in particular to a face recognition payment system facing a mobile terminal.
Background
Mobile payment has become the most widely used payment method in the online payment field at present, even in all commodity transactions. When the user uses the mobile payment, the user only needs to install the mobile payment software on the mobile terminal, the information of a payee or a payer is obtained during payment, the information can be transmitted to the corresponding server through the wireless network, and the server can complete the payment after identity verification. The mobile payment has the advantages of convenience and safety, so that the mobile payment is welcomed by the users.
In various mobile payment methods, the identity of a user needs to be verified, and common verification methods include: fingerprint verification, password verification and face verification, wherein the face verification is the most convenient, and the user can quickly finish the acquisition of identity information without memorizing passwords or actively inputting any information. Therefore, mobile payment based on face recognition becomes the focus of research on various large mobile payment platforms.
In the process of face verification, the prior art has made many researches on security, such as encrypting data, adopting a more accurate face recognition algorithm, etc., and these research results greatly enhance the security and the rapidity of the user in the mobile payment process. However, most of the existing face recognition algorithms default that all users provide real information, and if a user has a face-forgery behavior, such as wearing a mask or a face mask with the appearance of the face of another user, the user can easily provide false information to the mobile terminal, but the information can pass identity verification, which brings about a challenge to security of mobile payment.
Disclosure of Invention
The embodiment of the invention provides a face recognition payment system facing a mobile terminal, which is used for solving the problem that in the prior art, a payment system is deceived by face information forged by a user.
In one aspect, an embodiment of the present invention provides a face recognition payment system for a mobile terminal, including: the system comprises a mobile terminal, a face recognition server and a payment server;
the mobile terminal is used for acquiring a target image;
the face recognition server is used for extracting a target foreground image and a target background image in the target image and taking the target foreground image as a target face image of the user; the system is also used for verifying the identity of the user according to the target background image and the target face image;
and the payment server is used for performing online payment operation after the face recognition server passes the identity authentication.
In one possible implementation manner, the verifying the identity of the user by the face recognition server according to the target background image and the target face image may include: extracting target information in the target background image, comparing the target information with the stored target information, and if the background meets the condition, passing the background verification; extracting feature information in the target face image, comparing the feature information with stored feature information, and if the condition that the face meets the condition is met, the face verification is passed; and when the background verification and the face verification are both passed, the identity verification of the user is passed.
In one possible implementation, the background meeting condition may include: the extracted target information has a certain number of identical features with the stored target information.
In one possible implementation, when the extracted target information and the stored target information have a certain number of same features, the face recognition server determines that the extracted target information and the stored target information are the same target; the background may also include: the extracted object information and the stored object information have a certain number of identical objects.
In a possible implementation manner, after the user passes the authentication, the face recognition server further extracts the target information in the target background image, compares the target information with the stored target information, screens out the target information in the target background image, which is different from the stored target information, and stores the target information.
In one possible implementation manner, the method may further include: registering a server; the registration server is used for acquiring a registration image transmitted by the mobile terminal, extracting a registration background image and a registration foreground image in the registration image, taking the registration foreground image as a registration face image of the user, and extracting feature information in the registration face image; the registration server is also used for extracting target information in the registration background image; after the characteristic information in the registered face image and the target information in the registered background image are obtained, the registration server sends the characteristic information to the face recognition server, and the face recognition server stores the characteristic information and the target information.
In one possible implementation manner, the registration server, the face recognition server and the payment server are all independent servers.
The face recognition payment system facing the mobile terminal has the following advantages:
in the authentication, not only the face image of the user is authenticated, but also the background image other than the face image is authenticated. Because the environment of the real user is relatively fixed during mobile payment, the background image can play an auxiliary role in identifying the authenticity of the user. The system provided by the invention can fundamentally and greatly improve the security of mobile payment.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a functional block diagram of a face recognition payment system for a mobile terminal according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a functional block diagram of a face recognition payment system for a mobile terminal according to an embodiment of the present invention. The embodiment of the invention provides a face recognition payment system facing a mobile terminal, which comprises: a mobile terminal 100, a face recognition server 300, and a payment server 400;
the mobile terminal 100 is used for acquiring a target image;
the face recognition server 300 is configured to extract a target foreground image and a target background image in a target image, and use the target foreground image as a target face image of a user; the system is also used for verifying the identity of the user according to the target background image and the target face image;
the payment server 400 is used for performing online payment after the face recognition server 300 passes the identity authentication.
The mobile terminal 100 is an electronic device having image capturing and wireless communication functions, and a mobile phone carried by a user may be used. After the mobile terminal 100 is installed with the mobile payment software, for example, software such as WeChat, Paibao, and Payment wing, an image acquisition unit, for example, a built-in camera, is called according to the operation of the user to acquire the target image. The target image is an image containing a face of a user, and the face recognition server 300 may extract a foreground portion and a background portion in the target image, i.e., the target foreground image and the target background image, through a specific algorithm. The target foreground image is usually a part required by subsequent data processing, namely an interested part, and in face recognition, the target foreground image is a face image, which is an image required to be acquired in all face recognition algorithms at present. The target background image contains complex information, if the user is at home, the target background image contains information of a background wall, furniture and the like behind the user, and if the user is outdoors, the target background image contains information of buildings, plants and the like around the user.
In embodiments of the present invention, the user is required to select the goods or services to be purchased before making an online payment, which takes a large portion of the time, and therefore the user is usually in a relatively stable environment before making the payment. The stable environment is mostly at home, and furniture, arrangement, etc. of the home are basically kept unchanged for a specific user, so that the target background image in the target image acquired by the mobile terminal 100 contains information of background walls, furniture, etc. which often appear. If the user who pays is a real user, the target background image in the target image obtained at a certain time is very likely to contain the frequently-occurring information, and if the account number of the user is stolen, the possibility that the information in the target background image is the same as the information in the home of the real user is very low, so that the payment safety is improved from the source of the information.
In one possible embodiment, the face recognition server 300 verifies the identity of the user according to the target background image and the target face image, including: extracting target information in the target background image, comparing the target information with the stored target information, and if the background meets the condition, passing the background verification; extracting feature information in the target face image, comparing the feature information with stored feature information, and if the condition that the face meets the condition is met, the face verification is passed; and when the background verification and the face verification are both passed, the identity verification of the user is passed.
Illustratively, the target information in the target background image may include any extractable information, such as the user's clothing, hair style, accessories, furniture, and the like. And the characteristic information in the target face image comprises the distance between the two eyes, the width of the mouth and the like.
In one possible embodiment, the context qualifying comprises: the extracted target information has a certain number of identical features with the stored target information.
Illustratively, taking the example that the target background image includes a sofa, the corresponding target information includes information such as the shape, color, pattern and size of the sofa, and if the set number is three, and the sofa in the target background image is found to be the same as the stored target information in terms of shape, color and size through comparison, the current verification of the background is considered to be passed. If the target background image is identical to the already stored target information only in shape and color, the background verification is considered to be not passed.
In one possible embodiment, when the extracted target information and the stored target information have a certain number of identical features, the face recognition server 300 determines that the extracted target information and the stored target information are identical targets; the background meeting the conditions further comprises: the extracted object information and the stored object information have a certain number of identical objects.
For example, since there is more than one target in the target background image, each extracted target information needs to be compared, and only when the number of the same targets reaches a set number, the user is considered to be in a common environment. For example, the target background image includes a sofa, a background wall painting, a dining table, a television and other targets, if the set number is three, and the sofa, the background wall painting and the dining table are all the same as the stored target information after comparison, the background verification is considered to be passed, and if the target background image is only on the sofa and the background wall painting and is the same as the stored target information, the background verification is considered to be not passed.
Of course, which objects are present in the object background image has a large relationship with the face orientation at the time of payment by the user. Therefore, when the background authentication fails due to the number of the same objects being not reached, the mobile terminal 100 may also prompt the user to rotate the direction or move the position, and acquire the object image again. If the background authentication still fails after the target image at the different position is processed for a plurality of times, the mobile terminal 100 may prompt the user that the authentication fails.
In a possible embodiment, after the user passes the authentication, the face recognition server 300 further extracts the target information in the target background image, compares the target information with the stored target information, and screens out and stores the target information in the target background image, which is different from the stored target information.
Illustratively, if the authentication is passed, the face recognition server 300 considers the user to be in a common environment. However, due to the limitation of the stored target information, the face recognition server 300 may not store all the target information in the common environment where the user is located, and after the user passes the authentication, the target background image inevitably contains some targets in the common environment of the user, so that a part of the target information that is not stored in the face recognition server 300 may be stored in the face recognition server 300 to expand the stored target information and improve the passing rate of the subsequent authentication.
In a possible embodiment, further comprising: a registration server 200; the registration server 200 is configured to obtain a registration image transmitted by the mobile terminal 100, extract a registration background image and a registration foreground image in the registration image, use the registration foreground image as a registration face image of a user, and extract feature information in the registration face image; the registration server 200 is further configured to extract target information in the registration background image; after obtaining the feature information in the registered face image and the target information in the registered background image, the registration server sends the feature information and the target information to the face recognition server 300, and the face recognition server 300 stores the feature information and the target information.
Illustratively, at the time of registration, the mobile terminal 100 needs to acquire a registration image, which is the same image as the target image described above and which contains the face of the user. The extraction of the registered background image, the registered face image, the target information and the feature information is the same as the method described above, and is not described herein again.
In the embodiment of the present invention, when acquiring the registration image, the mobile terminal 100 needs to remind the user of being in a common environment, and the acquired registration image may be multiple photos taken by the user in the common environment, or multiple photos captured from a video recorded by the user in the common environment.
In one possible embodiment, the registration server 200, the face recognition server 300 and the payment server 400 are all independent servers.
For example, the three servers may be three independent servers disposed in the same data center, or may be servers disposed in different data centers. The servers are connected through cables, so that a single server is only used for executing specific functions, and the data processing speed is improved. Moreover, for the network attacker, the number of servers to be invaded is increased, and the difficulty of data invasion is increased.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (7)

1. A face recognition payment system facing a mobile terminal is characterized by comprising: the system comprises a mobile terminal (100), a face recognition server (300) and a payment server (400);
the mobile terminal (100) is used for acquiring a target image;
the face recognition server (300) is used for extracting a target foreground image and a target background image in the target image, and taking the target foreground image as a target face image of a user; the system is also used for verifying the identity of the user according to the target background image and the target face image;
the payment server (400) is used for performing online payment operation after the face recognition server (300) passes identity authentication.
2. A face recognition payment system facing mobile terminal according to claim 1, wherein the face recognition server (300) verifies the identity of the user according to the target background image and the target face image, and comprises:
extracting target information in the target background image, comparing the target information with the stored target information, and if the background meets the condition, passing the background verification;
extracting feature information in the target face image, comparing the feature information with stored feature information, and if the condition that the face meets the condition is met, passing face verification;
and when the background verification and the face verification are both passed, the identity verification of the user is passed.
3. The face recognition payment system for mobile terminals as claimed in claim 2, wherein the background meeting the condition comprises: the extracted target information has a certain number of identical features with the stored target information.
4. A mobile terminal-oriented face recognition payment system as claimed in claim 3, wherein the face recognition server (300) determines that the extracted target information and the stored target information are the same target when the extracted target information and the stored target information have a certain number of the same features;
the background meeting the condition further comprises: the extracted target information and the stored target information have a certain number of identical targets.
5. The face recognition payment system for mobile terminals as claimed in claim 1, wherein after the user's identity is verified, the face recognition server (300) further extracts the target information in the target background image, compares the target information with the stored target information, and screens out and stores the target information that is different from the stored target information in the target background image.
6. The face recognition payment system for mobile terminals according to claim 1, further comprising: a registration server (200);
the registration server (200) is used for acquiring a registration image transmitted by the mobile terminal (100), extracting a registration background image and a registration foreground image in the registration image, taking the registration foreground image as a registration face image of a user, and extracting feature information in the registration face image;
the registration server (200) is also used for extracting target information in the registration background image;
after the feature information in the registered face image and the target information in the registered background image are obtained, the registration server sends the feature information to the face recognition server (300), and the face recognition server (300) stores the feature information and the target information.
7. A mobile terminal-oriented face recognition payment system as claimed in claim 6, wherein the registration server (200), the face recognition server (300) and the payment server (400) are all independent servers.
CN202110757320.1A 2021-07-05 Face identification payment system for mobile terminal Active CN113344586B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110757320.1A CN113344586B (en) 2021-07-05 Face identification payment system for mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110757320.1A CN113344586B (en) 2021-07-05 Face identification payment system for mobile terminal

Publications (2)

Publication Number Publication Date
CN113344586A true CN113344586A (en) 2021-09-03
CN113344586B CN113344586B (en) 2024-05-31

Family

ID=

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017102684A (en) * 2015-12-01 2017-06-08 庄司 渉 Applicant authentication device and authentication method, and security authentication system using the method
CN109325413A (en) * 2018-08-17 2019-02-12 深圳市中电数通智慧安全科技股份有限公司 A kind of face identification method, device and terminal
CN111861240A (en) * 2020-07-27 2020-10-30 深圳前海微众银行股份有限公司 Suspicious user identification method, device, equipment and readable storage medium
CN112232206A (en) * 2020-10-16 2021-01-15 陈晶晶 Face recognition method and face recognition platform based on big data and artificial intelligence
CN112613345A (en) * 2020-03-18 2021-04-06 支付宝实验室(新加坡)有限公司 User authentication method and system
WO2021090743A1 (en) * 2019-11-07 2021-05-14 日本電気株式会社 Authentication device, authentication system, authentication method, and recording medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017102684A (en) * 2015-12-01 2017-06-08 庄司 渉 Applicant authentication device and authentication method, and security authentication system using the method
CN109325413A (en) * 2018-08-17 2019-02-12 深圳市中电数通智慧安全科技股份有限公司 A kind of face identification method, device and terminal
WO2021090743A1 (en) * 2019-11-07 2021-05-14 日本電気株式会社 Authentication device, authentication system, authentication method, and recording medium
CN112613345A (en) * 2020-03-18 2021-04-06 支付宝实验室(新加坡)有限公司 User authentication method and system
CN111861240A (en) * 2020-07-27 2020-10-30 深圳前海微众银行股份有限公司 Suspicious user identification method, device, equipment and readable storage medium
CN112232206A (en) * 2020-10-16 2021-01-15 陈晶晶 Face recognition method and face recognition platform based on big data and artificial intelligence

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
孙霖;潘纲;: "人脸识别中视频回放假冒攻击的实时检测方法", 电路与系统学报, no. 02, 15 April 2010 (2010-04-15), pages 39 - 46 *

Similar Documents

Publication Publication Date Title
JP6487105B2 (en) System and method for authorizing access to an access controlled environment
KR101997371B1 (en) Identity authentication method and apparatus, terminal and server
US9652663B2 (en) Using facial data for device authentication or subject identification
Chen et al. Sensor-assisted facial recognition: an enhanced biometric authentication system for smartphones
AU2017201463B2 (en) Methods and systems for authenticating users
KR20160144419A (en) Method and system for verifying identities
CN105912912B (en) A kind of terminal user ID login method and system
US11521208B2 (en) System and method for authenticating transactions from a mobile device
EP3655874B1 (en) Method and electronic device for authenticating a user
CN111831995A (en) Trusted identity authentication method and system based on eID and human body biological information
JP7318833B2 (en) Image processing device, image processing method, and program
Soares et al. Fingerprint and iris biometric controlled smart banking machine embedded with GSM technology for OTP
KR101057720B1 (en) User Authentication System and Method
CN106161030B (en) Account registration verification request based on image identification and registration verification method and device
CN106650657A (en) Authentication method and device based on full face binary matching
CN106599841A (en) Full face matching-based identity verifying method and device
US20240028698A1 (en) System and method for perfecting and accelerating biometric identification via evolutionary biometrics via continual registration
CN113344586B (en) Face identification payment system for mobile terminal
CN113344586A (en) Face recognition payment system facing mobile terminal
WO2018179723A1 (en) Facial authentication processing apparatus, facial authentication processing method, and facial authentication processing system
KR20220038015A (en) How to verify biometrics using a mobile device
KR20190026582A (en) Method and apparatus for preventing other people from photographing identification
CN112115454B (en) Single sign-on method, first server and electronic equipment
CN109299945B (en) Identity verification method and device based on biological recognition algorithm
Albu et al. Authentication and recognition, guarantor for on-line security

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant