CN111967879A - Online safe payment management system based on face recognition - Google Patents

Online safe payment management system based on face recognition Download PDF

Info

Publication number
CN111967879A
CN111967879A CN202010930786.2A CN202010930786A CN111967879A CN 111967879 A CN111967879 A CN 111967879A CN 202010930786 A CN202010930786 A CN 202010930786A CN 111967879 A CN111967879 A CN 111967879A
Authority
CN
China
Prior art keywords
module
face
image
iris
payment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202010930786.2A
Other languages
Chinese (zh)
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Zhongshen Electronic Technology Co ltd
Original Assignee
Shenzhen Zhongshen Electronic Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Zhongshen Electronic Technology Co ltd filed Critical Shenzhen Zhongshen Electronic Technology Co ltd
Priority to CN202010930786.2A priority Critical patent/CN111967879A/en
Publication of CN111967879A publication Critical patent/CN111967879A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/38Payment protocols; Details thereof
    • G06Q20/40Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401Transaction verification
    • G06Q20/4014Identity check for transactions
    • G06Q20/40145Biometric identity checks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/38Payment protocols; Details thereof
    • G06Q20/382Payment protocols; Details thereof insuring higher security of transaction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/193Preprocessing; Feature extraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/197Matching; Classification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Accounting & Taxation (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Finance (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The invention discloses an online safe payment management system based on face recognition, which comprises a face image acquisition module, a face image processing module, an image feature extraction module, a face recognition module, a payment mode selection module, an iris image acquisition module, an iris image processing module, a cloud server, a purchase information statistic module, a time limit module, a mobile display terminal and a cloud database, wherein the face image acquisition module is used for acquiring a face image; the method analyzes whether a payment person is the user or not through face recognition, if the payment person is the user, the user selects a payment mode through an account number and completes iris authentication payment through iris recognition; if the payment is carried out by the non-self operation equipment, the detail information of the purchased articles of the non-self operation equipment is counted and sent to the account number reservation contact way in a short message mode, the account number self judges whether the payment is carried out or not by confirming the identity of the personnel, the remote face recognition payment is completed within the set time, and the safety of the face recognition payment mechanism is improved.

Description

Online safe payment management system based on face recognition
Technical Field
The invention relates to the field of online security payment management, in particular to an online security payment management system based on face recognition.
Background
Electronic commerce has evolved as an important part of the economy, where consumers can now purchase items online and deliver them without visiting a physical business. With the rapid development of information technology, online payment is more and more widely approaching the lives of people due to the advantages of convenience, easy operation, high efficiency and the like.
At present, the existing online payment mechanism still generally has some defects, the existing online payment mechanism occupies the mainstream of a face recognition payment mechanism, but face information with high similarity of a user can be recognized and passed in the face recognition process, the existing online payment mechanism has insecurity and reduces the matching rate and accuracy of face recognition, meanwhile, the existing online payment mechanism is used for payment by logging in through an account, whether a person using the account for payment is the account himself cannot be detected, the non-himself completes payment by carrying out virtual vivid face information through illegal means, economic property loss of the account himself is caused, meanwhile, the existing online purchasing mechanism cannot provide specific information of purchased articles and face images of operators, a lot of uncertainty exists, thus causing some unnecessary troubles and reducing the experience of the operators, in order to solve the problems, an online safety payment management system based on face recognition is designed.
Disclosure of Invention
The invention aims to provide an online safe payment management system based on face recognition, which comprehensively analyzes whether a person paying by an operation device is the person or not through a face image acquisition module, a face image processing module, an image feature extraction module and a face recognition module, if the person paying by the operation device is the person, the person selects a payment mode to carry out iris authentication payment through an account number, and the iris authentication payment is completed through iris image acquisition, processing and comparison; if the non-self operating device pays, the detail information of the purchased articles of the non-self operating device is counted, the detail information is sent to the account number in a short message mode to reserve a contact mode, the account number self judges whether the bill of the purchased articles is paid or not by confirming the identity of the personnel and the detail information of the purchased articles, remote face recognition payment is completed within a specified time, and the problems in the background technology are solved.
The purpose of the invention can be realized by the following technical scheme:
an online safety payment management system based on face recognition comprises a face image acquisition module, a face image processing module, an image feature extraction module, a face recognition module, a payment mode selection module, an iris image acquisition module, an iris image processing module, a cloud server, a purchase information statistics module, a time limit module, a mobile display terminal and a cloud database;
the cloud server is respectively connected with the iris image processing module, the purchase information statistical module, the time limit module, the mobile display module and the cloud database, the face image processing module is respectively connected with the face image acquisition module and the image feature extraction module, the face recognition module is respectively connected with the image feature extraction module, the payment mode selection module, the purchase information statistical module and the cloud database, and the iris image acquisition module is respectively connected with the payment mode selection module and the iris image processing module;
the human face image acquisition module comprises a high-definition camera and is used for acquiring human face images of personnel who purchase unpaid articles by operating equipment, the high-definition camera detects the human face according to a detection method that the human face has a certain structural distribution characteristic, dynamic target tracking is carried out on the detected human face, the human face image of a target is acquired, and the acquired human face image is sent to the human face image processing module;
the human face image processing module is used for receiving a human face acquisition image sent by the human face image acquisition module, carrying out image segmentation on the received human face image, splicing human face characteristic regions obtained by image segmentation, removing background images outside the regions, changing the reserved region images into images with consistent sizes and without deflection angles of human faces through geometric normalization processing, simultaneously carrying out gray level conversion processing and image enhancement processing, and sending the enhanced human face image to the image characteristic extraction module;
the image feature extraction module is used for receiving a face enhancement image sent by the face image processing module, extracting face features of the enhanced face image, extracting feature data of main organs of a face according to shape description of the face organs and distance characteristics among the organs, wherein feature components of the feature data generally comprise Euclidean distances, curvatures, angles and sizes among feature points, constructing a face three-dimensional model according to geometric description of structural relations among parts of the face organs, and sending the constructed face three-dimensional model to the face recognition module;
the face recognition module is used for receiving the face three-dimensional model sent by the image feature extraction module, extracting a face three-dimensional model reserved by a login account stored in a cloud database, comparing the received face three-dimensional model with the face three-dimensional model reserved by the login account, counting the similarity between the received face three-dimensional model and the face three-dimensional model reserved by the login account, and if the similarity between the face three-dimensional model and the face three-dimensional model reserved by the login account is greater than or equal to a set similarity threshold value, indicating that the payment is carried out by the user operating equipment, sending the payment account of the user to the payment mode selection module; if the similarity between the human face three-dimensional model and the human face three-dimensional model reserved by the device person is smaller than a set similarity threshold value, indicating that the device is not operated by the person to pay, and sending the human face three-dimensional model corresponding to the person not to the person to a purchase information statistical module;
the payment mode selection module is used for receiving the personal payment account sent by the face recognition module, extracting each payment mode bound in the account according to the received personal payment account, wherein each payment mode comprises WeChat, Paibao, a bank card, a credit card and the like;
the iris image acquisition module comprises an iris camera and is used for receiving the iris authentication requirement instruction sent by the payment mode selection module, carrying out human eye detection on personnel paying by operating equipment by controlling the iris camera, carrying out dynamic target tracking on detected human eyes, acquiring a human eye iris image of a target and sending the acquired human eye iris image to the iris image processing module;
the iris image processing module is used for receiving the human eye iris image sent by the iris image acquisition module, carrying out iris positioning on the received human eye iris image, determining the positions of an inner circle, an outer circle and a secondary curve in the image, adjusting the size of the iris in the image to a fixed size set by an identification system, carrying out image enhancement processing, extracting iris texture features of the enhanced human eye iris image by adopting a specific algorithm, and sending the extracted human eye iris texture features to the cloud server;
the cloud server is used for receiving iris texture features sent by the iris image processing module, extracting iris texture features reserved for a login account number stored in a cloud database, comparing the received iris features of the human eye with the iris texture features reserved for the login account number, if the received iris features of the human eye are not completely matched with the iris texture features reserved for the login account number, the purchase and payment are failed, the iris image of the human eye of the user needs to be collected again, when the failure times reach a set failure threshold value, the account number of the user is automatically locked, and login transaction cannot be continued in a short time; if the received iris characteristics of the human eyes are completely matched with the iris texture characteristics reserved by the login account, the purchase payment is successful;
the purchasing information counting module is used for receiving the human face three-dimensional model corresponding to the non-self and sent by the human face recognition module, acquiring specific information of non-self operation equipment for purchasing unpaid goods through a shopping platform, counting detail information of the non-self operation equipment for purchasing goods, and sending the counted detail information of the goods purchased by the non-self operation equipment to the cloud server;
the cloud server is used for receiving the detail information of the articles purchased by the non-self operating equipment, which is sent by the purchase information counting module, extracting the contact way reserved by the login account number stored in the cloud database, and sending the detail information of the articles purchased by the non-self operating equipment to the mobile display terminal in a short message way; meanwhile, the time for sending the short message is recorded, and the recorded time for sending the short message is sent to a time limit module;
the time-limited module is used for receiving the recorded short message sending time sent by the cloud server, creating a fixed-time-efficiency purchased article payment link according to the short message sending time, and sending the fixed-time-efficiency purchased article payment link to the mobile display terminal;
the mobile display terminal is used for receiving item detail information of non-self operation equipment purchase sent by the cloud server, receiving a fixed-time-efficiency purchased item payment link sent by the time-limited module, the account self confirms the personnel identity and the purchased item detail information of the operation equipment purchased items through display, judging whether to pay a bill of the purchased items according to the confirmed personnel identity and the purchased item detail information, if the account self confirms to pay the bill of the purchased items, performing remote face recognition payment through the received fixed-time-efficiency purchased item payment link, if the account self does not pay the bill of the purchased items within a specified time, automatically losing the received fixed-time-efficiency purchased item payment link, retrying the personnel who need to operate the operation equipment to purchase the items again, and automatically locking the account which is not self to log in when the number of retrying times reaches a set retrying threshold value, the transaction can not be continued in a short time;
the cloud database is used for storing a face three-dimensional model and iris texture characteristics reserved by the login account, and storing a contact mode reserved by the login account;
further, the human face image enhancement processing is image gray scale stretching processing, namely, the formula adopted by the image enhancement processing is
Figure BDA0002670134180000051
x' is expressed as the pixel value of the corresponding pixel point after image enhancement processing, x is expressed as the pixel value before image enhancement processing, jmaxExpressed as the largest pixel value, j, in the normalized rectangular regionminExpressed as the smallest pixel value in the rectangular area after normalization processing;
further, the extraction of the iris texture features is a two-dimensional Gabor feature extraction algorithm, and the method comprises the following steps of:
s1, dividing the enhanced iris image I (x, y) of the human eye into 3 x 3 image blocks;
s2, establishing a Gabor filter bank: 4 scales and 6 directions are selected, so that 24 Gabor filters are formed;
s3, performing spatial convolution on the Gabor filter bank and each image block, wherein each image block can obtain 24 filter outputs which are images with the sizes of the image blocks;
s4, each image block is output by 24 Gabor filter banks, and a column vector with a 24 x 1 gray average value is extracted as the texture feature of the image block;
further, the detail information of the articles purchased by the non-self operating device comprises article names, article pictures, article numbers, article money amounts, purchasing time, article distribution address information, merchant information and a non-self corresponding human face three-dimensional model.
Has the advantages that:
(1) the invention provides an on-line safe payment management system based on face recognition, which comprehensively analyzes whether a person paying by an operation device is the person or not through a face image acquisition module, a face image processing module, an image characteristic extraction module and a face recognition module, avoids the problem that the person who is not the person finishes payment by carrying out virtual vivid face information through illegal means, reduces the economic property loss of the account person, simultaneously selects a payment mode to carry out iris authentication payment through the account person if the person operates the device to pay, finishes the iris authentication payment through iris image acquisition, processing and comparison, effectively avoids the unsafe problem caused by overhigh similarity of the face, improves the matching rate and the accuracy of face recognition, counts the detail information of the purchased articles of the device which is not the person operates if the person operates the device to pay, and the short message is sent to the account number to reserve the contact way, so that unnecessary troubles are avoided, and the experience of operators is improved.
(2) The invention displays the personnel identity of the purchased article and the detail information of the purchased article by the operating equipment through the mobile display terminal, and is convenient for the account to visually know the specific information of the purchased article and the identity of the operating personnel, thereby reducing the unknown uncertainty, completing the remote face recognition payment within the specified time and improving the safety of the face recognition payment mechanism.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic view of the present invention;
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, an online secure payment management system based on face recognition includes a face image acquisition module, a face image processing module, an image feature extraction module, a face recognition module, a payment mode selection module, an iris image acquisition module, an iris image processing module, a cloud server, a purchase information statistics module, a time limit module, a mobile display terminal and a cloud database;
the cloud server is respectively connected with the iris image processing module, the purchase information statistical module, the time limit module, the mobile display module and the cloud database, the face image processing module is respectively connected with the face image acquisition module and the image feature extraction module, the face recognition module is respectively connected with the image feature extraction module, the payment mode selection module, the purchase information statistical module and the cloud database, and the iris image acquisition module is respectively connected with the payment mode selection module and the iris image processing module;
the human face image acquisition module comprises a high-definition camera and is used for acquiring human face images of personnel who purchase unpaid articles by operating equipment, the high-definition camera detects the human face according to a detection method that the human face has a certain structural distribution characteristic, dynamic target tracking is carried out on the detected human face, the human face image of a target is acquired, and the acquired human face image is sent to the human face image processing module;
the face image processing module is used for receiving a face acquisition image sent by the face image acquisition module, carrying out image segmentation on the received face image, splicing face characteristic regions obtained by image segmentation, removing background images outside the regions, changing the reserved region images into images with consistent size and no deflection angle of the face through geometric normalization processing, and simultaneously carrying out gray level conversion processing and image enhancement processing, wherein the face image enhancement processing is image gray level stretching processing, namely the image enhancement processing adopts the formula of
Figure BDA0002670134180000081
x' is expressed as the pixel value of the corresponding pixel point after image enhancement processing, x is expressed as the pixel value before image enhancement processing, jmaxExpressed as the largest pixel value, j, in the normalized rectangular regionminAnd the image is expressed as the minimum pixel value in the rectangular area after normalization processing, and the enhanced face image is sent to the image feature extraction module.
The image feature extraction module is used for receiving a face enhancement image sent by the face image processing module, extracting face features of the enhanced face image, extracting feature data of main organs of a face according to shape description of the face organs and distance characteristics among the organs, wherein feature components of the feature data generally comprise Euclidean distances, curvatures, angles and sizes among feature points, constructing a face three-dimensional model according to geometric description of structural relations among parts of the face organs, and sending the constructed face three-dimensional model to the face recognition module;
the face recognition module is used for receiving the face three-dimensional model sent by the image feature extraction module, extracting a face three-dimensional model reserved by a login account stored in a cloud database, comparing the received face three-dimensional model with the face three-dimensional model reserved by the login account, counting the similarity between the received face three-dimensional model and the face three-dimensional model reserved by the login account, and if the similarity between the face three-dimensional model and the face three-dimensional model reserved by the login account is greater than or equal to a set similarity threshold value, indicating that the payment is carried out by the user operating equipment, sending the payment account of the user to the payment mode selection module; if the similarity between the human face three-dimensional model and the human face three-dimensional model reserved by the device owner is smaller than a set similarity threshold value, the payment of the device is represented by operating the device by a non-owner, and the human face three-dimensional model corresponding to the non-owner is sent to the purchasing information statistical module, so that the problem that the non-owner completes the payment by carrying out virtual vivid facial information by illegal means is solved, and the economic property loss of the account owner is reduced;
the payment mode selection module is used for receiving the personal payment account sent by the face recognition module, extracting each payment mode bound in the account according to the received personal payment account, wherein each payment mode comprises WeChat, Paibao, a bank card, a credit card and the like;
the iris image acquisition module comprises an iris camera and is used for receiving the iris authentication requirement instruction sent by the payment mode selection module, carrying out human eye detection on personnel paying by operating equipment by controlling the iris camera, carrying out dynamic target tracking on detected human eyes, acquiring a human eye iris image of a target and sending the acquired human eye iris image to the iris image processing module;
the iris image processing module is used for receiving a human eye iris image sent by the iris image acquisition module, carrying out iris positioning on the received human eye iris image, determining the positions of an inner circle, an outer circle and a secondary curve in the image, adjusting the size of an iris in the image to a fixed size set by an identification system, carrying out image enhancement processing, and carrying out iris texture feature extraction on the enhanced human eye iris image by adopting a specific algorithm, wherein the iris texture feature extraction is a two-dimensional Gabor feature extraction algorithm, and the iris image processing module comprises the following steps:
s1, dividing the enhanced iris image I (x, y) of the human eye into 3 x 3 image blocks;
s2, establishing a Gabor filter bank: 4 scales and 6 directions are selected, so that 24 Gabor filters are formed;
s3, performing spatial convolution on the Gabor filter bank and each image block, wherein each image block can obtain 24 filter outputs which are images with the sizes of the image blocks;
s4, outputting each image block through 24 Gabor filter banks, extracting a column vector with a 24 x 1 gray average value as the texture feature of the image block, and sending the extracted iris texture feature of the human eye to a cloud server;
the cloud server is used for receiving iris texture features sent by the iris image processing module, extracting iris texture features reserved by a login account number stored in a cloud database, comparing the received iris features of the human eye with the iris texture features reserved by the login account number, if the received iris features of the human eye are not completely matched with the iris texture features reserved by the login account number, the purchase payment fails, the iris image of the human eye of the user needs to be collected again, when the failure times reach a set failure threshold value, the account number of the user is automatically locked, the login transaction cannot be continued in a short time, and the safety of a face recognition payment mechanism is improved; if the received iris features of the human eyes are completely matched with the iris texture features reserved for the login account, the purchase payment is successful, the unsafe problem caused by the fact that the similarity of the human faces is too high is effectively avoided, and the matching rate and the accuracy of the human face recognition are improved.
The purchasing information counting module is used for receiving the non-self corresponding human face three-dimensional model sent by the human face recognition module, acquiring specific information of non-self operating equipment for purchasing unpaid goods through a shopping platform, counting detail information of the non-self operating equipment for purchasing goods, and sending the counted detail information of the goods purchased by the non-self operating equipment to the cloud server, wherein the detail information comprises goods names, goods pictures, goods number, goods amount, purchasing time, goods distribution address information, merchant information and the non-self corresponding human face three-dimensional model;
the cloud server is used for receiving the item detail information purchased by the non-self-operation equipment and sent by the purchase information statistical module, extracting the contact mode reserved by the login account stored in the cloud database, and sending the item detail information purchased by the non-self-operation equipment to the mobile display terminal in a short message mode, so that unnecessary troubles are avoided, and the experience of operators is improved; meanwhile, the time for sending the short message is recorded, and the recorded time for sending the short message is sent to a time limit module;
the time-limited module is used for receiving the recorded short message sending time sent by the cloud server, creating a fixed-time-efficiency purchased article payment link according to the short message sending time, and sending the fixed-time-efficiency purchased article payment link to the mobile display terminal;
the mobile display terminal is used for receiving detail information of articles purchased by non-self operating equipment sent by the cloud server, and simultaneously receiving a fixed-time-efficiency purchased article payment link sent by the time-limited module, the account self determines the personnel identity of the operating equipment for purchasing the articles and the detail information of the purchased articles through display, so that the account self can conveniently and visually know the specific information of the purchased articles and the identity of the operating personnel, the unknown uncertainty is reduced, whether the bill of the purchased articles is paid or not is judged according to the determined personnel identity and the detail information of the purchased articles, if the account self determines to pay the bill of the purchased articles, the remote face recognition payment is carried out through the received fixed-time-efficiency purchased article payment link, and if the account self does not pay the bill of the purchased articles in the specified time, the received fixed-time-efficiency purchased article payment link is automatically disabled, and the person who needs to operate the equipment to purchase the article retries again, and when the retry times reach the set retry threshold, the account number which is not logged in by the person is automatically locked, the transaction cannot be continued in a short time, and the safety of the face recognition payment mechanism is improved.
The cloud database is used for storing a face three-dimensional model and iris texture characteristics reserved by the login account, and storing a contact mode reserved by the login account.
The foregoing is merely exemplary and illustrative of the principles of the present invention and various modifications, additions and substitutions of the specific embodiments described herein may be made by those skilled in the art without departing from the principles of the present invention or exceeding the scope of the claims set forth herein.

Claims (4)

1. The utility model provides an online safety payment management system based on face identification which characterized in that: the system comprises a face image acquisition module, a face image processing module, an image feature extraction module, a face recognition module, a payment mode selection module, an iris image acquisition module, an iris image processing module, a cloud server, a purchase information statistics module, a time limit module, a mobile display terminal and a cloud database;
the cloud server is respectively connected with the iris image processing module, the purchase information statistical module, the time limit module, the mobile display module and the cloud database, the face image processing module is respectively connected with the face image acquisition module and the image feature extraction module, the face recognition module is respectively connected with the image feature extraction module, the payment mode selection module, the purchase information statistical module and the cloud database, and the iris image acquisition module is respectively connected with the payment mode selection module and the iris image processing module;
the human face image acquisition module comprises a high-definition camera and is used for acquiring human face images of personnel who purchase unpaid articles by operating equipment, the high-definition camera detects the human face according to a detection method that the human face has a certain structural distribution characteristic, dynamic target tracking is carried out on the detected human face, the human face image of a target is acquired, and the acquired human face image is sent to the human face image processing module;
the human face image processing module is used for receiving a human face acquisition image sent by the human face image acquisition module, carrying out image segmentation on the received human face image, splicing human face characteristic regions obtained by image segmentation, removing background images outside the regions, changing the reserved region images into images with consistent sizes and without deflection angles of human faces through geometric normalization processing, simultaneously carrying out gray level conversion processing and image enhancement processing, and sending the enhanced human face image to the image characteristic extraction module;
the image feature extraction module is used for receiving a face enhancement image sent by the face image processing module, extracting face features of the enhanced face image, extracting feature data of main organs of a face according to shape description of the face organs and distance characteristics among the organs, wherein feature components of the feature data generally comprise Euclidean distances, curvatures, angles and sizes among feature points, constructing a face three-dimensional model according to geometric description of structural relations among parts of the face organs, and sending the constructed face three-dimensional model to the face recognition module;
the face recognition module is used for receiving the face three-dimensional model sent by the image feature extraction module, extracting a face three-dimensional model reserved by a login account stored in a cloud database, comparing the received face three-dimensional model with the face three-dimensional model reserved by the login account, counting the similarity between the received face three-dimensional model and the face three-dimensional model reserved by the login account, and if the similarity between the face three-dimensional model and the face three-dimensional model reserved by the login account is greater than or equal to a set similarity threshold value, indicating that the payment is carried out by the user operating equipment, sending the payment account of the user to the payment mode selection module; if the similarity between the human face three-dimensional model and the human face three-dimensional model reserved by the device person is smaller than a set similarity threshold value, indicating that the device is not operated by the person to pay, and sending the human face three-dimensional model corresponding to the person not to the person to a purchase information statistical module;
the payment mode selection module is used for receiving the personal payment account sent by the face recognition module, extracting each payment mode bound in the account according to the received personal payment account, wherein each payment mode comprises WeChat, Paibao, a bank card, a credit card and the like;
the iris image acquisition module comprises an iris camera and is used for receiving the iris authentication requirement instruction sent by the payment mode selection module, carrying out human eye detection on personnel paying by operating equipment by controlling the iris camera, carrying out dynamic target tracking on detected human eyes, acquiring a human eye iris image of a target and sending the acquired human eye iris image to the iris image processing module;
the iris image processing module is used for receiving the human eye iris image sent by the iris image acquisition module, carrying out iris positioning on the received human eye iris image, determining the positions of an inner circle, an outer circle and a secondary curve in the image, adjusting the size of the iris in the image to a fixed size set by an identification system, carrying out image enhancement processing, extracting iris texture features of the enhanced human eye iris image by adopting a specific algorithm, and sending the extracted human eye iris texture features to the cloud server;
the cloud server is used for receiving iris texture features sent by the iris image processing module, extracting iris texture features reserved for a login account number stored in a cloud database, comparing the received iris features of the human eye with the iris texture features reserved for the login account number, if the received iris features of the human eye are not completely matched with the iris texture features reserved for the login account number, the purchase and payment are failed, the iris image of the human eye of the user needs to be collected again, when the failure times reach a set failure threshold value, the account number of the user is automatically locked, and login transaction cannot be continued in a short time; if the received iris characteristics of the human eyes are completely matched with the iris texture characteristics reserved by the login account, the purchase payment is successful;
the purchasing information counting module is used for receiving the human face three-dimensional model corresponding to the non-self and sent by the human face recognition module, acquiring specific information of non-self operation equipment for purchasing unpaid goods through a shopping platform, counting detail information of the non-self operation equipment for purchasing goods, and sending the counted detail information of the goods purchased by the non-self operation equipment to the cloud server;
the cloud server is used for receiving the detail information of the articles purchased by the non-self operating equipment, which is sent by the purchase information counting module, extracting the contact way reserved by the login account number stored in the cloud database, and sending the detail information of the articles purchased by the non-self operating equipment to the mobile display terminal in a short message way; meanwhile, the time for sending the short message is recorded, and the recorded time for sending the short message is sent to a time limit module;
the time-limited module is used for receiving the recorded short message sending time sent by the cloud server, creating a fixed-time-efficiency purchased article payment link according to the short message sending time, and sending the fixed-time-efficiency purchased article payment link to the mobile display terminal;
the mobile display terminal is used for receiving item detail information of non-self operation equipment purchase sent by the cloud server, receiving a fixed-time-efficiency purchased item payment link sent by the time-limited module, the account self confirms the personnel identity and the purchased item detail information of the operation equipment purchased items through display, judging whether to pay a bill of the purchased items according to the confirmed personnel identity and the purchased item detail information, if the account self confirms to pay the bill of the purchased items, performing remote face recognition payment through the received fixed-time-efficiency purchased item payment link, if the account self does not pay the bill of the purchased items within a specified time, automatically losing the received fixed-time-efficiency purchased item payment link, retrying the personnel who need to operate the operation equipment to purchase the items again, and automatically locking the account which is not self to log in when the number of retrying times reaches a set retrying threshold value, the transaction can not be continued in a short time;
the cloud database is used for storing a face three-dimensional model and iris texture characteristics reserved by the login account, and storing a contact mode reserved by the login account.
2. The online secure payment management system based on face recognition as claimed in claim 1, wherein: the human face image enhancement processing is image gray level stretching processing, namely, the formula adopted by the image enhancement processing is
Figure FDA0002670134170000041
x' is expressed as the pixel value of the corresponding pixel point after image enhancement processing, x is expressed as the pixel value before image enhancement processing, jmaxExpressed as the largest pixel value, j, in the normalized rectangular regionminExpressed as the smallest pixel value within the normalized rectangular area.
3. The online secure payment management system based on face recognition as claimed in claim 1, wherein: the extraction of the iris texture features is a two-dimensional Gabor feature extraction algorithm, and comprises the following steps:
s1, dividing the enhanced iris image I (x, y) of the human eye into 3 x 3 image blocks;
s2, establishing a Gabor filter bank: 4 scales and 6 directions are selected, so that 24 Gabor filters are formed;
s3, performing spatial convolution on the Gabor filter bank and each image block, wherein each image block can obtain 24 filter outputs which are images with the sizes of the image blocks;
and S4, outputting each image block by 24 Gabor filter banks, and extracting a column vector with a 24 multiplied by 1 gray average value as the texture feature of the image block.
4. The online secure payment management system based on face recognition as claimed in claim 1, wherein: the detail information of the articles purchased by the non-self operation equipment comprises article names, article pictures, article numbers, article money, purchase time, article distribution address information, merchant information and non-self corresponding human face three-dimensional models.
CN202010930786.2A 2020-09-07 2020-09-07 Online safe payment management system based on face recognition Withdrawn CN111967879A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010930786.2A CN111967879A (en) 2020-09-07 2020-09-07 Online safe payment management system based on face recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010930786.2A CN111967879A (en) 2020-09-07 2020-09-07 Online safe payment management system based on face recognition

Publications (1)

Publication Number Publication Date
CN111967879A true CN111967879A (en) 2020-11-20

Family

ID=73392483

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010930786.2A Withdrawn CN111967879A (en) 2020-09-07 2020-09-07 Online safe payment management system based on face recognition

Country Status (1)

Country Link
CN (1) CN111967879A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113468961A (en) * 2021-05-28 2021-10-01 郑州轻工业大学 Image information processing method and system for specific object
CN115131848A (en) * 2022-04-01 2022-09-30 深圳市丹德瑞电气有限公司 Staff information multidimensional standardized intelligent acquisition system

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150227937A1 (en) * 2014-02-10 2015-08-13 Mastercard International Incorporated Random biometric authentication method and apparatus
CN105046130A (en) * 2015-07-10 2015-11-11 韩文兵 Payment system based on face identification, fingerprint identification and iris identification
CN106845951A (en) * 2017-01-05 2017-06-13 福建天晴数码有限公司 One kind pays out method and system
CN106971303A (en) * 2017-02-21 2017-07-21 王宁 A kind of iris payment system
CN107122977A (en) * 2017-04-26 2017-09-01 陈志阳 A kind of payment system based on bio-identification
CN108615001A (en) * 2018-04-19 2018-10-02 湖南德熠智能科技有限公司 Applied to the face identification method on mobile terminal
US20190050865A1 (en) * 2013-06-17 2019-02-14 Visa International Service Association Biometrics transaction processing
CN109409895A (en) * 2018-09-29 2019-03-01 深圳先牛信息技术有限公司 A kind of payment mechanism and method of payment merging iris recognition and recognition of face
CN109948399A (en) * 2017-12-20 2019-06-28 宁波盈芯信息科技有限公司 A kind of the face method of payment and device of smart phone
CN110443619A (en) * 2019-08-05 2019-11-12 中国工商银行股份有限公司 Method of payment and device by bus based on iris recognition and face recognition

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190050865A1 (en) * 2013-06-17 2019-02-14 Visa International Service Association Biometrics transaction processing
US20150227937A1 (en) * 2014-02-10 2015-08-13 Mastercard International Incorporated Random biometric authentication method and apparatus
CN105046130A (en) * 2015-07-10 2015-11-11 韩文兵 Payment system based on face identification, fingerprint identification and iris identification
CN106845951A (en) * 2017-01-05 2017-06-13 福建天晴数码有限公司 One kind pays out method and system
CN106971303A (en) * 2017-02-21 2017-07-21 王宁 A kind of iris payment system
CN107122977A (en) * 2017-04-26 2017-09-01 陈志阳 A kind of payment system based on bio-identification
CN109948399A (en) * 2017-12-20 2019-06-28 宁波盈芯信息科技有限公司 A kind of the face method of payment and device of smart phone
CN108615001A (en) * 2018-04-19 2018-10-02 湖南德熠智能科技有限公司 Applied to the face identification method on mobile terminal
CN109409895A (en) * 2018-09-29 2019-03-01 深圳先牛信息技术有限公司 A kind of payment mechanism and method of payment merging iris recognition and recognition of face
CN110443619A (en) * 2019-08-05 2019-11-12 中国工商银行股份有限公司 Method of payment and device by bus based on iris recognition and face recognition

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
朱道明: "《建筑安防技术》", 31 January 2013, 东华大学出版社 *
王延江: "《数字图像处理》", 30 November 2016, 石油大学出版社 *
申时凯: "《物联网的技术开发与应用研究》", 31 October 2017, 东北师范大学出版社 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113468961A (en) * 2021-05-28 2021-10-01 郑州轻工业大学 Image information processing method and system for specific object
CN115131848A (en) * 2022-04-01 2022-09-30 深圳市丹德瑞电气有限公司 Staff information multidimensional standardized intelligent acquisition system

Similar Documents

Publication Publication Date Title
US11651337B2 (en) System and process for automatically analyzing currency objects
CN109886697B (en) Operation determination method and device based on expression group and electronic equipment
CN108985134B (en) Face living body detection and face brushing transaction method and system based on binocular camera
CN105069622A (en) Face identification payment system facing mobile terminal and face identification payment method facing mobile terminal
US20230044612A1 (en) Transaction Terminal Fraud Processing
US20170352037A1 (en) Identification and Payment Method Using Biometric Characteristics
CN111967879A (en) Online safe payment management system based on face recognition
CN109690542A (en) Use the user authen method and apparatus for the method for face recognition
CN107330699A (en) Mobile terminal payment system based on image processing algorithm
EP3594879A1 (en) System and method for authenticating transactions from a mobile device
CN105844460A (en) Composition of mobile phone face-scanning payment system
CN113177480A (en) Financial business processing method, device, equipment and medium based on face recognition
CN109523271A (en) Face payment system and method
CN211699105U (en) Face identification authentication mobile payment device
US20220277311A1 (en) A transaction processing system and a transaction method based on facial recognition
CN105844461A (en) Method of generating mobile phone face-scanning payment code
CN113066237B (en) Face living body detection and identification method for automatic teller machine and automatic teller machine
Dutta et al. ATM card security using bio-metric and message authentication technology
CN114783027A (en) Face recognition method based on anti-counterfeiting authentication scene before consumer consumption
CN110415113A (en) Finance data processing method, device, server and readable storage medium storing program for executing
CN105678534A (en) Unionpay transaction system and device based on palm vein identification authentication
JP7495973B2 (en) Secure payment method and system
CN106067116A (en) The data transmission method of a kind of as seen and system
CN112069915B (en) ATM with face recognition system
WO2020232889A1 (en) Check encashment method, apparatus and device, and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20201120

WW01 Invention patent application withdrawn after publication