CN110826442B

CN110826442B - Bill data processing method, system, equipment and medium based on in-vivo detection

Info

Publication number: CN110826442B
Application number: CN201911031465.2A
Authority: CN
Inventors: 姚志强; 周曦; 杨雨轩; 万珺; 游宇; 陈江豪; 唐梓烈; 李源; 张阳; 马楷; 胡逸凡; 贾伟森; 田豪杰; 黄铃
Original assignee: Guangzhou Yuncongkaifeng Technology Co Ltd
Current assignee: Guangzhou Yuncongkaifeng Technology Co Ltd
Priority date: 2019-10-28
Filing date: 2019-10-28
Publication date: 2020-10-27
Anticipated expiration: 2039-10-28
Also published as: CN110826442A

Abstract

The invention provides a bill data processing method, a bill data processing system, bill data processing equipment and a bill data processing medium based on in-vivo detection, wherein the bill data processing system comprises the following components: identifying the bill to be identified, and after acquiring the bill bearing information, carrying out biological feature identification authentication on the bill holder; after the biological characteristic identification authentication is passed, acquiring payment information corresponding to a bill to be identified, and determining user identification information corresponding to the payment information; if the user identification information is matched with the biological characteristics of the bill holder, performing living body detection on the bill holder to obtain a living body detection result; and determining bill associated characteristic information, and determining a corresponding bill processing strategy according to the living body detection result and the bill associated characteristic information. The bill processing automation is realized, the manual participation is not needed, and the manpower is saved; in the bill processing process, the security of the bill processing process is realized by means of matching the user identification information corresponding to the payment information with the biological characteristics of a bill holder and detecting the living body.

Description

Bill data processing method, system, equipment and medium based on in-vivo detection

Technical Field

The invention relates to a data processing technology, in particular to a bill data processing method, a bill data processing system, bill data processing equipment and bill data processing media based on in-vivo detection.

Background

Tickets, also known as purchase receipts, are held by consumers by stores or other commercial establishments while they are shopping. The shopping mall can redeem the bill credit for the consumer according to the bill, and the consumer can redeem the gift by using the bill credit, so that the purposes of activating the consumer, increasing the viscosity of the consumer and publicizing the brand of the shopping mall are achieved. Currently, the bill credit exchange is completed in a manual operation mode, but it is inconvenient to match the authenticity of the monitored user and the real user with the credit, for example, in an unmanned vending scene, the user can bypass biological identification in the form of a mask or a printed image, so that situations of imposition or human tampering can occur, situations of multiple purposes of the credit account, mismatch between the credit account and a payer and the like occur.

Disclosure of Invention

In view of the above-mentioned drawbacks of the prior art, it is an object of the present invention to provide a bill data processing method, system, device and medium based on liveness detection for solving the problem of inconvenient bill integration.

To achieve the above and other related objects, the present invention provides a bill data processing method based on liveness detection, comprising: identifying the bill to be identified, and after acquiring the bill bearing information, carrying out biological feature identification authentication on the bill holder; wherein the biometric identification comprises at least one of: face identification, fingerprint identification, pupil identification, palm print identification and finger vein identification; after the biological characteristic identification authentication is passed, acquiring payment information corresponding to a bill to be identified, and determining user identification information corresponding to the payment information; if the user identification information is matched with the biological characteristics of the bill holder, performing living body detection on the bill holder to obtain a living body detection result; and determining bill associated characteristic information, and determining a corresponding bill processing strategy according to the living body detection result and the bill associated characteristic information.

Optionally, the ticket association characteristic information includes at least one of: bill holder information corresponding to the bill, bill redemption information associated with the bill holder, bill confidence, number of bill identifications.

Optionally, determining the information of the bill holder according to the biological characteristics of the bill holder; and determining the bill association characteristic information according to the bill holder information and the bill bearing information.

Optionally, the ticket carrying information includes at least one of: bill ID, bill amount, bill printing time, bill printing place, and merchandise recorded on the bill.

Optionally, the ticket holder information includes a ticket holder ID.

Optionally, the ticket redemption information associated with the ticket holder includes at least one of:

the bill amount corresponding to the same bill holder ID; the number of times of bill refund integration of the same bill holder ID within a preset time; the same ticket holder ID redeems the total amount of the points for the ticket within a preset time.

Optionally, the low confidence of the bill includes the following situations: the ticket has null value and the ticket is changed.

Optionally, identifying the bill to be identified through a bill identification application program; wherein the bill identification application is: the device comprises a merchant APP, wherein a bill identification function module is arranged in the merchant APP.

Optionally, identifying the bill to be identified through a bill identification application program; wherein the ticket identifies an application

The sequence is as follows: and the WeChat applet comprises an API for calling the cloud bill identification function module.

Optionally, determining a corresponding bill processing policy according to the living body detection result and the bill association feature information includes: if the living body detection fails and the bill with the bill sum larger than the threshold value is detected, carrying out refuting processing or password verification; or if the living body detection fails and the number of times of bill refunding integration of the same bill holder ID in the preset time is larger than a first preset number of times, refuting processing or password verification is carried out; or if the living body detection fails, if the total sum of the bill refund credits of the same bill holder ID is larger than a second preset sum within a preset time, refuting processing or password verification is carried out; or, for the bill with low bill confidence coefficient, performing refuting treatment or secondary audit; or if the bill sum corresponding to the same bill holder ID is smaller than the first preset sum, the bill is processed and the point is exchanged.

Optionally, the process of performing biometric authentication on the ticket holder includes: extracting face characteristic information according to the acquired face image information of the bill holder; carrying out similarity comparison on the extracted face feature information and sample face feature information in a bottom library; and if the similarity is greater than a preset similarity threshold, the authentication is passed.

Optionally, before performing biometric authentication on the ticket holder, the method further includes: collecting a sample biometric characteristic of a user; and storing the matching relation between the sample biological characteristics and the user, and establishing a base.

Optionally, the way of acquiring the sample biometric features of the user is as follows: and acquiring the sample biological characteristics of the user through a gate with a biological characteristic acquisition device.

An apparatus, comprising: one or more processors; and one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform one or more of the methods described.

One or more media having instructions stored thereon that, when executed by one or more processors, cause an apparatus to perform one or more of the described methods.

The bill data processing method based on the living body detection comprises the following steps: performing biological characteristic identification authentication on the bill holder; wherein the biometric identification comprises at least one of: face identification, fingerprint identification, pupil identification, palm print identification and finger vein identification; after the biological characteristic identification authentication is passed, acquiring payment information corresponding to a bill to be identified, and determining user identification information corresponding to the payment information; if the user identification information is matched with the biological characteristics of the bill holder, performing living body detection on the bill holder to obtain a living body detection result; identifying a bill to be identified, acquiring bill bearing information, and determining bill association characteristic information; and determining a corresponding bill processing strategy according to the living body detection result and the bill associated characteristic information.

A biopsy-based ticket data system, comprising: the bill identification module is used for identifying the bill to be identified and acquiring the bill bearing information; the biological characteristic authentication module is used for carrying out biological characteristic identification authentication on the bill holder; the payment information acquisition module is used for acquiring payment information corresponding to a bill to be identified and determining user identification information corresponding to the payment information if the biological characteristic identification authentication passes; the living body detection module is used for carrying out living body detection on the bill holder to obtain a living body detection result if the user identification information is matched with the biological characteristics of the bill holder; and the bill processing strategy module is used for determining bill associated characteristic information and determining a corresponding bill processing strategy according to the in-vivo detection result and the bill associated characteristic information.

Optionally, the ticket holder information includes a ticket holder ID.

Optionally, the ticket redemption information associated with the ticket holder includes at least one of: the bill amount corresponding to the same bill holder ID; the number of times of bill refund integration of the same bill holder ID within a preset time; the same ticket holder ID redeems the total amount of the points for the ticket within a preset time.

Optionally, identifying the bill to be identified through a bill identification application program; wherein the bill identification application is: and the WeChat applet comprises an API for calling the cloud bill identification function module.

Optionally, determining a corresponding bill processing policy according to the living body detection result and the bill association feature information includes: if the living body detection fails and the bill with the bill sum larger than the threshold value is detected, carrying out refuting processing or password verification; or if the living body detection fails and the number of times of bill refunding integration of the same bill holder ID in the preset time is larger than a first preset number of times, refuting processing or password verification is carried out; or if the living body detection fails, if the total sum of the bill refund credits of the same bill holder ID is larger than a second preset sum within a preset time, refuting processing or password verification is carried out; or, for the bill with low bill confidence coefficient, performing refuting treatment or secondary audit; or the sum of the bills corresponding to the ID of the same bill holder is smaller than the first preset sum, and the bills are processed to exchange points.

As mentioned above, the bill data processing method, system, device and medium based on living body detection provided by the invention have the following beneficial effects:

1. the bill processing automation is realized, the manual participation is not needed, and the manpower is saved;

2. in the bill processing process, the security of the bill processing process is realized by means of matching the user identification information corresponding to the payment information with the biological characteristics of a bill holder and detecting the living body

Drawings

Fig. 1 is a schematic flow chart of a bill data processing method based on liveness detection in embodiment 1.

Fig. 2 is a schematic flow chart of biometric authentication in embodiment 1.

Fig. 3 is a schematic flow chart of creating a base library in embodiment 1.

Fig. 4 is a flowchart illustrating the ticket processing policy step S21 in embodiment 1.

Fig. 5 is a flowchart illustrating the ticket processing policy step S22 in embodiment 1.

Fig. 6 is a flowchart illustrating the ticket processing policy step S23 in embodiment 1.

Fig. 7 is a flowchart illustrating the ticket processing policy step S24 in embodiment 1.

Fig. 8 is a flowchart illustrating the ticket processing policy step S25 in embodiment 1.

Fig. 9 is a flowchart illustrating a bill data processing method based on liveness detection in embodiment 2.

FIG. 10 is a schematic diagram showing the configuration of a bill data processing system based on liveness detection according to embodiment 3.

FIG. 11 is a schematic diagram showing another bill data processing system based on liveness detection according to embodiment 3.

Fig. 12 is a schematic hardware structure diagram of a terminal device according to an embodiment.

Fig. 13 is a schematic diagram of a hardware structure of a terminal device according to another embodiment.

Description of the element reference numerals

1 Bill recognition module

2 biological feature recognition module

3 Payment information module

4 Living body detection module

5 Bill processing strategy module

1100 input device

1101 first processor

1102 output device

1103 first memory

1104 communication bus

1200 processing assembly

1201 second processor

1202 second memory

1203 communication assembly

1204 Power supply Assembly

1205 multimedia assembly

1206 voice assembly

1207 input/output interface

1208 sensor assembly

Detailed Description

The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.

It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.

Referring to fig. 1, embodiment 1 provides a method for processing bill data based on biometric identification, including:

s1: the method comprises the steps of identifying a bill to be identified, wherein the bill to be identified can be identified through image identification, for example, through OCR (Optical Character Recognition/Optical Character Recognition), NLP (Natural language processing/Natural language processing), through OCR, the text content on a picture or a photo is directly converted into an editable text, establishing a model of NLP identification through establishing semantic rules and text similarity, utilizing the model of NLP identification to assist OCR identification, obtaining bill bearing information of the bill to be identified after identification is completed, and performing biological feature identification and authentication on a bill holder after the bill bearing information is obtained, and further facilitating the biological feature of the bill holder to be used as an identifier corresponding to the bill to prevent the bill from being artificially tampered; wherein the biometric identification comprises at least one of: face identification, fingerprint identification, pupil identification, palm print identification and finger vein identification;

s2: after the biological characteristic identification authentication is passed, the payment information corresponding to the bill to be identified is acquired, the user identification information corresponding to the payment information is determined, and information matching is carried out among the bill/payment information, the user and the bill holder, so that the safety of data transmission, conversion, correspondence and storage is ensured, and the information safety of bill data processing is further ensured;

s3: if the user identification information is matched with the biological characteristics of the bill holder, performing living body detection on the bill holder to obtain a living body detection result;

s4: and determining bill associated characteristic information, and determining a corresponding bill processing strategy according to the living body detection result and the bill associated characteristic information. In the embodiment, firstly, the bill identification and the biological characteristic identification authentication are carried out, then the collection of the payment information and the user identification information is carried out, the user identification information is matched with the biological characteristic of the bill holder, the living body detection is carried out by the bill holder as the security guarantee, the method can be applied to the scene of unmanned sale, for example, in the scene, the user can carry out the activity judgment in the living body detection step through the biological characteristic identification authentication of a model, a mask, a plane printed matter or a three-dimensional printed matter only with the biological characteristic, the occurrence of counterfeiting is prevented, the security can be improved according to the living body detection result, finally, the bill data processing is carried out according to the living body detection result and the determination of the bill related characteristic information, and the corresponding bill processing strategy is called, so that the correspondence between the bill holder and the payer (matched with the payment information/the user identification information) is realized, the security is improved, the bill holder and the payer are corresponded, and then bill identification is carried out, so that the bill identification workload is reduced. Moreover, the automation and the safety of bill processing are realized; the bill processing automation is realized, the manual participation is not needed, and the manpower is saved; in the bill processing process, the user identification information corresponding to the payment information is matched with the biological characteristics and the activity of the bill holder, so that the safety of the bill processing process is realized.

In some implementations, the ticket association characteristic information includes at least one of: ticket holder information corresponding to the ticket (e.g., match information between the ticket and the ticket holder), ticket redemption information associated with the ticket holder (e.g., relationship between the ticket holder and the amount of the ticket, or redemption points), ticket confidence (e.g., confidence in the authenticity of the ticket and related information), number of ticket identifications; by subdividing the associated characteristic information of the bills and matching the subdivided associated information of the bills, the high-efficiency and high-reliability bill point redemption is realized.

In some implementation processes, the information of the bill holder can be determined according to the biological characteristics of the bill holder, and the relationship among the biological characteristics of the bill, the bill holder and the information of the bill holder is established, so that the information is prevented from being tampered, and the information safety is improved; and the bill association characteristic information can be determined according to the information of the bill holder, the information of the bill bearer and the relationship among the biological characteristics of the bill, the bill holder and the information of the bill holder.

Referring to fig. 2, in order to improve the reliability and convenience of the biometric authentication of the ticket holder, the process of performing the biometric authentication on the ticket holder is as follows:

s11: extracting face characteristic information according to the acquired face image information of the bill holder;

s12: carrying out similarity comparison on the extracted face feature information and sample face feature information in a bottom library;

s13: if the similarity is larger than a preset similarity threshold, the authentication is passed;

s14: and if the similarity is less than or equal to the preset similarity threshold, rejecting or performing secondary audit. The authentication of the bill holder in the bottom base can be completed through a face recognition technology, the bottom base can be a member bottom base of a merchant, and can also be a redemption bottom base of the bill score, so that the historical data of the bill holder can be conveniently called through the authentication, and the historical data can be conveniently accumulated.

Referring to fig. 3, to better complete the biometric authentication of the ticket holder, the following steps can be performed before the biometric authentication of the ticket holder:

s111: collecting a sample biometric characteristic of a user;

s112: and storing the matching relation between the sample biological characteristics and the user, establishing a bottom base, and training the bottom base through a convolutional neural network algorithm to improve the identification accuracy.

In some implementations, the way to collect the sample biometric features of the user is: and acquiring the sample biological characteristics of the user through a gate with a biological characteristic acquisition device. For example, when a user places a membership card on a sensing device of a gate, the sensing device can identify the identity of the user, and meanwhile, a biological characteristic acquisition device (such as a face snapshot machine) on the gate acquires face information of the user, so that the face information of the user is matched with the identity information of the user and stored. By adopting the method, the bottom library is established.

The method can also be used for identifying the bill to be identified through a bill identification application program, after the bill bearing information of the bill to be identified is acquired, an identity information input interface appears, through the identity information input interface, the information of a bill holder is input, and the process of identity information input can be carried out in one of the following modes: image recognition of a bill holder ID, manual input of a number of the bill holder ID, image recognition plus manual correction of the input of the bill holder ID, reading of the bill holder ID by NFC/RFID; and determining the bill associated characteristic information according to the bill holder information and the bill bearing information, and establishing a mapping relation among the bill bearing information, the bill holder information and the bill associated characteristic information, so as to facilitate the subsequent bill data processing by utilizing a bill processing strategy.

In some implementations, the ticket identification application is: the merchant APP, wherein, there is bill recognition function module in the merchant APP, the merchant APP can work through one of following mode: through the mobile terminal that is equipped with trade company APP, through the fixed floodgate machine that is equipped with trade company APP, through the terminal of operation trade company APP.

In some implementation processes, the ticket recognition application may further use a wechat applet, where the wechat applet has an API for calling a cloud ticket recognition function module, for example, the wechat applet may be set on a terminal of a merchant, for example, the wechat applet may run on a terminal of a user, and when ticket recognition is required, the ticket recognition application performs ticket recognition.

In some implementations, the ticket-bearing information includes at least one of: the method comprises the steps of acquiring bill bearing information in multiple dimensions, determining bill association information in corresponding dimensions, and conveniently establishing and matching corresponding bill processing strategies according to bill ID (for example, serial number of the bill), bill amount (for example, consumption amount of the bill, discount amount, amount participating in conversion and the like), bill printing time, bill printing place, commodities recorded on the bill, wherein the bill bearing information comprises bill holder ID which can be membership card, score card, city card, identity ID and the like of the bill holder.

To improve redemption efficiency and develop ticket processing policies, ticket redemption information associated with the ticket holder includes at least one of: the method comprises the steps of bill amount corresponding to the same bill holder ID, the number of times of bill redemption of the same bill holder ID in preset time and the total amount of bill redemption of the same bill holder ID in preset time. And determining a corresponding bill processing strategy according to the amount and frequency of the bill exchange information associated with the bill holder and the total amount in the preset time so as to avoid risks caused by overlarge amount, overhigh frequency and larger total amount in the preset time, and also appointing the corresponding bill processing strategy to perform corresponding risk prevention and control, thereby improving the reliability and safety of bill data processing.

In the process of processing actual bill data, the condition of low bill confidence degree often occurs, and in order to avoid the exchange risk and problem caused by low bill confidence degree, the relevant rule under the condition of low bill confidence degree can be firstly set, and the low bill confidence degree includes the following situations: and if the bill has a null value and is changed, optimizing a corresponding bill processing strategy according to the condition that the confidence coefficient of the bill is low.

Referring to FIG. 4, in some implementations, the ticket processing policy includes S41: if the living body detection does not pass and the bill with the bill amount larger than the threshold value is judged, if yes, S411 is executed, refute processing or password verification is carried out, the non-living body user is prevented from impersonating through the refute processing, the authenticity of the user can be verified through inputting the password, the situation that the user experience is reduced due to system errors of biological characteristic identification authentication and living body detection is avoided, meanwhile, the difficulty of verifying the bill with larger amount is increased, and the safety is improved through a multiple verification mode; when the "no" condition occurs, S412 is executed: the method has the advantages that the method can carry out the passing processing, can carry out the point exchange of the bill after the passing processing, and can also carry out other bill processing strategies, thereby achieving the purpose of risk prevention and control on the bill processing.

Referring to FIG. 5, in some implementations, the ticket processing policy includes S42: if the live body detection is not passed and the number of times of bill redemption points of the same bill holder ID in a preset time is greater than a first preset number of times, when a "yes" condition occurs, S421 is executed: the refuting processing or password verification is carried out, the non-living body user is prevented from being falsely named through the refuting processing, the authenticity of the user can be verified through inputting the password for verification, the condition that the user experience is reduced due to the system errors of biological feature identification authentication and living body detection is avoided, meanwhile, the difficulty of verifying bills with larger money is increased, and the safety is improved through a multi-verification mode; when the "no" condition occurs, S422 is executed: the method has the advantages that the method can carry out the passing processing, can carry out the point exchange of the bill after the passing processing, and can also carry out other bill processing strategies, thereby achieving the purpose of risk prevention and control on the bill processing.

FIG. 6 shows that in some implementations, the bill processing strategy includes S43, if the live body detection fails and the total amount of the bill refund total points of the ID of the same bill holder is greater than the second preset amount within the preset time, if yes occurs, then S431, performing a refund process or password verification, avoiding the imposition of the non-live body user through the refund process, verifying the authenticity of the user through inputting the password, avoiding the situation that the user experience is reduced due to the system errors of the biometric identification and the live body detection, and increasing the difficulty of verifying the bill with a larger amount of money to improve the security through a multiple verification mode; when no, S432 is executed: the method has the advantages that the method can carry out the passing processing, can carry out the point exchange of the bill after the passing processing, and can also carry out other bill processing strategies, thereby achieving the purpose of risk prevention and control on the bill processing.

Fig. 7, in some implementations, the ticket processing policy includes S44: when a bill with low bill confidence is present, S441 is executed: refuting processing or secondary auditing is carried out, the bill with low bill confidence coefficient is prevented from being exchanged, and the purpose of risk prevention and control is achieved.

Fig. 8, in some implementations, the ticket processing policy includes S45: the bill amount corresponding to the same bill holder ID is smaller than a first preset amount, and when the condition of yes occurs, S451 is executed, refute processing or password verification is carried out, impersonation substitution of a non-living user is avoided through the refute processing, verification can be carried out through inputting a password, authenticity of the user is verified, the condition that user experience is reduced due to system errors of biological characteristic identification authentication and living body detection is avoided, meanwhile, difficulty in verifying bills with larger amount is increased, and safety is improved through a multiple verification mode; when the "no" condition occurs, S452 is executed: the method has the advantages that the method can carry out the passing processing, can carry out the point exchange of the bill after the passing processing, and can also carry out other bill processing strategies, thereby achieving the purpose of risk prevention and control on the bill processing.

Referring to fig. 9, embodiment 2 provides a method for processing ticket data based on liveness detection, including:

s01: the biological characteristic identification authentication is carried out on the bill holder, and the biological characteristic of the bill holder can be conveniently used as the mark corresponding to the bill, so that the bill is prevented from being tampered manually; wherein the biometric identification comprises at least one of: face identification, fingerprint identification, pupil identification, palm print identification and finger vein identification;

s02: after the biological characteristic identification authentication is passed, acquiring payment information corresponding to a bill to be identified, determining user identification information corresponding to the payment information, and performing information matching among the bill/payment information, a user and a bill holder, so that the safety of data transmission, conversion, correspondence and storage is ensured, and further the information safety of bill data processing is ensured;

s03: identifying a bill to be identified, acquiring bill bearing information, identifying through OCR (Optical character recognition/Optical character recognition), identifying through NLP (Natural Language Processing/Natural Language Processing), directly converting character contents on a picture and a photo into editable texts through OCR identification, establishing a model of NLP identification through establishing semantic rules and text similarity, assisting OCR identification through the model of NLP identification, acquiring the bill bearing information of the bill to be identified after the identification is completed, and determining bill associated characteristic information through the bill bearing information;

s04: and determining a corresponding bill processing strategy according to the living body detection result and the bill associated characteristic information. In this embodiment, the biometric authentication is performed first, then the payment information and the user identification information are collected, the user identification information is matched with the biometric characteristics of the bill holder, and the live body detection of the bill holder is performed as a security guarantee, so that the method can be applied to a scene of unmanned selling, for example, in the scene, a user can perform the activity judgment in the live body detection step through the biometric authentication of a model, a mask, a flat printed matter or a three-dimensional printed matter only having the biometric characteristics, so as to prevent the occurrence of counterfeiting, improve the security according to the live body detection result, perform the bill identification and acquire the bill associated characteristic information, finally perform the bill data processing according to the live body detection result and the bill associated characteristic information, and perform the bill data processing by calling the corresponding bill processing strategy, thereby realizing the matching between the bill holder and the payer (the payment information/the user identification information) The security is improved, the bill holder corresponds to the payer, and then bill identification is carried out, so that the workload of bill identification is reduced. Moreover, the automation and the safety of bill processing are realized; the bill processing automation is realized, the manual participation is not needed, and the manpower is saved; in the bill processing process, the user identification information corresponding to the payment information is matched with the biological characteristics and the activity of the bill holder, so that the safety of the bill processing process is realized.

In some implementations, the information of the bill holder is determined according to the biological characteristics of the bill holder, and the relationship among the bill, the bill holder, the information of the bill holder and the biological characteristics of the bill holder is established, so that data mapping and processing are facilitated; furthermore, the ticket association characteristic information may be determined according to the ticket holder information and the ticket carrying information, and optionally, the ticket association characteristic information includes at least one of the following: the bill bearing information can be subdivided into the bill exchange information, the bill confidence coefficient and the bill identification times, and a bill processing strategy is formulated according to the bill bearing information, so that the processing efficiency is improved, and the safety is improved.

Referring to fig. 10 and 11, embodiment 3 provides a bill data system based on liveness detection, including: the bill identifying module 1 is used for identifying a bill to be identified and acquiring bill bearing information; the biological characteristic authentication module 2 is used for carrying out biological characteristic identification authentication on the bill holder; the payment information acquisition module 3 is used for acquiring payment information corresponding to a bill to be identified and determining user identification information corresponding to the payment information if the biometric characteristic identification authentication passes; the living body detection module 4 is used for carrying out living body detection on the bill holder to obtain a living body detection result if the user identification information is matched with the biological characteristics of the bill holder; and the bill processing strategy module 5 is used for determining bill associated characteristic information and determining a corresponding bill processing strategy according to the in-vivo detection result and the bill associated characteristic information. In some implementation processes, firstly bill identification and biological feature identification authentication are carried out, then payment information and user identification information are collected, and the user identification information is matched with the biological feature of a bill holder, and the bill holder carries out biopsy as a security guarantee, so that the method can be applied to an unmanned sale scene. In some implementation processes, the biometric feature identification authentication is firstly passed, then the payment information and the user identification information are acquired, the user identification information is matched with the biometric feature of a bill holder, the living body detection of the bill holder is carried out to serve as safety guarantee, the safety can be improved according to the living body detection result, the bill identification is carried out, the bill associated feature information is obtained, finally the bill data processing is carried out according to the living body detection result and the bill associated feature information, the corresponding between the bill holder and a payer (matched with the payment information/the user identification information) is realized by calling the corresponding bill processing strategy, the safety is improved, the bill holder and the payer are firstly corresponding, then the bill identification is carried out, and the bill identification workload is reduced.

s111: collecting a sample biometric characteristic of a user;

In this embodiment, the bill data processing method and apparatus based on liveness detection executes the above system or method, and specific functions and technical effects are as follows with reference to the above embodiment, and are not described herein again.

Other embodiments of the present application also provide an apparatus, which may include: one or more processors; and one or more media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of fig. 1. In practical applications, the device may be used as a terminal device, and may also be used as a server, where examples of the terminal device may include: the mobile terminal includes a smart phone, a tablet computer, an electronic book reader, an MP3 (Moving Picture Experts Group Audio Layer III) player, an MP4 (Moving Picture Experts Group Audio Layer IV) player, a laptop, a vehicle-mounted computer, a desktop computer, a set-top box, an intelligent television, a wearable device, and the like.

The embodiment of the present application further provides a non-volatile readable storage medium, where one or more modules (programs) are stored in the storage medium, and when the one or more modules are applied to a device, the device may be enabled to execute instructions (instructions) of steps included in the ticket data processing method in fig. 1 to 8 according to the embodiment of the present application.

Fig. 12 is a schematic hardware structure diagram of a terminal device according to an embodiment of the present application. As shown, the terminal device may include: an input device 1100, a first processor 1101, an output device 1102, a first memory 1103, and at least one communication bus 1104. The communication bus 1104 is used to implement communication connections between the elements. The first memory 1103 may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and the first memory 1103 may store various programs for performing various processing functions and implementing the method steps of the present embodiment.

Alternatively, the first processor 1101 may be, for example, a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a controller, a microcontroller, a microprocessor, or other electronic components, and the first processor 1101 is coupled to the input device 1100 and the output device 1102 through a wired or wireless connection.

Optionally, the input device 1100 may include a variety of input devices, such as at least one of a user-oriented user interface, a device-oriented device interface, a software programmable interface, a camera, and a sensor. Optionally, the device interface facing the device may be a wired interface for data transmission between devices, or may be a hardware plug-in interface (e.g., a USB interface, a serial port, etc.) for data transmission between devices; optionally, the user-facing user interface may be, for example, a user-facing control key, a voice input device for receiving voice input, and a touch sensing device (e.g., a touch screen with a touch sensing function, a touch pad, etc.) for receiving user touch input; optionally, the programmable interface of the software may be, for example, an entry for a user to edit or modify a program, such as an input pin interface or an input interface of a chip; the output devices 1102 may include output devices such as a display, audio, and the like.

In this embodiment, the processor of the terminal device includes a function for executing each module of the speech recognition apparatus in each device, and specific functions and technical effects may refer to the above embodiments, which are not described herein again.

Fig. 12 is a schematic hardware structure diagram of a terminal device according to an embodiment of the present application. FIG. 13 is a specific embodiment of the implementation of FIG. 12. As shown, the terminal device of the present embodiment may include a second processor 1201 and a second memory 1202.

The second processor 1201 executes the computer program code stored in the second memory 1202 to implement the method described in fig. 4 in the above embodiment.

The second memory 1202 is configured to store various types of data to support operations at the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, such as messages, pictures, videos, and so forth. The second memory 1202 may include a Random Access Memory (RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

Optionally, a second processor 1201 is provided in the processing assembly 1200. The terminal device may further include: communication component 1203, power component 1204, multimedia component 1205, speech component 1206, input/output interfaces 1207, and/or sensor component 1208. The specific components included in the terminal device are set according to actual requirements, which is not limited in this embodiment.

The processing component 1200 generally controls the overall operation of the terminal device. The processing assembly 1200 may include one or more second processors 1201 to execute instructions to perform all or part of the steps of the data processing method described above. Further, the processing component 1200 can include one or more modules that facilitate interaction between the processing component 1200 and other components. For example, the processing component 1200 can include a multimedia module to facilitate interaction between the multimedia component 1205 and the processing component 1200.

The power supply component 1204 provides power to the various components of the terminal device. The power components 1204 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal device.

The multimedia components 1205 include a display screen that provides an output interface between the terminal device and the user. In some embodiments, the display screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

The voice component 1206 is configured to output and/or input voice signals. For example, the voice component 1206 includes a Microphone (MIC) configured to receive external voice signals when the terminal device is in an operational mode, such as a voice recognition mode. The received speech signal may further be stored in the second memory 1202 or transmitted via the communication component 1203. In some embodiments, the speech component 1206 further comprises a speaker for outputting speech signals.

The input/output interface 1207 provides an interface between the processing component 1200 and peripheral interface modules, which may be click wheels, buttons, etc. These buttons may include, but are not limited to: a volume button, a start button, and a lock button.

The sensor component 1208 includes one or more sensors for providing various aspects of status assessment for the terminal device. For example, the sensor component 1208 may detect an open/closed state of the terminal device, relative positioning of the components, presence or absence of user contact with the terminal device. The sensor assembly 1208 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact, including detecting the distance between the user and the terminal device. In some embodiments, the sensor assembly 1208 may also include a camera or the like.

The communication component 1203 is configured to facilitate communications between the terminal device and other devices in a wired or wireless manner. The terminal device may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one embodiment, the terminal device may include a SIM card slot therein for inserting a SIM card therein, so that the terminal device may log onto a GPRS network to establish communication with the server via the internet.

From the above, the communication component 1203, the voice component 1206, the input/output interface 1207 and the sensor component 1208 involved in the embodiment of fig. 13 may be implemented as input devices in the embodiment of fig. 12.

The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims

1. A bill data processing method based on living body detection is characterized by comprising the following steps:

identifying the bill to be identified, and after acquiring the bill bearing information, carrying out biological feature identification authentication on the bill holder; wherein the biometric identification comprises at least one of: face identification, fingerprint identification, pupil identification, palm print identification and finger vein identification;

after the biological characteristic identification authentication is passed, acquiring payment information corresponding to a bill to be identified, and determining user identification information corresponding to the payment information;

if the user identification information is matched with the biological characteristics of the bill holder, performing living body detection on the bill holder to obtain a living body detection result;

and determining bill associated characteristic information, and determining a corresponding bill processing strategy according to the living body detection result and the bill associated characteristic information.

2. The biopsy-based ticket data processing method of claim 1, wherein the ticket-associated feature information comprises at least one of: bill holder information corresponding to the bill, bill redemption information associated with the bill holder, bill confidence, number of bill identifications.

3. The biopsy-based ticket data processing method of claim 2,

determining the information of the bill holder according to the biological characteristics of the bill holder;

and determining the bill association characteristic information according to the bill holder information and the bill bearing information.

4. The biopsy-based ticket data processing method of claim 2, wherein the ticket bearing information comprises at least one of: bill ID, bill amount, bill printing time, bill printing place, and merchandise recorded on the bill.

5. The live body detection-based ticket data processing method of claim 4, wherein the ticket holder information comprises a ticket holder ID.

6. The liveness detection based ticket data processing method of claim 5, wherein the ticket redemption information associated with the ticket holder comprises at least one of:

7. The liveness detection based ticket data processing method of claim 2, wherein said ticket confidence being low comprises the following situations: the ticket has null value and the ticket is changed.

8. The biopsy-based ticket data processing method of claim 1,

identifying the bill to be identified through a bill identification application program; wherein the bill identification application is: the device comprises a merchant APP, wherein a bill identification function module is arranged in the merchant APP.

9. The bill data processing method based on liveness detection according to claim 1, wherein the bill to be recognized is recognized by a bill recognition application; wherein the bill identification application is: the small program of the WeChat is,

the WeChat applet has an API for calling the cloud bill identification function module.

10. The bill data processing method based on living body detection as claimed in claim 6, wherein determining the corresponding bill processing policy according to the living body detection result and the bill associated feature information comprises:

if the living body detection fails and the bill with the bill sum larger than the threshold value is detected, carrying out refuting processing or password verification;

or if the living body detection fails and the number of times of bill refunding integration of the same bill holder ID in the preset time is larger than a first preset number of times, refuting processing or password verification is carried out;

or if the living body detection fails, if the total sum of the bill refund credits of the same bill holder ID is larger than a second preset sum within a preset time, refuting processing or password verification is carried out;

or, for the bill with low bill confidence coefficient, performing refuting treatment or secondary audit;

or if the bill sum corresponding to the same bill holder ID is smaller than the first preset sum, the bill is processed and the point is exchanged.

11. The bill data processing method based on liveness detection according to claim 1, wherein the process of biometric authentication of the bill holder is:

extracting face characteristic information according to the acquired face image information of the bill holder;

carrying out similarity comparison on the extracted face feature information and sample face feature information in a bottom library;

and if the similarity is greater than a preset similarity threshold, the authentication is passed.

12. The method for processing bill data based on liveness detection according to claim 1, wherein before the biometric authentication of the bill holder, further comprising:

collecting a sample biometric characteristic of a user;

and storing the matching relation between the sample biological characteristics and the user, and establishing a base.

13. The biopsy-based ticket data processing method of claim 12, wherein the means for acquiring the sample biometric features of the user is:

and acquiring the sample biological characteristics of the user through a gate with a biological characteristic acquisition device.

14. A computer device, comprising: one or more processors; and one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of one or more of claims 1-13.

15. One or more media having instructions stored thereon that, when executed by one or more processors, cause an apparatus to perform the method of one or more of claims 1-13.

16. A bill data processing method based on living body detection is characterized by comprising the following steps:

performing biological characteristic identification authentication on the bill holder; wherein the biometric identification comprises at least one of:

face identification, fingerprint identification, pupil identification, palm print identification and finger vein identification;

after the biological characteristic identification authentication is passed, acquiring payment information corresponding to a bill to be identified, and determining user identification information corresponding to the payment information; if the user identification information is matched with the biological characteristics of the bill holder, performing living body detection on the bill holder to obtain a living body detection result;

identifying a bill to be identified, acquiring bill bearing information, and determining bill association characteristic information;

and determining a corresponding bill processing strategy according to the living body detection result and the bill associated characteristic information.

17. The biopsy-based ticket data processing method of claim 16,

18. The biopsy-based ticket data processing method of claim 17,

the ticket associated characteristic information comprises at least one of the following: bill holder information corresponding to the bill, bill redemption information associated with the bill holder, bill confidence, number of bill identifications.

19. A biopsy-based ticket data system, comprising:

the bill identification module is used for identifying the bill to be identified and acquiring the bill bearing information;

the biological characteristic authentication module is used for carrying out biological characteristic identification authentication on the bill holder;

the payment information acquisition module is used for acquiring payment information corresponding to a bill to be identified and determining user identification information corresponding to the payment information if the biological characteristic identification authentication passes;

the living body detection module is used for carrying out living body detection on the bill holder to obtain a living body detection result if the user identification information is matched with the biological characteristics of the bill holder;

and the bill processing strategy module is used for determining bill associated characteristic information and determining a corresponding bill processing strategy according to the in-vivo detection result and the bill associated characteristic information.

20. The liveness detection based ticket data system of claim 19 wherein said ticket correlation characteristic information comprises at least one of: bill holder information corresponding to the bill, bill redemption information associated with the bill holder, bill confidence, number of bill identifications.

21. The liveness detection based ticket data system of claim 20,

22. The liveness detection based ticket data system of claim 20 wherein said ticket bearing information comprises at least one of: bill ID, bill amount, bill printing time, bill printing place, and merchandise recorded on the bill.

23. The liveness detection based ticket data system of claim 22, wherein the ticket holder information comprises a ticket holder ID.

24. The liveness detection based ticket data system of claim 23, wherein ticket redemption information associated with the ticket holder includes at least one of:

25. The liveness detection based ticket data system of claim 20 wherein said ticket confidence being low comprises the following: the ticket has null value and the ticket is changed.

26. The liveness detection based ticket data system of claim 19,

27. The liveness detection based ticket data system of claim 19, wherein the ticket to be recognized is recognized by a ticket recognition application; wherein the bill identification application is: and the WeChat applet comprises an API for calling the cloud bill identification function module.

28. The biopsy-based ticket data system of claim 24, wherein determining a corresponding ticket processing policy based on the biopsy results and the ticket-associated feature information comprises:

or the sum of the bills corresponding to the ID of the same bill holder is smaller than the first preset sum, and the bills are processed to exchange points.

29. The liveness detection based ticket data system of claim 19, wherein the biometric authentication of the ticket holder is performed by:

30. The liveness detection based ticket data system of claim 19, further comprising, prior to biometric authentication of the ticket holder:

collecting a sample biometric characteristic of a user;

31. The liveness detection based ticket data system of claim 30 wherein the means for capturing a sample biometric of the user is:

32. A computer device, comprising: one or more processors; and one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of one or more of claims 16-18.

33. One or more media having instructions stored thereon that, when executed by one or more processors, cause an apparatus to perform the method of one or more of claims 16-18.