Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, the present invention provides a payment system and a payment device, which are used to solve the problem that the face recognition system of the payment system in the prior art is falsely used as the user identity.
In order to achieve the above objects and other related objects, the present invention provides a payment system, including a server and a terminal device connected to the server; the terminal equipment comprises an acquisition module for acquiring information, wherein the acquisition module comprises an image acquisition device for acquiring image information; the server includes: a processing module, the processing module comprising: a living body detection unit for performing living body detection on the image information, and an authentication unit for performing authentication login according to a living body detection result of the living body detection unit; and the payment module is used for triggering payment operation according to the verification result of the processing module.
Optionally, the image capturing device includes at least one of: the device comprises a visible light camera for collecting visible light images, a floodlight for emitting floodlight beams, and a projector for emitting structured light beams; the infrared camera is used for collecting infrared images according to the floodlight beam or the structured light beam.
Optionally, the server further includes a storage module connected to the processing module and the acquisition module, respectively.
Optionally, the image capturing device includes a circuit board; the visible light camera, the floodlight, the projector and the infrared camera are respectively arranged on the circuit board.
Optionally, the acquisition module further includes at least one of: the device comprises a touch display screen, an identity card reading device for reading identity card information, a fingerprint identification device for acquiring fingerprint information and an iris camera for acquiring iris information.
Optionally, the processing module includes a module for processing at least one of the following information: the identification unit is used for identifying input information of the touch display screen, identity card information read by the identity card reading device, fingerprint information acquired by the fingerprint identification device, iris information acquired by the iris camera and face information acquired by the face camera.
Optionally, the projector comprises an infrared dot matrix projector or an infrared stripe projector.
Optionally, the floodlight comprises a vertical cavity surface emitting laser or an infrared light emitting diode.
Optionally, the image acquisition device includes a binocular camera for acquiring visible light images.
Optionally, the image capturing device includes a time-of-flight camera, and the time-of-flight camera includes a laser emitter and a camera connected to the laser emitter and composed of the photosensitive element and the lens assembly.
Optionally, the visible light camera and the infrared camera are arranged on two sides of the floodlight.
Optionally, the visible light camera and the infrared camera are disposed on two sides of the projector.
The present invention also provides a payment device comprising: the acquisition module is used for acquiring information and comprises an image acquisition device used for acquiring image information; the processing module is used for processing the information acquired by the acquisition module; a payment module for triggering payment operation according to the processing result of the processing module; the processing module comprises: the living body detection unit is used for carrying out living body detection on the image information, and the verification unit is used for carrying out verification login according to a living body detection result of the living body detection unit.
Optionally, the image capturing device includes at least one of: the device comprises a visible light camera for collecting visible light images, a floodlight for emitting floodlight beams, and a projector for emitting structured light beams; the infrared camera is used for collecting infrared images according to the floodlight beam or the structured light beam.
Optionally, the payment device includes a storage module connected to the processing module and the collecting module.
Optionally, the payment device includes a circuit board, and the visible light camera, the floodlight, the projector and the infrared camera are respectively disposed on the circuit board.
Optionally, the processing module, the storage module, and the payment module are respectively disposed on the circuit board.
As described above, the payment system and the payment device of the invention collect the infrared image and the visible light image through the image collecting device, and perform the living body detection on the image collected by the image collecting device through the living body detection unit in the processing module; after the living body detection is successful, the verification unit performs verification login payment, so that the payment operation is safer, and the risk that the identity is falsely used in face recognition payment is reduced.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
Referring to fig. 1, to achieve the above and other related objects, the present invention provides a payment system, including a server 20 and a terminal device 10 connected to the server 20; the terminal device 10 includes an acquisition module 11 for acquiring information, where the acquisition module 11 includes an image acquisition device 110 for acquiring image information; the server 20 includes: a processing module 21, the processing module 21 comprising: a living body detection unit 211 for performing living body detection on the image information, an authentication unit 212 for performing authentication login according to a living body detection result of the living body detection unit 211; and a payment module 22 for triggering a payment operation according to the verification result of the processing module 21.
In certain embodiments, the image capture device 110 comprises at least one of: a visible light camera 112 for collecting visible light images, a floodlight 113 for emitting a floodlight beam, a projector 114 for emitting a structured light beam; and an infrared camera 115 for collecting infrared images according to the floodlight beam or the structured light beam.
In some embodiments, the server 20 further comprises a storage module 23 connected to the processing module 21 and the acquisition module 11, respectively.
Referring to fig. 2, in some embodiments, the image capturing device 110 includes a circuit board 111; the visible light camera 112, the floodlight 113, the projector 114 and the infrared camera 115 are respectively arranged on the circuit board 111.
In certain embodiments, the acquisition module 11 further comprises at least one of: the device comprises a touch display screen, an identity card reading device for reading identity card information, a fingerprint identification device for acquiring fingerprint information and an iris camera for acquiring iris information.
In some embodiments, the processing module 21 includes a module for processing at least one of the following information: the identification unit is used for identifying input information of the touch display screen, identity card information read by the identity card reading device, fingerprint information acquired by the fingerprint identification device, iris information acquired by the iris camera and face information acquired by the face camera.
In certain embodiments, the projector 114 comprises an infrared dot matrix projector 114 or an infrared stripe projector 114.
In some embodiments, the floodlight 113 comprises a vertical cavity surface emitting laser or an infrared light emitting diode.
In some embodiments, the image capture device 110 includes a binocular camera for capturing visible light images.
In some embodiments, the image capturing device 110 includes a time-of-flight camera, which includes a laser emitter and a camera connected to the laser emitter and composed of the photosensitive element and a lens assembly.
The processing module 21 in the payment system is used for processing the infrared image and the visible light image, the infrared camera 115 is used for receiving infrared image information of the surface of an object and can be used for reconstructing a 3D point cloud, and the floodlight 113 is used for emitting a floodlight beam; the visible light camera 112 is used for acquiring two-dimensional image information of an object, the projector 114 may be an infrared dot matrix projector 114 or an infrared stripe projector 114, and the projector 114 may emit an infrared light source such as dot matrix or stripe; i.e. the floodlight 113 emits a light beam without a pattern, the projector 114 emits a light beam with a dot pattern or a stripe pattern, and the floodlight 113 and the projector 114 emit a near-infrared light beam; the light source emitted by the projector 114 can be projected onto the surface of the object and the background, and collected by the infrared camera 115, so that the processing module 21 can calculate information such as the position and the depth of the object according to the change of the optical signal caused by the object in the image collected by the infrared camera 115, so as to obtain the depth image. According to the invention, the projector 114 actively emits the infrared dot matrix with the specific pattern, the infrared and visible light images of the scene are collected through the plurality of cameras, the depth image of the scene is reconstructed based on the structured light depth reconstruction algorithm, the depth image, the infrared image and the visible light image at the same moment can be finally input, so that the processing module 21 can carry out the in-vivo detection on the shot object, and after the in-vivo detection is successful, the login verification or the payment verification is carried out through the verification unit 212, namely, the payment system of the invention can still carry out the risk of payment operation when the face information is falsely used through the double detection verification of the in-vivo detection unit 211 and the verification unit 212, and the payment safety is ensured.
In addition, in view of the fact that the acquisition module 11 further includes a touch display screen, an identification card reading device for reading identification card information, a fingerprint recognition device for acquiring fingerprint information, and an iris camera for acquiring iris information, a user may input text information, identification card information, fingerprint information, face information, and iris information when registering information, and the input text information may be a bank account number, a payment password, and the like for opening online payment. The processing module 21 may perform association matching and grouping on the registration information, and as can be understood, the information of one registered user includes a group of information, where the group of information includes identification card information, fingerprint information, face information, iris information, a bank account number, a payment password, and the like of the user. After the living body detection is successful, the user can select one or more of fingerprint payment, face recognition payment, iris payment or password payment during secondary verification, the payment safety and reliability are improved, meanwhile, the user has multiple payment selection modes, and the user experience is enriched.
The payment system of the invention processes the infrared image obtained by the image acquisition device 110 through the processing module 21 to obtain the depth image, so that the payment system of the invention can obtain the depth image, the visible light image and the infrared image of the target object at the same time.
In some embodiments, the processing module 21 is further configured to invoke an algorithm to align the three images, and keep a target area, such as a face area, of the three images at the same position; the processing module 21 can detect the face image regions in the three images at the same time, and can also detect the face quality, and then perform the living body detection and output the living body detection result. The living body detection is high in safety, good in attack and defense effects on paper, masks, electronic screens, videos, photos with different bending degrees and the like, and good in three-dimensional attack and defense effects; and does not need to do the cooperation action; the detection speed is high, and millisecond-level in-vivo detection result feedback can be realized on the embedded equipment. It should be noted that the algorithms for adjusting, detecting and deducting the human face, detecting the human face quality, and detecting the living body, which are performed on the depth image, the visible light image, and the infrared image at the same time and obtained by the payment system according to the present invention, may be existing, that is, the existing detection algorithms are embedded in the processing module 21, and will not be described in detail herein.
In some embodiments, the visible light camera 112 and the infrared camera 115 are disposed on opposite sides of the floodlight 113.
In some embodiments, the visible light camera 112 and the infrared camera 115 are disposed on both sides of the projector 114.
In some embodiments, the floodlight 113 is disposed adjacent to the projector 114, and the visible light camera 112 and the infrared camera 115 are disposed on both sides of the floodlight 113 and the projector 114, respectively.
Referring to fig. 3, the present invention further provides a payment device, including: an acquisition module 11 for information acquisition, the acquisition module 11 comprising an image acquisition device 110 for acquiring image information; a processing module 21 for processing the information collected by the collecting module 11; a payment module 22 for triggering a payment operation according to a processing result of the processing module 21; the processing module 21 includes: a living body detection unit 211 for performing living body detection on the image information, and an authentication unit 212 for performing authentication login according to a living body detection result of the living body detection unit 211.
In certain embodiments, the image capture device 110 comprises at least one of: a visible light camera 112 for collecting visible light images, a floodlight 113 for emitting a floodlight beam, a projector 114 for emitting a structured light beam; and an infrared camera 115 for collecting infrared images according to the floodlight beam or the structured light beam.
In some embodiments, the payment device includes a memory module 23 coupled to the processing module 21 and the acquisition module 11.
In some embodiments, the payment device includes a circuit board 111, and the visible light camera 112, the floodlight 113, the projector 114 and the infrared camera 115 are respectively disposed on the circuit board 111.
In some embodiments, the processing module 21, the storage module 23, and the payment module 22 are disposed on the circuit board 111, respectively.
The processing module 21 in the payment device is used for processing the infrared image and the visible light image, the infrared camera 115 is used for receiving infrared image information of the surface of an object and can be used for reconstructing a 3D point cloud, and the floodlight 113 is used for emitting a floodlight beam; the visible light camera 112 is used for acquiring two-dimensional image information of an object, the projector 114 may be an infrared dot matrix projector 114 or an infrared stripe projector 114, and the projector 114 may emit an infrared light source such as dot matrix or stripe; the light source emitted by the projector 114 can be projected onto the surface of the object and the background, and collected by the infrared camera 115, so that the processing module 21 can calculate information such as the position and the depth of the object according to the change of the optical signal caused by the object in the image collected by the infrared camera 115, so as to obtain the depth image. According to the invention, the projector 114 actively emits the infrared dot matrix with the specific pattern, the infrared and visible light images of the scene are collected through the plurality of cameras, the depth image of the scene is reconstructed based on the structured light depth reconstruction algorithm, the depth image, the infrared image and the visible light image at the same moment can be finally input, so that the processing module 21 can carry out the in-vivo detection on the shot object, and after the in-vivo detection is successful, the login verification or the payment verification is carried out through the verification unit 212, namely the payment equipment of the invention can still carry out the risk of payment operation when the face information is falsely used through the double detection verification of the in-vivo detection unit 211 and the verification unit 212, and the payment safety is ensured.
In addition, in view of the fact that the acquisition module 11 further includes a touch display screen, an identification card reading device for reading identification card information, a fingerprint recognition device for acquiring fingerprint information, and an iris camera for acquiring iris information, a user may input text information, identification card information, fingerprint information, face information, and iris information when registering information, and the input text information may be a bank account number, a payment password, and the like for opening online payment. The processing module 21 may perform association matching and grouping on the registration information, and as can be understood, the information of one registered user includes a group of information, where the group of information includes identification card information, fingerprint information, face information, iris information, a bank account number, a payment password, and the like of the user. After the living body detection is successful, the user can select one or more of fingerprint payment, face recognition payment, iris payment or password payment during secondary verification, the payment safety and reliability are improved, meanwhile, the user has multiple payment selection modes, and the user experience is enriched.
According to the payment device, the infrared image obtained by the image acquisition device 110 is processed by the processing module 21 to obtain the depth image, so that the payment device can obtain the depth image, the visible light image and the infrared image of the target object at the same time. In some embodiments, the processing module 21 is further configured to invoke an algorithm to align the three images, and keep a target area, such as a face area, of the three images at the same position; the processing module 21 can detect the face image regions in the three images at the same time, and can also detect the face quality, and then perform the living body detection and output the living body detection result. The living body detection is high in safety, good in attack and defense effects on paper, masks, electronic screens, videos, photos with different bending degrees and the like, and good in three-dimensional attack and defense effects; and does not need to do the cooperation action; the detection speed is high, and millisecond-level in-vivo detection result feedback can be realized on the embedded equipment. It should be noted that the algorithms for adjusting, detecting and deducting the human face, detecting the human face quality, and detecting the living body, which are performed on the depth image, the visible light image, and the infrared image at the same time and obtained by the payment device according to the present invention, may be existing, that is, the existing detection algorithms are embedded in the processing module 21, and will not be described in detail herein.
As described above, the payment system and the payment apparatus of the present invention collect the infrared image and the visible light image through the image collecting device 110, and perform the living body detection on the image collected by the image collecting device 110 through the living body detecting unit 211 in the processing module 21; after the living body detection is successful, the verification unit 212 performs verification login payment, so that the payment operation is safer, and the risk that the identity is falsely used in face recognition payment is reduced.
It can be understood that the payment system server 20 and the terminal device 10 of the present invention can be in communication connection in a wired or wireless manner, the terminal device 10 can be applied to the cash desk of each shopping mall so that the consumer can select various payment modes, the payment system can be located in each large chain supermarket, one server 20 can be connected with a plurality of terminal devices 10, the payment system of the present invention can be developed for the second time to match with the functions of the settlement system of the supermarket, so that the consumer can pay by self, the consumer can be subjected to living body detection by the payment system of the present invention, and the payment operation is performed after the living body detection is successful, so that the safety of the electronic payment mode is upgraded, and the payment is more reliable. The payment system can also be applied to college drawing halls, college dining halls, enterprise dining halls and the like, and has wide application scenes. Likewise, the application scenario described above is also applicable to the application of the payment device of the present invention, and will not be described herein again.
The payment system and the payment equipment of the invention acquire and receive infrared image information of the surface of an object through the infrared camera 115 of the image acquisition device 110, emit floodlight beams through the floodlight 113 to assist the acquisition of infrared images, emit structured light through the projector 114, and process the infrared images through the processing module 21 to obtain depth images; therefore, the payment system based on the invention can obtain the infrared image and the depth image, and solves the problems of low reliability of in-vivo detection, poor user experience and poor three-dimensional anti-attack effect of other payment systems in the weak light environment. The payment system provided by the invention can be used for carrying out living body detection on the information acquired by the image acquisition device 110, so that the safety of face detection and three-dimensional attack and defense capabilities are greatly improved, and the user experience, the reliability of living body detection and the safety of payment are improved. The invention effectively overcomes various defects in the prior art and has high industrial utilization value.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
The various modules or devices of the invention may be connected by way of a bus, which may represent one or more of several types of bus structures, including a memory module bus, a peripheral bus, a processing module, or a local bus using any of a variety of bus architectures.
Fig. 4 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present application. As shown, the terminal device may include: an input device 1100, a processor 1101, an output device 1102, a memory 1103, and at least one communication bus 1104. The communication bus 1104 is used to implement communication connections between the elements. The memory 1103 may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, where the memory 1103 may store various programs for performing various processing functions, processing the visible light image and the infrared image, performing liveness detection, verifying payment, and the like.
Alternatively, the processor/Processing module 1101 may be, for example, a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a controller, a microcontroller, a microprocessor, or other electronic components, and the processor 1101 is coupled to the input device 1100 and the output device 1102 through a wired or wireless connection.
Optionally, the input device 1100 may include a variety of input devices, such as at least one of a user-oriented user interface, a device-oriented device interface, a software programmable interface, a camera, and a sensor. Optionally, the device interface facing the device may be a wired interface for data transmission between devices, or may be a hardware plug-in interface (e.g., a USB interface, a serial port, etc.) for data transmission between devices; optionally, the user-facing user interface may be, for example, a user-facing control key, a voice input device for receiving voice input, and a touch sensing device (e.g., a touch screen with a touch sensing function, a touch pad, etc.) for receiving user touch input; optionally, the programmable interface of the software may be, for example, an entry for a user to edit or modify a program, such as an input pin interface or an input interface of a chip; the output devices 1102 may include output devices such as a display, audio, and the like.
In this embodiment, the processor of the terminal device includes a function for executing each module of the parameter management apparatus in each device, and specific functions and technical effects are as described in the above embodiments, which are not described herein again.
Fig. 5 is a schematic hardware structure diagram of a terminal device according to an embodiment of the present application. Fig. 5 is a specific embodiment of the implementation process of fig. 4. As shown, the terminal device of the present embodiment may include a processor 1201 and a memory 1202.
The processor 1201 executes the computer program code stored in the memory 1202 to implement the processing of the infrared image and the visible light image, the completion of the living body detection, the verification of the payment, and the like by the structured light device or the detection module.
The memory 1202 is configured to store various types of data to support operations at the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, such as messages, pictures, videos, and so forth. The memory 1202 may include a Random Access Memory (RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
Optionally, the processor 1201 is provided in the processing assembly 1200. The terminal device may further include: communication components 1203, power components 1204, multimedia components 1205, audio components 1206, input/output interfaces 1207, and sensor components 1208. The specific components included in the terminal device are set according to actual requirements, which is not limited in this embodiment.
The processing component 1200 generally controls the overall operation of the terminal device. The processing assembly 1200 may include one or more processors 1201 to execute instructions to perform the processing of the visible light images and infrared images described above, as well as to perform and liveness detection, validate payments, and the like.
Further, the processing component 1200 can include one or more modules that facilitate interaction between the processing component 1200 and other components. For example, the processing component 1200 can include a multimedia module to facilitate interaction between the multimedia component 1205 and the processing component 1200.
The power supply component 1204 provides power to the various components of the terminal device. The power components 1204 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal device.
The multimedia components 1205 include a display screen that provides an output interface between the terminal device and the user. In some embodiments, the display screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
The audio component 1206 is configured to output and input audio signals. For example, the audio component 1206 includes a Microphone (MIC) configured to receive an external audio signal when the terminal device is in an operational mode, such as a voice recognition mode. The received audio signals may further be stored in the memory 1202 or transmitted via the communication component 1203. In some embodiments, audio component 1206 also includes a speaker for outputting audio signals.
The input/output interface 1207 provides an interface between the processing component 1200 and peripheral interface modules, which may be click wheels, buttons, etc. These buttons may include, but are not limited to: a volume button, a start button, and a lock button.
The sensor component 1208 includes one or more sensors for providing various aspects of status assessment for the terminal device. For example, the sensor component 1208 may detect an open/closed state of the terminal device, relative positioning of the components, presence or absence of user contact with the terminal device. The sensor assembly 1208 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact, including detecting the distance between the user and the terminal device. In some embodiments, the sensor assembly 1208 may also include a camera or the like.
The communication component 1203 is configured to facilitate communications between the terminal device and other devices in a wired or wireless manner. The terminal device may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one embodiment, the terminal device may include a SIM card slot therein for inserting a SIM card therein, so that the terminal device may log onto a GPRS network to establish communication with the server via the internet.
As can be seen from the above, the communication component 1203, the audio component 1206, the input/output interface 1207 and the sensor component 1208 in the embodiment of fig. 5 may be implemented as the input device in the embodiment of fig. 4.
It should be noted that although several units or sub-units of the apparatus are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, the features and functions of two or more of the units described above may be embodied in one unit, according to embodiments of the invention. Conversely, the features and functions of one unit described above may be further divided into embodiments by a plurality of units.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.