CN210924596U

CN210924596U - Management system and management equipment based on face recognition

Info

Publication number: CN210924596U
Application number: CN201921178426.0U
Authority: CN
Inventors: 周曦; 姚志强; 陈腾
Original assignee: Yuncong Technology Group Co Ltd
Current assignee: Sichuan Yuncong Tianfu Artificial Intelligence Technology Co., Ltd
Priority date: 2019-07-24
Filing date: 2019-07-24
Publication date: 2020-07-03
Anticipated expiration: 2029-07-24

Abstract

The utility model provides a management system and a management device based on face recognition, wherein the management system comprises a server and a terminal device; the terminal equipment comprises a living body detection camera module and a regional image acquisition device, wherein the living body detection camera module is used for carrying out living body detection; the server comprises a living body detection unit for carrying out living body detection according to the information collected by the living body detection camera module; the verification matching unit is used for verifying according to the detection result of the living body detection unit and matching the user information acquired by the terminal equipment; the utility model collects infrared images and visible light images through the in-vivo detection camera module, and performs in-vivo detection on the images collected by the image collection device through the in-vivo detection unit in the processing module; the action path of the user is analyzed through the area image acquisition device on the basis of successful living body detection, the stay time of the customer in the presence of certain specific objects or specific faces is obtained through a timer, and the selection tendency of a specific customer can be analyzed.

Description

Management system and management equipment based on face recognition

Technical Field

The utility model relates to an information technology field especially relates to a management system and supervisory equipment based on face identification.

Background

With the continuous progress of science, a monitoring system in the existing supermarket system cannot intelligently recognize human faces and perform living body detection on the human faces, cannot analyze the action paths of customers in the supermarket, cannot obtain the staying time of the customers in front of certain specific objects, and cannot analyze the consumption tendency of the specific customers.

SUMMERY OF THE UTILITY MODEL

In view of the above-mentioned shortcomings of the prior art, an object of the present invention is to provide a management system and a management device based on face recognition, for solving the problems that the face recognition system of the management system in the prior art cannot perform living body detection on the face, cannot analyze the action path of the customer in the supermarket, cannot obtain the staying time of the customer in front of some specific objects, cannot analyze the consumption tendency of the specific customer, and the like.

In order to achieve the above and other related objects, the present invention provides a management system based on face recognition, which includes a server and a terminal device; the terminal equipment comprises an acquisition module for acquiring user information, wherein the acquisition module comprises a living body detection camera module for carrying out living body detection and a regional image acquisition device for acquiring face images in a plurality of different regions; the server comprises a processing module, and the processing module comprises a living body detection unit for carrying out living body detection according to the information collected by the living body detection camera module; the verification matching unit is used for verifying user information according to the detection result of the living body detection unit and matching the user information acquired by the acquisition module; the processing module is connected with the acquisition module, the processing module is connected with the payment module, the living body detection unit is connected with the verification matching unit, and the payment module is connected with the verification matching unit.

Optionally, the terminal device further includes a recording module for recording at least one of: and the timer is used for counting the continuous occurrence time of the same target face image in the area image acquisition device and the occurrence times of the face image in the area image acquisition device.

Optionally, the server includes a storage module connected to the in-vivo detection camera module and the area image acquisition device.

Optionally, the payment module is configured to open or close payment according to a verification result of the verification matching unit.

Optionally, the acquisition module includes at least one of: the device comprises a touch display screen, an identity card reading device for reading identity card information, a fingerprint identification device for acquiring fingerprint information and an iris camera for acquiring iris information.

Optionally, the living body detecting camera module includes at least one of: the device comprises a visible light camera for collecting visible light images, a floodlight for emitting floodlight beams, and a projector for emitting structured light beams; the infrared camera is used for collecting infrared images according to the floodlight beam or the structured light beam.

Optionally, the biopsy camera module comprises a substrate; the visible light camera, the floodlight, the projector and the infrared camera are all arranged on the substrate, and the visible light camera and the infrared camera are arranged on the floodlight or the two sides of the projector.

Optionally, the projector comprises an infrared dot matrix projector or an infrared stripe projector.

Optionally, the floodlight comprises a vertical cavity surface emitting laser or an infrared light emitting diode.

Optionally, the in-vivo detection camera module includes a time-of-flight camera, and the time-of-flight camera includes a laser emitter and a camera connected to the laser emitter and composed of the photosensitive element and the lens assembly.

Optionally, the terminal device further includes a display device for receiving the analysis result sent by the server.

Optionally, the area image acquisition device includes a plurality of cameras distributed in a preset area according to a certain distribution form, and a control unit that performs partition control on the plurality of cameras.

The utility model also provides a management equipment based on face identification, include: the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring user information and comprises a living body detection camera module used for carrying out living body detection and a regional image acquisition device used for acquiring face images in a plurality of different regions; the processing module comprises a living body detection unit for carrying out living body detection according to the information collected by the living body detection camera module; the verification matching unit is used for verifying user information according to the detection result of the living body detection unit and matching the user information acquired by the acquisition module; the processing module is connected with the acquisition module, the processing module is connected with the payment module, the living body detection unit is connected with the verification matching unit, and the payment module is connected with the verification matching unit.

Optionally, the method further comprises recording at least one of: and the timer is used for counting the continuous occurrence time of the same target face image in the area image acquisition device and the occurrence times of the face image in the area image acquisition device.

Optionally, the system further comprises a memory connected with the processing module and the acquisition module.

Optionally, the management device based on face recognition further includes a terminal device and a server, and the terminal device further includes a display device for receiving the analysis result sent by the server.

As described above, the management system and management device based on face recognition of the present invention collect infrared images and visible light images through the living body detection camera module, and perform living body detection on the images collected by the image collection device through the living body detection unit in the processing module; the action path of the customer is analyzed through the regional image acquisition device on the basis of successful living body detection, the stay time of the customer in front of certain specific objects is obtained through the timer, the consumption tendency of the specific customer can be analyzed, the number of people the customer stays for a specific commodity can also be analyzed, and therefore the supermarket can flexibly adjust the sales promotion mode and the placement mode of the commodity.

Drawings

Fig. 1 is a block diagram of a management system based on face recognition according to an embodiment of the present invention.

Fig. 2 is a schematic structural diagram of an image capturing device according to an embodiment of the present invention.

Fig. 3 is a block diagram of a management device based on face recognition according to an embodiment of the present invention.

Fig. 4 is a schematic diagram of a hardware structure of a terminal device in an embodiment of the present invention.

Fig. 5 is a schematic diagram of a hardware structure of a terminal device in an embodiment of the present invention.

Description of the element reference numerals

The system comprises a terminal device 10, an acquisition module 11, a living body detection camera module 111, a substrate 112, a visible light camera 113, a floodlight 114, a projector 115, an infrared camera 116, an area image acquisition device 12, a server 20, a processing module 21, a living body detection unit 211, a verification matching unit 212, a payment module 22 and a storage module 23;

Detailed Description

The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will be readily apparent to those skilled in the art from the disclosure herein. The present invention can also be implemented or applied through other different specific embodiments, and various details in the present specification can be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.

It should be noted that the drawings provided in the following embodiments are only for illustrating the basic concept of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the form, amount and ratio of the components in actual implementation may be changed at will, and the layout of the components may be more complicated.

Referring to fig. 1-2, to achieve the above and other related objects, an embodiment of the present invention provides a management system based on face recognition, including a server 20 and a terminal device 10; the terminal device 10 includes an acquisition module 11 for acquiring user information, where the acquisition module 11 includes a living body detection camera module 111 for performing living body detection and a region image acquisition device 12 for acquiring face images in a plurality of different regions; the server 20 comprises a processing module 21, and the processing module 21 comprises a living body detection unit 211 for carrying out living body detection according to the information collected by the living body detection camera module 111; a verification matching unit 212 for performing verification according to the detection result of the living body detection unit 211 and for matching the user information acquired by the acquisition module 11.

In some embodiments, the terminal device 10 further comprises means for recording at least one of: a timer for the time when the same target face image continuously appears in the area image acquisition device 12 and the number of times the face image appears in the area image acquisition device 12.

In certain embodiments, the server 20 includes a processing module 21; and a storage module 23 connected with the living body detecting camera module 111 and the area image acquiring device 12.

In some embodiments, the server 20 further includes a payment module 22 for opening or closing payment according to the verification result of the verification matching unit 212, and the payment module 22 is connected to the verification matching unit 212.

In certain embodiments, the acquisition module 11 comprises at least one of: the device comprises a touch display screen, an identity card reading device for reading identity card information, a fingerprint identification device for acquiring fingerprint information and an iris camera for acquiring iris information.

In some embodiments, the liveness detection camera module 111 includes at least one of: a visible light camera 113 for collecting a visible light image, a floodlight 114 for emitting a floodlight beam, a projector 115 for emitting a structured light beam; an infrared camera 116 is also included for infrared image acquisition from the flood light beam or the structured light beam.

In some embodiments, the biopsy camera module 111 includes a substrate 112; the visible light camera 113, the floodlight 114, the projector 115 and the infrared camera 116 are all arranged on the substrate 112, and the visible light camera 113 and the infrared camera 116 are arranged on two sides of the floodlight 114 or the projector 115.

In certain embodiments, the projector 115 comprises an infrared dot matrix projector 115 or an infrared fringe projector 115.

In some embodiments, the floodlight 114 comprises a vertical cavity surface emitting laser or an infrared light emitting diode.

The utility model discloses a processing module 21 among the management system based on face identification is used for handling above-mentioned infrared image and visible light image, and infrared camera 116 is used for receiving the infrared image information on object surface, can be used for rebuilding 3D point cloud, and floodlight 114 is used for launching floodlight speed; the visible light camera 113 is used for acquiring two-dimensional image information of an object, the projector 115 can be an infrared dot matrix projector 115 or an infrared stripe projector 115, and the projector 115 can emit infrared light sources such as dot matrixes or stripes; that is, the floodlight 114 emits a light beam without a pattern, the projector 115 emits a light beam with a dot pattern or a stripe pattern, and the floodlight 114 and the projector 115 emit a near-infrared light beam; the light source emitted by the projector 115 can be projected onto the surface of the object and the background, and collected by the infrared camera 116, so that the processing module 21 can calculate the information such as the position and the depth of the object according to the change of the optical signal caused by the object in the image collected by the infrared camera 116, so as to obtain the depth image. The utility model discloses a projecting apparatus 115 initiative transmission has the infrared dot matrix of specific pattern to gather on-the-spot infrared, visible light image through a plurality of cameras, then rebuild the on-the-spot depth image based on structured light degree of depth reconstruction algorithm, can input same degree of depth image, infrared image, visible light image constantly at last, so that processing module 21 carries out the live body detection to the object of shooing.

The acquisition of the auxiliary infrared image through floodlight 114 can send out the infrared light sources such as dot matrix or stripe through projector 115 in order to gather the structured light image, and this structured light equipment requires not high to the light, and the nearly dark environment also can accurately carry out live body detection user experience good, does not receive the influence of ambient light intensity.

In some embodiments, the terminal device 10 further includes a payment module 22 for opening or closing payment according to the verification result of the verification matching unit 212, and the payment module 22 is connected to the verification matching unit 212. Live body detecting element 211 is connected with payment module 22, and after the live body detection succeeded, the authentication of logging in or payment was verified through verifying matching unit 212, promptly the utility model discloses a management system based on face identification passes through live body detecting element 211 and verifies the dual detection of matching unit 212 and verifies, and the face information of avoiding is still can carry out the risk of payment operation when being falsely used, has guaranteed the security of payment.

In addition, in view of the fact that the acquisition module 11 further includes a touch display screen, an identification card reading device for reading identification card information, a fingerprint recognition device for acquiring fingerprint information, and an iris camera for acquiring iris information, a customer can input text information, identification card information, fingerprint information, face information, and iris information when registering information, and the input text information may be a bank account number, a payment password, and the like for opening online payment. The processing module 21 may perform correlation matching and grouping on the above registered information, and as can be understood, the information of one registered client includes a group of information, where the group of information includes identification card information, fingerprint information, face information, iris information, bank account number, payment password, and the like of the client. After the living body detection is successful, the client can select one or more of fingerprint payment, face recognition payment, iris payment or password payment during secondary verification, the payment safety and reliability are improved, meanwhile, the client has multiple payment selection modes, and the experience of the client is enriched.

The utility model discloses a management system based on face identification handles the infrared image that obtains live body detection camera module 111 through processing module 21 and obtains depth image, consequently, the utility model discloses a management system based on face identification can obtain the same degree of depth image, visible light image and the infrared image of moment of target object. In some embodiments, the processing module 21 is further configured to invoke an algorithm to align the three images, and keep a target area, such as a face area, of the three images at the same position; the processing module 21 can detect the face image regions in the three images at the same time, and can also detect the face quality, and then perform the living body detection and output the living body detection result. The living body detection is high in safety, good in attack and defense effects on paper, masks, electronic screens, videos, photos with different bending degrees and the like, and good in three-dimensional attack and defense effects; and does not need to do the cooperation action; the detection speed is high, and millisecond-level in-vivo detection result feedback can be realized on the embedded equipment. The above-mentioned that need explain is based on the utility model discloses a depth image, visible light image and the infrared image of the same moment that management system based on face identification obtained go on adjust the image, detect and withhold people's face, people's face quality detection and live body detection's algorithm can be current, promptly imbed in the processing module 21 and have current detection algorithm, no detailed description here again.

In some embodiments, the customer can pass through the utility model discloses a management system registers to become the member in a certain supermarket, in view of collection module 11 still includes the touch-control display screen, an ID card reading device for reading ID card information, an iris camera for obtaining fingerprint information's fingerprint identification device and being used for obtaining iris information, the customer can input text message when carrying out the information registration, ID card information, fingerprint information, face information and iris information, the text message of input can be the bank account number and the payment password of opening online payment etc. in the aforesaid registration information storage and storage module 23. The verification matching unit 212 of the processing module 21 may perform correlation matching and grouping on the above-mentioned registered information, and as can be understood, the information of one registered client includes a group of information, where the group of information includes identification card information, fingerprint information, face information, iris information, bank account number, payment password, and the like of the client. The living body detection camera module 111 may be disposed at an entrance and an exit of a supermarket, when a customer enters the supermarket, the living body detection camera module 111 performs living body detection on the customer, and after the living body detection is successful, the verification matching unit 212 matches the face image obtained by the living body detection camera module 111 with the registration information in the storage module 23 to determine whether the customer is a member of the supermarket. After a customer selects goods to be purchased in a supermarket, if the customer is a member, the customer can directly pay in a mode of combining living body detection and authentication, after the living body detection of the customer is successful, the verification matching unit 212 authenticates that the customer is the member, the payment module 22 starts or closes payment operation according to the verification result of the verification matching unit 212, when the payment verification is carried out, the customer can select one or more of fingerprint payment, face recognition payment, iris payment or password payment, the payment safety and reliability are improved, meanwhile, the customer has multiple payment selection modes, and the customer experience is enriched. If the management system is used for registering the supermarket to become a member of the supermarket, the member does not need to carry payment equipment when shopping in the supermarket, and the living body detection of the management system is combined with face recognition to realize payment, so that the management system is convenient and fast to operate.

In some embodiments, the living body detecting camera module 111 includes a time-of-flight camera, and the time-of-flight camera includes a laser emitter and a camera connected to the laser emitter and composed of the light sensing element and a lens assembly.

In some embodiments, the terminal device 10 further includes a display device for receiving the analysis result sent by the server 20.

In some embodiments, the area image capturing device 12 includes a plurality of cameras distributed in a predetermined area according to a certain distribution pattern, and a control unit for performing partition control on the plurality of cameras.

Referring to fig. 3, the present invention further provides a management device based on face recognition, including: the system comprises an acquisition module 11 for acquiring user information, wherein the acquisition module 11 comprises a living body detection camera module 111 for performing living body detection and a region image acquisition device 12 for acquiring face images in a plurality of different regions; a processing module 21, wherein the processing module 21 comprises a living body detection unit 211 for performing living body detection according to the information collected by the living body detection camera module 111; a verification matching unit 212 for performing verification according to the detection result of the living body detection unit 211 and for matching the user information acquired by the acquisition module 11.

In certain embodiments, further comprising means for recording at least one of: a timer for the time when the same target face image continuously appears in the area image acquisition device 12 and the number of times the face image appears in the area image acquisition device 12.

In some embodiments, a memory is also included that is coupled to the processing module 21 and the acquisition module 11.

In some embodiments, the payment module 22 further comprises a payment module 22 for opening or closing payment according to the verification result of the verification matching unit 212, and the payment module 22 is connected with the verification matching unit 212.

Referring to fig. 2, in some embodiments, the biopsy camera module 111 includes a substrate 112; the visible light camera 113, the floodlight 114, the projector 115 and the infrared camera 116 are all arranged on the substrate 112, and the visible light camera 113 and the infrared camera 116 are arranged on two sides of the floodlight 114 or the projector 115.

In some embodiments, the terminal device 10 further includes a display device for receiving the analysis result sent by the server 20. It is understood that the display device may be an LCD display, a plasma display, an OLED display, etc., and the kind of the display device is not limited herein, so that the analysis result can be visually read by the display device, and the analysis result includes at least one of the following: the result of the live body detection, the verification result after the live body detection passes, the user information matching result, the time when the same target face image continuously appears in the area image acquisition device 12, the number of times the face image appears in the area image acquisition device 12, and the like.

In some embodiments, the area image capturing device 12 includes a plurality of cameras distributed in a predetermined area according to a certain distribution pattern, and a control unit for performing partition control on the plurality of cameras

The utility model discloses a processing module 21 in the management equipment based on face identification is used for handling above-mentioned infrared image and visible light image, and infrared camera 116 is used for receiving the infrared image information on object surface, can be used for rebuilding 3D point cloud, and floodlight 114 is used for launching floodlight speed; the visible light camera 113 is used for acquiring two-dimensional image information of an object, the projector 115 can be an infrared dot matrix projector 115 or an infrared stripe projector 115, and the projector 115 can emit infrared light sources such as dot matrixes or stripes; the light source emitted by the projector 115 can be projected onto the surface of the object and the background, and collected by the infrared camera 116, so that the processing module 21 can calculate the information such as the position and the depth of the object according to the change of the optical signal caused by the object in the image collected by the infrared camera 116, so as to obtain the depth image. The utility model discloses a projecting apparatus 115 initiative transmission has the infrared dot matrix of specific pattern to gather on-the-spot infrared, visible light image through a plurality of cameras, then rebuild the on-the-spot depth image based on structured light degree of depth reconstruction algorithm, can input same degree of depth image, infrared image, visible light image constantly at last, so that processing module 21 carries out the live body detection to the object of shooing.

In some embodiments, the terminal device 10 further includes a payment module 22 for opening or closing payment according to the verification result of the verification matching unit 212, and the payment module 22 is connected to the verification matching unit 212. Live body detecting element 211 is connected with payment module 22, and after the live body detection succeeded, the authentication or payment authentication is carried out through verifying matching element 212, promptly the utility model discloses a management equipment based on face identification passes through live body detecting element 211 and verifies matching element 212's dual detection verification, and the face information of avoiding is still can carry out the risk of payment operation when being falsely used, has guaranteed the security of payment.

The utility model discloses a management equipment based on face identification handles the infrared image that obtains live body detection camera module 111 through processing module 21 and obtains depth image, consequently, the utility model discloses a management equipment based on face identification can obtain the same degree of depth image, visible light image and the infrared image of moment of target object. In some embodiments, the processing module 21 is further configured to invoke an algorithm to align the three images, and keep a target area, such as a face area, of the three images at the same position; the processing module 21 can detect the face image regions in the three images at the same time, and can also detect the face quality, and then perform the living body detection and output the living body detection result. The living body detection is high in safety, good in attack and defense effects on paper, masks, electronic screens, videos, photos with different bending degrees and the like, and good in three-dimensional attack and defense effects; and does not need to do the cooperation action; the detection speed is high, and millisecond-level in-vivo detection result feedback can be realized on the embedded equipment. The above-mentioned that need explain is based on the utility model discloses a go on to the image adjust, detect and withhold people's face, people's face quality detection and live body detection's algorithm that degree of depth image, visible light image and the infrared image of the same moment that management equipment based on face identification obtained can be current, promptly imbed with current detection algorithm in the processing module 21, no longer describe in detail here.

In some embodiments, the customer can pass through the utility model discloses a management equipment registers to become the member in a certain supermarket, in view of collection module 11 still includes the touch-control display screen, an ID card reading device for reading ID card information, an iris camera for obtaining fingerprint information's fingerprint identification device and being used for obtaining iris information, the customer can input text message when carrying out the information registration, ID card information, fingerprint information, face information and iris information, the text message of input can be the bank account number and the payment password of opening online payment etc. in the aforesaid registration information storage and storage module 23. The verification matching unit 212 of the processing module 21 may perform correlation matching and grouping on the above-mentioned registered information, and as can be understood, the information of one registered client includes a group of information, where the group of information includes identification card information, fingerprint information, face information, iris information, bank account number, payment password, and the like of the client. The living body detection camera module 111 may be disposed at an entrance and an exit of a supermarket, when a customer enters the supermarket, the living body detection camera module 111 performs living body detection on the customer, and after the living body detection is successful, the verification matching unit 212 matches the face image obtained by the living body detection camera module 111 with the registration information in the storage module 23 to determine whether the customer is a member of the supermarket. After a customer selects goods to be purchased in a supermarket, if the customer is a member, the customer can directly pay in a mode of combining living body detection and authentication, after the living body detection of the customer is successful, the verification matching unit 212 authenticates that the customer is the member, the payment module 22 starts or closes payment operation according to the verification result of the verification matching unit 212, when the payment verification is carried out, the customer can select one or more of fingerprint payment, face recognition payment, iris payment or password payment, the payment safety and reliability are improved, meanwhile, the customer has multiple payment selection modes, and the customer experience is enriched. If the management device is registered as a supermarket member, the member does not need to carry a payment device when shopping in the supermarket, the payment can be realized by combining the living body detection of the management device and the face recognition, and the operation is convenient.

The utility model discloses a management system and management equipment can also be applied to colleges and universities dining room, colleges and universities library, hospital etc. equally, use extensively. Such as being applied to the hospital, the patient can pass through the utility model discloses a management system or management equipment realize registering, see a doctor and collect fee etc. and the history information of seeing a doctor of patient can be saved the utility model discloses an among management system or the management equipment, the doctor can carry out live body detection to the patient through a terminal such as the record of seeing a doctor of calling for the patient that the display surveyability is at a glance, can effectively discern and impersonate the situation such as ID card, the card of seeing a doctor, impersonate the doctor and protect the card. The use of the management system or management device of the present invention in other scenarios is not illustrated in detail.

In some embodiments, the area image capturing device 12 includes a plurality of cameras distributed in a predetermined area according to a certain distribution pattern, and a control unit for performing partition control on the plurality of cameras. It can be understood that the supermarket can be divided into a commodity area, a household appliance area, a snack area and a food and oil subsidiary food area, a plurality of cameras can be installed in each area, each area is controlled by one control unit, the control units in each area can be controlled by the processing module 21 of the server 20 of the management system, the stay of a customer, particularly a member customer, in a specific area can be accurately positioned, the action path of the customer is analyzed through the area image acquisition device 12, the stay time of the customer in front of certain specific objects is obtained through a timer, the consumption tendency of a specific customer can be analyzed, the number of the stay of the customer of a specific commodity can also be analyzed, and the supermarket can flexibly adjust the sales promotion mode and the placement mode of the commodity.

The utility model discloses a management system based on face identification still includes the display device who is used for receiving the analysis result that processing module 21 sent at least, can understand, and display device can be LCD display, plasma display, OLED display etc. do not do the restriction here about display device's kind, so, can be through the audio-visual analysis result of reading of display device, the analysis result includes following at least one: the result of the live body detection, the verification result after the live body detection passes, the user information matching result, the time when the same target face image continuously appears in the area image acquisition device 12, the number of times the face image appears in the area image acquisition device 12, and the like.

As described above, the management system based on face recognition of the present invention collects the infrared image and the visible light image through the living body detection camera module 111, and performs living body detection on the image collected by the image collection device through the living body detection unit 211 in the processing module 21; the action path of the customer is analyzed through the regional image acquisition device 12 on the basis of successful living body detection, the stay time of the customer in front of certain specific objects is obtained through the timer, the consumption tendency of the specific customer can be analyzed, the number of stay persons of the customer of a specific commodity can also be analyzed, and therefore the supermarket can flexibly adjust the sales promotion mode and the placement mode of the commodity.

The utility model discloses a management system based on face identification, infrared image information through the infrared camera 116 collection and receiving object surface of biopsy camera module 111, through floodlight 114 transmission floodlight beam to assist the collection of infrared image, through projecting apparatus 115 transmission structured light, through processing module 21 to infrared image handle and obtain the depth image; therefore, based on the utility model discloses a management system based on face identification can obtain infrared image and depth map, has solved other management system based on face identification live body detectability under the low light environment, and the reliability that the live body detected is low, customer experience is poor and the three-dimensional not good problem of attack effect of preventing. The utility model discloses a management system based on face identification carries out the live body detection to the information that live body detection camera module 111 was gathered, very big promotion face detection's security and three-dimensional attack and defense ability, promoted the security of customer experience, live body detection's reliability and payment. The utility model discloses effectively overcome all kinds of shortcomings in the prior art and had high industry value.

As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Accordingly, various aspects of the present invention may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.

The utility model provides a connection of each module or device can be connected through the mode of bus, and the bus represents one or more in several kinds of bus structures, including memory module bus, peripheral bus, processing module or use the local bus of the arbitrary bus structure in the multiple bus structure.

It should be noted that although several units or sub-units of the apparatus are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, according to embodiments of the invention, the features and functions of two or more units described above may be embodied in one unit. Conversely, the features and functions of one unit described above may be further divided into embodiments by a plurality of units.

Fig. 4 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present application. As shown, the terminal device may include: an input device 1100, a processor 1101, an output device 1102, a memory 1103, and at least one communication bus 1104. The communication bus 1104 is used to implement communication connections between the elements. The memory 1103 may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, where the memory 1103 may store various programs for performing various processing functions and implementing processing, biopsy, verification login/payment, information matching, and the like of the visible light image and the infrared image according to this embodiment.

Alternatively, the processor/processing module 1101 may be, for example, a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a controller, a microcontroller, a microprocessor, or other electronic components, and the processor 1101 is coupled to the input device 1100 and the output device 1102 through a wired or wireless connection.

Optionally, the input device 1100 may include a variety of input devices, such as at least one of a user-oriented user interface, a device-oriented device interface, a software programmable interface, a camera, and a sensor. Optionally, the device interface facing the device may be a wired interface for data transmission between devices, or may be a hardware plug-in interface (e.g., a USB interface, a serial port, etc.) for data transmission between devices; optionally, the user-facing user interface may be, for example, a user-facing control key, a voice input device for receiving voice input, and a touch sensing device (e.g., a touch screen with a touch sensing function, a touch pad, etc.) for receiving user touch input; optionally, the programmable interface of the software may be, for example, an entry for a user to edit or modify a program, such as an input pin interface or an input interface of a chip; the output devices 1102 may include output devices such as a display, audio, and the like.

In this embodiment, the processor of the terminal device includes a function for executing each module of the parameter management apparatus in each device, and specific functions and technical effects are as described in the above embodiments, which are not described herein again.

Fig. 5 is a schematic hardware structure diagram of a terminal device according to an embodiment of the present application. Fig. 5 is a specific embodiment of the implementation process of fig. 4. As shown, the terminal device of the present embodiment may include a processor 1201 and a memory 1202.

The processor 1201 executes the computer program code stored in the memory 1202 to implement the processing of the visible light image and the infrared image, the living body detection, the authentication login/payment, the information matching, and the like of the above-described embodiments.

The memory 1202 is configured to store various types of data to support operations at the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, such as messages, pictures, videos, and so forth. The memory 1202 may include a Random Access Memory (RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

Optionally, the processor 1201 is provided in the processing assembly 1200. The terminal device may further include: communication components 1203, power components 1204, multimedia components 1205, audio components 1206, input/output interfaces 1207, and sensor components 1208. The specific components included in the terminal device are set according to actual requirements, which is not limited in this embodiment.

The processing component 1200 generally controls the overall operation of the terminal device. The processing component 1200 may include one or more processors 1201 to execute instructions to perform the processing of visible light images as well as infrared images, liveness detection, verification of login/payment, information matching, etc. of the above embodiments. Further, the processing component 1200 can include one or more modules that facilitate interaction between the processing component 1200 and other components. For example, the processing component 1200 can include a multimedia module to facilitate interaction between the multimedia component 1205 and the processing component 1200.

The power supply component 1204 provides power to the various components of the terminal device. The power components 1204 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal device.

The multimedia components 1205 include a display screen that provides an output interface between the terminal device and the user. In some embodiments, the display screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

The audio component 1206 is configured to output and input audio signals. For example, the audio component 1206 includes a Microphone (MIC) configured to receive an external audio signal when the terminal device is in an operational mode, such as a voice recognition mode. The received audio signals may further be stored in the memory 1202 or transmitted via the communication component 1203. In some embodiments, audio component 1206 also includes a speaker for outputting audio signals.

The input/output interface 1207 provides an interface between the processing component 1200 and peripheral interface modules, which may be click wheels, buttons, etc. These buttons may include, but are not limited to: a volume button, a start button, and a lock button.

The sensor component 1208 includes one or more sensors for providing various aspects of status assessment for the terminal device. For example, the sensor component 1208 may detect an open/closed state of the terminal device, relative positioning of the components, presence or absence of user contact with the terminal device. The sensor assembly 1208 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact, including detecting the distance between the user and the terminal device. In some embodiments, the sensor assembly 1208 may also include a camera or the like.

The communication component 1203 is configured to facilitate communications between the terminal device and other devices in a wired or wireless manner. The terminal device may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one embodiment, the terminal device may include a SIM card slot therein for inserting a SIM card therein, so that the terminal device may log onto a GPRS network to establish communication with the server via the internet.

As can be seen from the above, the communication component 1203, the audio component 1206, the input/output interface 1207 and the sensor component 1208 in the embodiment of fig. 5 may be implemented as the input device in the embodiment of fig. 4.

While the preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A management system based on face recognition is characterized by comprising a server and terminal equipment;

wherein the terminal equipment comprises an acquisition module for acquiring user information,

the acquisition module comprises a living body detection camera module for carrying out living body detection and a regional image acquisition device for acquiring face images in a plurality of different regions;

the server comprises a processing module, and the processing module comprises a living body detection unit for carrying out living body detection according to the information collected by the living body detection camera module; the verification matching unit is used for verifying user information according to the detection result of the living body detection unit and matching the user information acquired by the acquisition module;

the processing module is connected with the acquisition module, the processing module is connected with the payment module, the living body detection unit is connected with the verification matching unit, and the payment module is connected with the verification matching unit.

2. The face recognition-based management system of claim 1, wherein the terminal device further comprises a means for recording at least one of: and the timer is used for counting the continuous occurrence time of the same target face image in the area image acquisition device and the occurrence times of the face image in the area image acquisition device.

3. The management system based on face recognition according to claim 1, wherein the server comprises a storage module connected with the living body detection camera module and the area image acquisition device.

4. The management system based on face recognition of claim 1, wherein the payment module is configured to turn on or off payment according to the verification result of the verification matching unit.

5. The face recognition-based management system of claim 1, wherein the acquisition module comprises at least one of: the device comprises a touch display screen, an identity card reading device for reading identity card information, a fingerprint identification device for acquiring fingerprint information and an iris camera for acquiring iris information.

6. The system of claim 1, wherein the liveness detection camera module comprises at least one of: the device comprises a visible light camera for collecting visible light images, a floodlight for emitting floodlight beams, and a projector for emitting structured light beams; the infrared camera is used for collecting infrared images according to the floodlight beam or the structured light beam.

7. The system of claim 6, wherein the live-detection camera module comprises a substrate; the visible light camera, the floodlight, the projector and the infrared camera are all arranged on the substrate, and the visible light camera and the infrared camera are arranged on the floodlight or the two sides of the projector.

8. The face recognition based management system of claim 6, wherein the projector comprises an infrared dot matrix projector or an infrared stripe projector.

9. The management system based on face recognition of claim 6, wherein the floodlight comprises a vertical cavity surface emitting laser or an infrared light emitting diode.

10. The management system based on face recognition according to claim 1, wherein the living body detection camera module comprises a time-of-flight camera, and the time-of-flight camera comprises a laser emitter and a camera connected with the laser emitter and composed of a photosensitive element and a lens assembly.

11. The management system based on face recognition according to claim 1, wherein the terminal device further comprises a display device for receiving the analysis result sent by the server.

12. The management system based on face recognition according to claim 1, wherein the area image capturing device comprises a plurality of cameras distributed in a preset area according to a certain distribution form and a control unit for performing zone control on the plurality of cameras.

13. A management apparatus based on face recognition, comprising: the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring user information and comprises a living body detection camera module used for carrying out living body detection and a regional image acquisition device used for acquiring face images in a plurality of different regions; the processing module comprises a living body detection unit for carrying out living body detection according to the information collected by the living body detection camera module; the verification matching unit is used for verifying user information according to the detection result of the living body detection unit and matching the user information acquired by the acquisition module; the processing module is connected with the acquisition module, the processing module is connected with the payment module, the living body detection unit is connected with the verification matching unit, and the payment module is connected with the verification matching unit.

14. The face recognition-based management device of claim 13, further comprising means for recording at least one of: and the timer is used for counting the continuous occurrence time of the same target face image in the area image acquisition device and the occurrence times of the face image in the area image acquisition device.

15. The face recognition-based management device of claim 13, further comprising a memory coupled to the processing module and the acquisition module.

16. The device for managing based on human face recognition according to claim 13, wherein the payment module is configured to turn on or off payment according to the verification result of the verification matching unit.

17. The face recognition-based management device of claim 13, wherein the acquisition module comprises at least one of: the device comprises a touch display screen, an identity card reading device for reading identity card information, a fingerprint identification device for acquiring fingerprint information and an iris camera for acquiring iris information.

18. The face recognition-based management device of claim 13, wherein the liveness detection camera module comprises at least one of: the device comprises a visible light camera for collecting visible light images, a floodlight for emitting floodlight beams, and a projector for emitting structured light beams; the infrared camera is used for collecting infrared images according to the floodlight beam or the structured light beam.

19. The management device based on face recognition of claim 18, wherein the living body detection camera module comprises a substrate; the visible light camera, the floodlight, the projector and the infrared camera are all arranged on the substrate, and the visible light camera and the infrared camera are arranged on the floodlight or the two sides of the projector.

20. The face recognition-based management device of claim 18, wherein the projector comprises an infrared dot matrix projector or an infrared stripe projector.

21. The face recognition-based management device of claim 18, wherein the floodlight comprises a vertical-cavity surface-emitting laser or an infrared light-emitting diode.

22. The management device based on face recognition according to claim 13, wherein the living body detection camera module comprises a time-of-flight camera, and the time-of-flight camera comprises a laser emitter and a camera connected with the laser emitter and composed of a photosensitive element and a lens assembly.

23. The management device based on face recognition of claim 13, wherein the management device based on face recognition further comprises a terminal device and a server, and the terminal device further comprises a display device for receiving the analysis result sent by the server.

24. The management device based on face recognition according to claim 13, wherein the area image capturing means includes a plurality of cameras distributed in a predetermined area in a certain distribution pattern, and a control unit that performs zone control on the plurality of cameras.