CN111179017A

CN111179017A - Customized delivery method, equipment and system based on face recognition

Info

Publication number: CN111179017A
Application number: CN201911150222.0A
Authority: CN
Inventors: 郑旭东; 石恒; 甘翔; 王勇; 孟海秀; 任学良
Original assignee: Haier Smart Home Co Ltd; Haier Digital Technology Qingdao Co Ltd; Haier Caos IoT Ecological Technology Co Ltd; Qingdao Haier Industrial Intelligence Research Institute Co Ltd
Current assignee: Haier Digital Technology Qingdao Co Ltd; Haier Caos IoT Ecological Technology Co Ltd; Qingdao Haier Industrial Intelligence Research Institute Co Ltd
Priority date: 2019-11-21
Filing date: 2019-11-21
Publication date: 2020-05-19

Abstract

The embodiment of the invention discloses a customized delivery method, equipment and a system based on face recognition, wherein the method comprises the following steps: acquiring a face image of a user, and determining face identification information in the face image; if the face identification information exists in the local database, inquiring user Identity (ID) information corresponding to the face identification information in the local database; if the local database does not have the face identification information, matching the face identification information with the cloud database; if the face identification information exists in the cloud database, inquiring user Identity (ID) information corresponding to the face identification information in the cloud database; and displaying an order placing page matched with the user ID information, and generating order information based on commodity information selected by the user on the order placing page. The technical scheme provided by the embodiment of the invention can improve the convenience of commodity customization and delivery, protect the privacy of the user, save the time of user identity verification and improve the efficiency.

Description

Customized delivery method, equipment and system based on face recognition

Technical Field

The embodiment of the invention relates to the technical field of customized delivery, in particular to a customized delivery method, equipment and system based on face recognition.

Background

With the continuous improvement of consumption level, the differentiation and individuation requirements of users on commodities are more and more, more and more users hope to buy commodities different from other people, the uniqueness of the commodities and the individuation of the commodities are pursued, and based on the requirements of the users, a service of customizing and delivering the commodities is provided, so that the users can customize the commodities and can take the commodities through a goods taking terminal.

In the process of customized delivery of commodities (for example, in the process of customized delivery of household appliances), generally, a user logs in through an ordering terminal, and customizes through a display page of the commodities after logging in to complete an order; the user can get to the goods taking terminal within the set time to make the goods taking completion delivery. However, in the process of customizing and delivering the commodity, the user needs to input information such as user information and passwords to verify the identity of the user in the process of customizing the commodity and delivering the commodity through the ordering terminal and taking the commodity through the goods taking terminal, so that the user information is easy to leak, and the whole process of customizing and delivering the commodity is not fast. In addition, in the processes of customizing commodities and picking up goods by users, user information needs to be sent to a database for data matching, so that the user identity is verified, the verification process consumes longer time, and the efficiency is influenced.

Disclosure of Invention

The embodiment of the invention provides a customization delivery method, equipment and a system based on face recognition, which can improve the convenience of commodity customization delivery, protect the privacy of a user, save the time of user authentication and improve the efficiency.

In a first aspect, an embodiment of the present invention provides a customized delivery method based on face recognition, where the method is applied to an ordering terminal, and the method includes:

acquiring a face image of a user, and determining face identification information in the face image;

if the face identification information exists in a local database, inquiring user Identity (ID) information corresponding to the face identification information in the local database;

if the face identification information does not exist in the local database, matching the face identification information with a cloud database;

if the face identification information exists in the cloud database, inquiring user Identity (ID) information corresponding to the face identification information in the cloud database;

and displaying the order placing page matched with the user ID information, generating order information based on commodity information selected by the user on the order placing page, binding the order information and the user ID information, and sending the order information and the bound user ID information to a server.

In a second aspect, an embodiment of the present invention further provides a customized delivery method based on face recognition, where the method is applied to a goods-taking terminal, and the method includes:

acquiring a face image, and determining face identification information in the face image;

if the face identification information exists in a local database, inquiring user ID information matched with the face identification information in the local database;

if the face identification information does not exist in the local database, inquiring user ID information corresponding to the face identification information in a cloud database;

inquiring order information matched with the user ID information in a server based on the user ID information, and displaying the order information and the user ID information;

and when the goods taking operation of the user is detected, opening the goods taking opening corresponding to the order information so that the user takes out the goods.

In a third aspect, an embodiment of the present invention provides a customized delivery method based on face recognition, including:

the ordering terminal acquires a face image of a user and determines face identification information in the face image;

if the face identification information exists in a local database, the ordering terminal inquires user Identity (ID) information corresponding to the face identification information in the local database;

if the face identification information does not exist in the local database, the ordering terminal matches the face identification information with a cloud database;

if the face identification information exists in the cloud database, the ordering terminal inquires user Identity (ID) information corresponding to the face identification information in the cloud database;

the order placing terminal displays an order placing page matched with the user ID information, generates order information based on commodity information selected by a user on the order placing page, binds the order information with the user ID information, and sends the order information and the bound user ID information to a server;

the goods taking terminal acquires a face image and determines face identification information in the face image;

if the facial identification information exists in a local database, the goods taking terminal inquires user ID information matched with the facial identification information in the local database;

if the face identification information does not exist in the local database, the goods taking terminal inquires user ID information corresponding to the face identification information in a cloud database;

the goods taking terminal inquires order information matched with the user ID information in a server based on the user ID information, and displays the order information and the user ID information;

and when the goods taking terminal detects the goods taking operation of the user, the goods taking port corresponding to the order information is opened so that the user can take out the goods.

In a fourth aspect, an embodiment of the present invention provides a customized delivery system based on face recognition, including an ordering terminal and a goods-taking terminal;

the ordering terminal is used for executing the customized delivery method based on the face recognition provided by the embodiment of the invention;

the goods taking terminal is used for executing the customized delivery method based on the face recognition provided by the embodiment of the invention.

In a fifth aspect, an embodiment of the present invention provides a customized delivery apparatus based on face recognition, including:

one or more processors;

a memory for storing one or more programs,

when the one or more programs are executed by the one or more processors, the one or more processors implement a customized delivery method based on face recognition according to an embodiment of the present invention.

In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement a customized delivery method based on face recognition provided by the embodiment of the present invention.

According to the technical scheme provided by the embodiment of the invention, the commodity is customized and delivered through face recognition, the ordering and delivery convenience of the customized commodity is greatly improved, the privacy information of the user is protected, the matching time can be reduced by matching the face recognition information with the local database and then matching the face recognition information with the face recognition information matching mode of the cloud database, the identity of the user is verified through the face recognition mode, an order ordering page is logged in, the order of the commodity and the delivery of the commodity are finally formed, the commodity customization delivery process is completed, the convenience of the commodity customization delivery can be realized, the privacy of the user can be protected, and the user experience is improved.

Drawings

FIG. 1 is a flow chart of a customized delivery method based on face recognition according to an embodiment of the present invention;

FIG. 2 is a flow chart of a customized delivery method based on face recognition according to an embodiment of the present invention;

FIG. 3 is a flowchart of a customized delivery method based on face recognition according to an embodiment of the present invention;

FIG. 4 is a flowchart of a customized delivery method based on face recognition according to an embodiment of the present invention;

FIG. 5a is a flowchart of a customized delivery method based on face recognition according to an embodiment of the present invention;

FIG. 5b is a diagram of call relations between data based on face recognition according to an embodiment of the present invention;

FIG. 6 is a flowchart of a customized delivery method based on face recognition according to an embodiment of the present invention;

FIG. 7 is a block diagram of a customized delivery apparatus based on face recognition according to an embodiment of the present invention;

FIG. 8 is a block diagram of a customized delivery apparatus based on face recognition according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a customized delivery system based on face recognition according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of a customized delivery device based on face recognition according to an embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Fig. 1 is a flowchart of a customized delivery method based on face recognition according to an embodiment of the present invention, where the method may be executed by a customized delivery apparatus based on face recognition, where the apparatus may be implemented by software and/or hardware, and the apparatus may be configured in a ordering terminal, and the ordering terminal may be an all-in-one machine device or may be a mobile terminal device.

The method can be applied to the scene of customized delivery of household appliance commodities based on face recognition. Optionally, the method may be applied to a scene of ordering household appliance goods based on face recognition. In the related art, in the commodity customization and delivery process, a user needs to input information of the user, passwords and other information to verify the identity of the user through ordering the commodity by an ordering terminal, the information of the user is easy to leak, and the whole commodity customization process is not rapid. And the user information is required to be sent to a database for data matching when the user customizes the commodity, so that the user identity is verified, the verification process consumes longer time, and the efficiency is influenced. According to the technical scheme provided by the embodiment of the invention, the user identity is verified through face recognition, the leakage of user information can be avoided, and the matching time can be reduced, the user identity verification time can be saved and the convenience of purchasing commodities can be improved through the matching mode that the face recognition information is matched with the small-capacity local database and then matched with the cloud database.

It should be noted that, with the development of technology and artificial intelligence, the authentication of user identity information gradually increases from a specific card to biological features such as fingerprints and human faces. The authentication of the existing biological technology is to utilize the inherent biological characteristics and behavior characteristics of human bodies to carry out the identification of personal identities by the algorithm processing of artificial intelligence and the computer technical means. The face recognition is to process the shot picture through a camera, characterize and digitize facial features of the face to obtain face recognition information, and compare the face recognition information with pre-stored information so as to authenticate the identity of the user.

As shown in fig. 1, the technical solution provided by the embodiment of the present invention includes:

s110: the method comprises the steps of obtaining a face image of a user and determining face identification information in the face image.

In the embodiment of the invention, a user can customize the commodity through the ordering terminal, and the commodity can be a household appliance commodity, wherein the household appliance commodity can be a model of a household appliance product. When a user customizes the household appliance commodity by a single terminal, a face image of the user needs to be acquired, so that face recognition is completed.

In this embodiment of the present invention, optionally, the acquiring a face image of a user may further include: and calling a camera to acquire a face image of the user through a face recognition application program. The face recognition application program may be loaded in a face recognition system, and the system may be an application program with a ordering function. Wherein the camera may be disposed on the lower single terminal. The method for acquiring the face image of the user can also be to directly shoot by a camera so as to acquire the face image.

In the embodiment of the present invention, the face recognition information may include face recognition identity ID information and face feature data; or the face recognition information may include only facial feature data. The face identification ID information corresponds to the face feature data, and the face identification ID information may be identification information of the face feature data.

S120: it is determined whether facial recognition information is present in the local database.

If yes, go to S130, otherwise go to S140.

In an embodiment of the present invention, the local database may store registration information of users registered in a recent period of time and corresponding facial recognition information. The registration information of the user may include user identity ID information and the like, and the amount of data stored in the local database is limited, for example, the registration information of 1000 users and corresponding facial identification information may be stored in the local database.

S130: and inquiring user Identity (ID) information corresponding to the facial recognition information in the local database.

In the embodiment of the invention, if the face identification information determined based on the face image exists in the local database, the local database is inquired for the user ID information corresponding to the face identification information. The data volume in the local database is small, so that the face identification information can be matched with the local database, the time for matching the face identification information can be reduced, the user ID information corresponding to the face identification information is inquired in the local database, and compared with the prior art that the face identification information is sent to a remote database, the time in the data transmission process can be saved.

S140: and matching the facial recognition information with a cloud database.

In the embodiment of the invention, if the face identification information does not exist in the local database, the face identification information is matched with the cloud database. The method comprises the following steps: the ordering terminal can send the face identification information determined based on the face image to the cloud server, and the face identification information in the cloud database are respectively matched through the cloud server, so that whether the face identification information exists in the cloud database or not is inquired. The cloud database can store registration information of all users and corresponding face identification information.

S150: and if the facial recognition information exists in the cloud database, inquiring user Identity (ID) information corresponding to the facial recognition information in the cloud database.

In the embodiment of the invention, if the face identification information determined according to the face image exists in the cloud database, the user ID information corresponding to the face identification information is inquired. Specifically, the face identification information can be inquired in a cloud database through a cloud server, and user ID information corresponding to the face identification information is fed back to the ordering terminal.

S160: and displaying the order placing page matched with the user ID information, generating order information based on commodity information selected by the user on the order placing page, binding the order information and the user ID information, and sending the order information and the bound user ID information to a server.

In the embodiment of the present invention, a specific method for displaying an order placing page by an order placing terminal may be: the order placing terminal sends the user ID information to the management server, the management server can feed page information matched with the user ID information back to the order placing terminal, and the order placing terminal generates an order placing page matched with the user ID information based on the page information.

The user can select the household electrical appliance commodity on the order placing page and can also select the customized information of the household electrical appliance commodity, after the user selects the household electrical appliance commodity, the basic information of the user can be input, the operation of submitting the order is selected, and therefore order information is generated. And the system in the ordering terminal binds the order information and the user ID information and sends the order information and the bound user ID information to the server so as to be stored in a database of the server, so that data query is conveniently carried out when the user takes the goods. Wherein the database may be an MES database.

According to the technical scheme provided by the embodiment of the invention, the ordering terminal firstly matches the face identification information in the face image with the local database by acquiring the face image, and when the face identification information exists in the local database, the local database inquires the user ID information corresponding to the face identification information; when the face identification information does not exist in the local database, the face identification information is matched with the cloud database, so that corresponding user ID information is inquired, an order placing page matched with the user ID information is displayed, order information is generated based on commodity information selected by a user on the order placing page, and the order information and the bound user ID information are sent to a server, so that data inquiry when the user takes goods is facilitated. Therefore, the embodiment of the invention matches the face identification information with the local database firstly and then matches the face identification information with the cloud database, so that the matching time can be reduced, the identity of the user is verified in a face identification mode, the order placing page is logged in, the order of the commodity is finally formed, the convenience of purchasing the commodity can be improved, the privacy of the user can be protected, and the user experience is improved.

Fig. 2 is a flowchart of a customized delivery method based on face recognition according to an embodiment of the present invention, where in the embodiment of the present invention, the scheme of the present embodiment may be combined with one or more of the alternatives in the above embodiments. In this embodiment, optionally, the method provided in this embodiment of the present invention may further include:

if the facial recognition information does not exist in the cloud database, displaying a registration page of the user;

acquiring basic user information input on the registration page, and generating user ID information based on the basic user information;

and storing the facial recognition information and the user ID information in a cloud database, and updating the facial recognition information and the user ID information to a local database.

Optionally, the method provided in the embodiment of the present invention may further include:

obtaining a pattern customizing picture uploaded by a user, and sending the pattern customizing picture to printing equipment;

and receiving a sketch picture which is obtained by processing the pattern customization picture and sent by the printing equipment, and displaying the sketch picture in the order placing page.

As shown in fig. 2, the technical solution provided by the embodiment of the present invention includes:

s210: the method comprises the steps of obtaining a face image of a user and determining face identification information in the face image.

S220: and judging whether the facial recognition information exists in a local database.

If yes, go to S230, otherwise go to S240.

S230: and inquiring user Identity (ID) information corresponding to the facial recognition information in a local database.

S240: and matching the facial recognition information with a cloud database.

S250: and judging whether the cloud database contains the facial recognition information.

If yes, go to S260, otherwise go to S290.

S260: and displaying the registration page of the user.

In the embodiment of the invention, when the cloud database does not contain the facial recognition information determined based on the face image, the fact that the user does not register before is indicated, so that a registration page of the user is displayed, and the user can conveniently input basic information and the like for registering.

S270: and acquiring the basic information of the user input in the registration page, and generating user ID information based on the basic information of the user.

In the embodiment of the present invention, the basic information of the user includes information such as a name and a contact address of the user, or may further include information such as a contact address of the user. The user ID information may be identification information corresponding to the user basic information. The user can input the basic user information on the registration page, and the system in the ordering terminal acquires the input basic user information and generates the user ID information based on the basic user information.

S280: and storing the facial identification information and the user ID information in a cloud database, updating the facial identification information and the user ID information to a local database, and jumping to an order placing page.

In the embodiment of the invention, the face identification information and the user ID information are stored in the cloud database to realize the registration of the user, and the face identification information and the user ID information are updated to the local database, so that the latest data stored in the local database can be ensured, the face identification information is better matched with the local database, the matching of the face identification information is saved, and the ordering efficiency is improved.

S290: and inquiring user Identity (ID) information corresponding to the face identification information in the cloud database.

S291: and displaying the order placing page matched with the user ID information.

S292: and acquiring the pattern customized picture uploaded by the user, and sending the pattern customized picture to printing equipment.

In the embodiment of the invention, the pattern customized picture can be a picture customized on a commodity, and the picture is a picture of various different patterns such as a face picture, a landscape picture and the like uploaded by a user. The ordering terminal obtains the pattern customization picture uploaded by the user and sends the pattern customization picture to the printing equipment. The printing device may be a laser printing device, and the printing device may perform processing with the pattern customized picture, for example, may perform binarization processing on the pattern customized picture to obtain a sketch picture, or may perform other effect processing. After the printing equipment processes the pattern customized picture, the processed sketch picture is sent to a ordering terminal so that the ordering terminal can display pages.

S293: and receiving a sketch picture which is obtained by processing the pattern customization picture and sent by the printing equipment, and displaying the sketch picture in the order placing page.

In the embodiment of the invention, the ordering terminal can display the sketch picture in the ordering page, so that the user can conveniently check the effect of the picture, and when the sketch picture does not meet the requirement of the user, the user can continuously upload the pattern customization picture to obtain the sketch picture until the user views the satisfied picture. The sketch picture can be bound with the order information of the user or can be stored in the order information of the user.

Therefore, by uploading the pattern customized picture, receiving the sketch image obtained by processing the pattern customized picture and displaying the sketch image on an order placing page, a user can browse the sketch image of the pattern customized picture, preview of the sketch image is realized, and satisfaction degree of the customized pattern on a commodity is improved.

S294: and generating order information of the commodity based on the commodity information selected by the user on the order placing page, binding the order information with the user ID information, and sending the order information and the bound user ID information to a server.

In the embodiment of the present invention, the information of the commodity may include customized information of the commodity, basic information of the commodity, and the like. The basic information of the commodity includes information of the name, type, size, etc. of the commodity.

In any embodiment of the present invention, after sending the order information and the bound user ID information to the server, the method may further include: and quitting the user ID information from the order placing page, and re-opening the face recognition application program. After the order is placed by the user, the user ID information needs to be quitted from the order placing page to protect the user information and avoid leakage of the user information, and the face recognition application program can be restarted to obtain a face image of the next user, so that the operation efficiency is improved.

According to the embodiment of the invention, the face identification information and the user ID information are stored in the cloud database, and the face identification information and the user ID information are updated to the local database, so that the latest data stored in the local database can be ensured, the face identification information and the local database can be better matched, the matching of the face identification information is saved, the ordering efficiency is improved, the sketch image obtained by processing the pattern customization image is received by uploading the pattern customization image, and the sketch image is displayed on the ordering page, so that a user can browse the sketch image of the pattern customization image, the preview of the sketch image is realized, and the satisfaction degree of the customization pattern on a commodity is improved.

Fig. 3 is a flowchart of a customized delivery method based on face recognition according to an embodiment of the present invention, where the method may be executed by a customized delivery apparatus based on face recognition, where the apparatus may be implemented by software and/or hardware, and the apparatus may be configured in a goods-taking terminal, and the goods-taking terminal may be an all-in-one machine device or may be a mobile terminal device.

The method provided by the embodiment of the invention can be applied to the scene of customized delivery of the household electrical appliance commodities based on the face recognition, and optionally, the method provided by the embodiment of the invention can be applied to the scene of taking the household electrical appliance commodities customized based on the face recognition.

As shown in fig. 3, the technical solution provided by the embodiment of the present invention includes:

s310: acquiring a face image, and determining face identification information in the face image.

In the embodiment of the invention, a user can obtain a commodity by operating the goods taking terminal, wherein the commodity can be a household appliance commodity, and the household appliance commodity can be a model of a household appliance product. When the user acts as a goods taking terminal to take goods, the face image of the user needs to be acquired, and therefore face recognition is completed.

In this embodiment of the present invention, optionally, the acquiring a face image of a user may further include: and calling a camera to acquire a face image of the user through a face recognition application program. The face recognition application program can be loaded in a face recognition system, and the system can be an application program with a goods taking function. Wherein, the camera can be arranged on the goods taking terminal. The method for acquiring the face image of the user can also be to directly shoot by a camera so as to acquire the face image.

S320: it is determined whether facial recognition information is present in the local database.

If yes, go to S330, otherwise go to S340.

S330: querying the local database for user ID information that matches the facial recognition information.

And S340, matching the facial recognition information with a cloud database, and inquiring user ID information corresponding to the facial recognition information in the cloud database.

In the embodiment of the invention, the cloud database can store the registration information of all users and the corresponding face identification information. When the face identification information determined based on the face image does not exist in the local database, the face identification information is matched with the cloud database, so that data query is performed in the cloud database, the ID information of the user is queried, and the user can conveniently take goods.

S350: and inquiring order information matched with the user ID information in the server based on the user ID information, and displaying the order information and the user ID information.

In the embodiment of the invention, the database of the server stores the user ID information and the order information matched with the ID information. The database in the server may be MES data. Through the user ID information inquired in the cloud database or the user ID information inquired in the local database, the order information matched with the user ID information can be inquired in the server, and the order information and the user ID information are displayed, so that the user can browse the order information of the user. The displayed order information may include all the order information of the user, and all the order information of the user includes the order which is finished to pick and the order to be picked. The order which finishes picking the goods can be in a finished state, the order which finishes picking the goods can be in a state to be picked, and the user can select the corresponding order to pick the goods according to the requirement of the user.

S360: and when the goods taking operation of the user is detected, opening the goods taking opening corresponding to the order information so that the user takes out the goods.

In the embodiment of the invention, the user ID and the corresponding order information can be displayed in the delivery interface, all the order information of the user can be displayed in the delivery interface, and the user can select the corresponding order to pick up goods according to the requirement of the user. When a user needs to take out a commodity corresponding to certain order information, the user can click a corresponding option corresponding to the order information, so that a goods taking interface is displayed. And when the goods taking operation of the user on the goods taking interface is detected, opening the goods taking port corresponding to the order information so that the user can take out the goods. Wherein, can show on the interface of getting goods and get goods controlling part, "the user can act on the interface of getting goods" get goods controlling part "to get goods. The delivery interface can be combined with the goods taking interface, and when a user needs to take out a commodity corresponding to certain order information, the user can click a goods taking option corresponding to the order information on the delivery interface so as to take out the commodity.

In the embodiment of the present invention, the specific picking process may be: when the goods taking operation of the user is detected, the manipulator can be controlled to place the goods corresponding to the order information to the corresponding goods taking port, and the corresponding goods taking port is opened, so that the user takes out the goods.

According to the technical scheme provided by the embodiment of the invention, the goods taking terminal firstly matches face identification information in the face image with a local database by acquiring the face image, when the face identification information exists in the local database, user ID information corresponding to the face identification information is inquired in the local database, when the face identification information does not exist in the local database, the user ID information corresponding to the face identification information is inquired from a cloud database, order information matched with the user ID information is inquired, and the order information and the user ID information are displayed; and when the goods taking operation of the user is detected, opening the goods taking port corresponding to the order information so that the user takes out the goods. Therefore, the embodiment of the invention can reduce the matching time by matching the facial recognition information with the local database and then matching the facial recognition information with the facial recognition information matching mode of the cloud database, and can verify the identity of the user by means of facial recognition, so that the commodity is taken out, the convenience of taking the commodity is improved, the privacy of the user is protected, and the user experience is improved.

Fig. 4 is a customized delivery method based on face recognition, which is provided by the embodiment of the present invention, and as shown in fig. 4, the technical solution provided by the embodiment of the present invention includes:

s410: the ordering terminal acquires a face image of a user and determines face identification information in the face image;

s420: and the ordering terminal judges whether the face identification information exists in the local database.

If yes, go to step S430, otherwise, go to step S440.

S430: and the ordering terminal inquires user Identity (ID) information corresponding to the facial recognition information in the local database.

And S440, the ordering terminal matches the facial recognition information with a cloud database.

S450: and if the facial recognition information exists in the cloud database, the ordering terminal inquires user Identity (ID) information corresponding to the facial recognition information in the cloud database.

S460: and the order placing terminal displays the order placing page matched with the user ID information, generates order information based on commodity information selected by the user on the order placing page, binds the order information with the user ID information, and sends the order information and the bound user ID information to a server.

S470: the goods taking terminal acquires a face image and determines face identification information in the face image;

s480: the goods taking terminal judges whether the local database has the facial recognition information or not.

If yes, go to step S490, otherwise go to step S491.

S490: and the goods taking terminal inquires user ID information matched with the facial identification information in the local database.

S491: and the goods taking terminal inquires user ID information corresponding to the face identification information in a cloud database.

S492: and the goods taking terminal inquires order information matched with the user ID information in a server based on the user ID information and displays the order information and the user ID information.

S493: and when the goods taking terminal detects the goods taking operation of the user, the goods taking port corresponding to the order information is opened so that the user can take out the goods.

In the related art, in the process of customized delivery of commodities (for example, in the process of customized delivery of household electrical appliances), generally, a user logs in through an ordering terminal, and customizes through a display page of the commodities after logging in to complete an order; the user can get to the goods taking terminal within the set time to make the goods taking completion delivery. However, in the process of customizing and delivering the commodity, the user needs to input information such as user information and passwords to verify the identity of the user in the process of customizing the commodity and delivering the commodity through the ordering terminal and taking the commodity through the goods taking terminal, so that the user information is easy to leak, and the whole process of customizing and delivering the commodity is not fast. In addition, in the processes of customizing commodities and picking up goods by users, user information needs to be sent to a database for data matching, so that the user identity is verified, the verification process consumes longer time, and the efficiency is influenced.

According to the technical scheme provided by the embodiment of the invention, the commodity is customized and delivered through face recognition, the ordering and delivery convenience of the customized commodity is greatly improved, the privacy information of the user is protected, the matching time can be reduced and the efficiency is improved by matching the face recognition information with the local database and then matching the face recognition information matching mode of the cloud database, the identity of the user is verified through the face recognition mode, so that an order ordering page is logged in, the order of the commodity is finally formed and the commodity is taken out, the customized delivery process of the commodity is completed, the convenience of the customized delivery of the commodity is improved, the privacy of the user can be protected, and the user experience is improved.

Fig. 5a is a flowchart of a customized delivery method based on face recognition according to an embodiment of the present invention, and as shown in fig. 5a, a technical solution provided by an embodiment of the present invention includes:

s01: a face recognition system (app) provides real-time photography to produce a face recognition ID and a facial feature code. The facial feature code may be face feature data.

S02: the MES database should contain a table of user IDs versus order IDs (1: n) for pick-time information queries.

I01: the order placing terminal compares the face characteristic data with the face characteristic data in an existing face recognition database when the face recognition system successfully obtains the face characteristic data, opens a user registration page in an API (application program interface) mode to input user basic information if the face characteristic data is unsuccessfully matched with the face recognition database, so as to generate user ID information, sends the user ID and the face recognition ID to the database for storage after the user successfully registers, and returns the user ID and the face recognition ID to the face recognition system through the API to log in;

i02: skipping to an order placing interface corresponding to the user ID information after the registration is successful;

i03: if the face identification data is successfully matched, opening an order placing page corresponding to the user ID information;

i04: in the ordering process, a user self-timer is used for laser printing, an image processing method needs to be deployed in a server (portrait cutout and sketch) or ordering equipment, and after an interface is called for image processing, the method returns sketch photos (png and bmp) to an ordering page.

I05: after the order is placed, closing an order placing page, quitting the user ID information (responsible for a customer) from the order placing page, and calling an interface to re-open the face recognition app;

i06: and when the face recognition system successfully acquires the face feature data, the goods taking terminal compares the face feature data with the existing face feature data, a delivery interface is opened after the comparison is successful, parameter user ID information is required, and the goods taking interface calls and displays the user ID and the order information in the server so that the user can take goods, and then the goods are taken out.

In the process of placing an order and picking up goods, reference may also be made to the call relationship between the data based on face recognition as shown in fig. 5 b. The face recognition database may include face recognition ID, face feature data, and user ID information. The MES database includes user ID information and order ID information. The face identification ID may be identification information corresponding to the face feature data.

According to the technical scheme provided by the embodiment of the invention, the personal customization service of the household appliance is carried out through the face recognition, and the product delivery is carried out by using the face recognition technology after the production is finished, so that the ordering and delivery convenience of the customized household appliance is greatly improved for a user, the privacy information of the user is protected in the whole process, the scientific and technological sense and experience sense of the user in the process are improved, the development and application of an intelligent factory are promoted, the artificial intelligence and the Internet are combined, and the intelligent delivery level is improved.

Fig. 6 is a flow chart of a customized delivery method based on face recognition according to an embodiment of the present invention, as shown in fig. 6, wherein the local mini-database and the cloud server database both have a data storage function, and include face feature data and user registration information for a face recognition algorithm.

The face recognition algorithm only exists in terminal equipment, the function is to extract feature data of the face picture, and the terminal equipment can be an ordering terminal and a goods taking terminal.

Wherein, the local small database has memory limit, and can only store 1000 users' information (characteristic data and registration information)

As shown in fig. 6, for the order issuing terminal, assuming that the user is registered for the first time, the face feature data and the registration information are stored in the local database of the order issuing terminal and the cloud server database, and then the cloud database is updated and synchronized to the local database of the goods taking terminal, so that the local database of the goods taking terminal and the local database of the order issuing terminal can be ensured to keep consistent data, and when goods are taken through the goods taking terminal, the local database of the goods taking terminal can be matched to verify the identity of the user, thereby saving time.

As shown in fig. 6, only the latest data is retained after the local database exceeds the storage capacity, when the user customizes the commodity through the ordering terminal, the user is identified whether to be a registered user through the face, the face feature data of the user is firstly inquired in the local database, the face feature data is inquired in the cloud database after the face feature data is not matched, the face feature data of the user and the corresponding user ID information are updated to the local databases of the ordering terminal and the goods taking terminal again after the face feature data is matched, and the ordering terminal displays an order ordering page so that the user customizes the commodity. And if the face feature data of the user is not inquired in the cloud database, registering the new user, and after the registration is successful, skipping to an order placing page to customize the commodity for the user.

As shown in fig. 6, for the pickup terminal, pickup is performed through face recognition, specifically, a face image is obtained, face feature data is extracted through a face feature algorithm, and the face feature data is matched with a local database of the pickup terminal, so that order information matched with the face feature data can be queried, and a commodity corresponding to the order information can be taken out.

It should be noted that the face recognition information in the above embodiments of the present invention may include the face recognition ID and the face feature data, or may also include only the face feature data.

Therefore, the storage capacity of the local equipment terminal is limited by the hardware constraint, and the cloud database is established to store all the user information, so that the comprehensive user information can be stored, and the order placing and goods taking of a user are facilitated. The cloud database is used for updating and synchronizing to the local database in real time, the latest data can be stored in the local database, real-time performance is guaranteed, matching of face feature data through the cloud database is reduced, information can be processed more quickly (information matching is carried out on the cloud database, data transmission time is provided for result issuing), and user experience is improved.

Fig. 7 is a block diagram of a customized delivery apparatus based on face recognition, which is integrated in a lower single terminal and includes: a facial recognition information determination module 710, a first query module 720, a matching module 730, a second query module 740, and a generation/transmission module 750.

A face recognition information determining module 710, configured to obtain a face image of a user, and determine face recognition information in the face image;

a first query module 720, configured to query, if the facial recognition information exists in a local database, user identity ID information corresponding to the facial recognition information in the local database;

a matching module 730, configured to match the facial recognition information with a cloud database if the facial recognition information does not exist in the local database;

a second query module 740, configured to query, if the facial recognition information exists in the cloud database, user identity ID information corresponding to the facial recognition information in the cloud database;

the generating/sending module 750 is configured to display an order placing page matched with the user ID information, generate order information based on commodity information selected by the user on the order placing page, bind the order information with the user ID information, and send the order information and the bound user ID information to the server.

Optionally, the apparatus further includes a registration module, configured to:

Optionally, the apparatus further includes a display module, configured to, after displaying the order placing page matched with the user ID information, further include:

Optionally, the acquiring the face image of the user includes: and calling a camera to acquire a face image of the user through a face recognition application program.

Optionally, the apparatus may further include a quit module, configured to quit the user ID information from the order placing page and reopen the face recognition application.

The device can execute the method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Fig. 8 is a block diagram of a customized delivery device based on face recognition, which is applied to a pickup terminal according to an embodiment of the present invention, and the device includes a facial recognition information determining module 810, a first query module 820, a second query module 830, a display module 840, and a pickup module 850.

A face recognition information determining module 810, configured to obtain a face image, and determine face recognition information in the face image;

a first query module 820, configured to query, if the facial recognition information exists in a local database, user ID information matching the facial recognition information in the local database;

a second query module 830, configured to query, in a cloud database, user ID information corresponding to the facial recognition information if the facial recognition information does not exist in the local database;

a display module 840, configured to query, in a server, order information matched with the user ID information based on the user ID information, and display the order information and the user ID information;

and the goods taking module 850 is configured to open the goods taking port corresponding to the order information when a goods taking operation of the user is detected, so that the user takes out the goods.

Fig. 9 is a block diagram of a customized delivery system based on face recognition according to an embodiment of the present invention, and as shown in fig. 9, the system includes an ordering terminal 1 and a goods-taking terminal 2;

the ordering terminal 1 is configured to execute a customized delivery method based on face recognition in an ordering process provided by an embodiment of the present invention (for example, the method shown in fig. 1 and fig. 2). The goods taking terminal 2 is used for executing a customized delivery method based on face recognition in the goods taking process (for example, the method shown in fig. 3).

As shown in fig. 9, the system may further include: a printing device 3 and two cameras 4; the two cameras are respectively arranged on the ordering terminal 1 and the goods taking terminal 2; the printing device 3 is configured to process the pattern customized picture sent by the ordering terminal 1 to obtain a sketch picture, and send the sketch picture to the ordering terminal; and the camera 4 is used for shooting a face image. The ordering terminal and the printing device can be in wired connection or wireless connection.

The ordering terminal and the goods taking terminal can be all-in-one machine equipment, and the all-in-one machine equipment respectively performs face detection feature extraction, feature data distribution, screen display and the like. The image processing system in the all-in-one machine equipment transmits the image shot by the camera to the image processing and identifying system through a related algorithm (such as a machine learning algorithm). Standard image processing methods in printing devices include face recognition and matting, and image sketching. The face recognition and matting refers to automatic face feature recognition, and the head part of the portrait is separated from the whole photo. And (4) image sketching, namely sketching the separated picture into a sketching style picture for a printing device (laser printing device). Wherein the screen may display the identified user characteristic results, the login information, and the delivery status of the product.

According to the system provided by the embodiment of the invention, the commodity is customized and delivered through face recognition, the ordering and delivery convenience of the customized commodity is greatly improved, the privacy information of the user is protected, the face recognition information is matched with the local database firstly and then matched with the face recognition information matching mode of the cloud database, the matching time can be reduced, the efficiency is improved, the identity of the user is verified through the face recognition mode, an order ordering page is logged in, the commodity order is finally formed and taken out, the customized delivery process of the commodity is completed, the commodity customization delivery convenience is improved, the privacy of the user can be protected, and the user experience is improved.

Fig. 10 is a schematic structural diagram of a customized delivery device based on face recognition according to an embodiment of the present invention, where the device may be an order placing terminal or a goods taking terminal. As shown in fig. 10, the apparatus includes:

one or more processors 1010, one processor 1010 being illustrated in FIG. 10;

a memory 1020;

the apparatus may further include: an input device 1030 and an output device 1040.

The processor 1010, the memory 1020, the input device 1030, and the output device 1040 in the apparatus may be connected by a bus or other means, and fig. 10 illustrates the connection by a bus as an example.

The memory 1020, which may be a non-transitory computer-readable storage medium, may be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to a customized delivery method based on face recognition (e.g., the facial recognition information determining module 710, the first query module 720, the matching module 730, the second query module 740, and the generating/sending module 750 shown in fig. 7, or the facial recognition information determining module 810, the first query module 820, the second query module 830, the presentation module 840, and the pickup module 850 shown in fig. 8) in embodiments of the present invention. The processor 1010 executes various functional applications and data processing of the computer device by running the software programs, instructions and modules stored in the memory 1020, so as to implement a customized delivery apparatus method based on face recognition according to the above method embodiment, that is:

Or;

The memory 1020 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 1020 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 1020 may optionally include memory located remotely from processor 1010, which may be connected to a terminal device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 1030 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus. Output device 1040 may include a display device such as a display screen.

An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a customized delivery method based on face recognition, as provided by the embodiment of the present invention:

Or;

Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A customized delivery method based on face recognition is characterized in that the method is applied to an ordering terminal and comprises the following steps:

2. The method of claim 1, further comprising:

and storing the facial recognition information and the user ID information in the cloud database, and updating the facial recognition information and the user ID information to the local database.

3. The method of claim 1, further comprising, after the presenting the order placement page with the matching user ID information:

4. The method of claim 1, wherein the obtaining the face image of the user comprises: and calling a camera to acquire a face image of the user through a face recognition application program.

5. The method of claim 4, further comprising:

and quitting the user ID information from the order placing page, and re-opening the face recognition application program.

6. A customized delivery method based on face recognition is characterized in that the method is applied to a goods taking terminal, and comprises the following steps:

7. A customized delivery method based on face recognition is characterized by comprising the following steps:

8. A customized delivery system based on face recognition is characterized by comprising an ordering terminal and a goods taking terminal;

the ordering terminal is used for executing the customized delivery method based on the face recognition in any one of claims 1-5;

the goods taking terminal is used for executing the customized delivery method based on the face recognition in claim 6.

9. The system of claim 8, further comprising: a printing device and two cameras; the two cameras are respectively arranged on the ordering terminal and the goods taking terminal;

the printing equipment is used for processing the pattern customized picture sent by the ordering terminal to obtain a sketch picture and sending the sketch picture to the ordering terminal;

the camera is used for shooting a face image.

10. A customized delivery device based on face recognition, comprising:

one or more processors;

a memory for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement a method for customized delivery based on face recognition as claimed in any one of claims 1-5, or a method for customized delivery based on face recognition as claimed in claim 6.

11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements a method for customized delivery based on face recognition according to any one of claims 1-5, or a method for customized delivery based on face recognition according to claim 6.