WO2021018241A1

WO2021018241A1 - Information processing

Info

Publication number: WO2021018241A1
Application number: PCT/CN2020/105819
Authority: WO
Inventors: 陈楷佳; 李延存; 李刚; 王艺然; 董亚魁; 于志兴
Original assignee: 北京市商汤科技开发有限公司
Priority date: 2019-07-31
Filing date: 2020-07-30
Publication date: 2021-02-04
Also published as: KR20210098509A; JP2022516550A; TW202107402A

Abstract

The present disclosure relates to an information processing method and apparatus, a method and apparatus for taking an express delivery parcel out of storage, an electronic device, and a storage medium. The information processing method can be applied to an express delivery terminal, and comprises: acquiring a first express delivery image corresponding to a first express delivery parcel; obtaining express delivery waybill information, comprised in the first express delivery image, of the first express delivery parcel, wherein the express delivery waybill information comprises at least one of recipient information and express delivery identification information of the first express delivery parcel; acquiring a first facial image of a person who collects the first express delivery parcel; and executing an operation for taking an express delivery parcel out of storage on the first express delivery parcel on the basis of the express delivery waybill information of the first express delivery parcel and the first facial image.

Description

Information processing

Technical field

The present disclosure relates to the field of computer technology, in particular to an information processing method, an express delivery method and device, electronic equipment, and a storage medium.

Background technique

Nowadays, the express delivery industry is developing rapidly, and the number of daily express items is very large. Since the express delivery time is during working hours during the day, and many residents at this time are at work, it is not convenient to receive express delivery, so express delivery collection points came into being. The courier will put the courier in the courier collection point, and the residents will pick it away from the courier collection point.

Summary of the invention

The embodiments of the present disclosure provide an information processing method, an express delivery method and device, electronic equipment, and a storage medium.

A first aspect of the embodiments of the present disclosure provides an information processing method, which is applied to a courier terminal, and the method includes: collecting a first courier image corresponding to a first courier package; and acquiring the first courier image included in the first courier image Express document information of the express package, the express document information includes at least one of recipient information and express identification information of the first express package; collecting the first face of the person who picked up the first express package Image; based on the courier bill information of the first courier package and the first face image, perform the courier outbound operation of the first courier package.

A second aspect of the embodiments of the present disclosure provides an express delivery method, the method comprising: obtaining an express image of an express package collected by at least one camera of a terminal device, wherein the express image is used to obtain the express package Obtain the first facial image collected by the at least one camera; perform the delivery operation of the express package based on the express image and the first facial image.

A third aspect of the embodiments of the present disclosure provides an express delivery method, the method includes: receiving an express delivery request message sent by a terminal device, the express delivery request message includes: first face data and express data, wherein The first face data includes the first face image of the pickup person collected by the terminal device and/or the characteristic information of the first face image, and the express delivery data includes at least the first face image of the express package. Part of and/or the express document information obtained from the express image; based on the first face data and express data, perform outbound verification of express parcels; send to the terminal device to indicate the outbound The warehouse check whether the express delivery response is passed.

A fourth aspect of the embodiments of the present disclosure provides an electronic device, including a processor and a memory, the memory is used to store one or more programs, the one or more programs are configured to be executed by the processor, and The program includes some or all of the steps described in the first aspect, the second aspect, or the third aspect of the embodiment of the present disclosure.

A fifth aspect of the embodiments of the present disclosure provides an information processing device, which is applied to a courier terminal, and the device includes: an image acquisition module for collecting a first courier image corresponding to a first courier package, and collecting the first courier The first face image of the person who picked up the package; an information acquisition module for acquiring the express document information of the first express package included in the first express image, the express document information including recipient information, At least one of the courier identification information of the first courier package; an operation execution module for executing the processing of the first courier package based on the courier document information of the first courier package and the first face image Express delivery operation.

A sixth aspect of the embodiments of the present disclosure provides an express delivery device. The device includes an image acquisition module for acquiring an express image of an express package collected by at least one camera of a terminal device, wherein the express image is used for Obtain the courier document information of the express package; and, obtain the first facial image collected by the at least one camera; the warehouse-out processing module is configured to execute based on the express image and the first facial image The delivery operation of the express package.

A seventh aspect of the embodiments of the present disclosure provides an express delivery device. The device includes: a message receiving module configured to receive an express delivery request message sent by a terminal device, the express delivery request message including: first face data And express data, wherein the first facial data includes the first facial image of the pickup person collected by the terminal device and/or the characteristic information of the first facial image, and the express data includes the express package At least a part of the express image and/or express document information obtained from the express image; a verification processing module, configured to perform outbound verification of express parcels based on the first face data and express data; The response sending module is configured to send an express delivery response indicating whether the delivery check is passed to the terminal device.

An eighth aspect of the embodiments of the present disclosure provides a computer-readable storage medium, where the computer-readable storage medium is used to store a computer program, wherein the computer program enables a computer to execute the first aspect or the second aspect of the embodiments of the present disclosure Or part or all of the steps described in any method of the third aspect.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art.

FIG. 1 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure;

2 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure;

3 is a schematic flowchart of another information processing method disclosed in an embodiment of the present disclosure;

4 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure;

FIG. 5 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure;

FIG. 6 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure;

FIG. 7 is a schematic flowchart of an express query method disclosed in an embodiment of the present disclosure;

FIG. 8 is a schematic flowchart of a method for binding a face and a mobile phone number disclosed in an embodiment of the present disclosure;

FIG. 9 is a schematic flowchart of an express delivery storage method disclosed in an embodiment of the present disclosure;

FIG. 10 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure;

FIG. 11 is a schematic flowchart of an express delivery method disclosed in an embodiment of the present disclosure;

FIG. 12 is a schematic flowchart of an express delivery method disclosed in an embodiment of the present disclosure;

FIG. 13 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present disclosure;

FIG. 14 is a schematic structural diagram of a terminal device provided by an embodiment of the present disclosure;

15 is a schematic structural diagram of an information processing device provided by an embodiment of the present disclosure;

16 is a schematic structural diagram of an information processing device provided by an embodiment of the present disclosure;

Figure 17 is a schematic structural diagram of an express delivery device provided by an embodiment of the present disclosure;

18 is a schematic structural diagram of an express delivery device provided by an embodiment of the present disclosure;

Fig. 19 is a schematic structural diagram of an express delivery device provided by an embodiment of the present disclosure.

Detailed ways

In order to enable those skilled in the art to better understand the solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only These are part of the embodiments of the present disclosure, but not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present disclosure.

The terms “first”, “second”, etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes unlisted steps or units, or optionally also includes Other steps or units inherent to these processes, methods, products or equipment.

Reference to "embodiments" herein means that a specific feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present disclosure. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art clearly and implicitly understand that the embodiments described herein can be combined with other embodiments.

Normally, for the courier placed in the courier collection point, the staff will first enter the courier information into the system (warehouse), such as the tracking number, the user’s mobile phone number, etc., and then send a text message to the user to inform the user of a pickup code. Pick up with the pickup code. After the user comes to the courier collection point, he informs the staff of the pickup code, and the staff goes to the warehouse to find the express, and then delivers the express to the user.

In view of this, the embodiments of the present disclosure provide an information processing method, and the following describes the embodiments of the present disclosure in detail.

The embodiments of the present disclosure may be executed by a terminal device, and the terminal device may include, but is not limited to, an information processing device (express terminal) applied to express delivery management, a mobile phone with a touch-sensitive surface (for example, a touch screen display and/or a touch panel) , Laptop or tablet computer and other portable devices. It should also be understood that, in some embodiments, the terminal device is not a portable communication device, but may be a desktop computer with a touch-sensitive surface (for example, a touch screen display and/or a touch pad).

FIG. 1 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure, and the method can be applied to a courier terminal. As shown in Figure 1, the method may include:

In step 101, a first express image corresponding to the first express package is collected.

Among them, the above-mentioned first express image can be understood as including the image of the first express package, such as the image collected within the camera range of the first express package, specifically the image collected when the express package enters and exits the warehouse, or the user receives Images collected during express delivery, etc. The express package to be shipped out of the warehouse can be called the first express package. The user can hold the first express package and stand in the image collection area of the express terminal, and the express terminal can collect the express image of the first express package. The image can be called the first express image.

In step 102, obtain the courier document information of the first courier package included in the first courier image, where the courier document information includes at least one of recipient information and courier identification information of the first courier package .

The first express parcel is usually pasted with the express receipt, and the express receipt information on the first express parcel can be identified by processing the first express image. For example, the express document information includes, but is not limited to: the recipient information of the first express package (such as the recipient’s name, mobile phone number, etc.), express identification information (such as the express number that uniquely identifies the express package) ) One or more items. At least one of recipient information and express delivery identification information can be obtained. In addition, the identification of the courier document information can be performed by the courier terminal, or the courier terminal can send the collected first courier image to the server and receive the courier document information identified by the server, which is not limited in the embodiment of the present disclosure.

In step 103, the first face image of the picker of the first express package is collected.

The pickup person is a user who receives the first express package, and the face image of the pickup person can be collected through the express terminal, and the face image may be called the first face image.

The express terminal in the embodiment of the present disclosure may periodically collect images, and optionally include a face recognition function, and use face recognition technology to detect whether the collected first face image contains a face, or to identify the Face, or you can use the camera set on the express terminal to track the face in the scene.

The face recognition involved in the embodiments of the present disclosure uses image processing technology to analyze static pictures or video sequences to find faces and output one or more effective information such as the number, location and size of the faces, and identity; secondly In some embodiments, human faces can be tracked, that is, on the premise that the human face is detected in the previous image frame, information such as the position and size of the human face should be captured in subsequent frames. Exemplarily, the image collection may be performed periodically. For example, the camera of the express terminal may obtain an image every 2 seconds and execute a process of determining whether a human face is included to obtain a human face image. If the acquired image does not contain a human face, you can delete the acquired image above, or save it for a period of time and delete it to save storage space.

In an exemplary implementation, the courier terminal may include, but is not limited to, a first camera, a second camera, a transceiver, and a display screen, where the first face image can be collected through the first camera of the courier terminal, and the courier terminal The second camera captures the first express image. In the embodiment of the present disclosure, the first camera used to collect facial images and the second camera used to collect express images may be the same or different cameras. Exemplarily, the second camera used to collect the first express image may be an industrial camera camera. The black and white or color image is collected through the industrial camera camera to facilitate the subsequent verification of express document information (such as express bar code, express text, etc.). Information) identification and acquisition. Moreover, the order in which the first express image and the first face image are collected is not limited. For example, the first express image and the first face image may be collected at the same time after the user issues an express delivery instruction, where the first express image and the first face image may be collected separately, or the first express image and The first face image is contained in an image, for example, an image taken by the user placing a courier package in front of him; or the first camera is activated to collect the first face image after detecting the proximity of a person Or when it is detected that there are items placed in the package placement area, the second camera is activated to collect the first express image, which is not limited in the embodiment of the present disclosure.

In step 104, an express delivery operation of the first express package is performed based on the express receipt information of the first express package and the first face image.

Before the first express parcel leaves the warehouse, the identity verification of the pickup person can be performed through the above-mentioned express document information and the first face image, that is, the outbound verification is performed. For example, the first identity information matched by the first face image may be determined, and in the case that the first identity information is consistent with the recipient information of the first express package, it is confirmed that the express delivery verification of the first express package is passed. For another example, the first account information corresponding to the recipient information in the first express package can be determined. If the first biometric information corresponding to the first face image has a binding relationship with the first account information, determine The warehouse verification of the first express parcel passed. For another example, the first account information matched by the first face image can be determined, and the to-be-collected courier information corresponding to the first account information can be queried, and if the courier-to-be-collected information matches the courier identification information of the first courier package, determine The warehouse verification of the first express parcel passed. And so on, the embodiments of the present disclosure do not limit the specific implementation of identity verification.

Exemplarily, after obtaining the express document information included in the first express image and the aforementioned first face image, the express delivery operation can also be performed immediately, and the aforementioned information is recorded to confirm whether the first express package is delivered from the warehouse There is an abnormality. Among them, in some embodiments, it can be determined that the first express package is out of the warehouse normally when the first face image matches the express receipt information, but in the case where the first face image does not match the express receipt information Confirm that the first express package is out of the warehouse abnormally, and optionally send an alarm if an abnormality is found.

The information processing method of the embodiment of the present disclosure collects the first face image corresponding to the pickup person of the express package and the first express image of the express package, and the express receipt information and the first face image obtained based on the first express image The image determines whether the express package is out of the warehouse, so that the parcel is checked out between the picker and the package information when it is out of the warehouse, and the identity verification of the user in the process of taking the express is realized, thereby increasing the security of the express delivery management Sex.

FIG. 2 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure, in which a process of receiving an express package through an express terminal is described, and the first person who compares the pickup person in the embodiment of the present disclosure Whether the identity information matched by the face image is consistent with the recipient information of the express package is used to verify the delivery of the express package. As shown in Figure 2, the method may include:

In step 201, the first express image corresponding to the first express package is collected, and the express document information of the first express package included in the first express image is obtained.

In step 202, the first face image of the person who picked up the first express package is collected.

In step 203, first identity information matched by the first face image is obtained.

The aforementioned express terminal or server may store a face database, including multiple face templates and identity information corresponding to the face templates, where the face templates may include facial images and/or feature information of the face images, and the aforementioned identity information It can include one or more of the user's name, contact number, address, etc. That is, users can bind their face and identity information through courier terminals or mobile phone applications. In some embodiments, the courier terminal stores a human face database, and the courier terminal can determine the user's identity through face recognition processing on the first facial image, and obtain the first identity information that matches the first facial image. In some embodiments, when the server stores the face database, the courier terminal may send the first face image and/or the feature information of the first face image to the server, and the server determines the first face image and/or the first face image based on the stored face database. The first identity information matched by the image is returned to the express terminal.

In an implementation manner, the express terminal may send the first face image to the server, and the server recognizes the first face image, and determines the face template matching the first face image in the face template set. In turn, the first identity information corresponding to the face template matching the first face image can be queried.

Among them, the server in the embodiment of the present disclosure is also called a server, which is a device that provides computing services and can allow multiple terminals to access. The above-mentioned express terminal may communicate with the server through a transceiver. For example, the above-mentioned first face image and/or characteristic information of the first face image may be sent to the server through the transceiver for the server to search for and the first face image. Image matching first identity information.

The following description will be made by taking the server searching for the first identity information matching the first face image as an example, but those of ordinary skill in the art can understand that the description can also be applied to the express terminal.

Specifically, the aforementioned server may compare the first face image or the feature information of the first face image with the face template one by one to determine whether there is a matching face template in the set of face templates. In some embodiments, the face template includes a face image. Accordingly, the server may determine the similarity between the first face image and each face image in the set of face templates, and determine the face based on the similarity. The face template that matches the first face image in the template set. In some embodiments, the face template includes face feature information. Accordingly, the server can obtain the feature information of the first face image sent by the express terminal, or perform feature extraction on the first face image sent by the express terminal to obtain The feature information of the first face image, and compare the feature information of the first face image with the face feature information included in each face template to determine the face template that matches the first face image, but The embodiments of the present disclosure are not limited thereto.

In addition, in other implementation manners, the acquisition of the first identity information matched by the first face image may also be based on other information that can uniquely identify the user's identity other than facial features, for example, may be based on iris features. Exemplarily, the server may obtain the iris characteristics of the person picking up the express package according to the first face image, and obtain a similarly matched person by comparing it with the template in the iris feature library, and then obtain the identity such as the mobile phone number corresponding to the person Information, and then compare the mobile phone number with the mobile phone number in the express receipt information of the express package to determine whether it is the real recipient.

In some embodiments, it can be determined whether the similarity between the first face image or the feature information of the first face image and the face template is greater than a preset threshold, and the face template greater than the preset threshold is determined as the same The face template that matches the first face image. In some optional implementation manners, the server may store the aforementioned preset threshold, such as 95% or 90%, but the embodiment of the present disclosure is not limited thereto.

In some embodiments, if a face template matching the first face image is found in the face database, step 204 may be executed. If a face template matching the first face image is not found in the face database, it can be determined that the verification fails, or the user is prompted to enter account information.

In step 204, it is determined whether the first identity information is consistent with the recipient information of the first express package.

After obtaining the recipient information of the first express package and the first identity information, the express terminal may compare the first identity information with the recipient information to determine whether the two are consistent. Specifically, any multiple pieces of information such as user name or account name, contact number, address, etc. can be compared separately. Among them, in some embodiments, stricter verification can be performed. Accordingly, if one of the information is inconsistent In the case of, it is determined that the user identity verification has failed, and if the comparison of multiple pieces of information is consistent, it is determined that the user identity verification is successful. Alternatively, a looser comparison can be performed. For example, only one item of information, such as name, account name, or contact phone number, can be compared, and if the information is consistent, it is determined that the user identity verification is successful . For another example, multiple pieces of information can be compared, and if one of the pieces of information is consistent, it is determined that the user identity verification is successful, which is not limited in the embodiment of the present disclosure.

If the judgment result is consistent, continue to execute step 205; otherwise, continue to execute step 206.

In step 205, in the case that the first identity information is consistent with the recipient information of the first express package, it is confirmed that the express delivery verification of the first express package has passed, and/or the first The storage status corresponding to the express package is updated to the out-of-warehouse status.

In this step, in the case where the first identity information is consistent with the recipient information of the first express package, it can be confirmed that the first express package has passed the warehouse verification, and the picker can take the express package. It is also possible to update the storage status corresponding to the express identification information of the first express package to the out-of-warehouse state.

In an embodiment, if the first identity information is consistent with the recipient information, it is also possible to generate the express receipt information of the first express package and the express delivery information of the first face image, and send it to the express The management system sends the aforementioned express delivery information to instruct to record the receipt details of the express package. Among them, in some embodiments, the aforementioned express delivery information may also include relevant information such as delivery (collection) time, which is not limited here.

The express terminal in the embodiment of the present disclosure can interact with the express management system through business interface services. For outbound or pickup scenarios, the express outbound information can be sent to the express delivery management system for registration, and the express delivery or receipt can be recorded, so as to facilitate the update of express delivery management. In some embodiments, the aforementioned express delivery management system may be a third-party inventory management system, but the embodiments of the present disclosure are not limited thereto.

In step 206, when the above-mentioned first identity information is inconsistent with the recipient information of the first express package, output warning information, or put the express package into the express lock device, or prompt to input user verification information.

If the above first identity information is inconsistent with the recipient information of the first express package, the verification fails, which means that the user who picked up the express and left is not the real express picker, and the above warning information can be output. The above-mentioned warning information may include voice information, such as a prompt: "Pick-up person does not match, please confirm!" or a preset prompt sound. Exemplarily, multiple warning methods such as text information displayed on the display interface may also be included, which is not limited here.

In addition to issuing the above warning message, in another embodiment, the express terminal may also drop the first express package into the express locking device. For example, the express delivery lock device may be a storage space connected to the carrier (used to place express parcels) on the express terminal. When the identity comparison is abnormal, the express terminal can control to automatically open the storage space and make the carrier The express package on the object table automatically enters the storage space and locks, so as to achieve the purpose of no longer allowing the picker to take the express package, so as to protect the express package from being taken away by fraud. In another embodiment, the express terminal may also prompt the picker to enter user verification information when the identity comparison is abnormal, for example, prompt the user to enter other identification information such as mobile phone number and ID number. In actual implementation, other handling methods when the identity comparison is abnormal may also be adopted, which is not limited in this embodiment.

In the embodiment of the present disclosure, the express terminal can perform the outbound verification of the express package by judging whether the first identity information corresponding to the picker is consistent with the recipient information of the first express package. In some other feasible implementation manners , The courier terminal can also send the collected first courier image and the first facial image to the server side, and the server recognizes the courier document information according to the first courier image, and performs the matching between the courier document information and the first facial image After verification, the verification result is returned to the express terminal. Or, in some other feasible implementation manners, the express terminal may also send one of the first express image and the first face image to the server, and the server is responsible for acquiring image information, for example, identifying the first express The express bill information in the image, or the corresponding personal identity information obtained from the first face image, the server returns the identified information to the express terminal, and the express terminal continues to verify and compare. Or, in some other feasible implementation manners, even if the express terminal sends both the first express image and the first face image to the server, the server may obtain the corresponding identity information or express receipt information according to the images, The obtained information is returned to the express terminal, and the express terminal will verify the information. Other implementation methods will not be listed. Those skilled in the art can understand that the server and the courier terminal cooperate to implement the process of verifying the delivery of the express package. There are multiple implementation methods, and the server and the express terminal respectively cooperate to perform different processing of the verification process.

The information processing method of the embodiment of the present disclosure compares the identity information corresponding to the face image of the pickup person with the recipient information of the express package, and confirms that the express package delivery verification is passed only when the two are consistent. Improved the security control of express parcels out of the warehouse, and prevent the express parcels from being falsely collected.

FIG. 3 is a schematic flowchart of another information processing method disclosed in an embodiment of the present disclosure, in which another process of receiving a courier package through an express terminal is described, and in the embodiment of the present disclosure, it is compared with the picker Whether the biological feature corresponding to the first face image has a binding relationship with the first account information included in the recipient information of the express package is used to verify the delivery of the express package. As shown in Figure 3, the method may include:

In step 301, the first face image corresponding to the person picking up the first express package is collected.

In step 302, it is determined whether the first biological feature corresponding to the first face image has a binding relationship with the first account information. The first biological feature may be obtained by performing face recognition on a first face image, and the first biological feature may include: facial features and/or iris features that can uniquely identify the user.

In some embodiments, after the first biometric feature is collected, the courier document image on the collected courier package can also be automatically detected and identified to obtain the courier document information. The courier document information may include the first One account information, in this way, the binding relationship between the first biological feature and the first account information can be determined without the user's special operation.

In some embodiments, the first account information includes at least one of the following: a mobile communication identifier; an instant communication identifier; an identity identifier. Wherein, the mobile communication identifier includes but is not limited to a mobile phone number; the instant communication identifier may include various instant messaging application accounts, such as WeChat ID, Weibo account, Fetion ID, etc.; the identity identifier includes but is not limited to The ID number of the ID card and the passport number on the passport.

In some implementations, the account database can be queried based on the express bill information of the express package to obtain the first account information corresponding to the express bill information. For example, the first account information includes but is not limited to an ID number, WeChat ID, etc. In addition, the corresponding registered face data can be queried according to the first account information. The registered face data may be the user's pre-established association relationship between his first account information and the registered face data. The data may be, for example, registered facial images and/or facial features. Then you can compare whether the first face image of the pickup person of the express package matches with the registered face data. If they match, you can confirm that the pickup person is the true recipient of the express package, and you can confirm the express package The outbound verification passed.

In other implementation manners, the account information corresponding to the biometrics may be obtained by querying the first biometrics corresponding to the first face image, and the user may pre-register the association between his own account information and the biometrics. After obtaining the account information, you can obtain the pending courier information corresponding to the account information, and determine whether the pending courier information contains the courier package currently to be taken away, that is to say, determine whether the pending courier information contains the same as the first courier The item that matches the courier document information of the image, for example, determining whether at least one courier number to be retrieved included in the courier information to be retrieved is consistent with the courier identification included in the courier document information, etc., and the embodiment of the present disclosure does not limit this .

In step 303, in the case that the first biometric feature has a binding relationship with the first account information, it is determined that the verification of the predetermined operation of the storage or the storage operation of the collection object is passed. For example, if there is a binding relationship, it can be considered that the identity feature verification of the current pickup person has passed, and it is determined that the outbound verification of the first express package has passed, and the predetermined operation can be performed. The predetermined operation may include: the delivery of the document or the delivery operation of the express package where the document is located. For example, the document is a courier document, and the courier document is usually affixed to the courier package. If the first biometric characteristic is bound to the first account information, it means that the recipient of the courier is currently picking up the goods, and the picker After passing the identity verification, it is the real picker, so you can perform the shipment operation of the express package. Performing the shipping operation of the express package may include: opening the counter of the storage cabinet where the express package is located. In other implementations, when the verification is passed, the express terminal can send out a prompt sound such as "verification passed", and then the picker can take the express package away.

In an exemplary implementation, the method further includes: outputting a verification prompt for inputting verification information when the binding relationship between the first biometric feature and the first account information is not established. Based on the inputted verification information, it is determined that the verification of the warehouse entry or exit operation of the collection object is passed, for example, the express delivery operation of the first express package may be performed based on the verification information.

In the embodiment of the present disclosure, the execution verification of the execution of the predetermined operation is performed based on the collected first image information of the pickup person and based on the pre-established binding relationship. In this way, the user does not need to input the document number, the pickup number or their own account number. Information, etc., simplify user operations.

As shown in FIG. 4, an embodiment of the present disclosure provides an information processing method, which is used to describe a process of establishing a binding relationship between biometric characteristics of a face image and account information. The method can include:

In step 401, a face image is collected. In the embodiment of the present disclosure, the collection of the face image can be implemented in the process of warehousing and/or delivery of documents or express parcels, or the face image can also be performed in the process of face registration, such as user Face registration can be performed through the display man-machine interface of the express terminal or your own mobile phone application APP, and the biological characteristics of the face image and the account information can be bound during the registration.

In step 402, the account information of the express bill is obtained.

In step 403, according to the biological characteristics corresponding to the face image and the account information, the biological characteristics and the account information are correlated to obtain an association relationship.

The biometric feature may be a biometric feature extracted from a face image, for example, the user's facial feature and/or the user's iris feature, etc. In short, the biometric feature can uniquely identify the biometric information of the user. In the embodiment of the present disclosure, the camera will be activated to collect facial images during the delivery and/or warehousing of documents or express parcels, or even during the document filling process or registration process. Obtain the biological characteristics from the collected face images, and then associate them with the account information on the express receipts of the warehouse or the warehouse to establish an association relationship. In some embodiments, the account information includes at least one of the following: mobile communication identification; instant messaging identification; identity identification.

In some implementations, during the registration process, users can establish an association between their account information and registered facial data, and the registered facial data may include, but are not limited to, facial features and/or iris features, etc. , So as to be able to obtain the corresponding registered face data according to the account information and the association relationship later, and use it for comparison with the face image of the picker. In addition, the corresponding relationship between account information and courier bill information can be stored in the account database during the registration process, so that the corresponding account information can be found according to the bill information of the courier package during subsequent verification of the delivery of the courier package.

In step 404, in the case that the number of associations between the biometric feature and the account information meets the set binding condition, the binding relationship between the biometric feature and the account information is established based on the association relationship.

Each time the steps S401 to 403 are executed, the number of associations is increased by 1; when the number of associations reaches a predetermined number, it can be considered that the number of associations meets the preset binding conditions, and it can be further considered that the user account corresponds to The biological characteristics of the legal user of is the biological characteristics; at this time, the association relationship can be formally converted into a binding relationship.

In some embodiments, the method may include: determining a confidence value of the association relationship according to the number of associations; when the confidence value reaches a preset value, converting the association relationship into a binding relationship. For example, when the association relationship is established for the first time, the confidence value is determined to be 40%; when the same association relationship is established for the second time, the confidence value is determined to be 60%; when the same association relationship is established for the third time, all The confidence value increases to 70%; and so on; the more the number of associations of an association relationship, the higher the confidence value. When the confidence value of the association relationship reaches the preset value, the relationship is directly Convert to binding relationship.

There are many ways to convert the association relationship into the binding relationship. Two alternative ways are provided as follows: adding the association relationship to the relationship table containing the binding relationship; adding the type field of the association relationship Change to the type field of the binding relationship.

As described above, when the delivery verification of the express package is performed, the first express image corresponding to the collection of the express package is detected and identified, and the express document information included in the first express image is obtained. The following will explain how to perform the identification processing of the express document information on the first express image, and perform the outbound verification based on the express document information and the face image in the foregoing embodiment after the express document information is detected. In any of the foregoing embodiments of the present disclosure, the method described below can be used in the process of obtaining express delivery document information based on the express delivery image.

FIG. 5 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure. The method can be applied to various document processing terminal devices or information systems formed by terminal devices and cloud devices, such as express delivery terminals. As shown in Figure 5, the method may include:

In step 501, the first express image corresponding to the express package within the predetermined depth of field is collected.

In the embodiment of the present disclosure, the express terminal may collect the first express image corresponding to the express package through the image acquisition module. The depth of field range of the image acquisition module may be predetermined. If the express package is located in this area, the first express package The image is clear. The upper limit of the predetermined range of depth of field is greater than a preset value, for example, 50 cm, 60 cm, etc. For example, the image acquisition module that collects the first express image may include: an industrial camera, which is pre-configured with a predetermined depth of field range, for example, within 0-50cm, if the distance between the express package and the industrial camera is less than or equal to 50cm At that time, the first express image collected is clear. In this way, it reduces the focus operation caused by the use of a camera with a small depth of field range during the acquisition process that needs to control the current depth of field distance and the distance of the image acquisition module by focusing, thereby simplifying user operations and reducing the recognition delay caused by focusing Wait. In this way, when collecting the first express image, the camera does not need to focus again, which reduces the phenomenon of insufficient clarity of the first express image due to poor focus; at the same time, it reduces the phenomenon of large collection delay caused by focusing.

In the embodiment of the present disclosure, when collecting documents, most of the entire collection area is not required to be aligned with the barcode area of the document, so the time for manual focus or auto focus can be reduced, and only a clear first image including the document needs to be collected. That's it; thereby increasing the collection rate. Moreover, when the express terminal collects the express image corresponding to the express parcel to be out of the warehouse, it is sufficient as long as the image contains the image of the express document, and it is not required that most of the entire collection area is aligned with the image area where the express document is located. The collection efficiency of express package images.

In an exemplary implementation, before collecting the first express image, the express terminal may detect whether a collection object enters a predetermined depth of field. When the express terminal detects that the first express package has entered the predetermined depth of field, the image capture function is turned on. After the image acquisition function is turned on, the express terminal may acquire the first express image corresponding to the acquisition object (for example, express package) located within the predetermined depth of field.

For example, a distance sensor may be used to collect whether the collection object has entered the predetermined depth of field. The distance sensor includes but is not limited to: infrared sensor, visible light sensor, laser sensor, etc. It is very energy consuming to keep the camera turned on, but image acquisition based on user triggers, although the execution can be performed, will introduce acquisition delay. In the embodiment of the present disclosure, a sensor whose power consumption in the on state is less than that in the on state of the image acquisition module is used to collect through distance to trigger the image acquisition module to enter the acquisition state from the off state, or enter from the sleep state In the acquisition state, image acquisition is performed, on the one hand, the power consumption of the terminal is saved, on the other hand, the acquisition of unnecessary images is reduced, and the power consumption caused by processing unnecessary images is reduced.

For the scene where the express package is stored in the pickup container, a camera with a larger predetermined depth of field can be used to collect the face image of the pickup person of the express package, so that the pickup person only needs to enter the predetermined depth of field. The camera of the express terminal will be triggered to collect face images. After the collection is completed, the verification can be completed by querying the binding relationship between the facial biometric characteristics of the pickup person and the account information of the express package described in the foregoing embodiment. For example, according to the pickup person’s face image and the information of each express package stored in the warehouse, query the location of the container where the express package that the pickup person wants to pick up (the query of the express package will be implemented in the subsequent As described in the example), when the pickup user is close to the camera of the express terminal, he can complete the verification of the delivery of the express package, and can display on the display of the express terminal that the package to be picked up is displayed on the display of the express terminal. The storage location in the container (the storage location can also be played by voice). In this way, the user walks to the express terminal to complete the verification and obtains the storage location of the express package. The user can go directly to the corresponding pickup container to pick up the package, which simplifies the user operating.

In some other implementations, it is also possible that the picker first queries the storage location of the courier he wants to pick up on the courier terminal (similarly, for related query content, refer to the description of the subsequent embodiment), and then go to the storage location to receive After receiving the express package, the picker is approaching the express terminal with the received express package. Because the camera of the express terminal has a large predetermined depth of field, it can quickly trigger the automatic collection of the face of the picker The image and the express image of the express package, and the matching verification between the two is performed according to the method of any of the foregoing embodiments. After the verification is passed, the package can be prompted by voice or other means to verify that the package is out of the warehouse, and the picker can pick it up directly Express parcels, thus speeding up the verification process when parcels are delivered.

In step 502, the target area where the express document is located is obtained from the first express image.

In some embodiments, the required target area can be determined according to the requirements for obtaining document information. For example, when the acquisition requirement is to acquire the document number, it is determined that the required target area is the imaging area of the barcode in the express document. For another example, when the acquired information is the acquired document number and other information other than the document number, it is determined that the required target area is the imaging area of the entire express document. For example, when a document is put into the warehouse, it is considered that the acquisition requirement includes document information other than the document number; for another example, when the warehoused document is out of the warehouse, it can be considered that the acquisition requirement only includes the document number. Of course, the above is only an example, and it can be specifically implemented according to the requirements for obtaining document information to meet different requirements in different scenarios.

In some embodiments, the target area may be an imaging area of the document graph formed by the entire document being collected. For example, the imaging area of the document in the first express image (that is, the document image) and the background area outside the imaging area of the document directly identify the entire first express image. However, this will cause the background area to interfere with the recognition of the imaging area of the document. Therefore, it is also possible to initially identify the imaging area of the document (that is, the document image), and then only further identify the document imaging area, which improves the recognition rate of the document. , On the other hand, reduce unnecessary interference.

In some embodiments, the document image is an imaging of the document. The documents may be various types of documents, for example, express documents, invoices, tickets, or waybills. The document has document information, and the document information includes at least one of the following: the document number of the document, for example, the courier number of the courier ticket; the ticket number of the ticket, and the invoice number of the invoice. In some embodiments, the document information further includes: related information of the document holder on the document, for example, the contact information of the holder, the address information of the holder, the issuance time information of the document, and the validity of the document. Other document information such as time information is not limited to the document number.

In other embodiments, the target area may also be the imaging area of the barcode in the receipt. At this time, the information on the bill may have been recorded in the network device, but the current user operating with the bill needs to obtain at least the bill identification corresponding to the barcode in the bill, and then the bill information of the entire bill can be obtained from the network device. The barcode includes: a one-dimensional code and/or a two-dimensional code; the two-dimensional code includes: a rectangular two-dimensional code and/or a circular two-dimensional code. In some embodiments, the barcode may be: one or more.

In some embodiments, the document is the express document corresponding to the express package. In this case, the target area where the express document is obtained from the first express image may be the area corresponding to the entire express document as the target area, or it may be Use at least part of the area where the express documents are located as the target area. For example, the express delivery document information may include at least one of recipient information and express delivery identification information of the first express package. The recognition and acquisition of the recipient information and the express identification information may include at least one of the following: the text area of the express document is determined from the first express image as the target area, wherein the text area is the Chinese of the express document The imaging area of the character, the recipient information can be obtained by recognizing the character area. Alternatively, the barcode area of the express document is determined from the first express image as the target area, wherein the barcode area is the imaging area of the barcode in the express document, and the express identification can be obtained by identifying the barcode area information. In addition, the text area of the express receipt is not limited to: numbers, letters and/or Chinese, etc. In short, the imaging area where these text are located is the text area. Therefore, the text area can also be obtained by identifying the text area. Express identification information, and the form of the barcode area includes but not limited to two-dimensional code/one-dimensional code, etc., and the express identification information can also be obtained by identifying the barcode area.

In addition, in some embodiments, the detection of the receipt information may be realized by a detection model. In order to improve the detection accuracy of the receipt information, the method further includes: deforming the target area cut out from the first express image Processing, so that the target area after deformation processing meets the image processing requirements of the detection model. The deformation processing may include at least one of the following: transforming the target area of the first shape by stretching and/or compressing to obtain the target area of the second shape, wherein the second shape may be a standard shape , And/or the first shape is a non-standard shape. Pixel up-sampling is performed on the target area lower than the preset image resolution to obtain the target area at least equal to the preset image scenic spot. The target area in the first direction is rotated and/or mirrored to obtain the target area in the second direction, for example, the target area in which the text direction is reversed is flipped to the target area with the correct text orientation. Perform inverse perspective transformation on the target area to obtain the target area with the same depth of field in each sub-area. For example, when collecting express receipts, if a certain part of the receipt is closer to the separate camera of another part, the depth of field of each part of the collected receipt may be different, and a perspective effect is shown in the first image. In the embodiment of the present disclosure, through the inverse processing of the perspective transformation, a target area with no difference in perspective effect is obtained. In this way, after the target area after the deformation process is input into the detection model, on the one hand, the detection model can quickly detect the receipt information, and on the other hand, the detection accuracy can be improved.

In some embodiments, when the barcode area of the express delivery document is identified, edge detection processing may be performed on the first express image to determine the position information of the barcode area in the first express image; For the location information of the barcode area in the express image, crop the first express image to obtain the image of the barcode area; identify the image of the barcode area to obtain the express identification information of the first express package. In addition, in other embodiments, if the cropped barcode area is inclined, after obtaining the image of the barcode area, the image of the barcode area may be corrected; the image of the corrected barcode area may be recognized to obtain the express identification information.

The edge detection involved in the embodiments of the present disclosure is a basic problem in image processing and computer vision. The purpose of the edge detection is to identify points with obvious brightness changes in a digital image. Significant changes in image attributes usually reflect important events and changes in attributes, including (i) discontinuities in depth, (ii) discontinuities in surface orientation, (iii) changes in material properties, and (iv) changes in scene lighting. Edge detection is a research field in image processing and computer vision, especially in feature extraction. Through edge detection, the barcode area in the first express image can be extracted, and through the affine transformation method, the image of the barcode area after the correction is cut to obtain the image of the barcode area after the correction, and then the OCR recognition is performed.

As above, by determining the target area from the first express image, it is equivalent to separating the target area and the background area containing the express document information. In this way, only the target area can be detected. On the one hand, unnecessary detection is reduced and the rate of obtaining receipt information is increased. On the other hand, after the target area is obtained through preliminary recognition, only the target area is detected, reducing the number of areas outside the target area. The background area interferes with the detection of document information, thereby reducing the phenomenon of low detection accuracy caused by interference, and improving the detection accuracy.

In step 503, the image of the target area is detected, and the express bill information contained in the express bill is obtained.

In some embodiments, the image of the target area can be input to the detection model, and the detection model can output the bill information by means such as feature extraction. For example, the detection model may be a machine learning model or a deep learning model. For example, the express delivery document information may include: the delivery record of the express delivery, and the delivery record includes the document information and the delivery information, and the delivery information may include: delivery time, delivery location, delivery equipment, etc. . For another example, express delivery document information may also include: delivery record of express delivery, the delivery record includes the document information and delivery information, and the delivery information may include: delivery time, delivery location, and delivery equipment And other information. For another example, when the detected object is an invoice, the recognized document information may also include: electronic inventory information of the invoice.

In an exemplary scenario, the express delivery document information may include at least one of recipient information and express delivery identification information. The process of obtaining the recipient information and the express delivery identification information may include: identifying the barcode area in the first express delivery image to obtain the express delivery identification information of the first express delivery package; performing image text recognition on the first express delivery image to obtain the first express delivery image The recipient information of the package. Performing image character recognition on the collected first express image can obtain the recipient information and express identification information of the first express package described in the first express image.

The image character recognition in the embodiments of the present disclosure can be realized based on optical character recognition. The above-mentioned optical character recognition (OCR) generally refers to an electronic device (such as a scanner or a digital camera) inspecting characters printed on paper, and detecting dark characters. The bright pattern determines its shape, and then uses character recognition to translate the shape into computer text; that is, for printed characters, optically convert the text in a paper document into a black and white dot matrix image file, and A technology that converts the text in an image into a text format through recognition software for further editing and processing by word processing software. The above-mentioned image and text recognition of the collected first express image can mainly perform OCR recognition for the information on the packaging (parcel) of the first express, and may include the identification of the express order, which includes the identification of the barcode area of the express document, to Obtain the recipient information of the first express package and the express identification information of the first express package described in the first express image. The recipient information of the aforementioned first express package may include the recipient's name, contact number, address, etc.

In some embodiments, when identifying the courier identification information in the barcode area of the courier document, the barcode area in the first courier image is cut to obtain the image of the barcode area, and the image of the barcode area is corrected to identify the corrected image. Image of barcode area. After the image of the barcode area is corrected, it further includes: verifying whether the image of the barcode area after the correction is valid; if the image of the barcode area after the correction is valid, trigger the step of identifying the image of the barcode area after the correction . Further, the verification of whether the barcode information is valid includes: judging whether the barcode length in the barcode area is equal to the length threshold; in the case that the barcode length in the barcode area is equal to the length threshold, determining the barcode area after the correction The image is valid; or, it is determined whether the barcode in the barcode area meets the barcode encoding rules; if the barcode in the barcode area meets the barcode encoding rules, it is determined that the image in the corrected barcode area is valid.

The express terminal can determine whether the barcode in the first express image is a preset length threshold, and if not, the barcode is determined to be invalid, for example, due to factors such as occlusion, angle, etc., it can output a prompt message to re-collect the image. Exemplarily, it can also be judged whether the above barcode meets the barcode encoding rules, so as to filter invalid barcode information. The foregoing barcode encoding rules may be barcode rules set according to the needs of various existing express companies, and invalid barcode filtering may be performed according to regular matching. Regular matching is a matching filtering rule based on regular expressions. Regular expression is a kind of logical formula for string manipulation. It uses some pre-defined specific characters and the combination of these specific characters to form a "rule string". This "rule string" is used to express the pair of characters. A filtering logic for strings.

Exemplarily, the express terminal may verify the above-mentioned barcode information through the express inventory management interface, that is, the above-mentioned OCR identification and/or the above-mentioned verification process may be completed through the cloud server, or may be completed locally at the express terminal, which is not done in the embodiment of the present disclosure. limit. In an embodiment, the above model may be trained based on a sample image with a relatively fixed background (the input image is a grayscale image). In the embodiments of the present disclosure, a smaller algorithm model can be used to integrate face recognition algorithms, OCR algorithms, etc., and run on low-profile open source boards. Compared with running on hosts and servers, it greatly saves equipment costs. And reduce the difficulty of deployment.

In some embodiments, if the information obtained by identifying the text area of the express document is called the first identification information, and the information obtained by identifying the barcode area of the express document is called the second identification information, it may be based on the first identification. The information and the second identification information are cross-checked, and the accuracy of the information is ensured through the cross-checking. Specifically, in the embodiment of the present disclosure, optical character recognition (OCR) may be used to recognize the text area to obtain the first identification information. For example, the first identification information is obtained by recognizing text information in the image through OCR technology or the like. In some embodiments, the text area is sent to the cloud device, and the first identification information obtained by the cloud device recognizing the text area is received. In other embodiments, the barcode area may also be sent to the cloud device, and the second identification information obtained by the cloud device identifying the barcode area may be received. Of course, in some embodiments, the terminal device may also recognize the text area and the barcode area by itself to obtain the first identification information and the second identification information.

In the case that the first identification information and the second identification information satisfy a preset matching condition, the express delivery document information contained in the express delivery document is obtained according to the first identification information and/or the second identification information. For example, when the degree of matching between the first identification information and the second identification information reaches a preset matching degree value, it is considered that the first identification information and the second identification information satisfy the preset matching condition. For example, the document number in the first identification information and the second document number in the second identification information are compared one by one to count the number of matches; according to the number of matches and the total number of characters, The degree of matching is determined. For example, when the matching degree reaches 90% or more than 95%, it is determined that the matching degree between the first identification information and the second identification information reaches the preset matching degree value.

When the first identification information and the second identification information completely match, the express delivery document information of the express delivery document is determined according to the first identification information or the second identification information. When the first identification information and the second identification information do not completely match, the express delivery bill information is determined according to the identification status information of the first identification information and the second identification information. For example, if the document number contains a certain number of characters, or the encoding of the document number satisfies certain rules, if one of the first identification information and the second identification information has fewer or more characters, etc. When one of the matching rules of the document number is used, the express document information is determined according to the other. In some other embodiments, it is determined whether to determine the express receipt information based on the first identification information or the second identification information according to the status information of the text area and the barcode area. For example, by comparing the clarity of the text area and the barcode area, the one with higher clarity is determined; according to the identification information corresponding to the one with higher clarity, the express receipt information is finally obtained.

In some embodiments, the method further includes: when the first identification information and the second identification information do not meet a preset matching condition, outputting prompt information to be collected again. If the match between the first identification information and the second identification information does not meet the preset matching conditions, a prompt message will be output, which will trigger a re-collection. In this way, it can be reduced automatically when accurate express receipt information cannot be obtained due to one collection. Trigger another collection to obtain accurate express information.

After the express delivery document information is identified, the delivery verification of the express parcel can be performed based on the express delivery document information and the first face image of the pickup person of the express parcel. For details, please refer to the foregoing embodiment.

6 is a schematic flowchart of an information processing method disclosed in an embodiment of the present disclosure. When the method in the embodiment of the present disclosure is applied to a courier terminal, the courier terminal may include, but is not limited to, a first camera, a transceiver, and a display screen. . This method describes the process of express inquiry. For example, the pickup person can check whether he has an express package to be picked up through the express terminal. As shown in Fig. 6, the information processing method includes the following steps. Wherein, for the content that has been described in any of the foregoing embodiments, the embodiments of the present disclosure will not be described in detail, and reference may be made to the foregoing embodiments in combination.

In step 601, a second face image is collected.

In the embodiment of the present disclosure, the express terminal may include a face recognition system, which may collect images periodically, for example, may collect a second face image corresponding to a user who comes to inquire about express packages.

In step 602, the second face image is sent to the server through the transceiver; the first face image is used to instruct the server to find the second identity information that matches the second face image.

In step 603, the to-be-taken express delivery information determined by the server based on the second identity information is received through the transceiver.

Wherein, the courier information to be fetched that is determined by the server and matches the second identity information may include: storage location information of the courier package. For example, the foregoing storage location information may be used to indicate the shelf information of the warehouse where the foregoing express package is located, so as to quickly find the express storage location. In an embodiment, the identity information of the user to which the express package belongs can be bound when generating the storage location information of the express package, and the courier package to be received can be found through the above identity information, and the storage location of the express package can be determined.

In an embodiment, the above-mentioned second identity information may be a target mobile phone number, and the server may query the express delivery information bound to the target mobile phone number. The aforementioned express delivery information to be picked up may include express delivery information that the user has not picked up. After determining the above-mentioned target mobile phone number, the server can query the pickup express information associated with the target mobile phone number, and then obtain the storage location information of the express package. After obtaining the storage location information of the express package matching the second identity information, the server may send the foregoing storage location information to the express terminal.

In step 604, the pending delivery information is displayed on the display screen.

Wherein, the aforementioned storage location information may include at least one of the following information: warehouse identification information, shelf identification information, identification information of storage compartments in the shelf, and express delivery identification information.

The aforementioned warehouse identification information can be used to indicate the warehouse where the express is stored, the aforementioned shelf identification information can be used to indicate the shelf for express storage, the identification information of the storage compartment in the aforementioned shelf can be used to indicate the storage compartment for express storage, and the aforementioned express delivery identification information can include but It is not limited to the information used to identify the courier, such as the express number and the express barcode.

The courier terminal can receive the storage location information through the transceiver, and then display the storage location information on the display of the courier terminal to indicate to the user the courier and its storage location, so that the courier can be found quickly. Carry out outbound or pickup.

With the embodiment of the present disclosure, after obtaining the storage location information, the user can go to the corresponding storage location to pick up the courier without requiring staff to go to the warehouse to find the courier. On the one hand, it can quickly find and locate the courier storage location, on the other hand. Save labor costs and improve processing efficiency in the express delivery process. Moreover, since the storage location information is information obtained after the user's identity verification is passed, the identity verification during the user's delivery process can also be implemented, which increases the security of express delivery management.

Fig. 7 shows a schematic flow chart of an express inquiry method. As shown in Fig. 7, the express terminal can interact with a server and a third-party service server. The express inquiry method may include the following steps:

In step 701, the express terminal detects an image change through the first camera. That is, the first camera may periodically obtain images to detect whether a user, a face, etc. appear in the scene.

In step 702, a face image is obtained and sent to module 1 of the server. Specifically, the acquired face image may be sent to the server, and the module 1 may be a business service module for face image processing, and specifically may be a face recognition software program. In some embodiments, module 1 is a collection of development tools used by software engineers to build application software for specific software packages, software frameworks, hardware platforms, operating systems, and the like. That is, a toolkit provided by a third-party service provider to realize a certain function of a software product.

In step 703, according to the face image group returned by the server, the most likely face image is filtered and selected. Module 1 can provide a face recognition function, query and return a face image group that meets the similarity requirements (the similarity exceeds a preset threshold), and the express terminal can determine a face image as a face recognition result.

In step 704, the face image is sent to module 2 of the server, and module 2 matches the mobile phone number bound to the face. As mentioned above, the stored face image has a binding relationship with the mobile phone number. Module 2 can provide a cloud business service for querying identity information in the server. The server can determine the user’s target mobile phone number through the cloud business service and feed it back to Express terminal.

In step 705, query and obtain the pending express list of the mobile phone number through the third-party service server. The express terminal may send a query instruction containing the target mobile phone number to a third-party service server (such as a third-party inventory management system server), and the third-party service server may obtain a pending express list of the target mobile phone number and feed it back to the express terminal.

In one embodiment, multiple express terminals can be deployed in multiple regions. After the facial data is uploaded to the cloud platform, it can be distinguished by device number, etc., to achieve the smallest possible range of facial feature matching, improve matching speed, Reduce the false recognition rate. Exemplarily, the above-mentioned binding relationship between the face template image and the identity information can be lifted or changed as required. The above device number can default to the collected courier terminal machine number. If not, one can be generated when the courier terminal runs the application for the first time to ensure the uniqueness of the device number.

Exemplarily, other user terminal devices may also communicate with the above-mentioned express terminal via the network. The specific method may be that the user can interact with the above-mentioned express terminal through an application (APP) installed on the terminal device (such as a mobile phone) .

Usually, for express delivery, only the delivery of the express delivery can be recorded, and the identity of the express pickup person cannot be verified, and the specific information of the express pickup person cannot be recorded. And now there are many express delivery points storefronts all over the country, including express delivery points that are sent and received through the store. Due to the large number of express delivery, the staff workload is large, and the store clerk responsible for express delivery has other tasks. There is often no time to carefully check whether the pickup person and the courier's recipient information match, nor can the pickup person’s information be recorded. The embodiment of the present disclosure can separately collect the face image and the image of the express package through two cameras, and verify the identity of the picker. In the express delivery scene, the express delivery information can be recorded for easy query, and abnormalities can also be realized in the pickup scene. Remind the clerk at time and recorded the information of the person who picked it up to reduce fraudulent claims.

Exemplarily, for the express picker in the pick-up or out-of-warehouse scene, if there is no corresponding face image information, prompt information indicating that the personal registration information is missing can be output, such as when the user manually enters the mobile phone number, etc. When the identity information is inquired by express delivery, for a user who has not been registered, the user may be prompted to collect face and bind face image information with identity information. For details, please refer to the relevant description of the embodiment described in FIG. 8.

Specifically, the binding of the face and the identity information can also be completed through the aforementioned express terminal. For the express recipient in the pickup or delivery scene, if there is no corresponding facial feature information, a prompt message indicating the lack of personal registration information can be output, for example, when the user manually enters personal information such as mobile phone number for express delivery When inquiring, for a user who has not registered, the user can be prompted to collect face and bind face feature information with identity information.

That is, in an embodiment, the method further includes: receiving a query instruction containing third identity information; in response to the query instruction, obtaining a face template image corresponding to the third identity information; In the case of face template image information corresponding to the information, a third face image is collected through the first camera; the third identity information and the corresponding third face image are sent to the server through the transceiver.

The user can make a manual query on the courier terminal. The user can input the third identity information to trigger the above query instruction, and the courier terminal can obtain the face template image corresponding to the third identity information. As described above, the exemplary The aforementioned obtaining of the face template image corresponding to the aforementioned third identity information can be executed in the courier terminal or the cloud server, and will not be repeated here. If the face template image corresponding to the third identity information is not found, that is, the user has not registered the face information, the express terminal may collect the third face image of the user through the first camera. Further, the third identity information and the corresponding third face image may be sent to the server through the transceiver, and the server may store the information to complete the user information registration. After that, the user can complete functions such as express inquiry and pickup through face recognition. Specifically, the courier terminal may receive information input by the user to make a query. For example, the user may input the aforementioned third identity information at the courier terminal to query whether there is a courier to be picked up.

The express terminal can query the corresponding bound express information through the mobile phone number entered by the user, and display it to the user. Specifically, reference may be made to the schematic flow chart of the method for binding a face and a mobile phone number shown in FIG. 8. The method may include the following steps, wherein the following steps have been described in the previous embodiment and will not be repeated here:

In step 801, the first camera detects an image change.

In step 802, a face image is acquired and sent. The server can realize face recognition by module 3.

In step 803, according to the returned face group, filter and select the most probable face.

In step 804, the mobile phone number is bound to the module 4 of the face picture sending server. As mentioned above, the stored face pictures have a corresponding relationship with the mobile phone number, and the user's target mobile phone number can be determined through the cloud service of the module 4.

In step 805, the binding information is sent to the third-party service server. The courier terminal can send the above-mentioned binding information to a third-party service server (such as a courier management system), and the third-party service server can store the binding information of the user, and then the user can pick up the package through the aforementioned methods (including face recognition) ,Inquire.

This scenario is suitable for the user to enter the mobile phone number for manual query, and if the corresponding express order is found, the binding interface can be called to perform face binding.

In an implementation manner, the express terminal in the embodiment of the present disclosure may also be applied to information registration in the express delivery storage scenario. The method includes the following steps: collecting the express image of the express package through the camera of the express terminal, and obtaining the recipient information of the express package and the express identification information of the express package described in the express image; The courier warehousing information of the person information and the courier identification information; the above-mentioned express warehousing information is sent to the third-party management system for storage registration. .

Specifically, the aforementioned express image may be understood to include an image of a courier package, such as an image collected within a camera range when the courier is in storage, such as an image collected when a worker carries the courier when the courier is in storage. The above-mentioned express terminal includes a camera for collecting express images, that is, the staff can hold the express station in the image collection area of the express terminal, and the express terminal can collect and recognize express images through the camera.

For the method of extracting the above image information, reference may be made to the description of any of the foregoing embodiments, and details are not described herein again.

Exemplarily, the face recognition described above can also be combined to determine or register the identity of the staff responsible for the courier warehousing, and the facial image acquisition and identity verification can also be performed through the camera. The courier warehousing information can include the staff’s identity. Face image. Further, through face recognition, you can also inquire about the inbound express information that different staff are responsible for. The process is similar to express pickup inquiry, so I won't repeat it here. Through the above scheme, the express delivery can be more standardized and safer and easier to inquire.

FIG. 9 is a schematic flowchart of an express delivery storage method disclosed in an embodiment of the present disclosure. The execution subject in the embodiment of the present disclosure may be the aforementioned express terminal, which can interact with the server and the third-party service server. As shown in Figure 9, the method may include:

In step 901, the second camera detects an image change; sends camera frame data. For details, please refer to the description of any one of the foregoing embodiments. The second camera is different from the first camera for face recognition, and may be an industrial camera camera to obtain black and white images, which is convenient for barcode recognition. The above-mentioned camera frame data is the collected express image, which can be sent to the module 5 in the figure (such as the express order picture clipping SDK) for processing.

In step 902, through the image processing service provided by the module 5, the barcode area can be cropped and the image can be corrected, and then returned to the express terminal.

In step 903, the forwarded courier note is sent. After the conversion, the converted express order can be sent to the server, and the server can use module 6, such as a cloud service with express order identification function, to perform the cloud identification of the express order and obtain the information of the converted express order.

In step 904, the mobile phone number, barcode, other OCR information, etc. are returned to the express terminal.

In step 905, storage (express number, recipient's mobile phone number). The express terminal sends the storage information including the above-mentioned express number and the recipient's mobile phone number to a third-party service server (such as a third-party inventory management system server), and the third-party service server can register, so as to facilitate accurate and safe inventory management.

The express terminal can also carry out advertisement recommendations. In one embodiment, the express terminal may also: obtain a target feature tag matching the first face image of the pickup person from the server, and at least one target recommendation information corresponding to the target feature tag; The above-mentioned at least one target recommendation information is displayed on the display screen.

In an embodiment, the express terminal may obtain a target feature tag matching the first facial image of the pickup person from the server, and the server may store a plurality of feature tags for describing facial feature attributes. Exemplarily, the face feature information of the first face image can be obtained through the trained neural network model, that is, the face feature is extracted, and the target feature tag that matches the first face image is determined, so as to realize the directional information recommendation .

Facial features are more accurately extracted and analyzed through face recognition to determine the user's feature label. For example, the feature label may include user attributes (such as gender, age, race, etc.) and user behavior (smiling, calm, etc.). By determining one or more target feature tags corresponding to the first face image information, at least one piece of corresponding recommendation information can be obtained for display, so as to implement targeted recommendation to users, that is, to recommend advertisements that meet their identity and status.

In an embodiment, a variety of feature tags and the mapping relationship between the feature tags and the recommendation information can be preset, and at least one target recommendation information can be determined through the target feature tags. The foregoing target information recommendation may be performed in a scenario where the user queries express delivery or express pickup. For example, the foregoing target recommendation information may be displayed while the express terminal displays storage location information for the user.

Exemplarily, the characteristic tags of the user can also be determined by recognizing the user's wear, so as to recommend corresponding advertisements, such as clothing of similar style, which is not limited here.

The above information recommendation can be implemented based on cloud services (such as advertising Software Development Kit). Exemplarily, the existing delivery application can be used to achieve advertisement pull, and finally the corresponding advertisement is displayed on the express terminal.

The above method can quickly track and capture the facial features of the express pickup person under the premise of a general-purpose common camera, and realize the directional information recommendation to the user by obtaining accurate feature tags.

In another embodiment, according to the facial information, the multimedia information corresponding to the user portrait corresponding to the facial information is output. One or more kinds of information that can identify the user's identity can be extracted from the face information. In the embodiment of the present disclosure, the user portrait of the user who is currently processing the receipt can be obtained according to the face information. The user portrait may be used to indicate at least one of the following information: the user's preferences; the user's dislikes; the user's consumption needs; the user's consumption habits; the user's ability to pay; the user's aesthetic ability, etc.

In the embodiment of the present disclosure, the multimedia information is output according to the user portrait. The terminal device may have waiting time such as information entry in the process of document entry or exit, during which time multimedia information suitable for the user portrait can be output, which can improve user experience. The multimedia information includes various promotion information, for example, advertisements of goods and/or services.

The embodiment of the present disclosure also provides an information processing method, which is applied in a server. FIG. 10 shows a schematic flowchart of another information processing method. As shown in FIG. 10, the above method includes:

1001. Receive a second face image sent by an express terminal;

1002. Search for second identity information matching the second face image;

1003. Determine the storage location information of the courier that matches the second identity information; send the storage location information to the courier terminal, and the storage location information is used to indicate the location information of the courier.

In an embodiment, the aforementioned storage location information includes at least one of the following information: warehouse identification information, shelf identification information, identification information of storage compartments in the shelf, and express delivery identification information.

For the specific process of the information processing method executed on the server side, reference may be made to the server-related description in the foregoing embodiment, and the description is not repeated here.

The foregoing mainly introduces the solutions of the embodiments of the present disclosure from the perspective of the execution process on the method side. It can be understood that, in order to realize the above-mentioned functions, the information processing apparatus includes hardware structures and/or software modules corresponding to each function. Those skilled in the art should be aware that, in combination with the units and algorithm steps of the examples described in the embodiments disclosed herein, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of the present disclosure.

The embodiments of the present disclosure may divide the information processing apparatus into functional units according to the foregoing method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit. It should be noted that the division of units in the embodiments of the present disclosure is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.

Two specific examples are provided below in conjunction with any of the foregoing embodiments:

Example 1: This example provides an information processing method. This solution is mainly based on express OCR recognition and extracts all text information on the express delivery note. Among them, the identification of the express order number uses both text OCR recognition and bar code recognition, and a cross-checking method is used to ensure high accuracy in this complex scene.

At the same time, verification is carried out by means of face recognition and courier note recognition to ensure the correct and efficient delivery of couriers.

Courier tracking number identification: The use of express tracking number in this scenario is mainly completed by the following steps:

First, the advertising machine (Android) detects the express order, takes a picture and cuts out the part of the express order; the advertising machine returns the part of the express order to the cloud, and the cloud server performs OCR detection, and the barcode area and the express order The number area is detected, and barcode recognition and OCR recognition are used respectively. Obtain one identification information for the barcode; at the same time, obtain another identification information based on OCR identification; through the cross comparison of these two identification information, the cross comparison result of this express tracking number will be obtained.

The cloud then cross-checks the two results to get a high-confidence result; if the comparison results are inconsistent, the confidence is low, and you can re-detect, take pictures and identify.

Face recognition verification: When the express delivery is out of the warehouse, the user scans the express order to identify the tracking number and mobile phone number, and the all-in-one machine recognizes the user's face at the same time, and associates the user according to the previously completed face and mobile phone number binding relationship The account number (ie mobile phone number) is compared with the mobile phone number of the recipient of the express face bill. If the comparison is correct, the verification is passed. This method can greatly improve the efficiency of express delivery. The traditional method is to manually sign and tear off the bottom sheet, which takes about 15 to 30 seconds. The self-service delivery method only takes 1 to 2 seconds, which greatly improves the processing efficiency.

Example 2: This example provides a method for non-sense binding between mobile phone number and face, which can specifically include:

Since there is no association between the user's face and the phone number in the initial stage, a set of association mechanism is needed. This product adopts a non-sense binding method. Because the user's delivery of express delivery is greatly related to his identity, the relationship between the user's face and mobile phone number can be gradually enhanced by tracking the user's delivery behavior; , User A receives a courier (mobile phone number is A), assuming the association relationship is 60%, if next time A receives a courier with mobile phone number A again, it can increase to 90%, if it happens again, it can be considered 99 %. This parameter is a hypothetical parameter, which is actually a big data predicted value. Then we set a threshold as the threshold of the association relationship (corresponding to the aforementioned preset value), and then the binding relationship between the user's face and the mobile phone number can be completed.

After obtaining the user's facial feature information and other identifying user identity information, the user's portrait can be obtained according to the user's identity, thereby realizing the targeted placement of target recommendation information.

FIG. 11 shows a schematic flowchart of an express delivery method in an exemplary embodiment. The method may be executed by any device, for example, may be executed by an express terminal, or may be executed by a server. As shown in FIG. 11, the method may include the following processing, wherein the execution order between the steps is not limited in specific implementation, and the processing that has been described in any of the previous embodiments will not be described in detail:

In step 1101, an express image of the express package collected by at least one camera of the terminal device is acquired, where the express image is used to acquire the express document information of the express package.

For example, the terminal device in the embodiment of the present disclosure may include, but is not limited to, a courier terminal. The terminal device can collect the courier image and the first face image through the same camera, or it can collect the courier image and the first person through different cameras. Face image. The express package may be a package to be out of the warehouse, and the express document information includes but is limited to at least one of the recipient information of the express package and the express identification information.

In step 1102, a first face image collected by the at least one camera is acquired. For example, the first facial image may be the facial image of the person who picked up the parcel.

In step 1103, based on the express image and the first face image, perform the delivery operation of the express package.

For example, when the delivery operation of express parcels is performed based on the express image and the first face image, the execution of the operation can be performed by judging whether the first facial image matches the express document information obtained from the express image. Delivery operations of express parcels.

This method can be applied to a terminal device. The terminal device can collect the first face image and the express image through a camera, and perform the delivery operation of the express package based on the express image and the first face image. For example, the terminal device can verify the express image and the first face image, obtain the verification result, and perform the outbound operation of the express package based on this. For another example, the terminal device may send a request to the server to check out the warehouse, and the server will check the check result based on the request, and return the check result to the terminal device. The terminal device may check the express package based on the check result. Outbound operation. The delivery request may include the first facial image and the express image, or the terminal device processes the first facial image and the express image, for example, one or more of feature extraction, document detection, text recognition, barcode recognition, etc. Item, and send the library out request included in the processed result to the server, which is not limited in the embodiment of the present disclosure.

The method can be applied to a server, and the server can receive a warehouse-out request sent by a terminal device. The warehouse-out request includes the first face image and the express image, and the first facial image and the express image are verified to obtain the verification result , And determine the outbound operation of the express package based on this, or the server may return an instruction for the outbound operation of the express package to the terminal device, so that the terminal device performs the outbound operation of the express package.

When judging whether the first face image matches the express receipt information obtained from the express image, the account database can be queried based on the express receipt information to obtain the first account information; by judging the first face image Whether the registered face data corresponding to the first account information matches, it is determined whether the express package passes through the warehouse. For example, the first account information may include, but is not limited to, mobile phone number, ID number and other information. The registered face data corresponding to the first account information may be obtained based on the binding relationship between the user's pre-bound account information and the face data. If the first face image matches the registered face data, it can be shipped out after the verification is passed. Among them, the above-mentioned registered face data can be information that uniquely identifies a person's identity, such as facial features/iris features, etc. The registered face data can be compared with the person's face image to determine whether the person who picked up is genuine Recipient.

In other embodiments, when determining whether the first face image matches the express receipt information obtained from the express image, it may also be based on the first face image to query the face database to obtain the The person identity information of the first face image; by judging whether the face identity information is consistent with the recipient information included in the courier receipt information, and/or by judging whether the face identity information corresponds to waiting Whether the express delivery information is consistent with the express delivery identification information included in the express delivery document information, it is determined whether the express package passes through the warehouse.

For example, the facial identity information can be a mobile phone number, which is to obtain the mobile phone number of the pickup person based on the face image of the pickup person, and check whether the mobile phone number is consistent with the recipient's mobile phone number written in the express receipt on the express package. Or, find the corresponding mobile phone number based on the person's face image, and then find the corresponding courier to be picked up based on the mobile phone number, and check whether the courier to be picked up is consistent with the courier logo on the courier package currently to be taken . If the above comparisons are consistent, the verification is confirmed and the express package can be passed out of the warehouse. In addition, the above-mentioned comparison method based on whether the courier information to be retrieved corresponding to the facial identity information is consistent with the courier identification information realizes the express delivery out of the warehouse, so that text recognition is not required, so that the recipient information of the express is not the real name. The download can also be successfully released.

In some embodiments, in the case that the first face image matches the express document information obtained from the express package image, it is determined that the express package passes through the warehouse; and the status of the express package can be checked Update to the state of being shipped out. Of course, whether to change the outbound status can be an optional operation.

In some embodiments, in a case where the first face image does not match the obtained express delivery document information, it is determined that the express package is abnormally shipped out of the warehouse. When the warehouse is abnormal, warning information (for example, voice prompt) can be output, or the express package can be put into the express locking device, or the user verification information can be prompted to input. For example, the picker can place the courier package to be taken on the shelf of the courier terminal. If the verification face image does not match the courier document information, the courier locking device on the courier terminal can be opened, such as the courier locking device It can be a storage space connected to the supporting platform, and the storage space can be automatically opened, so that the express package enters the storage space automatically, thereby protecting the express package from being taken away by fraud.

In some embodiments, document identification processing is performed on at least a part of the express image to obtain the express document information, wherein the express document information includes at least one of the recipient information of the express package and the express identification information One kind. Based on the courier document information and the first face image, perform an outbound operation of the courier package. For example, barcode recognition processing may be performed on the barcode area of the express image to obtain the express delivery identification information; and/or text recognition processing may be performed on the text area of the express image to obtain the recipient information and the At least one of express delivery identification information.

Performing document identification processing on at least a part of the express image to obtain the express document information may include: performing edge detection processing on at least a part of the express image to obtain position information of the barcode area; At least a part of the barcode area is cropped to obtain the image of the barcode area; the image of the barcode area is recognized to obtain the express delivery identification information.

Before the identifying the image of the barcode area, the method further includes: verifying whether the image of the barcode area is valid by comparing at least one of the barcode length and the barcode content contained in the image of the barcode area; Recognizing the image of the barcode area includes: when it is determined that the image of the barcode area is valid, recognizing the image of the barcode area.

For example, by comparing the length of the barcode contained in the image of the barcode area with a length threshold, it is verified whether the image of the barcode area is valid. Alternatively, it is verified whether the image of the barcode area is valid by determining whether the barcode in the image of the barcode area meets the barcode encoding rule. For specific judgment rules, refer to the foregoing embodiment.

The performing document identification processing on at least a part of the express image to obtain the express document information includes: performing express document detection on the express image to obtain position information of the express document in the express image; based on the The location information of the express document is obtained from the express image including at least a part of the target area image of the express document; the target area image is recognized to obtain the express document information.

The express delivery identification information includes: first express delivery identification information obtained by performing text recognition processing on at least a part of the express delivery image, and second express delivery identification information obtained by performing barcode recognition processing on at least a part of the express delivery image; The execution of the outbound operation of the express package based on the express delivery document information and the first face image includes: determining whether the first express delivery identification information and the second express delivery identification information match; In the case where the first express delivery identification information and the second express delivery identification information match, based on the first express delivery identification information or the first identification information and the first face image, perform a check on the express package Outbound operation. For the matching comparison between the first express identification information and the second express identification here, please refer to the matching comparison between the first identification information and the second identification information in the foregoing embodiment for details, which will not be described in detail.

The performing the outbound operation of the express package based on the express delivery receipt information and the first face image includes: querying an account database based on the express delivery receipt information to obtain first account information; Whether the first face image matches the registered face data corresponding to the first account information, it is determined whether the express package passes through the warehouse.

The performing an outbound operation of the express package based on the express receipt information and the first face image includes: querying a face database based on the first face image to obtain the first face image The facial identity information of the image; by judging whether the facial identity information is consistent with the recipient information included in the courier receipt information, and/or by judging whether the courier information to be fetched corresponding to the facial identity information is consistent with Whether the express delivery identification information included in the express delivery bill information is consistent, it is determined whether the express package passes through the warehouse.

When the method is applied to a server, the acquiring the express image and the first face image included in the express collected by at least one camera of the terminal device includes: receiving the express delivery request message sent by the terminal device, and the express delivery The library request message includes at least one of the express image and the first face image. For example, this scenario can be that the picker puts the courier package to be taken on the courier terminal. The courier terminal can collect the courier image of the courier package and the first face image of the picker. The courier terminal can Both images are sent to the server by express delivery request message, and the server extracts the express document information in the express image, and performs matching verification between the first face image and the express document information; or, the express terminal will express The image is sent to the server, and the server returns the courier document information recognized by the courier terminal, and the courier terminal performs matching verification between the first face image and the courier document information. Or, it can also be that the courier terminal sends the first face image to the server, and the server returns the identity information of the pickup person identified by the courier terminal, and the courier terminal itself based on the identity information and the courier identified in the courier image Document information is compared. The actual implementation is not limited to the above-mentioned examples, and there are other ways. In short, the express terminal can send at least one of the collected express image and the first face image to the server, and the server assists in image recognition or Match checking and other processing.

The method further includes: in response to receiving a courier query request, obtaining a second face image collected by the at least one camera; based on the second facial image, obtaining information about the storage location of the courier to be taken by the user; The storage location information is displayed on the display screen of the terminal device.

For example, when the method is executed by the courier terminal, the courier terminal can receive the courier query request and collect the second face image of the picker. Among them, the storage location information of the courier to be picked up by the user is obtained. The face image is sent to the server, and the storage location information returned by the server is received. When the method is executed by the server, the express terminal may forward the express inquiry request to the server after receiving the express inquiry request of the pickup person, and also send the collected second face image to the server, and the server obtains the storage The location information is then sent to the courier terminal, and the courier terminal side displays the storage location information.

The method further includes: obtaining a target feature tag matching the first face image, and obtaining at least one target recommendation information corresponding to the target feature tag; and displaying the at least one target feature tag on the display screen of the terminal device Target recommendation information.

When the method is applied to a terminal device, the executing the delivery operation of the express package based on the express image and the first facial image includes: sending the first facial data and express data to a server, So that the server determines whether the first face image matches the express image, wherein the first face data includes the first face image and/or the features of the first face image Information, the courier data includes at least a part of the courier image and/or the courier document information obtained from the courier image; receiving instruction information sent by the server, wherein the instruction information is used to indicate Whether the express parcel passes out of the warehouse.

That is to say, in this case, the server performs outbound verification, that is, the server performs matching verification between the express receipt information and the first facial image. The express image and the first face image are both collected by the express terminal. In specific implementation, the express terminal can directly send the first face image to the server, or send the first face image through feature extraction. The face feature data, or the first face image and face feature data can be sent. The express delivery data may be at least a part of the express image corresponding to the express package, or at least a part of the express image and/or express document information. The express document information may be express identification information obtained by identifying the barcode area, or through Perform text detection in the text area to obtain recipient information.

In some embodiments, the express terminal or server may also send an express delivery notification message to the express management system after the express package is delivered, where the express delivery notification message includes the information of the express package and the first face image Wherein, the information of the express package may include at least a part of the express image corresponding to the express package and/or the express document information, so that the express management system performs the outbound record.

The express delivery method of the embodiments of the present disclosure can be executed by a terminal device or a server, and the processing described in the foregoing embodiments of the information processing method can be flexibly executed on the terminal device side or on the server side. The disclosed embodiments do not limit the specific execution device of the method, as long as the terminal device and the server cooperate to realize the outbound control of the express package. For example, the processing related to the detection and identification of the courier document information in the courier image can be executed on the terminal device, on the server side, or by the two in cooperation. For another example, the recognition processing of the face image, or the matching verification based on the face image and the express receipt information, can also be performed on any device.

The express delivery method of the embodiment of the present disclosure performs the delivery control of the express package by verifying the express image of the express package and the face image of the picker, so that the identity of the picker can be verified. Verify whether the picker is the real recipient of the express package, so that the express package is safer from the warehouse.

FIG. 12 shows a schematic flow chart of an express delivery method in an exemplary embodiment. The method may be executed by a server. As shown in FIG. 12, the method may include:

In step 1201, an express delivery request message sent by a terminal device is received. The express delivery request message includes: first facial data and express data, wherein the first facial data includes data collected by the terminal device. The first face image of the pickup person and/or the characteristic information of the first face image, the express delivery data includes at least a part of the express image of the express package and/or the express receipt obtained from the express image information.

In step 1202, based on the first face data and courier data, the delivery check of the courier package is performed.

In step 1203, an express delivery response indicating whether the delivery check is passed is sent to the terminal device.

Wherein, in step 1202, based on the first facial data and the express data, performing the outbound verification of the express package may include: judging based on the first facial data that the corresponding facial identity information corresponds to the express data Whether the recipient information included in the courier document information is consistent, and/or the courier package is determined by determining whether the courier information to be retrieved corresponding to the facial identity information is consistent with the courier identification information included in the courier document information Whether it is out of the library. Alternatively, it may also be determined whether the express package is out of the warehouse by determining whether the first facial image matches the registered facial data corresponding to the first account information obtained from the express data. For specific processing, please refer to any embodiment of the present disclosure.

In some embodiments, when the express delivery data received by the server is at least a part of the express delivery image, the express delivery document detection can also be performed on the express delivery image to obtain the location information of the express delivery document in the express delivery image. Based on the location information of the express document, a target area image containing at least a part of the express document is obtained from the express image, and the target area image is recognized to obtain express document information.

In addition, the server can also perform the processing of obtaining corresponding personal identity information based on the first face image. When detecting and identifying express bill information, it can also perform the detection of the text area, the detection of the barcode area, and the validity judgment of the barcode area. , The conversion of barcode graphics and other processing, for details, please refer to any embodiment of the present disclosure.

The express delivery method of the embodiment of the present disclosure performs the delivery control of the express package by verifying the express data of the express package and the face data of the picker, so that the identity of the picker can be verified. Verify whether the picker is the real recipient of the express package, so that the express package is safer from the warehouse.

As shown in FIG. 13, an embodiment of the present disclosure provides an electronic device that includes a processor 1301 and a memory 1302. The electronic device 1300 may also include a bus 1303, and the processor 1301 and the memory 1302 may communicate with each other through the bus 1303. For connection, the bus 1303 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus 1303 can be divided into an address bus, a data bus, a control bus, and so on. For ease of presentation, only one thick line is used in FIG. 13, but it does not mean that there is only one bus or one type of bus. The electronic device 1300 may further include an input/output device 1304, and the input/output device 1304 may include a display screen, such as a liquid crystal display screen. The memory 1302 is used to store one or more programs containing instructions; the processor 1301 is used to call the instructions stored in the memory 1302 to execute some or all of the method steps mentioned in any embodiment of the present disclosure.

For example, the memory may be various types of memory, such as random access memory, read-only memory, flash memory, etc. The memory can be used for information storage, for example, storing computer executable instructions and the like. The computer-executable instructions may be various program instructions, for example, target program instructions and/or source program instructions.

The processor may be various types of processors, for example, a central processing unit, a microprocessor, a digital signal processor, a programmable array, a digital signal processor, an application specific integrated circuit, or an image processor.

The processor may be connected to the memory through a bus. The bus may be an integrated circuit bus or the like.

In some embodiments, the electronic device may further include: a communication interface, and the communication interface may include: a network interface, for example, a local area network interface, a transceiver antenna, and the like. The communication interface is also connected to the processor and can be used for information transmission and reception.

In some embodiments, the electronic device further includes a human-computer interaction interface. For example, the human-computer interaction interface may include various input and output devices, such as a keyboard, a touch screen, and the like.

In a possible implementation manner, the above electronic device is implemented to collect a second face image through a camera; the second face image is sent to the server through a transceiver; the second face image is used to instruct the server to find the The second identity information matched by the second face image, and the storage location information of the express package matching the second identity information is determined; the storage location information is received through the transceiver; wherein the storage location information is used to indicate the express package The shelf information of the warehouse; the above storage location information is displayed on the display screen.

In another possible implementation manner, implementing the above electronic device can receive the second face image sent by the express terminal; search for the second identity information that matches the second face image; determine the express delivery that matches the second identity information The storage location information of the package; sending the storage location information to the express terminal, and the storage location information is used to indicate the shelf information of the warehouse where the express package is located.

In another possible implementation manner, the above-mentioned electronic device may be a terminal device (for example, an express terminal) shown in FIG. 14. The terminal equipment includes: a top camera, which can scan the courier package placed in the placement area to obtain the first courier image, or scan the courier document on the package to obtain the courier document image; the terminal device also includes: face recognition The camera can collect face images and extract biological characteristics. The terminal device may also include a human-computer interaction interface such as a touch display screen for receiving user operations and processing based on user operations. The touch display screen can be used for man-machine interactive operations of express parcel storage or storage.

In some embodiments, the device shown in FIG. 14 is a network terminal connected to the network; that is, the terminal device has a communication module. After the communication device discovers that the package carrying documents such as the courier is distributed to the terminal device, the terminal device will automatically scan the document information on the courier note during the parcel storage process. After obtaining the account information in the bill information, the user terminal that has a binding relationship established between the account information and the account information sends pickup information. The pickup information can remind the user to pick up the goods. The pick-up information includes at least: pick-up address. In some embodiments, the pick-up information may further include: pick-up voucher and so on.

If the user does not have time to pick up the goods himself, he can ask someone to help pick up the goods. At this time, the face image does not need to be picked up automatically, so the user who picks up the goods for others can pick up the goods with the pick-up voucher. In this way, a document warehousing staff such as a courier can place the document in the placement area for scanning, and then can simply complete the document warehousing, without manually editing a message to notify the corresponding customer to pick up the goods. In some embodiments, in order to clearly collect the image of the express package and/or the face image, a fill light is also provided on the top of the terminal device. In the case of insufficient ambient light, the fill light can be turned on or the brightness Adjust to collect images of express parcels and/or faces with sufficient brightness.

15 is a structural diagram of an information processing device provided by an embodiment of the disclosure. As shown in FIG. 15, the device may include: an image acquisition module 1501, an information acquisition module 1502, and an operation execution module 1503. Among them, the image acquisition module 1501 is used to collect the first express image corresponding to the first express package, and to collect the first face image of the picker of the first express package. The information obtaining module 1502 is configured to obtain the courier document information of the first courier package included in the first courier image, and the courier document information includes recipient information and the courier identification information of the first express package At least one of. The operation execution module 1503 is configured to execute an express delivery operation of the first express package based on the express receipt information of the first express package and the first face image.

In some embodiments, the operation execution module 1503 is specifically configured to: obtain the first identity information matching the first face image; when the first identity information matches the recipient of the first express package If the information is consistent, confirm that the express delivery verification of the first express package is passed, and/or update the storage status corresponding to the first express package to the delivered state.

In some embodiments, the operation execution module 1503 is further configured to output warning information when the first identity information is inconsistent with the recipient information of the first express package.

In some embodiments, as shown in FIG. 16, the apparatus may further include: an information display module 1504. Among them, the image acquisition module 1501 is also used to acquire a second face image. The information acquisition module 1502 is further configured to send the second face image to a server; the second face image is used by the server to search for second identity information that matches the second face image; The server determines to-be-obtained express delivery information based on the second identity information. The information display module 1504 is configured to display the pending express delivery information on the display screen.

In some embodiments, when the information acquiring module 1502 is used to acquire the express document information of the first express package included in the first express image, it includes: performing edge detection processing on the first express image, and determining The position information of the barcode area in the first express image; based on the position information of the barcode area in the first express image, crop the first express image to obtain the image of the barcode area; identify the barcode The image of the area, the express identification information of the first express package is obtained.

In some embodiments, when the information obtaining module 1502 is used to obtain the courier document information of the first courier package included in the first courier image, it includes: obtaining the destination of the courier document from the first courier image. Area; detecting the image of the target area to obtain express delivery document information contained in the express delivery document, the express delivery document information including at least one of the recipient information and the express delivery identification information.

In some embodiments, as shown in FIG. 16, the device further includes: an acquisition trigger module 1505, configured to detect whether an acquisition object enters a predetermined depth of field before the image acquisition module acquires the first express image , And when it is detected that the first express package has entered the predetermined depth of field, the image capturing function of the image capturing module is turned on.

In some embodiments, when the information acquisition module 1502 is used to acquire the target area where the express document is located from the first express image, it includes at least one of the following: the first express image determines the express The text area of the document is used as the target area, where the text area is the imaging area of the text in the express document; the barcode area of the express document is determined from the first express image as the target area, wherein, The barcode area is an imaging area of the barcode in the express receipt.

In some embodiments, when the information acquisition module 1502 is used to detect the image of the target area and obtain the express document information contained in the express document, it includes: acquiring the first document obtained by detecting the text area of the express document. Identification information; acquiring the second identification information obtained by detecting the barcode area of the courier document; in the case that the first identification information and the second identification information meet a preset matching condition, according to the first identification information and /Or the second identification information obtains the express delivery document information contained in the express delivery document.

In some embodiments, the operation execution module 1503 is specifically configured to: when it is determined that the first biological feature corresponding to the first face image has a binding relationship with the first account information, determine to The delivery verification of the express package is passed; wherein, the recipient information of the first express package includes: the first account information.

In some embodiments, the operation execution module 1503 is further configured to: output a verification prompt for inputting verification information in a case where the binding relationship between the first biometric feature and the first account information is not established; The entered verification information is used to perform an express delivery operation of the first express package.

FIG. 17 is a structural diagram of an express delivery device provided by an embodiment of the present disclosure. As shown in FIG. 17, the device may include: an image acquisition module 1701 and a warehouse delivery processing module 1702. Wherein, the image acquisition module 1701 is configured to acquire the express image of the express package collected by at least one camera of the terminal device, wherein the express image is used to acquire the express document information of the express package; The first face image collected by at least one camera. The outbound processing module 1702 is configured to perform the outbound operation of the express package based on the express image and the first face image.

In some embodiments, the outbound processing module 1702 is specifically configured to perform the outbound operation of the express package by determining whether the first face image matches the express delivery document information obtained from the express image.

In some embodiments, when the device is applied to a terminal device, the outbound processing module 1702 is configured to perform the outbound operation of the express package based on the express image and the first face image, including : Sending the first face data and express delivery data to the server, so that the server determines whether the first face image matches the express delivery image, wherein the first face data includes the first face Image and/or feature information of the first face image, the express delivery data includes at least a part of the express image and/or the express document information obtained from the express image; receiving the information sent by the server The instruction information, wherein the instruction information is used to indicate whether the express package passes through the warehouse.

In some embodiments, the outbound processing module 1702, when used to perform the outbound operation of the express package based on the express image and the first face image, includes: performing at least part of the express image Perform document identification processing to obtain the express document information, where the express document information includes at least one of the recipient information of the express package and express identification information; based on the express document information and the first The face image is used to perform the delivery operation of the express package.

In some embodiments, the outbound processing module 1702 is used to perform document recognition processing on at least a part of the express image to obtain the express document information, including: performing barcode recognition processing on the barcode area of the express image , Obtain the express delivery identification information; and/or perform text recognition processing on the text area of the express delivery image to obtain at least one of the recipient information and the express delivery identification information.

In some embodiments, the outbound processing module 1702 is configured to perform document recognition processing on at least a part of the express image, and when obtaining the express document information, it includes: performing edge detection processing on at least a part of the express image , Obtain the location information of the barcode area; perform cropping processing on at least a part of the express image to obtain the image of the barcode area; identify the image of the barcode area to obtain the express identification information.

In some embodiments, the outbound processing module 1702 is further configured to: before identifying the image of the barcode area, compare at least one of the barcode length and the barcode content contained in the image of the barcode area , Verifying whether the image of the barcode area is valid; the identifying the image of the barcode area includes: identifying the image of the barcode area when it is determined that the image of the barcode area is valid.

In some embodiments, the outbound processing module 1702 is used to perform document identification processing on at least a part of the express image to obtain the express document information, including: performing express document inspection on the express image to obtain the express document information. The location information of the document in the express image; based on the location information of the express document, obtain a target area image containing at least a part of the express document from the express image; perform recognition processing on the target area image to obtain State the courier bill information.

In some embodiments, the outbound processing module 1702, when used to perform the outbound operation of the express package based on the express delivery receipt information and the first face image, includes: determining the first express delivery identification information And the second express identification information; in the case that the first express identification information matches the second express identification information, based on the first express identification information or the first identification information and the first Face image, execute the outbound operation of the express package; wherein the express delivery identification information includes: the first express delivery identification information obtained by performing text recognition processing on at least a part of the express delivery image, The second express delivery identification information obtained by performing barcode recognition processing on at least a part of the express delivery image.

In some embodiments, the outbound processing module 1702, when used to perform the outbound operation of the express package based on the express document information and the first face image, includes: based on the express document information The account database is queried to obtain the first account information; by judging whether the first face image matches the registered face data corresponding to the first account information, it is determined whether the express package passes through the warehouse.

In some embodiments, the outbound processing module 1702, when used to perform the outbound operation of the express package based on the express receipt information and the first face image, includes: based on the first person The face image queries the face database to obtain the face identity information of the first face image; by judging whether the face identity information is consistent with the recipient information included in the express receipt information, and/or, It is determined whether the express delivery information corresponding to the facial identity information is consistent with the express delivery identification information included in the express delivery document information, and it is determined whether the express package passes through the warehouse.

In some embodiments, when the device is applied to a server, the image acquisition module 1701, when acquiring the express image and the first face image, includes: receiving the express delivery request message sent by the terminal device, the express delivery request message At least one of the express image and the first face image is included.

In some embodiments, as shown in FIG. 18, the device further includes a query processing module 1703, configured to: in response to receiving an express query request, obtain a second face image collected by the at least one camera; based on the The second face image obtains the storage location information of the courier to be picked up by the user; the storage location information is displayed on the display screen of the terminal device.

In some embodiments, as shown in FIG. 18, the device further includes an information recommendation module 1704, configured to obtain a target feature tag matching the first face image, and to obtain at least one corresponding to the target feature tag. One piece of target recommendation information; the at least one piece of target recommendation information is displayed on the display screen of the terminal device.

FIG. 19 is a structural diagram of an express delivery device provided by an embodiment of the present disclosure. As shown in FIG. 19, the device may include: a message receiving module 1901, a verification processing module 1902, and a response sending module 1903. Wherein, the message receiving module 1901 is configured to receive an express delivery request message sent by a terminal device. The express delivery request message includes: first face data and express delivery data, where the first face data includes the The first facial image of the pickup person and/or the characteristic information of the first facial image collected by the terminal device, the express data includes at least a part of the express image of the express package and/or is obtained from the express image Courier receipt information that arrives. The verification processing module 1902 is configured to perform delivery verification of express parcels based on the first face data and express data. The response sending module 1903 is configured to send an express delivery response indicating whether the delivery check is passed to the terminal device.

In some embodiments, the verification processing module 1902 is specifically configured to: query a face database based on the first face image to obtain the person identity information of the first face image; and determine the face identity information Whether it is consistent with the recipient information included in the courier bill information, and/or, by determining whether the to-be-taken courier information corresponding to the facial identity information is consistent with the courier identification information included in the courier bill information, it is determined Whether the express parcel passes out of the warehouse.

In some embodiments, the verification processing module 1902 is specifically configured to: query an account database based on the express receipt information to obtain first account information; and determine that the first face image corresponds to the first account information Whether the registered face data matches, it is determined whether the express package passes through the warehouse.

In some embodiments, the verification processing module 1902, when used to perform outbound verification of express parcels based on the first face data and express data, includes: performing express document inspection on the express image to obtain the express The location information of the document in the express image; based on the location information of the express document, obtain a target area image containing at least a part of the express document from the express image; perform recognition processing on the target area image to obtain State the courier bill information.

The embodiments of the present disclosure provide a computer storage medium that stores computer-executable instructions; after the computer-executable instructions are executed, the information processing method or express delivery provided by one or more of the foregoing embodiments can be implemented. Library method.

The computer storage medium may include various recording media with recording functions, for example, various storage media such as CD, floppy disk, hard disk, magnetic tape, optical disk, U disk, or mobile hard disk. The optional computer storage medium may be a non-transitory storage medium, which can be read by the processor, so that the computer executable instructions stored on the computer storage medium can be obtained and executed by the processor to realize the foregoing The information processing method or express delivery method provided by any technical solution.

The embodiments of the present disclosure also provide a computer program product, the computer program product includes computer-executable instructions; after the computer-executable instructions are executed, they can implement the information processing method or express delivery provided by one or more of the foregoing embodiments. Library method.

The computer program includes a computer program tangibly contained on a computer storage medium. The computer program includes program code for executing the method shown in the flowchart. The program code may include instructions corresponding to the steps of the method provided in the embodiments of the present disclosure.

The disclosed devices and methods provided in the present disclosure can be implemented in other ways. The device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, such as: multiple units or components can be combined or integrated To another system, or some features can be ignored or not implemented. In addition, the coupling, or direct coupling, or communication connection between the displayed or discussed components, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical, or other forms.

The units described above as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, which may be located in one place or distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the objectives of the solutions of the embodiments of the present disclosure.

In addition, the functional units in the various embodiments of the present disclosure can be all integrated into one processing module, or each unit can be individually used as a unit, or two or more units can be integrated into one unit; The unit can be realized in the form of hardware or in the form of hardware plus software functional unit.

The technical features disclosed in any embodiment of the present disclosure can be arbitrarily combined to form a new method embodiment or device embodiment without conflict. The method embodiments disclosed in any embodiment of the present disclosure can be combined arbitrarily to form a new method embodiment if there is no conflict. The device embodiments disclosed in any embodiment of the present disclosure can be combined arbitrarily to form a new device embodiment if there is no conflict.

Those of ordinary skill in the art can understand that all or part of the steps in the above method embodiments can be implemented by a program instructing relevant hardware. The foregoing program can be stored in a computer readable storage medium, and when the program is executed, it is executed. Including the steps of the foregoing method embodiment; and the foregoing storage medium includes: removable storage devices, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc. A medium that can store program codes.

The above are only specific implementations of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present disclosure. It should be covered within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

An information processing method applied to a courier terminal, wherein the method includes:

Collect the first express image corresponding to the first express package;

Acquiring courier document information of the first courier package included in the first courier image, where the courier document information includes at least one of recipient information and courier identification information of the first courier package;

Collecting the first face image of the picker of the first express package;

Based on the express document information of the first express package and the first face image, perform an express delivery operation of the first express package.
The method according to claim 1, wherein the performing an express delivery operation based on the express receipt information of the first express package and the first face image comprises:

Acquiring first identity information matched by the first face image;

In the case that the first identity information is consistent with the recipient information of the first express package, confirm that the express delivery verification of the first express package is passed, and/or correspond to the first express package The storage status of is updated to the out of library status.
The method according to claim 2, wherein the method further comprises: outputting a warning message when the first identity information is inconsistent with the recipient information of the first express package.
The method according to any one of claims 1 to 3, wherein the method further comprises:

Collect the second face image;

Sending the second face image to a server; the second face image is used by the server to search for second identity information matching the second face image;

Receiving the courier information to be picked up determined by the server based on the second identity information;

Display the pending delivery information on the display screen.
The method according to any one of claims 1 to 4, wherein said obtaining the express document information of the first express package included in the first express image comprises:

Performing edge detection processing on the first express image to determine the position information of the barcode area in the first express image;

Crop the first express image based on the location information of the barcode area in the first express image to obtain the image of the barcode area;

Identify the image of the barcode area to obtain the express identification information of the first express package.
The method according to any one of claims 1 to 5, wherein said obtaining the express delivery document information of the first express package included in the first express image comprises:

Obtaining the target area where the express document is located from the first express image;

The image of the target area is detected to obtain express delivery document information contained in the express delivery document, and the express delivery document information includes at least one of the recipient information and the express delivery identification information.
The method according to claim 6, wherein the method further comprises:

Before collecting the first express image, it is detected whether there is a collection object within the predetermined depth of field range, and when it is detected that the first express package has entered the predetermined depth range, the image acquisition function is turned on.
The method according to claim 6 or 7, wherein the obtaining the target area where the express document is located from the first express image includes at least one of the following:

Determining the text area of the courier document as a target area from the first courier image, wherein the text area is an imaging area of the text in the courier document;

The barcode area of the express document is determined from the first express image as the target area, wherein the barcode area is an imaging area of the barcode in the express document.
8. The method according to any one of claims 6 to 8, wherein the detecting the image of the target area to obtain the express document information contained in the express document comprises:

Acquiring the first identification information obtained by detecting the text area of the express receipt;

Acquiring the second identification information obtained by detecting the barcode area of the express document;

In the case that the first identification information and the second identification information satisfy a preset matching condition, the first identification information and/or the second identification information are used to obtain the Courier bill information.
The method according to claim 6, wherein the recipient information of the first express package comprises: first account information; the express receipt information based on the first express package and the second face image , To perform the express delivery operation of the first express package, including:

When it is determined that the first biometric characteristic corresponding to the first face image has a binding relationship with the first account information, it is determined that the verification of the first express package is passed.
The method according to claim 10, wherein the method further comprises:

In the case where the binding relationship between the first biological feature and the first account information is not established, outputting a verification prompt for inputting verification information;

Based on the input verification information, an express delivery operation of the first express package is performed.
An express delivery method, the method includes:

Acquiring the express image of the express package collected by at least one camera of the terminal device, wherein the express image is used to acquire the express document information of the express package;

Acquiring a first face image collected by the at least one camera;

Based on the express image and the first face image, perform an outbound operation of the express package.
The express delivery method of claim 12, wherein the executing the delivery operation of the express package based on the express image and the first face image comprises:

By judging whether the first face image matches the courier document information obtained from the courier image, the delivery operation of the courier package is performed.
The express delivery method according to claim 12 or 13, wherein the method is applied to the terminal device, and the delivery of the express package is executed based on the express image and the first face image Operations, including:

Send the first face data and express data to the server, so that the server determines whether the first face image matches the express image, wherein the first face data includes the first face image And/or the feature information of the first face image, the express delivery data includes at least a part of the express image and/or the express document information obtained from the express image;

Receiving instruction information sent by the server, where the instruction information is used to indicate whether the express package passes through the warehouse.
The express delivery method according to claim 12 or 13, wherein the executing the delivery operation of the express package based on the express image and the first face image includes:

Performing document identification processing on at least a part of the express image to obtain the express document information, wherein the express document information includes at least one of the recipient information of the express package and the express identification information;

Based on the courier document information and the first face image, perform an outbound operation of the courier package.
The express delivery method according to claim 15, wherein said performing document identification processing on at least a part of said express delivery image to obtain said express delivery document information comprises:

Perform barcode recognition processing on the barcode area of the express image to obtain the express identification information; and/or,

Perform text recognition processing on the text area of the express delivery image to obtain at least one of the recipient information and the express delivery identification information.
The express delivery method according to claim 15 or 16, wherein said performing document identification processing on at least a part of said express image to obtain said express document information comprises:

Performing edge detection processing on at least a part of the express image to obtain position information of the barcode area;

Performing cropping processing on at least a part of the express image to obtain the image of the barcode area;

Identify the image of the barcode area to obtain the express delivery identification information.
The express delivery method according to claim 17, wherein before said identifying the image of the barcode area, further comprising:

Verifying whether the image of the barcode area is valid by comparing at least one of the length of the barcode contained in the image of the barcode area and the content of the barcode;

The recognizing the image of the barcode area includes: performing the recognition of the image of the barcode area when it is determined that the image of the barcode area is valid.
The express delivery method according to any one of claims 15 to 18, wherein the performing document identification processing on at least a part of the express image to obtain the express document information comprises:

Performing express document detection on the express image to obtain location information of the express document in the express image;

Obtaining a target area image containing at least a part of the express document from the express image based on the location information of the express document;

Perform recognition processing on the target area image to obtain the express bill information.
The express delivery method according to any one of claims 15 to 19, wherein the express delivery identification information comprises: first express delivery identification information obtained by performing text recognition processing on at least a part of the express delivery image, Second express delivery identification information obtained by performing barcode recognition processing on at least a part of the express delivery image;

The performing the outbound operation of the express package based on the express delivery document information and the first face image includes:

Determining whether the first express delivery identification information and the second express delivery identification information match;

In the case where the first express delivery identification information and the second express delivery identification information match, based on the first express delivery identification information or the first identification information and the first face image, performing the Outbound operation of parcels.
The express delivery method according to any one of claims 15 to 20, the executing the delivery operation of the express package based on the express receipt information and the first face image includes:

Query the account database based on the express receipt information to obtain the first account information;

By judging whether the first face image matches the registered face data corresponding to the first account information, it is determined whether the express package passes through the warehouse.
The express delivery method according to any one of claims 15 to 20, wherein the executing the delivery operation of the express package based on the express receipt information and the first face image includes:

Query a face database based on the first face image to obtain face identity information of the first face image;

By judging whether the facial identity information is consistent with the recipient information included in the courier document information, and/or by judging whether the courier information to be picked up corresponding to the facial identity information and the courier document information include Whether the courier identification information is consistent with each other, determine whether the courier package passes through the warehouse.
The express delivery method according to claim 12, wherein the method is applied to a server, and said acquiring the express image and the first face image included in the express collected by at least one camera of the terminal device includes:

Receiving an express delivery request message sent by a terminal device, where the express delivery request message includes at least one of the express image and the first face image.
The express delivery method according to any one of claims 12 to 22, the method further comprising:

In response to receiving the express inquiry request, acquiring a second face image collected by the at least one camera;

Based on the second face image, obtain the storage location information of the courier to be picked up by the user;

The storage location information is displayed on the display screen of the terminal device.
The express delivery method according to any one of claims 12 to 24, the method further comprising:

Acquiring a target feature tag that matches the first face image, and acquiring at least one target recommendation information corresponding to the target feature tag;

The at least one target recommendation information is displayed on the display screen of the terminal device.
An express delivery method, wherein the method includes:

Receive an express delivery request message sent by a terminal device, where the express delivery request message includes: first face data and express data, wherein the first face data includes the first person's first face data collected by the terminal device A face image and/or feature information of the first face image, the courier data includes at least a part of the courier image of the courier package and/or the courier document information obtained from the courier image;

Based on the first face data and express delivery data, performing outbound verification of express parcels;

Sending to the terminal device an express delivery response indicating whether the delivery check is passed.
The method according to claim 26, wherein the performing the outbound verification of the express package based on the first face data and the express data comprises:

Query a face database based on the first face image to obtain the person identity information of the first face image;

By judging whether the facial identity information is consistent with the recipient information included in the courier document information, and/or by judging whether the courier information to be picked up corresponding to the facial identity information and the courier document information include Whether the express delivery identification information is consistent with each other, and determine whether the express package passes through the warehouse.
The method according to claim 26, wherein the performing the outbound verification of the express package based on the first face data and express data includes:

Query the account database based on the express receipt information to obtain the first account information;

By judging whether the first face image matches the registered face data corresponding to the first account information, it is determined whether the express package passes through the warehouse.
The method according to claim 26, wherein the performing the outbound verification of the express package based on the first face data and the express data comprises:

Performing express document detection on the express image to obtain location information of the express document in the express image;

Obtaining a target area image containing at least a part of the express document from the express image based on the location information of the express document;

Perform recognition processing on the target area image to obtain the express bill information.
An electronic device, which includes a processor and a memory, the memory is used to store one or more programs, the one or more programs are configured to be executed by the processor, and the program includes rights for executing The method described in any one of 1-11, 12-25, 26-29 is required.
An information processing device applied to an express terminal, wherein the device includes:

An image collection module, configured to collect the first express image corresponding to the first express package, and to collect the first face image of the picker of the first express package;

The information acquisition module is configured to acquire the express document information of the first express package included in the first express image, where the express document information includes recipient information and the express identification information of the first express package At least one

The operation execution module is configured to execute the express delivery operation of the first express package based on the express receipt information of the first express package and the first face image.
The device according to claim 31, wherein:

The operation execution module is specifically configured to: obtain the first identity information matched by the first face image; when the first identity information is consistent with the recipient information of the first express package, confirm The express delivery verification of the first express package is passed, and/or the storage status corresponding to the first express package is updated to the delivered state.
The device according to claim 32, wherein:

The operation execution module is further configured to output warning information when the first identity information is inconsistent with the recipient information of the first express package.
The device according to any one of claims 31 to 33, wherein:

The image acquisition module is also used to acquire a second face image;

The information acquisition module is further configured to send the second face image to a server; the second face image is used by the server to search for second identity information that matches the second face image; The express information to be fetched determined by the server based on the second identity information;

The device further includes: an information display module for displaying the pending express delivery information on the display screen.
The device according to any one of claims 31 to 34, wherein:

The information acquisition module, when used to acquire the express document information of the first express package included in the first express image, includes: performing edge detection processing on the first express image to determine the first express image The position information of the barcode area in the first express image; based on the position information of the barcode area in the first express image, crop the first express image to obtain the image of the barcode area; identify the image of the barcode area to obtain Express delivery identification information of the first express package.
The device according to any one of claims 31 to 35, wherein:

The information acquisition module, when used to acquire the express document information of the first express package included in the first express image, includes: acquiring the target area where the express document is located from the first express image; and detecting the The image of the target area obtains the express document information contained in the express document, and the express document information includes at least one of the recipient information and the express identification information.
The device according to claim 36, wherein:

The device further includes: an acquisition trigger module, configured to detect whether a collection object enters a predetermined depth of field before the image acquisition module acquires the first express image, and when it is detected that the first express package enters When it is within the predetermined depth of field, the image acquisition function of the image acquisition module is turned on.
The device according to claim 36 or 37, wherein:

When the information acquisition module is used to acquire the target area where the express document is located from the first express image, it includes at least one of the following: the text area of the express document is determined in the first express image as The target area, wherein the text area is the imaging area of the text in the express delivery document; the barcode area of the express delivery document is determined from the first express image as the target area, wherein the barcode area is The imaging area of the barcode in the express receipt.
The device according to any one of claims 36 to 38, wherein:

When the information acquisition module is used to detect the image of the target area and obtain the express document information contained in the express document, it includes: acquiring the first identification information obtained by detecting the text area of the express document; The second identification information obtained from the barcode area of the express receipt; in the case that the first identification information and the second identification information meet a preset matching condition, according to the first identification information and/or the first identification information 2. Identification information to obtain the express document information contained in the express document.
The device according to claim 36, wherein:

The operation execution module is specifically configured to: when it is determined that the first biometric characteristic corresponding to the first face image has a binding relationship with the first account information, determine the delivery of the first express package The verification is passed; wherein, the recipient information of the first express package includes: the first account information.
The device of claim 40, wherein:

The operation execution module is further configured to: in the case where the binding relationship between the first biometric feature and the first account information is not established, output a verification prompt for inputting verification information; and the verification based on the input Information, perform an express delivery operation of the first express package.
An express delivery device, wherein the device includes:

The image acquisition module is used to acquire the express image of the express package collected by at least one camera of the terminal device, wherein the express image is used to acquire the express document information of the express package; The first face image collected;

The outbound processing module is configured to execute the outbound operation of the express package based on the express image and the first face image.
The device of claim 42, wherein

The outbound processing module is specifically configured to perform the outbound operation of the express package by determining whether the first face image matches the express document information obtained from the express image.
The device according to claim 42 or 43, wherein the device is applied to a terminal device;

The outbound processing module, when used to execute the outbound operation of the express package based on the express image and the first face image, includes: sending the first face data and express data to a server to Enabling the server to determine whether the first face image matches the express image, wherein the first face data includes the first face image and/or feature information of the first face image The express data includes at least a part of the express image and/or the express document information obtained from the express image; receiving instruction information sent by the server, wherein the instruction information is used to indicate State whether the express parcel is delivered through the warehouse
The device according to claim 42 or 43, wherein:

The outbound processing module, when used to perform the outbound operation of the express package based on the express image and the first face image, includes: performing document recognition processing on at least a part of the express image, Obtain the courier document information, where the courier document information includes at least one of the recipient information of the courier package and the courier identification information; based on the courier document information and the first face image, execute The outbound operation of the express package.
The device of claim 45, wherein:

The outbound processing module is used to perform document recognition processing on at least a part of the express image to obtain the express document information, including: performing barcode recognition processing on the barcode area of the express image to obtain the express image Identification information; and/or, performing text recognition processing on the text area of the express image to obtain at least one of the recipient information and the express identification information.
The device according to claim 45 or 46, wherein:

The warehouse-out processing module is used to perform document recognition processing on at least a part of the express image to obtain the express document information, including: performing edge detection processing on at least a part of the express image to obtain the barcode area Location information; cropping at least a part of the express image to obtain the image of the barcode area; identifying the image of the barcode area to obtain the express identification information.
The device of claim 47, wherein:

The outbound processing module is further configured to verify the barcode by comparing at least one of the length of the barcode and the content of the barcode contained in the image of the barcode area before the image of the barcode area is identified. Whether the image of the area is valid; the recognizing the image of the barcode area includes: performing the recognition of the image of the barcode area when it is determined that the image of the barcode area is valid.
The device according to any one of claims 45 to 48, wherein:

The outbound processing module is used to perform document identification processing on at least a part of the express image to obtain the express document information, including: performing express document detection on the express image to obtain the express document in the express document Location information in the image; based on the location information of the courier document, obtain a target area image containing at least a part of the courier document from the courier image; perform recognition processing on the target area image to obtain the courier document information.
The device according to any one of claims 45 to 49, wherein:

The outbound processing module is configured to perform an outbound operation on the express package based on the express delivery document information and the first face image, including: determining the first express delivery identification information and the second express delivery identification Whether the information matches; in the case that the first express delivery identification information matches the second express delivery identification information, execute based on the first delivery identification information or the first identification information and the first face image The delivery operation of the express package; wherein, the express delivery identification information includes: the first express delivery identification information obtained by performing text recognition processing on at least a part of the express image, and at least Part of the second express delivery identification information obtained by performing barcode recognition processing.
The device according to any one of claims 45-50, wherein:

The outbound processing module, when used to perform the outbound operation of the express package based on the express delivery document information and the first face image, includes: querying an account database based on the express delivery document information to obtain First account information; by determining whether the first face image matches the registered face data corresponding to the first account information, it is determined whether the express package passes through the warehouse.
The device according to any one of claims 45-50, wherein:

The outbound processing module, when used to perform the outbound operation of the express package based on the express receipt information and the first face image, includes: querying the face based on the first face image Database to obtain the face identity information of the first face image; by judging whether the face identity information is consistent with the recipient information included in the express receipt information, and/or by judging the face Whether the courier information to be retrieved corresponding to the identity information is consistent with the courier identification information included in the courier document information, and whether the courier package passes through the warehouse is determined.
The device according to claim 42, wherein the device is applied to a server;

The image acquisition module, when acquiring the express image and the first face image, includes: receiving an express delivery request message sent by a terminal device, the express delivery request message including the express image and the first face image At least one of the images.
The device according to any one of claims 42-52, wherein the device further comprises:

The query processing module is configured to: in response to receiving a courier query request, obtain a second face image collected by the at least one camera; obtain the storage location information of the courier to be taken by the user based on the second face image; The storage location information is displayed on the display screen of the terminal device.
The device according to any one of claims 42-54, wherein the device further comprises:

An information recommendation module, configured to obtain a target feature tag matching the first face image, and obtain at least one target recommendation information corresponding to the target feature tag; and display the at least one target feature tag on the display screen of the terminal device Target recommendation information.
An express delivery device, wherein the device includes:

The message receiving module is configured to receive an express delivery request message sent by a terminal device. The express delivery request message includes: first face data and express data, wherein the first face data includes the terminal device collection The first facial image of the pickup person and/or the feature information of the first facial image, the express delivery data includes at least a part of the express image of the express package and/or the express image obtained from the express image Document information;

The verification processing module is configured to perform the outbound verification of the express package based on the first face data and the express data;

The response sending module is configured to send an express delivery response indicating whether the delivery check is passed to the terminal device.
The device of claim 56, wherein

The verification processing module is specifically configured to: query a face database based on the first face image to obtain the person identity information of the first face image; and judge the face identity information and the express receipt Whether the recipient information included in the information is consistent, and/or, by determining whether the courier information to be retrieved corresponding to the facial identity information is consistent with the courier identification information included in the courier document information, it is determined whether the courier package is Passed out of the library.
The device of claim 56, wherein

The verification processing module is specifically configured to: query an account database based on the express receipt information to obtain first account information; and determine whether the first face image corresponds to the registered face data corresponding to the first account information Matching, it is determined whether the express package passes through the warehouse.
The device of claim 56, wherein

When the verification processing module is used to perform outbound verification of express parcels based on the first face data and express data, it includes: performing express document detection on the express image to obtain the express document in the express Location information in the image; based on the location information of the courier document, obtain a target area image containing at least a part of the courier document from the courier image; perform recognition processing on the target area image to obtain the courier document information.
A computer-readable storage medium for storing a computer program, wherein the computer program causes a computer to execute the method according to any one of claims 1-11, 12-25, 26-29.