CN110837817A

CN110837817A - Target object identification method, device, equipment and storage medium

Info

Publication number: CN110837817A
Application number: CN201911127457.8A
Authority: CN
Inventors: 杨亮; 祁建斌; 王冲; 李肇中
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2019-11-18
Filing date: 2019-11-18
Publication date: 2020-02-25

Abstract

The disclosure provides a target object identification method, a target object identification device and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: the method comprises the steps that an electronic device obtains a target object picture, sends an identification instruction comprising the target object picture to an intelligent doorbell, when the intelligent doorbell receives the identification instruction sent by the electronic device, the target object picture is stored, when the intelligent doorbell detects doorbell trigger operation, pictures in a preset area are collected, objects in the pictures are identified according to the target object picture, and when the objects in the pictures are determined to be the target objects, notification messages are sent to the electronic device. When the electronic device receives the notification message, the notification message is output. The user can know that the target object arrives based on the electronic equipment, the method for automatically identifying the target object and informing the user based on the linkage of the intelligent doorbell and the electronic equipment is provided, the process of identifying the target object by the user is optimized, the function of the intelligent doorbell is expanded, and the practicability of the intelligent doorbell is enhanced.

Description

Target object identification method, device, equipment and storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method, an apparatus, a device, and a storage medium for identifying a target object.

Background

The doorbell is a common device arranged on a doorway, and can be pressed when a guest visits, the doorbell makes prompt sound to remind an owner of the guest visiting, the owner can learn the guest visiting after hearing the prompt sound, but the owner cannot learn who the guest of the visiting is, and when the owner opens the door for the guest, the owner can learn who the guest of the visiting is. Therefore, the existing doorbell can only send out prompt sound, the transmitted information amount is small, the function is single, and the processing capability is poor.

Disclosure of Invention

The present disclosure provides a target object identification method, apparatus, device and storage medium, which can overcome the problems existing in the related art, and the technical scheme is as follows:

according to a first aspect of the embodiments of the present disclosure, a target object identification method is provided, which is applied to an intelligent doorbell, and the method includes:

when detecting the trigger operation of the doorbell, collecting pictures in a preset area of the intelligent doorbell;

identifying an object in the picture according to a target object picture provided by the electronic equipment;

and when the object in the picture is determined to be the target object, sending the notification message to the electronic equipment, wherein the notification message is used for notifying the arrival of the target object.

In one possible implementation, the method further includes:

when an identification instruction sent by a server is received, the target object picture included in the identification instruction is stored, and the identification instruction is sent to the server by the electronic equipment.

In another possible implementation manner, the sending the notification message to the electronic device when it is determined that the object in the screen is the target object includes:

and when the object in the picture is determined to be the distribution personnel matched with the distribution personnel photo, acquiring an order identification corresponding to the distribution personnel photo, and sending a notification message carrying the order identification to the electronic equipment.

In another possible implementation manner, the notification message carries an object in the screen.

In another possible implementation, the method further includes:

and when the object in the picture is determined to be the target object, sending out a prompt sound, wherein the prompt sound is used for notifying the arrival of the target object.

In another possible implementation manner, the notification message is used to trigger the electronic device to invoke a fast application, and the notification message is output through the fast application, where the fast application runs based on a native application program interface API provided by an operating system of the electronic device.

According to a second aspect of the embodiments of the present disclosure, there is provided another target object identification method applied to an electronic device, the method including:

acquiring a target object picture;

sending an identification instruction comprising the target object picture, wherein the server or the intelligent doorbell receiving the identification instruction is used for returning a notification message when the intelligent doorbell detects doorbell trigger operation and an object in a picture acquired by the intelligent doorbell is a target object;

and when the notification message is received, outputting the notification message, wherein the notification message is used for notifying the arrival of the target object.

In one possible implementation manner, the obtaining a picture of a target object includes: acquiring a target object picture through a currently running fast application, wherein the fast application runs based on a native Application Program Interface (API) provided by an operating system of the electronic equipment;

the sending of the identification instruction including the target object picture includes:

and calling an object identification interface provided by the fast application, and sending the identification instruction.

In another possible implementation manner, the outputting the notification message when the notification message is received includes:

and when the notification message is received, calling the currently running fast application, and outputting the notification message through the fast application.

In another possible implementation manner, the obtaining a picture of a target object includes:

and when a delivery order is generated, acquiring a delivery person photo distributed in the delivery order as the target object picture.

In another possible implementation, the method further includes:

and updating the state of the delivery order to be a delivered state when the notification message is received.

In another possible implementation manner, the outputting the notification message includes at least one of:

displaying a text notification message;

and playing the voice notification message.

In another possible implementation, the method further includes:

scanning intelligent equipment in a preset area to obtain an equipment identifier of the intelligent doorbell in the preset area;

sending a binding request to the server, wherein the binding request carries a currently logged-in user identifier and an equipment identifier of the intelligent doorbell, and the server is used for establishing a binding relationship between the user identifier and the equipment identifier;

the identification instruction further comprises the user identification, and the server is further used for returning the notification message to the electronic equipment according to the binding relationship when the intelligent doorbell detects doorbell trigger operation and an object in a picture collected by the intelligent doorbell is a target object.

According to a third aspect of the embodiments of the present disclosure, there is provided another target object identification method applied to a server, the method including:

receiving pictures in a preset area collected by an intelligent doorbell;

and when the object in the picture is determined to be the target object, sending a notification message to the electronic equipment, wherein the notification message is used for notifying the arrival of the target object.

In one possible implementation, the method further includes:

and when an identification instruction sent by the electronic equipment is received, storing the target object picture included in the identification instruction.

In another possible implementation manner, the identifying an object in the screen according to a target object picture provided by an electronic device includes:

acquiring a user identifier bound with the equipment identifier of the intelligent doorbell according to the binding relationship between the user identifier and the equipment identifier, wherein the electronic equipment logs in based on the user identifier;

acquiring a target object picture corresponding to the user identification;

and identifying the object in the picture according to the target object picture.

In another possible implementation, the method further includes:

receiving a binding request sent by the electronic equipment, wherein the binding request carries the user identifier and the equipment identifier;

and establishing a binding relationship between the user identifier and the equipment identifier.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a target object recognition apparatus applied to an intelligent doorbell, the apparatus including:

the intelligent doorbell comprises an acquisition module, a storage module and a display module, wherein the acquisition module is used for acquiring pictures in a preset area of the intelligent doorbell when detecting the doorbell trigger operation;

the identification module is used for identifying the object in the picture according to a target object picture provided by the electronic equipment;

and the sending module is used for sending the notification message to the electronic equipment when the object in the picture is determined to be the target object, and the notification message is used for notifying the arrival of the target object.

In one possible implementation, the apparatus further includes:

and the storage module is used for storing the target object picture included in the identification instruction when the identification instruction sent by the server is received, and the identification instruction is sent to the server by the electronic equipment.

In another possible implementation manner, the target object picture is a distribution person photo allocated in a distribution order, and the sending module is further configured to, when it is determined that the object in the picture is a distribution person matched with the distribution person photo, obtain an order identifier corresponding to the distribution person photo, and send a notification message carrying the order identifier to the electronic device.

In another possible implementation manner, the apparatus further includes:

and the prompting module is used for sending out a prompting sound when the object in the picture is determined to be the target object, and the prompting sound is used for notifying the arrival of the target object.

According to a fifth aspect of the embodiments of the present disclosure, there is provided another target object recognition apparatus applied to an electronic device, the apparatus including:

the acquisition module is used for acquiring a target object picture;

the instruction sending module is used for sending an identification instruction comprising the target object image, and the server or the intelligent doorbell receiving the identification instruction is used for returning a notification message when the intelligent doorbell detects that the doorbell triggers operation and an object in the image acquired by the intelligent doorbell is a target object;

and the output module is used for outputting the notification message when the notification message is received, wherein the notification message is used for notifying the arrival of the target object.

In one possible implementation manner, the obtaining module includes:

the electronic equipment comprises a first obtaining unit, a second obtaining unit and a third obtaining unit, wherein the first obtaining unit is used for obtaining a target object picture through a currently running fast application, and the fast application runs on the basis of a native Application Program Interface (API) provided by an operating system of the electronic equipment;

the instruction sending module is further configured to call an object identification interface provided by the fast application, and send the identification instruction.

In another possible implementation manner, the output module includes:

and the output unit is used for calling the currently running fast application when the notification message is received, and outputting the notification message through the fast application.

In another possible implementation manner, the obtaining module includes:

and the second acquisition unit is used for acquiring the pictures of the distribution personnel distributed in the distribution order as the target object pictures when the distribution order is generated.

In another possible implementation manner, the apparatus further includes:

and the updating module is used for updating the state of the delivery order to the delivered state when the notification message is received.

In another possible implementation manner, the output module includes at least one of the following:

a display unit for displaying a text notification message;

and the playing unit is used for playing the voice notification message.

In another possible implementation manner, the apparatus further includes:

the scanning module is used for scanning intelligent equipment in a preset area to obtain an equipment identifier of the intelligent doorbell in the preset area;

the request sending module is used for sending a binding request to the server, wherein the binding request carries a currently logged-in user identifier and an equipment identifier of the intelligent doorbell, and the server is used for establishing a binding relationship between the user identifier and the equipment identifier;

According to a sixth aspect of the embodiments of the present disclosure, there is provided another target object recognition apparatus applied to a server, the apparatus including:

the picture receiving module is used for receiving pictures in a preset area collected by the intelligent doorbell;

and the sending module is used for sending a notification message to the electronic equipment when the object in the picture is determined to be the target object, wherein the notification message is used for notifying the arrival of the target object.

In one possible implementation, the apparatus further includes:

and the storage module is used for storing the target object picture included in the identification instruction when the identification instruction sent by the electronic equipment is received.

In another possible implementation manner, the identification module includes:

the first obtaining unit is used for obtaining a user identifier bound by the equipment identifier of the intelligent doorbell according to the binding relationship between the user identifier and the equipment identifier, and the electronic equipment logs in based on the user identifier;

the second acquisition unit is used for acquiring a target object picture corresponding to the user identifier;

and the identification unit is used for identifying the object in the picture according to the target object picture.

In another possible implementation manner, the apparatus further includes:

a request receiving module, configured to receive a binding request sent by the electronic device, where the binding request carries the user identifier and the device identifier;

and the relationship establishing module is used for establishing the binding relationship between the user identifier and the equipment identifier.

According to a seventh aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:

one or more processors;

volatile or non-volatile memory for storing the one or more processor-executable instructions;

wherein the one or more processors are configured to perform the operations performed in the target object identification method of the first, second or third aspect.

According to an eighth aspect of the embodiments of the present disclosure, there is provided an intelligent doorbell, the intelligent doorbell comprising:

one or more processors;

According to a ninth aspect of embodiments of the present disclosure, there is provided a server including:

one or more processors;

According to a tenth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having at least one instruction stored therein, the at least one instruction being loaded and executed by a processor to implement the target object identification method of any one of the first, second or third aspects.

The beneficial effects brought by the technical scheme provided by the embodiment of the disclosure at least comprise:

according to the method, the device, the equipment and the storage medium provided by the embodiment of the disclosure, the electronic equipment acquires a target object picture, sends an identification instruction comprising the target object picture to the intelligent doorbell, stores the target object picture when the intelligent doorbell receives the identification instruction sent by the electronic equipment, collects a picture in a preset area of the intelligent doorbell when the intelligent doorbell detects doorbell trigger operation, identifies an object in the picture according to the target object picture, and sends a notification message to the electronic equipment when the object in the picture is determined to be the target object. When the electronic device receives the notification message, the notification message is output. The user can timely know that the target object arrives based on the fact that the electronic equipment receives the notification message. The embodiment of the disclosure provides a method for automatically identifying a target object and notifying a user based on linkage of an intelligent doorbell and electronic equipment, so that the process of identifying the target object by the user is optimized, the functions of the intelligent doorbell are expanded, the processing capacity of the intelligent doorbell is improved, and the practicability of the intelligent doorbell is enhanced.

And the electronic equipment sends an identification instruction to the intelligent doorbell or the server by calling an object identification interface of any currently running fast application, and also outputs a notification message sent by the intelligent doorbell or the server through the fast application, so that the fast application realizes the identification of a target object through the interaction with the intelligent doorbell and the server, the function of the fast application is expanded, and the processing capacity and the practicability of the fast application are improved.

And the electronic equipment can also send a binding request to the server, the server establishes a binding relationship between the user identifier and the equipment identifier according to the binding request, the electronic equipment sends a recognition instruction comprising the target object picture and the user identifier to the server, and the server acquires the equipment identifier bound by the user identifier and sends the recognition instruction to the intelligent doorbell corresponding to the equipment identifier. And the intelligent doorbell identifies the object in the picture according to the target object picture. When the intelligent doorbell determines that the object in the picture is the target object, a notification message is sent to the server, the server sends the notification message to the electronic equipment, and the electronic equipment outputs the notification message. By establishing the binding relationship between the user identification and the equipment identification, data interaction among the electronic equipment, the server and the intelligent doorbell is realized, the target object is identified, and the flexibility of target object identification is improved. The electronic equipment outputs the notification message to remind the user that the target object arrives, the method for automatically identifying the target object and notifying the user based on the linkage of the intelligent doorbell, the server and the electronic equipment is provided, the process of identifying the target object by the user is optimized, the function of the intelligent doorbell is expanded, the processing capacity of the intelligent doorbell is improved, and the practicability of the intelligent doorbell is enhanced.

And the intelligent doorbell sends a notification message carrying the object in the picture to the electronic device, and the electronic device can further judge whether the object is the target object according to the object in the picture carried in the notification message. Or the notification message is output by the electronic device, and the user can judge whether the object is the target object based on the object in the electronic device viewing screen. Therefore, the flexibility of target object identification is enhanced, errors can be timely found when the intelligent doorbell identifies wrongly, and the accuracy of target object identification is improved.

And when the intelligent doorbell determines that the object in the picture is the target object, the intelligent doorbell makes a prompt sound. The user can know that the target object arrives according to the prompt sound, and the condition that the user misses the notification message on the electronic equipment due to the fact that the user does not check the electronic equipment in time is avoided.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a schematic diagram of an implementation environment shown in accordance with an exemplary embodiment;

FIG. 2 is a schematic diagram of another implementation environment shown in accordance with an example embodiment;

FIG. 3 is a flow diagram illustrating a method of target object identification in accordance with an exemplary embodiment;

FIG. 4 is a flow diagram illustrating another method of target object identification in accordance with an exemplary embodiment;

FIG. 5 is a flow diagram illustrating another method of target object identification in accordance with an exemplary embodiment;

FIG. 6 is a flow diagram illustrating another method of target object identification in accordance with an exemplary embodiment;

FIG. 7 is a flow diagram illustrating another method of target object identification in accordance with an exemplary embodiment;

FIG. 8 is a flow diagram illustrating another method of target object identification in accordance with an exemplary embodiment;

FIG. 9 is a block diagram illustrating a fast application framework in accordance with an exemplary embodiment;

FIG. 10 is a flowchart illustrating the launching of a fast application in accordance with an exemplary embodiment;

FIG. 11 is a schematic diagram illustrating a target object recognition apparatus in accordance with an exemplary embodiment;

fig. 12 is a schematic structural diagram illustrating another target object recognition apparatus according to an exemplary embodiment;

fig. 13 is a schematic structural diagram illustrating another target object recognition apparatus according to an exemplary embodiment;

fig. 14 is a schematic structural diagram illustrating another target object recognition apparatus according to an exemplary embodiment;

fig. 15 is a schematic structural diagram illustrating another target object recognition apparatus according to an exemplary embodiment;

fig. 16 is a schematic structural diagram illustrating another target object recognition apparatus according to an exemplary embodiment;

FIG. 17 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

To make the objects, technical solutions and advantages of the present disclosure more apparent, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

Fig. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present disclosure, and referring to fig. 1, the implementation environment includes: an electronic device 101 and a smart doorbell 102. The electronic device 101 is connected with the intelligent doorbell 102 through a network. The electronic device 101 may be a mobile phone, a computer, a tablet computer, or the like, and in addition, the electronic device 101 may also be a smart television.

The electronic device 101 provides a target object picture to be identified to the smart doorbell 102, the smart doorbell 102 identifies the acquired picture according to the target object picture, and when an object in the picture is determined to be a target object, a notification message is sent to the electronic device 101 and output by the electronic device 101. Therefore, the user can receive the notification message based on the electronic equipment and timely know that the target object arrives, the method for automatically identifying the target object and notifying the user based on the intelligent doorbell is provided, the functions of the intelligent doorbell are expanded, the processing capacity of the intelligent doorbell is improved, and the practicability of the intelligent doorbell is enhanced.

Fig. 2 is a schematic diagram of another implementation environment provided by the embodiment of the present disclosure, and referring to fig. 2, the implementation environment further includes a server 103. The electronic device 102 is connected with the server 103 through a network, and the intelligent doorbell 102 is connected with the server 103 through a network. The server 103 may be a server, a server cluster composed of a plurality of servers, or a cloud computing service center, which is not limited in this disclosure.

The electronic device 101 sends a target object picture to the server 103, the server 103 sends the target object picture to the smart doorbell 102 for recognition, when the smart doorbell 102 recognizes the target object, the smart doorbell 102 sends a notification message to the server 103, and the server 103 sends the notification message to the electronic device 101. Therefore, the target object is identified through data interaction among the electronic device 101, the server 103 and the intelligent doorbell 102, and flexibility of a target object identification method is improved.

Fig. 3 is a flowchart illustrating a target object recognition method applied to an intelligent doorbell, according to an exemplary embodiment, and referring to fig. 3, the method includes:

in step 301, when a doorbell trigger operation is detected, a picture in a preset area of the intelligent doorbell is collected.

In step 302, an object in the screen is identified according to a target object picture provided by the electronic device.

In step 303, when it is determined that the object in the screen is the target object, a notification message is transmitted to the electronic device.

Wherein the notification message is used for notifying the arrival of the target object.

According to the method provided by the embodiment of the disclosure, the electronic equipment provides the target object picture for the intelligent doorbell, and when the intelligent doorbell detects the doorbell trigger operation, the intelligent doorbell identifies the object in the collected picture according to the target object picture. And when the intelligent doorbell determines that the object in the picture is the target object, sending a notification message to the electronic equipment. Therefore, the user can receive the notification message based on the electronic equipment and timely know that the target object arrives, the method for automatically identifying the target object and notifying the user based on the intelligent doorbell is provided, the functions of the intelligent doorbell are expanded, the processing capacity of the intelligent doorbell is improved, and the practicability of the intelligent doorbell is enhanced.

In one possible implementation, the method further comprises:

and when an identification instruction sent by the server is received, storing the target object picture included in the identification instruction, wherein the identification instruction is sent to the server by the electronic equipment.

In another possible implementation manner, the target object picture is a delivery person picture allocated in a delivery order, and when it is determined that the object in the screen is the target object, a notification message is sent to the electronic device, where the notification message includes:

In another possible implementation, the notification message carries an object in a picture.

In another possible implementation, the method further includes:

when the object in the picture is determined to be the target object, a prompt sound is emitted, and the prompt sound is used for notifying the arrival of the target object.

In another possible implementation, the notification message is used to trigger the electronic device to invoke a fast application, through which the notification message is output.

Wherein the fast application runs based on a native application program interface, API, provided by an operating system of the electronic device.

Fig. 4 is a flowchart illustrating another target object recognition method applied to an electronic device according to an exemplary embodiment, and referring to fig. 4, the method includes:

in step 401, a target object picture is acquired.

In step 402, an identification instruction including a target object picture is transmitted.

The server or the intelligent doorbell receiving the identification instruction is used for returning a notification message when the intelligent doorbell detects doorbell trigger operation and an object in a picture acquired by the intelligent doorbell is a target object.

In step 403, when the notification message is received, the notification message is output.

According to the method provided by the embodiment of the disclosure, the electronic equipment acquires the target object picture and sends the identification instruction including the target object picture to the intelligent doorbell or the server. When the intelligent doorbell receives an identification instruction, a target object picture is stored, when the intelligent doorbell detects doorbell trigger operation, objects in the collected pictures are identified according to the target object picture, and when the objects in the pictures are determined to be the target objects, a notification message is sent to the electronic equipment; or the server receives the identification instruction of the electronic equipment and sends the identification instruction to the intelligent doorbell, the intelligent doorbell performs identification, and the server receives the notification message of the intelligent doorbell and sends the notification message to the electronic equipment. And when the electronic equipment receives the notification message, outputting the notification message. Therefore, the user can receive the notification message based on the electronic equipment and timely know that the target object arrives, the method for automatically identifying the target object and notifying the user based on the intelligent doorbell is provided, the functions of the intelligent doorbell are expanded, the processing capacity of the intelligent doorbell is improved, and the practicability of the intelligent doorbell is enhanced.

The electronic equipment sends the identification instruction comprising the target object picture, other equipment identifies the target object picture, and the notification message is output when the notification message is received, so that a user can know that the target object arrives through the electronic equipment, and convenience is improved.

In one possible implementation, acquiring a target object picture includes: acquiring a target object picture through a currently running fast application, wherein the fast application runs based on a native Application Program Interface (API) provided by an operating system of the electronic equipment;

sending an identification instruction including a target object picture, including:

and calling an object identification interface provided by the fast application, and sending an identification instruction.

In another possible implementation, when the notification message is received, outputting the notification message includes:

In another possible implementation manner, acquiring a picture of a target object includes:

when a delivery order is generated, a delivery person photo distributed in the delivery order is obtained and used as a target object picture.

In another possible implementation, the method further includes:

when the notification message is received, the status of the delivery order is updated to the delivered status.

In another possible implementation, the notification message is output, including at least one of:

displaying a text notification message;

and playing the voice notification message.

In another possible implementation, the method further includes:

scanning intelligent equipment in a preset area to obtain an equipment identifier of an intelligent doorbell in the preset area;

sending a binding request to a server, wherein the binding request carries a currently logged-in user identifier and an equipment identifier of the intelligent doorbell, and the server is used for establishing a binding relationship between the user identifier and the equipment identifier;

the identification instruction further comprises a user identifier, and the server is further used for returning a notification message to the electronic equipment according to the binding relationship when the intelligent doorbell detects doorbell-triggered operation and an object in a picture acquired by the intelligent doorbell is a target object.

Fig. 5 is a flowchart illustrating another target object recognition method applied to a server according to an exemplary embodiment, referring to fig. 5, the method including:

in step 501, a picture in a preset area collected by an intelligent doorbell is received.

In step 502, an object in the screen is identified according to a target object picture provided by the electronic device.

In step 503, when it is determined that the object in the screen is the target object, a notification message is transmitted to the electronic device.

According to the method provided by the embodiment of the disclosure, the server identifies the object in the picture provided by the intelligent doorbell according to the target object picture provided by the electronic equipment, and when the object in the picture is determined to be the target object, the server sends a notification message to the electronic equipment. The intelligent doorbell can send the collected pictures to the server for processing, and a user can receive the notification message based on the electronic equipment and timely know that a target object arrives.

In one possible implementation, the method further comprises:

In another possible implementation manner, identifying an object in a screen according to a target object picture provided by an electronic device includes:

acquiring a user identifier bound with the equipment identifier of the intelligent doorbell according to the binding relationship between the user identifier and the equipment identifier, and logging in the electronic equipment based on the user identifier;

acquiring a target object picture corresponding to a user identifier;

In another possible implementation, the method further includes:

receiving a binding request sent by electronic equipment, wherein the binding request carries a user identifier and an equipment identifier;

Fig. 6 is a flowchart illustrating another target object recognition method applied to an electronic device and a smart doorbell according to an example embodiment, and referring to fig. 6, the method includes:

in step 601, the electronic device acquires a target object picture and sends an identification instruction including the target object picture to the smart doorbell.

The electronic equipment can be various types such as smart televisions, mobile phones, computers, tablet computers and the like. The intelligent doorbell is installed on a door in any place and used for monitoring the condition of visitors, can comprise a camera, a loudspeaker, a display screen, a doorbell button and the like, and has various functions such as a camera shooting function, a display function and a data processing function.

In the embodiment of the disclosure, the intelligent doorbell establishes a binding relationship with the electronic device, and data interaction can be performed with the electronic device based on the binding relationship. The binding relationship may be a binding relationship established through network connection, or a binding relationship established when the electronic Device and the smart doorbell simultaneously log in the same user identifier, or a connection relationship established through a USB (universal serial Bus), or a communication connection relationship established based on the same communication protocol, where the communication protocol may be a D2D (Device-to-Device) protocol, a bluetooth protocol, a WiFi (Wireless Fidelity, Wireless network) protocol, a CSMA/CA (Carrier Sense Multiple Access with collision Avoidance) protocol, a RF (Radio Frequency) protocol, and the like.

In the embodiment of the disclosure, the target object is a visitor expected by the user, and the intelligent doorbell prompts when determining that the target object arrives, so that the user can timely know that the target object has arrived.

For this purpose, the electronic device acquires a target object picture and sends an identification instruction including the target object picture to the smart doorbell. The identification instruction is used for instructing the intelligent doorbell to identify the target object.

In a possible implementation manner, the electronic device runs a fast application, and the electronic device obtains a target object picture through the fast application running at present, calls an object identification interface provided by the fast application, and sends an identification instruction. The fast application runs based on a native application program interface API provided by an operating system of the electronic equipment, and can run directly without installation. The fast application is provided with an object recognition interface, the object recognition interface is associated with the intelligent doorbell, and the electronic equipment calls the object recognition interface based on the target object picture, so that a recognition instruction comprising the target object picture can be sent to the intelligent doorbell.

In another possible implementation manner, when the electronic device generates a delivery order, a picture of a delivery person assigned in the delivery order is obtained as a target object picture, and therefore an identification instruction including the target object picture is sent to the intelligent doorbell.

The type of order generated varies according to the type of fast application. For example, if the fast application is an online shopping application, the generated order is a shopping order. Or the fast application is a take-away application, the generated order is a take-away order.

For example, when a user needs delivery services such as take-out delivery, express delivery and the like, an order placing operation is triggered on the electronic device, the electronic device generates a corresponding delivery order according to the order placing operation of the user, and also distributes a delivery person providing the delivery services for the delivery order, and through a delivery person photo, the delivery person can distribute take-out or express for the user, and then the delivery person is a visitor expected by the user.

In another possible implementation, the operating system of the electronic device provides at least one fast application having functionality to provide dispatch services. The electronic equipment displays an application interface of the fast application based on the currently logged-in user identifier, the application interface at least comprises an order placing option, when the electronic equipment detects a trigger operation on the order placing option, a delivery order is generated, delivery personnel are allocated to the delivery order, and delivery personnel photos are added to the delivery order. When the electronic equipment acquires the photos of the distribution personnel, the electronic equipment calls an object recognition interface provided by the quick application and sends a recognition instruction comprising the photos of the distribution personnel to the intelligent doorbell.

The triggering operation for the menu option may be a click operation, a long-press operation, a sliding operation, etc. for the menu option, which are directly detected in a display screen of the electronic device, or may be a selection operation for the menu option triggered by inputting voice information, or may also be other triggering operations for the menu option.

In step 602, when the intelligent doorbell receives an identification instruction sent by the electronic device, a target object picture is stored.

When the intelligent doorbell receives an identification instruction sent by the electronic equipment, a target object picture included in the identification instruction is obtained and stored, so that the target object picture can be identified later according to the target object picture to judge whether a target object arrives.

In step 603, when the intelligent doorbell detects a doorbell trigger operation, a picture in a preset area of the intelligent doorbell is collected, and an object in the picture is identified according to the target object picture.

The intelligent doorbell has a shooting function, and can shoot a preset area, wherein the preset area is an area in a shooting range of the intelligent doorbell. For example, the intelligent doorbell is installed on a door, and the area in front of the door is the preset area of the intelligent doorbell.

When the intelligent doorbell detects the doorbell triggering operation, if the current visitor arrives, the intelligent doorbell collects the picture in the preset area, identifies the shot picture according to the stored target object picture, and judges whether the object in the picture is the target object.

In a possible implementation manner, the intelligent doorbell further comprises a doorbell button, and the doorbell trigger operation refers to a pressing operation on the doorbell button. Or a pressure sensor can be arranged in the intelligent doorbell, the doorbell trigger operation refers to the pressing operation of the pressure sensor, or the doorbell trigger operation can also be other types of operations.

And the intelligent doorbell performs face recognition on the target object picture to obtain a face in the target object picture, and performs face recognition on the object in the picture to obtain the face in the shot picture. The intelligent doorbell compares the face in the target object picture with the face in the shot picture to judge that the face in the shot picture is matched with the face in the target object picture. The face recognition is a biometric technology for identity recognition based on face feature information of a person.

In addition, when the intelligent doorbell detects the doorbell trigger operation, the intelligent doorbell can also make a prompt sound to remind a user of visiting guests.

In step 604, when the smart doorbell determines that the object in the screen is the target object, a notification message is sent to the electronic device.

The notification message is used for notifying the electronic equipment of the arrival of the target object.

When the intelligent doorbell detects that the face in the shooting picture is matched with the face in the target object picture, the object in the picture is determined to be the target object, namely the target object arrives, and then a notification message is sent to the electronic equipment. When the human face in the shot picture is detected not to be matched with the human face in the target object picture, the object in the picture is determined not to be the target object, namely the target object does not arrive, and a notification message does not need to be sent to the electronic equipment.

In one possible implementation, the notification message also carries the object in the screen. Therefore, the electronic device can further determine whether the object is the target object according to the object in the screen carried in the notification message. Or the electronic equipment acquires the notification message, and displays the object in the picture for the user to check, so that the user can judge whether the object is the target object by himself, the flexibility of target object identification is improved, errors can be found timely when the intelligent doorbell identifies errors, and the accuracy of target object identification is improved.

In another possible implementation manner, when the intelligent doorbell determines that the object in the picture is the target object, a prompt sound is emitted, and the prompt sound is used for notifying the arrival of the target object. The prompting sound can be a string of ring tones set by the intelligent doorbell in a default mode, or a string of voice set by the user, and the like. Therefore, the user can know that the target object arrives according to the prompt sound, and the condition that the user misses the notification message on the electronic equipment due to the fact that the user does not check the electronic equipment in time is avoided.

In another possible implementation manner, the target object picture is a delivery person picture, and the delivery person picture is distributed in a delivery order generated by the electronic device. The delivery order has a corresponding order identifier, which may be a randomly generated order number or an order code sequentially generated in time sequence, etc. The electronic device sends a recognition instruction to the intelligent doorbell, which includes a photo of the dispatching person and an order identifier. When the intelligent doorbell receives the identification instruction, the distribution personnel photo and the order identification can be obtained, and the distribution personnel photo and the order identification are correspondingly stored.

When the intelligent doorbell determines that the object in the picture is the delivery person matched with the delivery person photo, it is determined that the delivery person arrives, the intelligent doorbell obtains the order identification corresponding to the delivery person photo, and sends a notification message carrying the order identification to the electronic device, wherein the notification message is used for notifying the electronic device that the delivery person corresponding to the order identification has arrived. The subsequent electronic device can process the corresponding delivery order according to the order identification in the notification message.

In step 605, when the electronic device receives the notification message, the notification message is output.

When the electronic equipment receives the notification message sent by the intelligent doorbell, the notification message is output to inform the user that the target object arrives. The notification message may be a text notification message, a voice notification message, or other form of notification message.

In one possible implementation, the electronic device displays a text notification message. For example, when the electronic device receives the notification message, a text notification message "the delivery person has reached the door" or the like is displayed in the interface of the electronic device. Alternatively, the electronic device plays a voice notification message. For example, when the electronic device receives the notification message, a voice notification message "delivery person has reached the door" or the like is played in the electronic device. Alternatively, the electronic device simultaneously displays the text notification message and plays the voice notification message when receiving the notification message.

In another possible implementation manner, the target object picture is a delivery person picture, the delivery person picture is distributed in a delivery order generated by the electronic device, and the notification message carries an order identifier of the delivery order. When the electronic device receives the notification message, the electronic device obtains the delivery order corresponding to the order identifier, determines that the delivery person corresponding to the delivery order arrives, and updates the status of the delivery order to the reached status, which indicates that the delivery order is completed.

For example, when the delivery order is a shopping order, the shopping order is in a to-be-received state after the shopping order is generated, when express delivery personnel arrive, the state of the shopping order can be updated to a received state, and at this time, the shopping order is completed. Or when the delivery order is a take-away order, the take-away order is in a state that a take-away delivery person takes food after the take-away order is generated, and then the take-away order is in a delivery state after the take-away delivery person takes food from a merchant.

In another possible implementation manner, a fast application runs on the electronic device, and the electronic device obtains a target object picture through the fast application running at present, calls an object recognition interface provided by the fast application, and sends a recognition instruction to the intelligent doorbell. The notification message is used for triggering the electronic device to call the fast application, and when the electronic device receives the notification message sent by the intelligent doorbell, the fast application is called, and the notification message is output through the fast application.

According to the method provided by the embodiment of the disclosure, the electronic device acquires a target object picture, sends an identification instruction including the target object picture to the intelligent doorbell, stores the target object picture when the intelligent doorbell receives the identification instruction sent by the electronic device, collects a picture in a preset area of the intelligent doorbell when the intelligent doorbell detects a doorbell trigger operation, identifies an object in the picture according to the target object picture, and sends a notification message to the electronic device when the object in the picture is determined to be the target object. When the electronic device receives the notification message, the notification message is output. The user can timely know that the target object arrives based on the fact that the electronic equipment receives the notification message. The embodiment of the disclosure provides a method for automatically identifying a target object and notifying a user based on linkage of an intelligent doorbell and electronic equipment, so that the process of identifying the target object by the user is optimized, the functions of the intelligent doorbell are expanded, the processing capacity of the intelligent doorbell is improved, and the practicability of the intelligent doorbell is enhanced.

And the electronic equipment sends an identification instruction to the intelligent doorbell or the server by calling an object identification interface of any currently running fast application, and also calls the fast application to output a notification message sent by the intelligent doorbell or the server through the fast application, so that the fast application realizes the identification of a target object through the interaction with the intelligent doorbell and the server, the function of the fast application is expanded, and the processing capacity and the practicability of the fast application are improved.

Fig. 7 is a flowchart illustrating another target object recognition method according to an exemplary embodiment, applied to an electronic device, a server and a smart doorbell, referring to fig. 7, the method including:

in step 701, the electronic device scans the intelligent device in the preset area to obtain the device identifier of the intelligent doorbell in the preset area, and sends a binding request to the server.

In the embodiment of the disclosure, a network connection is established between the electronic device and the server, and a network connection is established between the server and at least one intelligent device including the intelligent doorbell. Therefore, in order to interact with the intelligent doorbell through the server, the electronic device needs to be bound with the intelligent doorbell.

Therefore, the electronic device scans the intelligent device in the preset area to obtain the device identifier of the intelligent doorbell in the preset area, and sends a binding request carrying the currently logged-in user identifier and the device identifier to the server. The preset area refers to an area within a scanning range of the electronic device.

The user identifier is used for indicating the identity of the user of the electronic equipment, and can be a user account number, a telephone number, a user nickname, an electronic mailbox and the like. The device identifier is used for uniquely determining an intelligent device, and may be a device name, a device number, or the like.

In a possible implementation manner, a fast application runs in the electronic device, the electronic device logs in the fast application based on the user identifier, and a scanning option is set in a display interface of the fast application and used for scanning the intelligent device. When the user needs to bind the electronic device with the smart doorbell, the scan option is triggered based on the fast application. When the electronic equipment detects the triggering operation of the scanning option, the intelligent equipment in the preset area is scanned to obtain the equipment identifier of at least one intelligent equipment, and the equipment identifiers are displayed in the display interface. And the user determines the device identifier of the intelligent doorbell, which needs to be bound, in the multiple device identifiers, and triggers the device identifier of the intelligent doorbell. When the electronic equipment detects the trigger operation of the equipment identification, a binding request carrying the user identification and the equipment identification is sent to a server.

In step 702, the server receives a binding request sent by the electronic device, and establishes a binding relationship between the user identifier and the device identifier.

When the server receives a binding request sent by the electronic equipment, the server determines a user identifier and an equipment identifier carried in the binding request, and establishes a binding relationship between the user identifier and the equipment identifier.

The binding relationship indicates that the intelligent doorbell corresponding to the equipment identifier is bound with the electronic equipment corresponding to the user identifier, and the server performs data transmission for the intelligent doorbell and the electronic equipment.

In step 703, the electronic device obtains a target object picture and sends an identification instruction including the target object picture and a user identifier to the server.

The process of acquiring the target object picture by the electronic device is similar to the step 601, and is not described in detail herein.

The identification instruction sent by the electronic equipment to the server comprises a target object picture and a user identifier, and the identification instruction is used for indicating the intelligent doorbell bound by the user identifier to identify the target object.

In step 704, the server obtains the device identifier bound to the user identifier, and sends the identification instruction to the smart doorbell corresponding to the device identifier.

When the server receives an identification instruction comprising a target object picture and a user identifier, acquiring a device identifier bound by the user identifier, determining an intelligent doorbell corresponding to the device identifier, and sending the identification instruction to the intelligent doorbell.

In step 705, when the smart doorbell receives the identification instruction sent by the electronic device, the target object picture is stored.

In step 706, when the smart doorbell detects a doorbell trigger operation, a picture in a preset area of the smart doorbell is collected, and an object in the picture is identified according to the target object picture.

In step 707, when the smart doorbell determines that the object in the screen is the target object, a notification message is sent to the server.

The steps 705-707 in the present embodiment are similar to the steps 602-604, and are not described in detail herein.

In step 708, the server sends the notification message to the electronic device.

When the server receives a notification message sent by the intelligent doorbell, the device identifier corresponding to the intelligent doorbell is determined, the user identifier bound with the device identifier is obtained, and the notification message is forwarded to the electronic device logging in the user identifier.

In step 709, when the electronic device receives the notification message, the notification message is output.

Step 709 in this embodiment is similar to step 605, and is not described herein again.

It should be noted that, in the embodiment of fig. 6, the electronic device directly establishes a network connection with the smart doorbell, and the electronic device and the smart doorbell may directly perform data interaction to identify the target object. In the embodiment of fig. 7, the electronic device and the intelligent doorbell do not directly establish a network connection, a binding relationship is established between the electronic device and the intelligent doorbell, the electronic device and the server establish a network connection, the intelligent doorbell also establishes a network connection with the server, and the electronic device and the intelligent doorbell perform data interaction through the server to identify the target object.

It should be noted that, in the embodiment of fig. 7, the server sends the identification instruction to the smart doorbell, and the smart doorbell identifies the target object. In another embodiment, the target object may be further identified by the server, and the specific process includes:

and the server receives the identification instruction which is sent by the electronic equipment and comprises the target object picture and the user identification, and stores the target object picture. The intelligent doorbell sends the collected pictures in the preset area to the server, when the server receives the pictures in the preset area, the user identification bound by the equipment identification of the intelligent doorbell is determined according to the binding relationship between the user identification and the equipment identification, a target object picture corresponding to the user identification is obtained, and the object in the pictures is identified according to the target object picture. And when the server determines that the object in the picture is the target object, sending a notification message to the electronic equipment.

According to the method provided by the embodiment of the disclosure, the electronic device sends a binding request to the server, the server establishes a binding relationship between the user identifier and the device identifier according to the binding request, the electronic device sends an identification instruction comprising the target object picture and the user identifier to the server, and the server acquires the device identifier bound by the user identifier and sends the identification instruction to the intelligent doorbell corresponding to the device identifier. And the intelligent doorbell identifies the object in the picture according to the target object picture. When the intelligent doorbell determines that the object in the picture is the target object, a notification message is sent to the server, the server sends the notification message to the electronic equipment, and the electronic equipment outputs the notification message. The method for automatically identifying the target object and informing the user based on the linkage of the intelligent doorbell, the server and the electronic equipment is provided, the process of identifying the target object by the user is optimized, the function of the intelligent doorbell is expanded, the processing capacity of the intelligent doorbell is improved, and the practicability of the intelligent doorbell is enhanced.

In an application scenario provided by the embodiment of the present disclosure, a takeaway deliverer is identified as a target object, so that the user is notified when the takeaway deliverer arrives.

A flow chart for identifying the target object is shown in fig. 8. The process comprises the following steps:

1. the electronic equipment runs with a takeaway application, and when a user takes a take-away from the takeaway application, the electronic equipment generates a takeaway order, and a photograph of a takeaway distributor is distributed in the takeaway order.

2. The electronic device obtains a photograph of the take-away deliverer and sends a recognition instruction including the photograph to the smart doorbell.

3. And when the intelligent doorbell receives the identification instruction, storing the pictures of the take-away deliverers. When someone presses the doorbell button, the intelligent doorbell collects the shot pictures and identifies the people in the shot pictures according to the pictures of the takeaway dispatchers.

4. And when the intelligent doorbell determines that the person in the shooting picture is a takeaway distributor, sending a notification message to the electronic equipment.

5. When the electronic equipment receives the notification message, the take-out order is updated to the delivered state, and a text message of 'take-out' is displayed or a voice message of 'take-out' is played on the electronic equipment to remind the user that the take-out deliverer has arrived.

The fast Application related in the embodiments of the present disclosure is a novel Application form based on a hardware platform of an electronic device, and can run based on a native API (Application Programming Interface) provided by an operating system.

The fast application is developed by adopting a unified standard, and is rendered as native without installation, namely, the fast application is used as point, and has native application experience (performance, system integration, interaction and the like). The framework of the fast application can be deeply integrated in an operating system, can operate at the level of the operating system, and realizes seamless connection with other application services. Developers can operate on different types of electronic equipment through one-time development. The method is applied to the electronic equipment manufacturers at the beginning of birth, realizes standardization unification among the electronic equipment manufacturers on the aspects of development specifications, capability access, developer service and the like, and greatly reduces the adaptation cost of developers.

Compared with the traditional application, the quick application has the following characteristics:

instant: the user can use the method point by point, and the user does not need to wait;

everywhere (Everywhere visible): deeply integrated with the use scene of the electronic equipment, and everywhere has an entrance, such as a search engine, an intelligent assistant, intelligent recommendation, an application market, a browser and the like;

efficiency: the quasi-front-end development mode is high in efficiency.

Fig. 9 shows a block diagram of a fast application framework 900 shown in an exemplary embodiment of the present disclosure, the fast application framework including: scenario portal 920, fast application engine 940, and Operating System (OS) infrastructure and hardware 960.

The scene portal 920 includes at least one of a negative one-screen, a global search, a lock screen, a desktop, an application marketplace, a browser, and a two-dimensional code. The appearance of the scene portal 920 may be in the form of a page and a card.

The fast application engine 940 includes a front end framework 941, a generic scenario 942, a lightweight scenario 943, an embedded SDK (Software Development Kit) 944, and business access 945.

The front-end framework 941 includes MVVM (Model-View-Model ), V-DOM (Virtual-Document Object Model), routing, basic API (Application Programming Interface), service API, UI (user Interface) component, routing, and the like;

the general scene 942 and the lightweight scene 943 include a JavaScript (a programming language) engine, a standard rendering engine, an extreme speed rendering engine, an end-cloud-core acceleration, a security mechanism, an emerging scene such as AI (Artificial Intelligence), AR (Augmented Reality), and the like, system integration (application management, rights management, and the like);

service access 945 includes push, account/payment, etc.

The OS infrastructure and hardware 960 includes: a graphics library, a native control, a system service, and a GPU (graphics Processing Unit)/NPU (embedded Neural network processor), etc.

From the execution path level, there are a standard HTML (Hyper Text Markup Language) 5 mode to support a general Web scene, and a JS (JavaScript, a programming Language) and Native (Native) mode to support a lighter and faster experience.

The architecture of the fast application engine will be briefly described in 3 aspects below.

1) Application development:

the design of the front end of the fast application refers to and integrates the design thought of the mainstream front end framework: the application is built in a componentized mode, an MVVM design mode taking data binding as a core is adopted, the performance is improved in a V-DOM mode, and meanwhile, a simple and clear template of a class Vue (a virtual machine shelling engine) is selected. Meanwhile, the layout aspect is correspondingly simplified. From the perspective of new application form, native UI mapping and capability opening, a set of components and API specifications need to be defined, and the rapid development application is convenient to develop.

2) System integration:

fast applications, as a complete application modality, can be deeply integrated with the system, run as native applications, and interact with the system. There are currently two forms of rapid application: a full screen mode independent application mode and an embedded mode card mode. Under the independent application form, the experience of the user is similar to a native application program, and the method has complete life cycle management, page management, routing and the like. The fast application can be hosted in the Activity of android, the page is hosted in Fragment, and the instance is managed and controlled through independent background Service. The card form is another form, and dynamic content is displayed in a light weight manner by embedding the embedded SDK (Software Development Kit) as an independent local control into each corner of the system. In the aspect of security isolation, better security guarantee can be achieved through a sandbox mechanism, process isolation and authority control in combination with the support of an operating system layer.

3) Performance experience and emerging scenes, such as JavaScript engines, rendering engines, end-cloud-core acceleration, emerging scenes, and the like:

in the aspects of interactive experience, resource overhead, stability and the like, the fast application realizes effective combination of a front-end development mode, native rendering and platform capability by introducing a native rendering path.

Different from cross-platform frameworks of other application layers, the application is planted in an operating system of the electronic equipment, and deep integration of a slave chip, the operating system and the cloud can be realized. By taking the acceleration of the starting performance as an example by combining the end and the cloud, the optimization of the network link layer can greatly accelerate the starting speed of the application through the cooperative rendering of the cloud and the end. Meanwhile, the special capability of the hardware platform can be integrated, and the experience is further improved. For example, the computing power of an NPU (Neural-network processing Unit, network processor) may be integrated into a fast application engine in combination with an AI chip of an electronic device, so that an AI scene (face recognition, image super-resolution, and the like) may be executed at a low latency and high performance on an end side, and meanwhile, the privacy of a user is effectively protected, and a bandwidth is saved.

Fig. 10 shows a flowchart illustrating the start-up of a fast application according to an exemplary embodiment of the present disclosure, including:

1) when the system is started for the first time, a user clicks a program package for triggering downloading of the fast application, and meanwhile, initialization related work of the fast application engine is carried out. After the whole fast application program package is downloaded and verified, the JavaScript file of the first page to be displayed is loaded and rendered.

2) The page rendering comprises JavaScript loading, execution of page and JavaScript frame logic, layout operation and drawing of the native UI control. When the logic in the page is executed, one or more network requests are generated, and the data returned by the network requests drive the page to be rendered again until the content of the page on the first screen is completely displayed.

The network request, JavaScript execution, typesetting and drawing are not in simple serial relation, but are parallelly interwoven, thereby affecting the rendering performance of the whole page and being strongly related to the logic and network conditions of page design and the running state of equipment.

Due to the specificity of fast applications, fast applications are expected to perform more tasks and perform more functions. At present, while the function of the fast application is being gradually improved, the embodiment of the present disclosure provides a new function of the fast application, and the new function is utilized to automatically identify a target object and notify a user, so that the function of the fast application is expanded, and the processing capability and the practicability of the fast application are improved.

Fig. 11 is a schematic structural diagram illustrating a target object recognition apparatus according to an exemplary embodiment, applied to an intelligent doorbell, and referring to fig. 11, the apparatus includes:

the acquisition module 1101 is used for acquiring pictures in a preset area of the intelligent doorbell when the doorbell trigger operation is detected;

the identification module 1102 is configured to identify an object in a picture according to a target object picture provided by the electronic device;

a sending module 1103, configured to send a notification message to the electronic device when it is determined that the object in the screen is the target object, where the notification message is used to notify that the target object arrives.

In one possible implementation, referring to fig. 12, the apparatus further comprises:

and the storage module 1104 is configured to store the target object picture included in the identification instruction when the identification instruction sent by the server is received, and the identification instruction is sent to the server by the electronic device.

In another possible implementation manner, the target object picture is a delivery person photo allocated in a delivery order, and the sending module is further configured to, when it is determined that the object in the screen is a delivery person matched with the delivery person photo, obtain an order identifier corresponding to the delivery person photo, and send a notification message carrying the order identifier to the electronic device.

In another possible implementation manner, the apparatus further includes:

the prompting module 1105 is configured to, when it is determined that the object in the screen is the target object, emit a prompting sound, where the prompting sound is used to notify that the target object arrives.

In another possible implementation manner, the notification message is used for triggering the electronic device to call a fast application, and the fast application is used for outputting the notification message and runs based on a native application program interface API provided by an operating system of the electronic device.

It should be noted that: the target object recognition device provided in the above embodiment is only illustrated by the division of the above functional modules when recognizing the target object, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the smart doorbell is divided into different functional modules to complete all or part of the above described functions. In addition, the target object identification apparatus provided in the above embodiments and the target object identification method embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments, and are not described herein again.

Fig. 13 is a schematic structural diagram of another target object recognition apparatus according to an exemplary embodiment, applied to an electronic device, and referring to fig. 13, the apparatus includes:

an obtaining module 1301, configured to obtain a target object picture;

the instruction sending module 1302 is configured to send an identification instruction including a target object picture, and the server or the smart doorbell that receives the identification instruction is configured to return a notification message when the smart doorbell detects a doorbell-triggered operation and an object in a picture acquired by the smart doorbell is a target object;

and an output module 1303, configured to output a notification message when the notification message is received, where the notification message is used to notify that a target object arrives.

In one possible implementation, referring to fig. 14, the obtaining module 1301 includes:

a first obtaining unit 1311, configured to obtain a target object picture through a currently running fast application, where the fast application runs based on a native application program interface API provided by an operating system of the electronic device;

the instruction sending module 1302 is further configured to call an object identification interface provided by the fast application, and send an identification instruction.

In another possible implementation manner, the output module 1303 includes:

an output unit 1313, configured to, when receiving the notification message, invoke the fast application currently running, and output the notification message through the fast application.

In another possible implementation manner, the obtaining module 1301 includes:

the second obtaining unit 1321 is configured to obtain, as the target object picture, a picture of a delivery person assigned in the delivery order when the delivery order is generated.

In another possible implementation manner, the apparatus further includes:

an update module 1304 for updating the status of the delivery order to a delivered status when the notification message is received.

In another possible implementation, the output module 1303 includes at least one of:

a display unit 1323 for displaying a text notification message;

a playing unit 1333 for playing the voice notification message.

In another possible implementation manner, the apparatus further includes:

the scanning module 1305 is configured to scan the intelligent device in the preset area to obtain a device identifier of the intelligent doorbell in the preset area;

a request sending module 1306, configured to send a binding request to a server, where the binding request carries a currently logged-in user identifier and an equipment identifier of an intelligent doorbell, and the server is configured to establish a binding relationship between the user identifier and the equipment identifier;

It should be noted that: the target object recognition apparatus provided in the above embodiment is only illustrated by the division of the above functional modules when recognizing the target object, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the electronic device may be divided into different functional modules to complete all or part of the above described functions. In addition, the target object identification apparatus provided in the above embodiments and the target object identification method embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments, and are not described herein again.

Fig. 15 is a schematic structural diagram of another target object recognition apparatus according to an exemplary embodiment, applied to a server, and referring to fig. 15, the apparatus includes:

the picture receiving module 1501 is used for receiving pictures in a preset area collected by the intelligent doorbell;

an identification module 1502, configured to identify an object in a picture according to a target object picture provided by an electronic device;

a sending module 1503, configured to send a notification message to the electronic device when the object in the screen is determined to be the target object, where the notification message is used to notify that the target object arrives.

In one possible implementation, referring to fig. 16, the apparatus further comprises:

the storage module 1504 is configured to store the target object picture included in the identification instruction when the identification instruction sent by the electronic device is received.

In another possible implementation, identifying module 1502 includes:

the first obtaining unit 1512 is configured to obtain, according to a binding relationship between a user identifier and a device identifier, a user identifier bound to the device identifier of the smart doorbell, where the electronic device logs in based on the user identifier;

a second obtaining unit 1522, configured to obtain a target object picture corresponding to the user identifier;

the identifying unit 1532 is configured to identify an object in the screen according to the target object picture.

In another possible implementation manner, the apparatus further includes:

a request receiving module 1505, configured to receive a binding request sent by an electronic device, where the binding request carries a user identifier and a device identifier;

the relationship establishing module 1506 is configured to establish a binding relationship between the user identifier and the device identifier.

It should be noted that: in the target object recognition apparatus provided in the above embodiments, only the division of the above functional modules is taken as an example for the purpose of recognizing the target object, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the server is divided into different functional modules to complete all or part of the above described functions. In addition, the target object identification apparatus provided in the above embodiments and the target object identification method embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments, and are not described herein again.

FIG. 17 is a block diagram illustrating an electronic device in accordance with an example embodiment. For example, the electronic device 1700 may be a mobile phone, a computer, a digital broadcaster, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 17, electronic device 1700 may include one or more of the following components: processing component 1702, memory 1704, power component 1706, multimedia component 1708, audio component 1710, input/output (I/O) interface 1712, sensor component 1714, and communications component 1716.

The processing component 1702 generally controls the overall operation of the electronic device 1700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing component 1702 may include one or more processors 1720 to execute instructions to perform all or a portion of the steps of the above-described method. Further, processing component 1702 may include one or more modules that facilitate interaction between processing component 1702 and other components. For example, processing component 1702 may include a multimedia module to facilitate interaction between multimedia component 1708 and processing component 1702.

The memory 1704 is configured to store various types of data to support operations at the electronic device 1700. Examples of such data include instructions for any application or method operating on the electronic device 1700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1704 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 1706 provides power to the various components of the electronic device 1700. The power components 1706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 1700.

The multimedia component 1708 includes a screen between the electronic device 1700 and a user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 1700 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

Audio component 1710 is configured to output and/or input audio signals. For example, audio component 1710 includes a Microphone (MIC) configured to receive external audio signals when electronic device 1700 is in an operational mode, such as a call mode, a record mode, and a voice recognition mode. The received audio signal may further be stored in the memory 1704 or transmitted via the communication component 1716. In some embodiments, audio component 1710 also includes a speaker for outputting audio signals.

The I/O interface 1712 provides an interface between the processing component 1702 and peripheral interface modules, such as a keyboard, click wheel, buttons, and the like. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 1714 includes one or more sensors for providing various aspects of state assessment for the electronic device 1700. For example, sensor assembly 1714 may detect an open/closed state of electronic device 1700, the relative positioning of components, such as a display and keypad of electronic device 1700, the sensor assembly 1714 may also detect a change in the position of electronic device 1700 or a component of electronic device 1700, the presence or absence of user contact with electronic device 1700, orientation or acceleration/deceleration of electronic device 1700, and a change in the temperature of electronic device 1700. The sensor assembly 1714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1716 is configured to facilitate communications between the electronic device 1700 and other devices in a wired or wireless manner. The electronic device 1700 may access a wireless network based on a communication standard, such as Wi-Fi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1716 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1716 further includes a Near Field Communication (NFC) module to facilitate short-range communications.

In an exemplary embodiment, the electronic device 1700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described target object recognition method.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions that, when executed by the processor 1720 of the electronic device 1700, enable the electronic device 1700 to perform the operations performed in the target object recognition method in the above-described embodiments. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A target object identification method is applied to an intelligent doorbell and comprises the following steps:

2. The method of claim 1, further comprising:

3. The method according to claim 1, wherein the target object picture is a delivery person picture allocated in a delivery order, and the sending the notification message to the electronic device when the object in the screen is determined to be the target object comprises:

4. A method according to any of claims 1-3, wherein the notification message carries an object in the picture.

5. The method according to any one of claims 1-3, further comprising:

6. The method of any of claims 1-3, wherein the notification message is used to trigger the electronic device to invoke a fast application through which the notification message is output, the fast application running based on a native Application Program Interface (API) provided by an operating system of the electronic device.

7. A target object identification method is applied to electronic equipment, and the method comprises the following steps:

acquiring a target object picture;

8. The method of claim 7, wherein the obtaining the target object picture comprises: acquiring a target object picture through a currently running fast application, wherein the fast application runs based on a native Application Program Interface (API) provided by an operating system of the electronic equipment;

9. The method of claim 7, wherein outputting the notification message when the notification message is received comprises:

10. The method of claim 7, wherein the obtaining the target object picture comprises:

11. The method of claim 10, further comprising:

12. The method of claim 7, wherein outputting the notification message comprises at least one of:

displaying a text notification message;

and playing the voice notification message.

13. The method of claim 7, further comprising:

14. A target object identification method is applied to a server, and the method comprises the following steps:

receiving pictures in a preset area collected by an intelligent doorbell;

15. The method of claim 14, further comprising:

16. The method according to claim 14, wherein the identifying the object in the screen according to the target object picture provided by the electronic device comprises:

acquiring a target object picture corresponding to the user identification;

17. The method of claim 16, further comprising:

18. A target object recognition device, applied to an intelligent doorbell, the device comprising:

19. The apparatus of claim 18, further comprising:

20. The apparatus according to claim 18, wherein the target object picture is a delivery person photo allocated in a delivery order, and the sending module is further configured to, when it is determined that the object in the screen is a delivery person matched with the delivery person photo, obtain an order identifier corresponding to the delivery person photo, and send a notification message carrying the order identifier to the electronic device.

21. The apparatus according to any of claims 18-20, wherein the notification message carries an object in the screen.

22. The apparatus of any one of claims 18-20, further comprising:

23. The apparatus of any of claims 18-20, wherein the notification message is configured to trigger the electronic device to invoke a fast application, and wherein the notification message is output by the fast application, and wherein the fast application is run based on a native Application Program Interface (API) provided by an operating system of the electronic device.

24. An object recognition apparatus applied to an electronic device, the apparatus comprising:

the acquisition module is used for acquiring a target object picture;

25. The apparatus of claim 24, wherein the obtaining module comprises:

26. The apparatus of claim 24, wherein the output module comprises:

27. The apparatus of claim 24, wherein the obtaining module comprises:

28. The apparatus of claim 27, further comprising:

29. The apparatus of claim 24, wherein the output module comprises at least one of:

a display unit for displaying a text notification message;

and the playing unit is used for playing the voice notification message.

30. The apparatus of claim 24, further comprising:

31. An object recognition device applied to a server, the device comprising:

32. The apparatus of claim 31, further comprising:

33. The apparatus of claim 31, wherein the identification module comprises:

34. The apparatus of claim 33, further comprising:

35. An electronic device, characterized in that the electronic device comprises:

one or more processors;

wherein the one or more processors are configured to perform operations performed in the target object identification method of any one of claims 1-6, or in the target object identification method of any one of claims 7-13, or in the target object identification method of any one of claims 14-17.

36. The utility model provides an intelligent doorbell which characterized in that, intelligent doorbell includes:

one or more processors;

37. A server, characterized in that the server comprises:

one or more processors;

38. A computer-readable storage medium having stored therein at least one instruction, which is loaded and executed by a processor to perform an operation performed in the target object recognition method of any one of claims 1 to 6, or the operation performed in the target object recognition method of any one of claims 7 to 13, or the operation performed in the target object recognition method of any one of claims 14 to 17.