CN110634211A

CN110634211A - Visiting reminding method and related equipment

Info

Publication number: CN110634211A
Application number: CN201910719012.2A
Authority: CN
Inventors: 余承富
Original assignee: SHENZHEN DANALE TECHNOLOGY Co Ltd
Current assignee: SHENZHEN HAIQUE TECHNOLOGY Co.,Ltd.
Priority date: 2019-08-05
Filing date: 2019-08-05
Publication date: 2019-12-31

Abstract

The invention discloses a visiting reminding method and related equipment, wherein the method comprises the steps of firstly obtaining the biological identification characteristic information of a visitor, then comparing the biological identification characteristic information of the visitor with a relational network database to obtain a related family member corresponding to the visitor, and finally pushing the visiting information of the visitor to the related family member, so that the family member related to the visitor can receive the visiting information of the visitor, thereby avoiding missing important visitors and overcoming the technical problems that in the prior art, when the visitor is not indoors, a user cannot know the visitor and easily misses an important visit. The invention can be widely applied to the fields of intelligent home furnishing and the like.

Description

Visiting reminding method and related equipment

Technical Field

The invention relates to the field of smart home, in particular to a visiting reminding method and related equipment.

Background

In the known technology, a doorbell becomes a necessary product for a home of a user, a visitor can trigger a switch by pressing a button on the doorbell outside the user, and after the visitor triggers the switch of the doorbell, a corresponding device in the user's house will ring to prompt the user that the visitor visits. When no user is in the room, the user cannot know the visitor visit, and easily misses an important visit.

Therefore, the known technology has defects and needs to be improved and developed.

Disclosure of Invention

The present invention is intended to solve at least one of the technical problems described in the related description to a certain extent. Therefore, the invention aims to provide a visiting reminding method and related equipment.

The technical scheme adopted by the invention is as follows:

in a first aspect, the present invention provides a method for reminding a visitor, including:

acquiring biological identification characteristic information of a visitor;

comparing the biological identification characteristic information of the visitor with a relational network database, and acquiring an associated family member corresponding to the visitor according to a comparison result, wherein the relational network database stores the association relationship between the preset biological identification characteristic information of a preset person and the associated family member;

and pushing the visiting information of the visiting person to the associated family member.

Further, the visiting reminding method further comprises the following steps:

and pushing the visiting information of the visiting person to a preset family member.

Further, the visiting reminding method further comprises the following steps:

receiving a receipt generating instruction of the associated family member and/or the preset family member to generate receipt information according to the receipt generating instruction;

and pushing the receipt information to the visitor.

Further, the visiting reminding method further comprises the following steps:

sorting the family members from high priority to low priority in advance;

acquiring the visiting times and/or the staying time of the visiting person;

judging whether the visiting times exceed a preset time and/or judging whether the staying time exceeds a preset time;

if the judgment result is yes, detecting whether the receipt information of the family members with high priority is pushed or not;

and if the detection result is negative, pushing the visiting information of the visiting person to a family member with low priority.

Further, the visiting reminding method further comprises the following steps:

receiving an authorization processing instruction of the associated family member and/or the preset family member, wherein the authorization processing instruction comprises authorized family member information;

and pushing the visiting information to authorized family members according to the authorization processing instruction.

Further, the relational network database includes an identity database and a relational database, the identity database stores a correspondence between the identity information of the preset person and the preset biometric feature information, and the relational database stores a correspondence between the identity information of the preset person and the associated family members.

In a second aspect, the present invention provides a visiting reminding device, including:

the characteristic information acquisition module is used for acquiring the biological identification characteristic information of the visitor;

the system comprises an associated member acquisition module, a relationship network database and a database management module, wherein the associated member acquisition module is used for comparing the biological identification characteristic information of the visitor with the relationship network database and acquiring an associated family member corresponding to the visitor according to a comparison result, and the relationship network database stores the association relationship between the preset biological identification characteristic information of a preset person and the associated family member;

and the first information pushing module is used for pushing the visiting information of the visiting person to the associated family member.

Further, the visiting reminding device further comprises:

and the second information pushing module is used for pushing the visiting information of the visiting person to a preset family member.

Further, the visiting reminding device further comprises:

the receipt information generating module is used for receiving a receipt generating instruction of the associated family member and/or the preset family member so as to generate receipt information according to the receipt generating instruction;

and the receipt information pushing module is used for pushing the receipt information to the visitor.

In a third aspect, the present invention provides a computer-readable storage medium, which stores computer-executable instructions for causing a computer to execute the visiting reminding method.

The invention has the beneficial effects that:

according to the invention, the biological identification characteristic information of the visitor is firstly obtained, the associated family member corresponding to the visitor is obtained by comparing the biological identification characteristic information of the visitor with the relational network database, and the visiting information of the visitor is finally pushed to the associated family member, so that the family member associated with the visitor can receive the visiting information of the visitor, thereby avoiding missing to receive important visitors, and overcoming the technical problems that in the prior art, when the visitor is not indoors, the user cannot know the visitor visiting and easily misses important visitors.

Drawings

FIG. 1 is a flow chart of an embodiment of a method for reminding a visitor in the present invention;

FIG. 2 is a block diagram of an embodiment of an intelligent doorbell in accordance with the present invention;

FIG. 3 is a flow chart of an embodiment of a method for visiting reminder according to the present invention;

FIG. 4 is a schematic diagram of one embodiment of a relational network database in the present invention;

FIG. 5 is a schematic diagram of one embodiment of a relational database in the present invention;

FIG. 6 is a flow chart of an embodiment of a method for visiting reminder according to the present invention;

FIG. 7 is a flow chart of an embodiment of a method for visiting reminder in accordance with the present invention;

FIG. 8 is a block diagram of an embodiment of the visit reminder device according to the present invention;

FIG. 9 is a block diagram of an embodiment of the visit reminder device according to the present invention;

FIG. 10 is a block diagram of an embodiment of the visit reminder device according to the present invention;

FIG. 11 is a block diagram of an embodiment of the visit reminder device according to the present invention;

201-a communication module, 202-a camera, 203-a touch key, 204-a light supplement lamp, 205-a doorbell key, 206-a human body infrared sensing module, 207-a fingerprint identification module, 208-a first microphone module, 209-a first main control module, 210-a storage module, 211-a second main control module, 212-a second microphone module, 213-a loudspeaker, 81, 92, 101, 111-a characteristic information acquisition module, 82, 93, 102, 112-an associated member acquisition module, 83, 94, 104, 114-a first information push module, 91-a visit detection module, 103, 113-a second information push module, 115-a receipt information generation module and 116-a receipt information push module.

Detailed Description

Reference will now be made in detail to the present preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein the purpose of the drawings is to graphically supplement the description of the text portion of the specification, so that each feature and the whole technical solution of the present invention can be visually and vividly understood, but the scope of the present invention should not be construed as being limited thereto. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.

In addition, unless defined otherwise, technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.

Example 1

Referring to fig. 1, fig. 1 exemplarily shows a flow chart of a visiting reminding method, the visiting reminding method includes:

step S101: acquiring biological identification characteristic information of a visitor;

step S102: comparing the biological identification characteristic information of the visitor with a relational network database, and acquiring an associated family member corresponding to the visitor according to a comparison result, wherein the relational network database stores the association relationship between the preset biological identification characteristic information of the preset person and the associated family member;

step S103: visiting information of the visiting person is pushed to the associated family members.

In the embodiment, the biological identification characteristic information of the visitor is obtained, the associated family member corresponding to the visitor is obtained by comparing the biological identification characteristic information of the visitor with the relational network database, and the visiting information of the visitor is pushed to the associated family member, so that the family member associated with the visitor can receive the visiting information of the visitor and timely receive the visitor, thereby avoiding missing of important visitors, and overcoming the technical problem that the user cannot know the visitor to visit and easily misses an important visit when the visitor is not indoors in the prior art.

Example 2

The visiting reminding method can be applied to the field of smart homes, each smart home comprises a smart home appliance control system and a smart doorbell, in the embodiment, the smart doorbell is taken as an example for explanation, referring to fig. 2, fig. 2 exemplarily shows a structural block diagram of the smart doorbell, the smart doorbell comprises an outdoor unit and an indoor unit, the outdoor unit is generally installed at an outdoor doorway, and the indoor unit is generally installed indoors to send out a prompting ring to realize visitor visiting reminding. Specifically, the indoor unit includes a speaker 213 for playing voice, a storage module 210 for storing information, a second microphone module 212 for collecting voice, and a second main control module 211 serving as a main control center of the indoor unit; the outdoor unit comprises a communication module 201 for realizing external communication, a first main control module 209 used as a main control center of the outdoor unit, a first microphone module 208 for collecting voice, a camera 202 for collecting doorway monitoring video, a light supplement lamp 204 for collecting images or video light supplement for the camera 202, a human body infrared sensing module 206 for realizing human body detection, a fingerprint identification module 207 for carrying out fingerprint identification, and a trigger switch for triggering the intelligent doorbell, wherein in some application scenarios, the trigger switch can be a touch button 203 or a doorbell button 205, and once a visitor touches the touch button 203 of the outdoor unit or presses the doorbell button 205 of the outdoor unit, the intelligent doorbell control speaker 213 is triggered to send out a prompt ring. In addition, the communication module 201 may be a wired communication module or a wireless communication module, and the wireless communication module may be a bluetooth module or a WiFi module or a mobile communication module, such as a 2G mobile communication module, a 3G mobile communication module, a 4G mobile communication module, or a 5G mobile communication module. By using the communication module 201, the smart doorbell can communicate with other external communication devices, such as a mobile phone or a server.

Referring to fig. 2, the first main control module 209 and the second main control module 211 have a communication connection therebetween, which may be a wired connection or a wireless connection, for example, the communication connection is established through WiFi, and a communication connection manner between the first main control module 209 and the second main control module 211 is not limited herein. In practical use, the first microphone module 208 and the second microphone module 212 may be implemented by a microphone array, and the fill light 204 is implemented by an annular fill light, which may be an annular LED fill light. In addition, the human body infrared sensing module 206 is implemented by a human body infrared sensor. The intelligent doorbell is provided with the fingerprint identification module 207 for realizing door opening according to fingerprint information of a user, and therefore the intelligent doorbell further comprises an electronic lock module, and after the first main control module confirms that the user is a preset user, the first main control module 209 controls the electronic lock module to unlock so as to realize door opening.

In this embodiment, referring to fig. 3, fig. 3 exemplarily shows a flowchart of a visiting reminding method, where the visiting reminding method includes:

step S301: detecting whether a visitor exists in a preset range of a doorway;

step S302: if the visitor is detected within a preset range at the doorway, acquiring biological identification characteristic information of the visitor, wherein the biological identification characteristic information comprises one or more of a human face and voice;

step S303: comparing the biological identification characteristic information of the visitor with a relational network database, and acquiring an associated family member corresponding to the visitor according to a comparison result, wherein the relational network database stores the association relationship between the preset biological identification characteristic information of the preset person and the associated family member;

step S304: visiting information of the visiting person is pushed to the associated family members.

Further, referring to fig. 2, the following describes a specific implementation method of step S301 by taking an intelligent doorbell as an example, including but not limited to the following methods:

the first detection method comprises the following steps: whether the intelligent doorbell is pressed or not is detected, and if the judgment result is yes, it is determined that a visitor is at the door; for example, whether the doorbell button 205 is pressed is detected, and when the doorbell button 205 is pressed, a button signal is output to the first main control module 209, so that it can be determined that there is a visitor in the preset range of the doorway.

The second detection method comprises the following steps: and judging whether the touch key 203 of the intelligent doorbell is touched, if so, indicating that a person touches the key at the door, and determining that a visitor appears in a preset range at the door.

The third detection method comprises the following steps: the camera 202 or the human body infrared sensing module 206 for controlling the intelligent doorbell detects whether a visitor is present in a preset range of an outdoor doorway, wherein the camera 202 can judge whether a human figure or a moving object is present in a monitoring picture through an image processing and recognition technology, when the human figure or the moving object is judged to be present, timing is started to count the staying time, whether the staying time exceeds a first preset time is judged, and if the judgment is yes, the visitor is determined to come. The first preset time period may be freely set, for example, to 5 minutes. Similarly, when the human body infrared sensing module 206 detects that a human body appears, the staying time period starts to be counted, whether the staying time period exceeds a first preset time period is judged, and if the staying time period exceeds the first preset time period, it is determined that a visitor comes.

The fourth detection method comprises the following steps: and controlling the intelligent doorbell to detect whether sound appears in a preset range of an outdoor door, if the sound appears, starting timing to count the duration, judging whether the duration exceeds a second preset duration, and if the duration exceeds the second preset duration, determining that a visitor exists at the door. Similarly, the second preset time period may be freely set, for example, to 5 minutes.

According to the detection method for the visitor, multiple detection methods can be combined to realize detection, so that the detection accuracy of the visitor is improved.

When a visitor is detected at the doorway, the biometric feature information of the visitor is obtained, wherein, referring to fig. 2, the camera 202 may be used to obtain the face image information of the visitor, and similarly, the first microphone module 208 installed at the outdoor doorway may be used to obtain the voice information of the visitor.

In this embodiment, step S303 has two implementation methods, the first implementation method: establishing a relationship network database in advance, acquiring biological identification characteristic information of a preset person as preset biological identification characteristic information, establishing the relationship network database according to an association relationship between the preset person and family members, and referring to fig. 4, fig. 4 exemplarily shows a schematic diagram of the relationship network database, wherein the preset biological identification characteristic information takes human face characteristics as an example, and takes an intelligent doorbell as an example, the family members comprise a user self, a user child, a user partner, a user father and a user mother, after acquiring human face images of a person a and a person B in advance, the user can manually input the human face images of the person a and the person B into the intelligent doorbell, or can shoot the human face images of the person a and the person B by using the intelligent doorbell, take the person a and the person B as the preset person, establish the relationship network database according to the association relationship between the person a and the person B and each family member, referring to fig. 4, person a has an association with the user's child, the user's father, and person B has an association with only the user's father. After the smart doorbell acquires the biological identification feature information of the visitor, taking the face feature as an example, and the visitor acquires the face image of the person A and then searches the relational network database, at this time, family members related to the person A can be acquired as children of the user and fathers of the user through comparison and search.

The second implementation method of step S303: the method comprises the steps that a relational network database is established in advance, specifically, the relational network database comprises an identity database and a relational database, the identity database stores the corresponding relation between the identity information of preset personnel and the preset biological identification characteristic information, the identity information comprises one or more of names and identification numbers, in addition, the identity information can also comprise one or more of ages, sexes, heights and contact calls, and the preset biological identification characteristic information comprises one or more of human faces and voice characteristics; in this embodiment, the preset biometric feature information is face features, the identity information is a name, the family members include the user himself, the user's child, the user's partner, the user's father, and the user's mother, after obtaining the face images of the person a and the person B in advance, the person a and the person B are used as the preset persons, the face images are used as the preset biometric feature information, an identity database is established according to the name of the person a, the name of the person B, and the association relationship between the person a, the person B, and each family member. In an actual visit, taking the person B as an example, after the face image of the person B is acquired, the identity database is searched to determine the identity information of the person B, and after the name (i.e., the identity information) of the person B is acquired, the relationship database is searched according to the name of the person B, so that a family member related to the person B can be acquired as a father of the user.

It is worth noting that when the preset biological recognition characteristic information is voice characteristics and voice of preset personnel is acquired, the intelligent doorbell can be directly utilized for voice characteristic acquisition and recording.

And after acquiring the associated family member corresponding to the visitor, pushing the visiting information of the visitor to the associated family member. The visiting information comprises one or more of a face image of the visiting person, voice of the visiting person and identity information of the visiting person, and in addition, the visiting information can also comprise one or more of visiting times and visiting time. In this embodiment, the visiting information is, for example, a face image of a visitor, and the smart doorbell is, for example, a contact manner of all family members is prestored in the smart doorbell, where the contact manner includes device information (including a phone number and the like) of the smart mobile terminal and contact mailbox information (for example, specific mailbox information), and then the smart doorbell can push the visiting information to the smart mobile terminal of the associated family member through a network or send a notification email to the contact mailbox of the associated family member, where the smart mobile terminal includes a mobile phone, a tablet computer, a smart watch, a smart bracelet and other devices, and after obtaining that the family member associated with the person a is a child of the user and a father of the user, the smart doorbell sends the face image of the person a to the smart watch of the child of the user through the communication module, and at the same time, sending the face image of the person A to a mobile phone of a father of the user; in some application scenarios, a notification mail (containing the face image of person a) may also be sent to 163 mailbox of the father of the user through the communication module.

Therefore, when a visitor visits, the associated family members corresponding to the visitor can be informed in time, the associated family members can know the visit of the visitor in time and can receive the visitor in time, and the family members are prevented from missing important visits.

Further, when the associated family member corresponding to the visiting person cannot be acquired by using the relational network database, the visiting person is determined to be a stranger at this time. In order to improve the feasibility of the method of this embodiment, when the associated family member corresponding to the visitor cannot be obtained by using the relational network database, the voice of the visitor may be identified by using a voice identification technology, and whether the name of the family member appears in the voice is determined, and if the name of the family member appears in the voice, the name of the family member is used as the associated family member of the visitor. Taking the intelligent doorbell as an example, after the intelligent doorbell acquires the associated family member corresponding to the visitor by using a voice recognition technology, the intelligent doorbell sends identity information of the visitor, such as a face image and prompt information for prompting that the next visitor is a stranger, to an intelligent mobile terminal, such as a mobile phone, of the associated family member through a communication module.

Example 3

Embodiment 3 is provided based on embodiment 2, and referring to fig. 6, fig. 6 exemplarily shows a flowchart of a visiting reminding method, and the embodiment provides a visiting reminding method, which includes:

step S601: acquiring biological identification characteristic information of a visitor;

step S602: comparing the biological identification characteristic information of the visitor with a relational network database, and acquiring an associated family member corresponding to the visitor according to a comparison result, wherein the relational network database stores the association relationship between the preset biological identification characteristic information of the preset person and the associated family member;

step S603: the visiting information of the visiting person is pushed to a preset family member;

step S604: visiting information of the visiting person is pushed to the associated family members.

The future access information is pushed to the associated family members corresponding to the visitors, so that the associated family members can receive the push information in real time and receive the visitors, and important visitors are prevented from being missed; the visiting information of the visiting personnel can be pushed to the preset family members, so that the preset family members can be ensured to acquire the visiting information, the safety problem is avoided, and the safety is improved.

In some application scenarios, a software may be developed based on the method of this embodiment, so that a user may install the software on a terminal such as a mobile phone, a tablet computer, a notebook computer, etc., and may set an association relationship between a preset person and a family member for establishing a relationship network database, and may set a family member as a preset family member in advance on the software, where the preset family member is a family member with a viewing right of visiting information, and take an intelligent doorbell as an example, the terminal of the user may establish a communication connection with the intelligent doorbell through a server, so that an operation on the software may be transmitted to the intelligent doorbell, for example, the information of the relationship network database and the preset family member may be transmitted to the intelligent doorbell, and when the user is set as the preset family member, the intelligent doorbell is actually used, when a visiting person comes, the intelligent doorbell firstly confirms the family member with the viewing right of visiting information, when the preset family member is confirmed to be the user, the visiting information of the visiting person is pushed to the intelligent mobile terminal of the user, such as a mobile phone, and specifically, the visiting information is displayed in a message list of software installed on the mobile phone of the user.

Example 4

Embodiment 4 is proposed on the basis of embodiment 3, and referring to fig. 7, fig. 7 exemplarily shows a flowchart of a visiting reminding method, which includes:

step S701: acquiring biological identification characteristic information of a visitor;

step S702: comparing the biological identification characteristic information of the visitor with a relational network database, and acquiring an associated family member corresponding to the visitor according to a comparison result, wherein the relational network database stores the association relationship between the preset biological identification characteristic information of the preset person and the associated family member;

step S703: the visiting information of the visiting person is pushed to a preset family member;

step S704: the visiting information of the visiting person is pushed to the related family members;

step S705: receiving a receipt generating instruction of the associated family member and/or the preset family member to generate receipt information according to the receipt generating instruction;

step S706: and pushing the receipt information to the visitor.

Referring to fig. 2, taking an intelligent doorbell as an example, after visiting information is pushed to a preset family member and an associated family member, the associated family member and the preset family member may input a receipt generation instruction on the software described in embodiment 3, and the software generates receipt information according to the receipt generation instruction, where the receipt information includes voice receipt information or text receipt information, the voice receipt information may be voice of a "notified user", and similarly, the text receipt information may be a text prompt of the "notified user", and finally, the receipt information is pushed to the visitor, and the push manner of the receipt information may be that the voice of the "notified user" is played by using the intelligent doorbell or a text of the "notified user" is displayed on a display screen of the intelligent doorbell, so as to push the receipt information to the visitor, so that the visitor knows that the family member has been notified of a visitor, effectively avoiding the meaningless waiting of the visitors.

The push mode of the receipt information may also be: when the identity information in the identity database in the second implementation method of step S303 includes a contact call and the receipt information is pushed, the receipt information may be directly pushed to a terminal such as a mobile phone of a visitor.

Example 5

Embodiment 5 is proposed on the basis of embodiment 4, and embodiment 5 provides a visiting reminding method, including:

sorting all family members from high priority to low priority in advance;

acquiring the visiting times and/or the staying time of the visiting personnel;

judging whether the number of visits exceeds a preset number and/or judging whether the stay time exceeds a preset time;

if the judgment result is yes, the visitor is shown to have important matters to visit, and whether the receipt information of the family members with high priority is pushed or not is detected;

and if the detection result is negative, the visiting information of the visiting person is pushed to the family member with low priority.

In this embodiment, for the processing of an important visit, whether receipt information has been pushed is detected according to the priority level, and when a high-priority family member does not push receipt information to a visitor, the visit information is pushed to a low-priority family member, so that the visitor is ensured to receive the receipt information from the family member, and the visitor is prevented from waiting for a long time. Taking family members including father, mother, user and sister as an example, the family members are subjected to priority ranking in advance, and are ranked from high to low according to the sequence of the father, the mother, the user and the sister, when the visitors are judged to have important things to visit, whether the father has pushed receipt information or not is judged, if the detection result is negative, the visiting information of the visitors is pushed to the mother, so that the mother knows that the visitors visit; returning to continuously judge whether the mother pushes the receipt information or not, if the receipt information is still not pushed, pushing the visiting information to the user, and so on until the receipt information is pushed to the visitor, so as to ensure that the visitor can receive the receipt information pushed by the family members.

Example 6

In practical applications, a family member receiving the visiting information of the visiting person may have inconvenience in handling the visiting information, and therefore, embodiment 6 is proposed on the basis of embodiment 3, and embodiment 6 provides a visiting reminding method, where the visiting reminding method further includes:

receiving an authorization processing instruction of a related family member and/or a preset family member, wherein the authorization processing instruction comprises authorized family member information;

and pushing the visiting information to the authorized family members according to the authorization processing instruction.

The family members who are not convenient to process the visiting information can input an authorization processing instruction on the software described in embodiment 3, authorize the visiting information and push the visiting information to other family members for receiving processing, so as to avoid that the receipt information cannot be pushed to the visiting persons because the family members are not occupied in processing the visiting information. After receiving the pushed visiting information, other family members may perform operations on the software, such as sending a voice receipt, or performing operations like real-time conversation.

Example 7

Referring to fig. 8, fig. 8 exemplarily shows a structure of a visiting reminder apparatus including:

a characteristic information obtaining module 81, configured to obtain biometric characteristic information of a visitor;

the associated member acquiring module 82 is configured to compare the biometric characteristic information of the visitor with a relationship network database, and acquire an associated family member corresponding to the visitor according to a comparison result, where the relationship network database stores an association relationship between preset biometric characteristic information of a preset person and the associated family member;

the first information pushing module 83 is configured to push visiting information of a visiting person to an associated family member.

In this embodiment, the characteristic information obtaining module 81 first obtains the biometric characteristic information of the visitor, the associated member obtaining module 82 then compares the biometric characteristic information of the visitor with the relational network database to obtain an associated family member corresponding to the visitor, and finally the first information pushing module 83 pushes the visiting information of the visitor to the associated family member, so that the family member associated with the visitor can receive the visiting information of the visitor and timely receive the visitor, thereby avoiding missing important visitors, and overcoming the technical problem that in the prior art, when the visitor is not indoors, the user cannot know the visitor visiting and easily misses an important visitor.

Example 8

The visiting reminding device can be applied to the field of smart homes, each smart home comprises a smart home appliance control system and a smart doorbell, in the embodiment, the smart doorbell is taken as an example for explanation, referring to fig. 2, fig. 2 exemplarily shows a structural block diagram of the smart doorbell, the smart doorbell comprises an outdoor unit and an indoor unit, the outdoor unit is generally installed at an outdoor doorway, and the indoor unit is generally installed indoors to send out a prompting ring to realize visitor visiting reminding. Specifically, the indoor unit includes a speaker 213 for playing voice, a storage module 210 for storing information, a second microphone module 212 for collecting voice, and a second main control module 211 serving as a main control center of the indoor unit; the outdoor unit comprises a communication module 201 for realizing external communication, a first main control module 209 used as a main control center of the outdoor unit, a first microphone module 208 for collecting voice, a camera 202 for collecting doorway monitoring video, a light supplement lamp 204 for collecting images or video light supplement for the camera 202, a human body infrared sensing module 206 for realizing human body detection, a fingerprint identification module 207 for carrying out fingerprint identification, and a trigger switch for triggering the intelligent doorbell, wherein in some application scenarios, the trigger switch can be a touch button 203 or a doorbell button 205, and once a visitor touches the touch button 203 of the outdoor unit or presses the doorbell button 205 of the outdoor unit, the intelligent doorbell control speaker 213 is triggered to send out a prompt ring. In addition, the communication module 201 may be a wired communication module or a wireless communication module, and the wireless communication module may be a bluetooth module or a WiFi module or a mobile communication module, such as a 2G mobile communication module, a 3G mobile communication module, a 4G mobile communication module, or a 5G mobile communication module. By using the communication module 201, the smart doorbell can communicate with other external communication devices, such as a mobile phone or a server.

In this embodiment, referring to fig. 9, fig. 9 is a block diagram illustrating a structure of a visiting reminder, where the visiting reminder includes:

the visiting detection module 91 is used for detecting whether a visitor exists in a preset range of a doorway;

the characteristic information acquiring module 92 is configured to acquire biometric characteristic information of the visitor when the visitor is detected within a preset range at the doorway, where the biometric characteristic information includes one or more of a human face and a voice;

the associated member acquiring module 93 is configured to compare the biometric characteristic information of the visitor with a relationship network database, and acquire an associated family member corresponding to the visitor according to a comparison result, where the relationship network database stores an association relationship between preset biometric characteristic information of a preset person and the associated family member;

and the first information pushing module 94 is used for pushing the visiting information of the visiting person to the associated family member.

Further, the visiting detection module 91 includes, but is not limited to, a first visiting detection sub-module, a second visiting detection sub-module, a third visiting detection sub-module and a fourth visiting detection sub-module, taking an intelligent doorbell as an example, refer to fig. 2, in which:

the first visiting detection submodule is used for detecting whether the intelligent doorbell has a pressing operation or not, and if the judgment result is yes, the fact that a visitor exists at the door is determined; for example, whether the doorbell button 205 is pressed is detected, and when the doorbell button 205 is pressed, a button signal is output to the first main control module 209, so that it can be determined that there is a visitor in the preset range of the doorway.

And the second visiting detection submodule is used for judging whether the touch key 203 of the intelligent doorbell is touched, if so, the second visiting detection submodule indicates that a person touches the key at the door, and the fact that a visiting person appears in the preset range at the door can be determined.

And a third visiting detection submodule, configured to control the camera 202 or the human body infrared sensing module 206 of the smart doorbell to detect whether a visitor is present in a preset range of an outdoor doorway, where the camera 202 may determine whether a human figure or a moving object is present in a monitored picture through an image processing and recognition technique, and when determining that a human figure or a moving object is present, start timing to count a staying time, determine whether the staying time exceeds a first preset time, and if yes, determine that the visitor is present. The first preset time period may be freely set, for example, to 5 minutes. Similarly, when the human body infrared sensing module 206 detects that a human body appears, the staying time period starts to be counted, whether the staying time period exceeds a first preset time period is judged, and if the staying time period exceeds the first preset time period, it is determined that a visitor comes.

And the fourth visiting detection submodule is used for controlling the intelligent doorbell to detect whether sound appears in a preset range of an outdoor door, if the sound appears, timing is started to count the duration, whether the duration exceeds a second preset duration is judged, and if the duration exceeds the second preset duration, a visitor is determined at the door. Similarly, the second preset time period may be freely set, for example, to 5 minutes.

The visiting detection module 91 can be implemented by at least one of the first visiting detection sub-module, the second visiting detection sub-module, the third visiting detection sub-module and the fourth visiting detection sub-module, and the detection results of the plurality of visiting detection sub-modules can be combined to be judged to realize the detection of the visiting person, so that the detection accuracy of the visiting person can be effectively improved. Specifically, the visiting detection module 91 may be implemented by an outdoor unit of an intelligent doorbell.

When a visitor is detected at the doorway, the feature information obtaining module 92 starts to obtain the biometric feature information of the visitor, and the feature information obtaining module 92 may be implemented by using a camera and a first microphone module of the smart doorbell, wherein, referring to fig. 2, the camera 202 may be used to obtain the face image information of the visitor, and similarly, the first microphone module 208 installed at the outdoor doorway may be used to obtain the voice information of the visitor.

In this embodiment, the associated member obtaining module 93 has two working methods, the first working method: establishing a relationship network database in advance, acquiring biological identification characteristic information of a preset person as preset biological identification characteristic information, establishing the relationship network database according to an association relationship between the preset person and family members, and referring to fig. 4, fig. 4 exemplarily shows a schematic diagram of the relationship network database, wherein the preset biological identification characteristic information takes human face characteristics as an example, and takes an intelligent doorbell as an example, the family members comprise a user self, a user child, a user partner, a user father and a user mother, after acquiring human face images of a person a and a person B in advance, the user can manually input the human face images of the person a and the person B into the intelligent doorbell, or can shoot the human face images of the person a and the person B by using the intelligent doorbell, take the person a and the person B as the preset person, establish the relationship network database according to the association relationship between the person a and the person B and each family member, referring to fig. 4, person a has an association with the user's child, the user's father, and person B has an association with only the user's father. After the smart doorbell acquires the biological identification feature information of the visitor, taking the face feature as an example, and the visitor acquires the face image of the person A and then searches the relational network database, at this time, family members related to the person A can be acquired as children of the user and fathers of the user through comparison and search.

The second working method of the associated member acquiring module 93 is as follows: the method comprises the steps that a relational network database is established in advance, specifically, the relational network database comprises an identity database and a relational database, the identity database stores the corresponding relation between the identity information of preset personnel and the preset biological identification characteristic information, the identity information comprises one or more of names and identification numbers, in addition, the identity information can also comprise one or more of ages, sexes, heights and contact calls, and the preset biological identification characteristic information comprises one or more of human faces and voice characteristics; in this embodiment, the preset biometric feature information is face features, the identity information is a name, the family members include the user himself, the user's child, the user's partner, the user's father, and the user's mother, after obtaining the face images of the person a and the person B in advance, the person a and the person B are used as the preset persons, the face images are used as the preset biometric feature information, an identity database is established according to the name of the person a, the name of the person B, and the association relationship between the person a, the person B, and each family member. In an actual visit, taking the person B as an example, after the face image of the person B is acquired, the identity database is searched to determine the identity information of the person B, and after the name (i.e., the identity information) of the person B is acquired, the relationship database is searched according to the name of the person B, so that a family member related to the person B can be acquired as a father of the user.

It should be noted that, when the preset biometric characteristic information is a voice characteristic and the voice of the preset person is acquired, the characteristic information acquiring module 92 may directly acquire and record the voice characteristic by using the intelligent doorbell.

After the associated member obtaining module 93 obtains the associated family member corresponding to the visitor, the first information pushing module 94 pushes the visiting information of the visitor to the associated family member. The visiting information comprises one or more of a face image of the visiting person, voice of the visiting person and identity information of the visiting person, in addition, the visiting information can also comprise one or more of visiting times and visiting time, the visiting times can utilize a camera of the intelligent doorbell to obtain the face image of the visiting person so as to realize visiting times statistics, and similarly, the visiting event of the visiting person can be recorded by utilizing the networking of the intelligent doorbell to obtain the time.

In this embodiment, the visiting information is, for example, a face image of a visitor, and is, for example, an intelligent doorbell, where contact information of all family members, including device information (including a phone number and the like) of an intelligent mobile terminal and contact mailbox information (for example, specific mailbox information), is prestored in the intelligent doorbell, so that the intelligent doorbell can push the visiting information to an intelligent mobile terminal of an associated family member through a network or send a notification email to a contact mailbox of the associated family member, where the intelligent mobile terminal includes a mobile phone, a tablet computer, an intelligent watch, an intelligent bracelet and other devices, and after obtaining that the family member associated with the person a is a child of the user and a father of the user, the intelligent doorbell sends the face image of the person a to a smart watch of the child of the user through a communication module, taking as an example a first working method of the associated member obtaining module 93, meanwhile, the face image of the person A is sent to the mobile phone of the father of the user; in some application scenarios, a notification mail (containing the face image of person a) may also be sent to 163 mailbox of the father of the user through the communication module.

Further, when the associated family member corresponding to the visiting person cannot be acquired by using the relational network database, the visiting person is determined to be a stranger at this time. In order to improve the feasibility of the apparatus of this embodiment, when the associated family member corresponding to the visitor cannot be obtained by using the relational network database, the associated member obtaining module 93 may perform recognition processing on the voice of the visitor by using a voice recognition technology, determine whether the name of the family member appears in the voice, and if it is determined that the name of the family member appears, take the name of the family member as the associated family member of the visitor. Taking the intelligent doorbell as an example, after the intelligent doorbell acquires the associated family member corresponding to the visitor by using a voice recognition technology, the intelligent doorbell sends identity information of the visitor, such as a face image and prompt information for prompting that the next visitor is a stranger, to an intelligent mobile terminal, such as a mobile phone, of the associated family member through a communication module.

Example 9

Embodiment 9 is provided based on embodiment 8, and referring to fig. 10, fig. 10 exemplarily shows a structure diagram of a visiting reminder, and the embodiment provides a visiting reminder, including:

a characteristic information obtaining module 101, configured to obtain biometric characteristic information of a visitor;

the associated member acquiring module 102 is configured to compare the biometric characteristic information of the visitor with a relationship network database, and acquire an associated family member corresponding to the visitor according to a comparison result, where the relationship network database stores an association relationship between preset biometric characteristic information of a preset person and the associated family member;

the second information pushing module 103 is used for pushing the visiting information of the visiting person to a preset family member;

the first information pushing module 104 is configured to push visiting information of a visiting person to an associated family member.

In the visiting reminding device of the embodiment, the first information pushing module 104 pushes the visiting information to the associated family members corresponding to the visiting persons, so that the associated family members can receive the pushed information in real time and receive the visiting persons, and important visiting persons are prevented from being missed; the second information pushing module 103 can also push the visiting information of the visiting person to the preset family member, so that the preset family member can be ensured to obtain the visiting information, the safety problem is avoided, and the safety is improved.

In some application scenarios, a software may be developed based on the device of this embodiment, so that a user may install the software on a terminal such as a mobile phone, a tablet computer, a notebook computer, etc., and may set an association relationship between a preset person and a family member for establishing a relationship network database, and may set a family member as a preset family member in advance on the software, where the preset family member is a family member with a viewing right of visiting information, and in the case of an intelligent doorbell, the terminal of the user may establish a communication connection with the intelligent doorbell through a server, so that an operation on the software may be transmitted to the intelligent doorbell, for example, the information of the relationship network database and the preset family member may be transmitted to the intelligent doorbell, and when the user is set as the preset family member, the intelligent doorbell is actually used, when a visiting person comes, the intelligent doorbell firstly confirms the family member with the viewing right of visiting information, when the preset family member is confirmed to be the user, the visiting information of the visiting person is pushed to the intelligent mobile terminal of the user, such as a mobile phone, and specifically, the visiting information is displayed in a message list of software installed on the mobile phone of the user.

Example 10

An embodiment 10 is proposed on the basis of the embodiment 9, and referring to fig. 11, fig. 11 exemplarily shows a structure diagram of a visiting reminder apparatus, which includes:

a feature information obtaining module 111, configured to obtain biometric feature information of a visitor;

an associated member obtaining module 112, configured to compare the biometric characteristic information of the visitor with a relationship network database, and obtain an associated family member corresponding to the visitor according to a comparison result, where the relationship network database stores an association relationship between the preset biometric characteristic information of the preset person and the associated family member;

the second information pushing module 113 is configured to push the visiting information of the visiting person to a preset family member;

and the first information pushing module 114 is used for pushing the visiting information of the visiting person to the associated family member.

A receipt information generating module 115, configured to receive a receipt generating instruction of the associated family member and/or the preset family member, so as to generate receipt information according to the receipt generating instruction;

and the receipt information pushing module 116 is used for pushing the receipt information to the visitor.

Referring to fig. 2, taking an intelligent doorbell as an example, after visiting information is pushed to a preset family member and an associated family member, the associated family member and the preset family member may input a receipt generation instruction on the software described in embodiment 9, and the software generates receipt information according to the receipt generation instruction, where the receipt information includes voice receipt information or text receipt information, the voice receipt information may be voice of "notified user", and similarly, the text receipt information may be text prompt of "notified user", and finally, the receipt information is pushed to the visiting person, and the pushing manner of the receipt information pushing module 116 may be to play the voice prompt of "notified user" by using the intelligent doorbell or display a word of "notified user" on a display screen of the intelligent doorbell to implement pushing of the receipt information to the visiting person, therefore, the visitor can know that the family member is informed of visiting, and the meaningless waiting of the visitor is effectively avoided.

The pushing manner of the receipt information pushing module 116 may also be: when the identity information in the identity database in the second working method of the related member obtaining module 93 includes a contact call, the receipt information may be directly pushed to a terminal such as a mobile phone of a visitor when the receipt information is pushed.

Example 11

Embodiment 11 is proposed on the basis of embodiment 10, and embodiment 11 provides a visiting reminding apparatus, including:

the sequencing module is used for sequencing all family members from high priority to low priority in advance;

the visiting information acquisition module is used for acquiring the visiting times and/or the staying time of the visiting personnel;

the judging module is used for judging whether the number of visiting times exceeds the preset number of times and/or judging whether the stay time exceeds the preset time;

the detection module is used for detecting whether the receipt information of the family member with high priority is pushed or not when the judgment result of the judgment module is yes and the visitor shows that the important matter is visited;

and the third information pushing module is used for pushing the visiting information of the visiting person to the family member with low priority when the detection result of the detection module is negative.

In this embodiment, for the processing of an important visit, whether receipt information is pushed or not is detected according to the priority level, and when the detection module detects that a family member with a high priority level does not push receipt information to a visitor, the third information pushing module pushes the visit information to a family member with a low priority level, so as to ensure that the visitor receives the receipt information from the family member, and avoid long-time waiting of the visitor. Taking family members including father, mother, user and sister as an example, the family members are subjected to priority ranking in advance, and are ranked from high to low according to the sequence of the father, the mother, the user and the sister, when the visitors are judged to have important things to visit, whether the father has pushed receipt information or not is judged, if the detection result is negative, the visiting information of the visitors is pushed to the mother, so that the mother knows that the visitors visit; returning to continuously judge whether the mother pushes the receipt information or not, if the receipt information is still not pushed, pushing the visiting information to the user, and so on until the receipt information is pushed to the visitor, so as to ensure that the visitor can receive the receipt information pushed by the family members.

Example 12

In practical applications, there is a case where a family member receiving the visiting information of the visiting person is inconvenient to handle the visiting information, so embodiment 12 is proposed on the basis of embodiment 9, and embodiment 12 provides a visiting reminding device, further including:

the system comprises an authorization processing instruction receiving module, a processing module and a processing module, wherein the authorization processing instruction receiving module is used for receiving an authorization processing instruction of a related family member and/or a preset family member, and the authorization processing instruction comprises authorized family member information;

and the fourth information pushing module is used for pushing the visiting information to authorized family members according to the authorization processing instruction.

By using the authorization processing instruction receiving module, the family members who are not convenient to process the visiting information can input the authorization processing instruction on the software described in embodiment 9, authorize the visiting information and push the visiting information to other family members for receiving processing, so as to avoid that the receipt information cannot be pushed to the visiting persons because the family members are not available to process the visiting information. After receiving the pushed visiting information, other family members may perform operations on the software, such as sending a voice receipt, or performing operations like real-time conversation.

Example 13

Embodiment 13 provides a computer-readable storage medium storing computer-executable instructions for causing a computer to perform the visiting reminder method as described in the above embodiment.

It will be understood by those of ordinary skill in the art that all or some of the steps, modules, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.

While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A visiting reminding method is characterized by comprising the following steps:

acquiring biological identification characteristic information of a visitor;

2. The visiting reminder method according to claim 1, wherein the visiting reminder method further comprises:

3. The visiting reminder method according to claim 2, wherein the visiting reminder method further comprises:

and pushing the receipt information to the visitor.

4. The visiting reminder method according to claim 3, wherein the visiting reminder method further comprises:

sorting the family members from high priority to low priority in advance;

acquiring the visiting times and/or the staying time of the visiting person;

5. The visiting reminder method according to claim 2, wherein the visiting reminder method further comprises:

6. The visiting reminding method according to any one of claims 1 to 5, wherein the relational network database comprises an identity database and a relational database, the identity database stores the corresponding relationship between the identity information of the preset person and the preset biological identification feature information, and the relational database stores the corresponding relationship between the identity information of the preset person and the associated family members.

7. An apparatus for reminding a visitor, comprising:

8. The visit reminder device as claimed in claim 7, further comprising:

9. The visit reminder device as claimed in claim 8, further comprising:

10. A computer-readable storage medium storing computer-executable instructions for causing a computer to perform the method of reminding a visitor according to any one of claims 1 to 6.