CN115331340A - Voice interaction method and device of intelligent door lock and intelligent door lock - Google Patents

Voice interaction method and device of intelligent door lock and intelligent door lock Download PDF

Info

Publication number
CN115331340A
CN115331340A CN202210978709.3A CN202210978709A CN115331340A CN 115331340 A CN115331340 A CN 115331340A CN 202210978709 A CN202210978709 A CN 202210978709A CN 115331340 A CN115331340 A CN 115331340A
Authority
CN
China
Prior art keywords
visitor
door lock
relatives
intelligent door
friends
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210978709.3A
Other languages
Chinese (zh)
Inventor
王妙玉
陈嘉乐
吴宁泉
李昌
周亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Hotata Smart Home Co Ltd
Original Assignee
Guangdong Hotata Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Hotata Smart Home Co Ltd filed Critical Guangdong Hotata Smart Home Co Ltd
Priority to CN202210978709.3A priority Critical patent/CN115331340A/en
Publication of CN115331340A publication Critical patent/CN115331340A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00309—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated with bidirectional data transmission between data carrier and locks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/332—Query formulation
    • G06F16/3329—Natural language query formulation or dialogue systems
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00571—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated by interacting with a central unit

Abstract

The invention relates to a voice interaction method and device for an intelligent door lock, the intelligent door lock, an intelligent door lock system and a storage medium. The voice interaction method comprises the following steps: obtaining visitor information, and determining the type of a visitor according to the visitor information; if the visitor is a relative friend, acquiring first interactive content corresponding to the relative friend, and performing voice interaction with the relative friend outdoors based on the first interactive content; and if the visitor is an unfamiliar visitor, acquiring second interactive content corresponding to the unfamiliar visitor, and performing voice interaction with the unfamiliar visitor outdoors based on the second interactive content. The voice interaction method of the intelligent door lock can acquire the corresponding voice content to be played according to the type of the visitor, achieves intelligent voice interaction with different visitors, and is convenient to use.

Description

Voice interaction method and device of intelligent door lock and intelligent door lock
Technical Field
The invention relates to the technical field of intelligent home, in particular to a voice interaction method and device of an intelligent door lock, the intelligent door lock, an intelligent door lock system and a computer readable storage medium.
Background
With the rapid development of security technology, the intelligent door lock gradually enters common families and occupies an important position in the intelligent home. The intelligent door lock can be opened through modes such as passwords, fingerprints or magnetic cards, and generally has a quick voice guide function, so that a user can be helped to correctly set or use the door lock, for example, the user is prompted to open or close the door through voice, and the user is guided to add unlocking fingerprints.
However, the voice content of the quick voice guidance function of the existing intelligent door lock is pre-recorded by a manufacturer, and a user can only select one of the recorded entries to perform voice broadcast, so that the intelligent interactive communication with a visitor cannot be further performed according to the identity of the visitor, and the use is inconvenient.
Disclosure of Invention
In order to solve the problems in the related art, the invention provides a voice interaction method and device for an intelligent door lock, the intelligent door lock, an intelligent door lock system and a computer readable storage medium.
According to a first aspect of the embodiments of the present invention, a voice interaction method for an intelligent door lock is provided, which is applied to the intelligent door lock, and the voice interaction method includes the following steps:
obtaining visitor information, and determining the type of a visitor according to the visitor information;
if the visitor type is relatives and friends, acquiring first interactive content corresponding to the relatives and friends, and performing voice interaction with the relatives and friends outdoors based on the first interactive content;
and if the visitor type is an unfamiliar visitor, acquiring second interactive content corresponding to the unfamiliar visitor, and performing voice interaction with the unfamiliar visitor outdoors based on the second interactive content.
According to a second aspect of the embodiments of the present invention, there is provided a voice interaction device for an intelligent door lock, including:
the visitor type determining module is used for acquiring visitor information and determining the type of a visitor according to the visitor information;
the visitor interaction module is used for acquiring first interaction content corresponding to relatives and friends and carrying out voice interaction with relatives and friends outside a door on the basis of the first interaction content if the visitor is a relatives and friends;
and the second interaction module is used for acquiring second interaction content corresponding to the strange visitor if the visitor is the strange visitor and performing voice interaction with the strange visitor outside the door based on the second interaction content.
According to a third aspect of embodiments of the present invention, there is provided an intelligent door lock, comprising a processor and a memory; the memory is electrically connected with the processor;
the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the voice interaction method of the intelligent door lock as described in any one of the above embodiments.
According to a fourth aspect of the embodiments of the present invention, there is provided an intelligent door lock system, including an intelligent door lock, a server, and a mobile terminal; the intelligent door lock and the mobile terminal are both electrically connected with the server,
the intelligent door lock is in voice interaction with an out-door visitor through the voice interaction method of the intelligent door lock as described in any one of the above embodiments.
According to a fifth aspect of the embodiments of the present invention, there is provided a computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the voice interaction method of the intelligent door lock as described in any one of the above embodiments.
By applying the technical scheme of the embodiment of the application, the visitor information is obtained, the visitor type is determined based on the visitor information, the corresponding interactive content is called according to the visitor type, and voice interaction is carried out on the visitor outside the door based on the interactive content, so that targeted intelligent voice interaction is realized. If the visitor type is relatives and friends, then carry out voice interaction with relatives and friends outdoors based on first interactive content, if the visitor type is strange visitor, then carry out voice interaction with strange visitor outdoors based on second interactive content to realized the intelligent voice interaction with the visitor of different grade type, played the effect of telling the visitor or pacifying the visitor before visitor's visit intelligent door lock is opened, it is comparatively convenient to use, and intelligent degree is high.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
For a better understanding and practice, the invention is described in detail below with reference to the accompanying drawings.
Drawings
Fig. 1 is an application scenario diagram of an intelligent door lock system according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating a voice interaction method for an intelligent door lock according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a step S1 of a voice interaction method according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a step S2 of the voice interaction method according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating a step S22 of a voice interaction method according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating a step S3 of a voice interaction method according to an embodiment of the present invention;
FIG. 7 is a flowchart illustrating step S32 of the voice interaction method according to the embodiment of the present invention;
fig. 8 is a schematic structural diagram of a voice interaction device of an intelligent door lock according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of an intelligent door lock according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present invention. The word "if/if" as used herein may be interpreted as "at … …" or "at … …" or "in response to a determination", depending on the context.
An application scenario of the voice interaction method for the intelligent door lock in the embodiment of the present invention is an intelligent door lock system, please refer to fig. 1, and fig. 1 is an application scenario diagram of the intelligent door lock system shown in the embodiment of the present invention.
The intelligent door lock system comprises an intelligent door lock 100, a server 200 and a mobile terminal 300; the intelligent door lock 100 and the mobile terminal 300 are both connected to the server 200 through a network, and the intelligent door lock 100 performs voice interaction with an out-door visitor through the voice interaction method of the intelligent door lock as described in the above embodiments.
In the intelligent door lock system, the intelligent door lock 100 and the mobile terminal 300 establish network connection with the server 200 to implement network communication, and the network connection mode may be a wired connection mode or a wireless connection mode.
The intelligent door lock 100 is an intelligent lock, and can be installed at a user entrance door or other entrance guard places, collect visitor information and upload the visitor information in a voice interaction process to the server 200, and open or close a door under the control of a user. The intelligent door lock 100 at least comprises a lockset, a processor, a memory, a camera, a voice acquisition device and the like.
The server 200 is a media device between the intelligent door lock 100 and the mobile terminal 300, and provides data processing and data transfer services for the voice interaction method. The server 200 may be an intelligent device such as a desktop computer, an interactive tablet, an intelligent home controller, and the like, which is not limited in this embodiment.
The server 200 is configured to pre-store interactive content with the visitor, pre-store information such as friend-friend feature information and friend-friend identification number, and after the smart door lock 100 determines the type of the visitor, send corresponding interactive content to the smart door lock 100 according to the type of the visitor, or send the interactive content to the smart door lock 100 in advance, and after the smart door lock 100 determines the type of the visitor, directly call the corresponding interactive content to perform voice interaction with the visitor outside the door.
The server 200 may be configured to receive a door lock control instruction sent by the mobile terminal 300 bound to the intelligent door lock 100, and control the intelligent door lock 100 to respond.
The server 200 may be configured to receive visitor visiting information, such as a relatives visiting event or a strangers visiting event, uploaded by the smart door lock 100, and send the relatives visiting information and the friends visiting information and interaction information in an interaction process to the smart terminal bound to the smart door lock 100.
One server 200 can establish network connection with a plurality of intelligent door locks 100, provide data information processing service for the plurality of intelligent door locks 100, and contribute to reducing the data information processing amount of the intelligent door locks 100.
The mobile terminal 300 may be a mobile terminal bound to the smart door lock 100, such as a personal mobile phone, a personal computer, an interactive tablet, an intelligent home indoor unit, and other intelligent devices, which is not limited in this embodiment.
Optionally, if the server 200 is an intelligent home central control machine, the intelligent door lock 100 and the server 200 may be connected by a network cable. Or, the intelligent door lock 100, the server 200, and the mobile terminal 300 may be connected via a local area network, and since the local area network is a network in the same closed area and is not connected to an external network, related data may be prevented from being stolen by an external network hacker, which is helpful to enhance the security of the intelligent door lock.
The following describes the voice interaction method of the smart door lock in detail by using a specific embodiment.
According to a first aspect of the embodiment of the invention, a voice interaction method for an intelligent door lock is provided, and is applied to the intelligent door lock.
Referring to fig. 2, fig. 2 is a flowchart illustrating a voice interaction method for an intelligent door lock according to an embodiment of the present invention.
The voice interaction method of the intelligent door lock is applied to the intelligent door lock and comprises the following steps:
s1: and obtaining visitor information, and determining the type of the visitor according to the visitor information.
In this embodiment, the visitor information is related information for identifying the visitor, such as a visitor image, and/or a visitor voice, and/or a visitor fingerprint, and/or a visitor finger vein information, and other visitor information.
Visitor's image accessible camera is shot and is acquireed the visitor, and visitor's sound accessible sound collection system gathers the sound of visitor, and visitor's fingerprint can be acquireed when the visitor presses the doorbell through fingerprint collection system, and visitor's finger vein information can be acquireed through CCD camera (CCD image sensor).
If the visitor information is the visitor image, the visitor is photographed through the camera to obtain the visitor image, and then the type of the visitor is determined by the intelligent door lock according to the human face characteristic information in the visitor image. The camera used for photographing the visitor can be installed on the intelligent door lock or the user entrance door or the wall and enables the lens to face the entrance direction, the camera can be connected with the intelligent door lock through a network or directly connected with the intelligent door lock, and the acquired visitor image is transmitted to the intelligent door lock, so that the visitor image and pre-stored friend feature information can be matched through the intelligent door lock, and the visitor can be judged to be a friend or an unfamiliar visitor.
Optionally, in order to avoid that the collection of invalid data occupies more memories of the intelligent door lock, after the visitor image is collected, the visitor image is matched with the relatives and friends image prestored on the intelligent door lock, and if the current visitor image is not matched with the prestored relatives and friends image, the current image is deleted immediately, or deleted after a preset time, or deleted after the owner of the intelligent door lock confirms, or deleted automatically according to the collection time node when the image of an unfamiliar visitor is stored to a certain number.
If the visitor information is the voice of the visitor, the voice in the preset range of the intelligent door lock can be collected through the voice collecting device, and then the type of the visitor is determined by the intelligent door lock according to the tone characteristic information in the voice of the visitor. The voice collecting device can be installed on the intelligent door lock or on a user entrance door or on a wall, the voice collecting device can be connected with the intelligent door lock, and the picked visitor voice is transmitted to the intelligent door lock, so that the visitor voice is matched with prestored friend feature information by the intelligent door lock, and the visitor is judged to be a friend or a strange visitor.
If the visitor information is the visitor fingerprint, the visitor information can be acquired through the fingerprint acquisition device. Because visitor usually can press the doorbell in order to try to inform owner when visiting, consequently, for the convenience of the collection of visitor's fingerprint, can combine together fingerprint collection and doorbell and set up as an organic whole, can realize visitor's fingerprint collection, convenient and fast when the visitor presses the doorbell.
Optionally, in order to avoid that the collection of invalid data occupies more memory of the intelligent door lock, after the fingerprint of the visitor is collected, the fingerprint of the visitor is matched with the fingerprint of the relatives and friends prestored on the intelligent door lock, and if the current fingerprint of the visitor is not matched with the fingerprint of the relatives and friends prestored, the current fingerprint is deleted immediately, or deleted after a preset time, or deleted after the owner of the intelligent door lock confirms, or deleted automatically according to the collection time node when the fingerprint of an unfamiliar visitor is stored to a certain amount.
The visitor type can comprise relatives or strangers, the strangers comprise couriers, takemen and other outsiders who are not familiar with the owner of the intelligent door lock, and the strangers cannot store the characteristic information in advance, so that the characteristic information of the visitors which can be stored in advance is related to relatives or family members of the owner of the intelligent door lock.
In an optional embodiment, the user can upload the friend feature information of part of friends to the server in advance through the mobile terminal, and then the server determines the corresponding friend identification number according to the friend feature information, and sends the friend feature information and the friend identification number to the intelligent door lock together. The intelligent door lock receives the relatives and friends characteristic information and the relatives and friends identification number sent by the server in advance and stores the relatives and friends characteristic information and the relatives and friends identification number in advance correspondingly, so that when a visitor visits, the intelligent door lock can directly judge whether the visitor is a relatives and friends according to the visitor information.
If the friend feature information is prestored in the intelligent door lock, as shown in fig. 3, step S1 may include:
s11: and obtaining visitor information, and extracting current visitor characteristic information from the visitor information.
In this embodiment, the visitor information at least includes: a visitor image, and/or a visitor sound, and/or a visitor fingerprint, and/or a visitor finger vein. The visitor feature information includes at least: face feature information, and/or tone feature information, and/or fingerprint feature information, and/or finger vein feature information.
In other embodiments, the guest information may also include other related information, and the guest characteristic information may also include other characteristic information.
S12: and judging whether the current visitor characteristic information is matched with prestored relatives and friends characteristic information, if so, judging that the visitor type is relatives and friends, and if not, judging that the visitor type is an unfamiliar visitor.
The intelligent door lock is pre-stored with a plurality of relatives and friends feature information, if a visitor visits outside the door, the visitor image can be collected through the camera, the visitor face feature is extracted from the visitor image, whether the visitor face feature is matched with the relatives and friends face feature in the pre-stored relatives and friends feature information or not is judged, if the visitor face feature is matched with the relatives and friends face feature, the visitor type is judged as a relatives and friends, and if the visitor face feature is not matched with the relatives and friends face feature, the visitor type is judged as a strange visitor. In addition, the voice of the visitor can be collected through the voice collecting device, the voiceprint feature of the visitor is extracted from the voice of the visitor, whether the voiceprint feature of the visitor is matched with the voiceprint feature of the relatives and friends in the pre-stored characteristic information of the relatives and friends is judged, if yes, the type of the visitor is judged to be the relatives and friends, and if not, the type of the visitor is judged to be a strange visitor.
In an alternative embodiment, the relatives and friends comprise a plurality of relatives and friends caring members, and each relatives and friends caring member is set with a unique relatives and friends identification number. The friend identification number can be a friend identification ID or other friend identifications, and can be used for distinguishing the identities of the friends.
The relatives and friends caring members can be set on the application program by the user through the mobile terminal and uploaded to the server, and the related setting of the relatives and friends caring members comprises the following contents:
and adding or deleting the relatives and friends caring members, and/or remarking the relatives and friends caring members, and/or starting relatives and friends visiting reminding, and/or customizing voice interaction content.
Generally, the intelligent door lock allows setting of a plurality of relatives and friends caring members, for example, setting of ten relatives and friends caring members, and can set voice interaction contents according to the characteristics of each relatives and friends, so that the feelings of the relatives and friends are increased, and the user experience is improved.
In an optional embodiment, when the visitor type is a relatives friend, before the obtaining the first interactive content corresponding to the relatives friend, the method further includes:
determining a relatives identification number corresponding to the matched relatives characteristic information according to the matched relatives characteristic information and the pre-stored incidence relation between the relatives characteristic information and the relatives identification number so as to determine the relatives identification number corresponding to the current visitor characteristic information; and reporting the relatives and friends identification number and the visiting event to a server, and sending relatives and friends visiting information to an intelligent terminal bound with the intelligent door lock through the server.
And in the incidence relation between the relatives and friends characteristic information and the relatives and friends identification number, one relatives and friends identification number is correspondingly matched with at least one relatives and friends characteristic information. For example, a friend identification number may be matched with the friend's facial features and/or may be matched with the friend's voiceprint features and/or may be matched with the friend's fingerprint features and/or may be matched with the friend's finger vein features.
The association relation between the relatives and friends feature information and the relatives and friends identification numbers is stored in the intelligent door lock in advance, and the response speed of the intelligent door lock is improved. Therefore, before the step of obtaining the visitor information and extracting the visitor feature information from the visitor information, the method further comprises the following steps:
receiving and storing the association relationship between the relatives and friends feature information and the relatives and friends identification number issued by the server; the system comprises a server, a mobile terminal and an intelligent door lock, wherein the server receives the relatives and friends characteristic information uploaded by a user through the mobile terminal or the intelligent door lock, and the relatives and friends identification number is correspondingly determined by the server according to the relatives and friends characteristic information.
The mode that the user uploads the friend information through the mobile terminal can be as follows:
the method comprises the steps that a user installs an application program on a mobile terminal, logs in the application program through a registered account, and then collects images, sounds or fingerprints of relatives and friends in real time through the mobile terminal, or directly uploads the images, sounds or fingerprints of relatives and friends stored on the mobile terminal to the application program, and then uploads relatives and friends information to a server to generate and match relatives and friends identification numbers.
In an optional embodiment, the time for acquiring the visitor information may be that when the visitor visits and presses a doorbell or makes a call, the smart door lock starts the visitor information acquisition device to acquire the visitor information of the visitor, and in other times when the visitor does not visit, the visitor information acquisition device and the smart door lock may be in a dormant state, which is beneficial to reducing the power consumption of the smart door lock system and prolonging the service life of a battery of the smart door lock.
In an optional embodiment, the step of obtaining the visitor information and determining the visitor type according to the visitor information further includes: and responding to the pressing operation of the outdoor doorbell, controlling the indoor doorbell to sound to inform the visitor to visit, and sending the visitor visit reminder to the mobile terminal bound with the intelligent door lock. If the intelligent door lock is also bound with other intelligent equipment in a house, if the intelligent door lock is bound with the intelligent sound box, the intelligent sound box can inform the host that a visitor visits.
The visitor arrival reminding mode can be voice reminding and/or short message reminding. If the visitor is a close friend, for example, if the visitor is a grandmother, the visitor is called as a grandmother, and the visitor is called as a grandmother to visit and open a door in time; if the visitor is a strange visitor, the voice prompt can be 'express delivery is arrived, please confirm', or 'take away, please confirm', etc. If the visitor visiting reminder is a short message reminder, when the visitor is a relatives and friends, for example, when the visitor is a grandma, the short message reminder is 'grandma visiting, please open the door in time', and the like; if the visitor is a strange visitor, the short message prompting can be 'express delivery is arrived, please confirm', or 'take away, please confirm', and the like.
S2: and if the visitor type is relatives and friends, acquiring first interactive content corresponding to the relatives and friends, and performing voice interaction with the relatives and friends outdoors based on the first interactive content.
Therefore, a relatives and friends caring member list and first interactive contents corresponding to relatives and friends caring members can be preset in the intelligent door lock system through the mobile terminal, so that the intelligent door lock can be controlled to perform voice interaction with relatives and friends out of a door according to the first interactive contents during visiting, the purposes of pacifying and informing relatives and friends before opening the door can be achieved, urgent waiting of relatives and friends is avoided, and emotional communication among relatives and friends is facilitated to be improved.
In an alternative embodiment, as shown in fig. 4, step S2 may include the steps of:
s21: and if the visitor is a relatives and friends, acquiring first interactive content corresponding to relatives and friends caring members.
The first interactive content comprises a plurality of care interactive contents, and each friend identification number is set with a corresponding care interactive content. Different relatives and friends identification numbers and care interactive contents are set for the relatives and friends, so that the intelligent door lock can replace a host to interactively communicate with the relatives and friends with different contents when the different relatives and friends visit, the intelligent degree is higher, the intelligent door lock is more humanized, and the user experience is improved. If the relatives and friends with a relatively large age such as the grandmother or the father visit, care interactive contents can be properly added, so that the relatives and friends can communicate with the grandmother or the father for many times, and the soothing effect on the grandmother or the father is improved. If the visitor includes a child or a young child, the visitor may also ask whether to play the children's song.
Acquiring first interactive content corresponding to relatives and friends, wherein the method comprises the following steps: and determining the care interactive content corresponding to the relatives and friends identification number according to the incidence relation between the relatives and friends identification number and the care interactive content.
The intelligent door lock can store the incidence relation between the relatives and friends identification number and the care interactive content, and after the intelligent door lock determines the corresponding relatives and friends identification number according to the current visitor characteristic information, the corresponding care interactive content can be searched according to the relatives and friends identification number, and then voice interaction is carried out between the care interactive content and relatives and friends outside the door.
In addition, the server can also store the association relationship between the relatives and friends identification number and the care interactive content.
After the intelligent door lock determines the corresponding relatives and friends identification number according to the current visitor characteristic information, the relatives and friends identification number and the care interactive content obtaining request are sent to the server, the server searches the corresponding care interactive content according to the relatives and friends identification number and sends the corresponding care interactive content to the intelligent door lock, and then the intelligent door lock performs voice interaction with relatives and friends outside the door according to the care interactive content.
Furthermore, a plurality of relatives and friends identification numbers are preset for relatives and friends caring members, and the first interactive content comprises a plurality of caring interactive contents corresponding to the relatives and friends identification numbers.
The friend identification numbers include, but are not limited to, the following friend identification numbers:
grandma identification number, and/or jiujiu identification number, and/or jiuma identification number, and/or tertiary identification number, and/or palliative identification number.
When the care interactive content is used for visiting the relatives and friends, the intelligent door lock can call the care interactive content to deeply communicate with the relatives and friends, so that the effect of pacifying and informing the relatives and friends is achieved, and the intelligent door lock is not only simple voice guidance.
Care interactive content includes, but is not limited to, the following care interactive content:
the method comprises the steps of obtaining first care interactive content corresponding to a grandma identification number, and/or second care interactive content corresponding to a grandma identification number, and/or third care interactive content corresponding to a jijiujiu identification number, and/or fourth care interactive content corresponding to a jiujiu identification number, and/or fifth care interactive content corresponding to a tertiary identification number, and/or sixth care interactive content corresponding to a palliative identification number.
The number of the friend identification numbers is not limited, and the number of the texts concerning the interactive contents is also not limited.
S22: and performing voice interaction with relatives and friends outdoors based on the first interactive content.
Wherein the first interactive contents may include first query contents and first reply contents.
The first interactive content at least comprises first inquiry content inquired for the first time and first response content used for subsequent interactive communication, for example, when the relatives and friends visit and press a doorbell, after the visitor information acquisition device starts to acquire visitor information, if the characteristic information of the relatives and friends is identified, and after the identification number of the relatives and friends is determined, the corresponding first inquiry content can be searched in the corresponding first interactive content for playing. The first query contents may include query contents such as "welcome grandma, informed of the owner to open the door, please wait", and may include query contents such as "welcome grandma, informed of the owner to open the door, please wait".
Optionally, the first interactive content may be set by the owner of the intelligent door lock through the bound mobile terminal, and is sent to the mobile terminal through the server to be prestored. Alternatively, the first interactive contents can be set directly on the smart door lock by the owner of the smart door lock.
In addition, in order to prevent the first interactive content from occupying more memory of the intelligent door lock, the first interactive content can be stored on the server in a text form, when the first interactive content needs to be played, the server searches the corresponding first interactive content according to the friend identification number uploaded by the intelligent door lock, the text of the first interactive content is sent to the intelligent door lock, and the intelligent door lock converts the first interactive content into audio for playing.
Optionally, as shown in fig. 5, step S22 may include:
s221: and acquiring first inquiry content from the first interactive content, and synthesizing the first inquiry content into audio playing.
The first inquiry content can be sent to the intelligent door lock by the server in advance for storage, and during storage, the first inquiry content and the corresponding friend identification number need to be stored correspondingly. When the visitor visits, the intelligent door lock can be used for calling the corresponding first inquiry content to synthesize audio for playing after the intelligent door lock acquires the visitor type issued by the server, so that the response speed of the intelligent door lock is increased, and the user experience is improved.
In addition, the first inquiry content can also be stored in the server in advance, the first inquiry content is issued after the server receives the relatives and friends identification number and the visiting event reported by the intelligent door lock, and then the intelligent door lock synthesizes audio for playing according to the first inquiry content.
S222: and acquiring a parent-friend reply voice, converting the parent-friend reply voice into a first reply language text and uploading the first reply language text to a server, so that the server searches and issues the corresponding first reply text according to the first reply language text.
The friend reply voice can be acquired through the voice acquisition device and converted into the first reply language text by the voice acquisition device to be uploaded to the server, or the friend reply voice is converted into the first reply language text by the intelligent door lock to be uploaded to the server. In other embodiments, the sound collection device may also directly upload the friend reply voice to the server, and the server converts the friend reply voice into the first reply language text.
S223: and receiving the first response text sent by the server, and synthesizing the first response text into audio for playing.
The first reply text is generated by the server according to the first reply language text, so that the information processing capacity of the intelligent door lock is favorably reduced, the power consumption of the intelligent door lock is reduced, and the cost is saved.
The server can generate a first answer text in time according to the first reply voice text, can also generate a plurality of answer texts in advance, extracts keywords in the first reply voice text when the first reply voice text is received, searches the corresponding answer text according to the keywords, and sends the answer text to the intelligent door lock.
Furthermore, the first response content can comprise a plurality of response contents, after the response voice of the relatives and friends is picked up again, the keywords are identified from the response voice of the relatives and friends again, the corresponding response contents are searched again according to the keywords, and the response contents are sent to the intelligent door lock again and converted into audio playing, so that multiple interactions between the intelligent door lock and the relatives and friends at the outer door are realized, a better appeasing effect is achieved for the relatives and friends at the outer door, and the friendship between the relatives and the master is promoted.
The method for recognizing the keywords from the relatives and friends reply voice comprises the following steps: and converting the parent-friend reply voice into text information, and performing semantic recognition on the text information to acquire keywords.
If the visitor is the relatives and friends corresponding to the preset relatives and friends identification number, acquiring care interactive content corresponding to the relatives and friends identification number, and performing voice interaction with relatives and friends outside the door based on the care interactive content; and meanwhile, the visiting information of relatives and friends is sent to the mobile terminal bound with the intelligent door lock so as to inform the owner in the door to open the door.
The visiting information of the relatives and the friends can be sent to the mobile terminal in a short message form and/or a voice form and other forms so as to inform the intelligent door lock owner to open the door in time. The visiting information of relatives and friends can be 'XX visiting, please the master to open the door'. In order to ensure that the host can check the visiting information of the relatives and the friends, the visiting information of the relatives and the friends can be played or popped up for a plurality of times before the host confirms the visiting information.
S3: and if the visitor type is an unfamiliar visitor, acquiring second interactive content corresponding to the unfamiliar visitor, and performing voice interaction with the unfamiliar visitor outdoors based on the second interactive content.
Since the unfamiliar visitor is unfamiliar with the owner of the intelligent door lock, the identification number for identifying the identity cannot be preset, and therefore, the corresponding preset identity identification number cannot be found in face recognition or tone recognition. At this time, second interactive content corresponding to the strange visitor may be acquired, and voice interaction may be performed with the strange visitor at the outer door based on the second interactive content.
In an alternative embodiment, as shown in fig. 6, step S3 may include the steps of:
s31: and if the visitor type is an unfamiliar visitor, acquiring second interactive content corresponding to the unfamiliar visitor.
Since the stranger may include a takeaway, courier, or other stranger, interactive contents corresponding to various stranger types may be included in the second interactive contents.
S32: and performing voice interaction with stranger visitors outside the door based on the second interaction content.
The second interactive content comprises first inquired second inquiry content and second response content used for subsequent interactive communication, and if the visitor information acquisition device starts to acquire visitor information and finds that the visitor outside the door is an unfamiliar visitor when the strange visitor presses the doorbell, the corresponding second inquiry content can be searched in the corresponding second interactive content for playing. The second query content may include query content such as "the host is at rest, please say," or "the host is out, please say," or "the host is busy, please say," etc. to facilitate the corresponding response by the visitor. Optionally, the second interactive content may be set by the owner of the smart door lock through the bound mobile terminal, or may be set directly on the smart door lock.
In order to prevent the second interactive content from occupying more memory of the intelligent door lock, the second interactive content can be stored on the server in a text form, when the second interactive content needs to be played, the text of the second interactive content is sent to the intelligent door lock, and the intelligent door lock converts the second interactive content into audio for playing.
In an alternative embodiment, as shown in fig. 7, step S32 includes:
s321: and acquiring second inquiry content from the second interactive content, and synthesizing the second inquiry content into audio for playing.
The second inquiry content can be sent to the intelligent door lock by the server in advance for storage, when the visitor visits, the intelligent door lock can be used for calling the corresponding second inquiry content to be synthesized into audio for playing after the intelligent door lock obtains the visitor type sent by the server, the response speed of the intelligent door lock is improved, and the user experience is improved.
In addition, the second inquiry content can be pre-stored in the server, when the server receives the visitor type (strange visitor) and the visiting event reported by the intelligent door lock, the second inquiry content is issued to the intelligent door lock, and then the intelligent door lock synthesizes audio according to the first inquiry content for playing.
S322: and acquiring a reply voice of the strange visitor, converting the reply voice of the strange visitor into a second reply language text, uploading the second reply language text to the server, and enabling the server to search and issue a corresponding second reply text according to the second reply language text.
The strange visitor response voice can be acquired through the voice acquisition device and converted into a second response language text by the voice acquisition device to be uploaded to the server, or the strange visitor response voice is converted into the second response language text by the intelligent door lock to be uploaded to the server. In other embodiments, the sound collection device can also directly upload the stranger reply voice to the server, and the stranger reply voice is converted into the second reply language text by the server.
The second response text is generated by the server according to the second reply language text, so that the information processing capacity of the intelligent door lock is reduced, the power consumption of the intelligent door lock is reduced, and the cost is saved.
The server can timely generate a second response text according to the second response voice text, can also generate a plurality of response texts in advance, extracts keywords in the second response voice text when the second response voice text is received, searches for the corresponding response text according to the keywords, and sends the response text to the intelligent door lock.
S323: and receiving a second response text sent by the server, and synthesizing the second response text into audio for playing.
If the picked strange visitor replies that the voice is 'take out', the second response content can be 'take out please put the door open'; if the picked strange visitor replies that the voice is 'express delivery is reached', the second response content can be 'express delivery please put the door' so as to achieve the purpose of informing the visitor.
Furthermore, the second response content can comprise a plurality of response contents, after the response voice of the strange visitor is picked up again, the strange visitor recognizes the keywords in the response voice again, the corresponding response contents are searched again according to the keywords, and the response contents are sent to the intelligent door lock again and converted into audio playing, so that multiple interactions between the intelligent door lock and the strange visitor at the outer door are achieved, and user experience is improved.
In an optional embodiment, if the visitor is an unfamiliar visitor, second interactive content corresponding to the unfamiliar visitor is obtained, and voice interaction is carried out on the stranger visitor outside the door based on the second interactive content; meanwhile, strange visitor visiting information is sent to the mobile terminal bound with the intelligent door lock so as to inform an owner in the door to open the door.
The visiting information of the strange visitor can be sent to the mobile terminal in a short message form, a voice form or other forms so as to inform the intelligent door lock owner to open the door in time. The visiting information of the strange visitor can be 'going out and asking the host to confirm' or 'going in express and asking the host to confirm'. In order to ensure that the owner can see the visiting information of the strange visitor, the visiting information of the strange visitor can be played or popped up for a plurality of times to remind before the owner confirms the visiting information. In other embodiments, the intelligent door lock owner can set that only the visiting information of strange visitors is received without playing or popping up a popup window reminder.
On the basis of the above embodiment, the visitor type and the interactive content corresponding to the visitor type, and/or the related settings may be preset by the user through the mobile terminal and uploaded to the server.
For example, the visitor types can include relatives and friends, strange visitors, door cleaning personnel, home installation personnel and the like, and the number of the visitor types is not limited. The visitor type can also be set according to the use scene of the intelligent door lock, and if the intelligent door lock is installed in a hotel room, the visitor type can also comprise a waiter, a cleaning worker and the like. If the smart door lock is installed in an office, the visitor type may also include a customer, property person, waiter, and other visitor types.
Relevant settings for guest type include, but are not limited to, the following: the method is characterized in that the method comprises the steps of adding and deleting visitor types, and/or commenting the visitor types, and/or opening a visit reminder, and/or customizing voice interaction content, so that the intelligent interaction of the intelligent door lock is promoted.
Optionally, on the basis of the above embodiment, the voice interaction method may further include the following steps: the voice interaction content with the visitor is collected, the interaction log is generated and stored and uploaded to the server, so that the user can check the visitor at the mobile terminal, and the home security is improved.
Optionally, on the basis of the above embodiment, the voice interaction method may further include the following steps: the voice interaction content with the visitor is collected, and the voice interaction content is sent to the mobile terminal bound with the intelligent door lock in real time, so that the user can know the visitor in time.
Optionally, on the basis of the above embodiment, the voice interaction method may further include the following steps: collecting voice interaction content with a visitor, extracting visiting information from the voice interaction content, and sending the visiting information to a mobile terminal bound with an intelligent door lock in real time, wherein the visiting information comprises: visiting purpose information, and/or door opening and closing information, and/or visiting again information, and/or visitor informing content.
For example, a visitor arrival reminder is generated based on the visitor type and sent to the mobile terminal bound with the intelligent door lock. If the relatives and friends visit, the relatives and friends visit information is sent to the mobile terminal and the user is informed in time, so that the host can prepare for reception. If the strange visitor visits, the visiting information of the strange visitor is sent to the mobile terminal and the user is informed, so that the home safety is improved.
Optionally, on the basis of the above embodiment, the usage mode of the intelligent door lock may include a care response mode and a regular response mode, and the usage mode of the intelligent door lock may be preset by the user, for example, the care response mode for visiting relatives and friends.
Thus, step S1 may be preceded by:
responding to the pressing operation of a doorbell of the intelligent door lock, and judging the current use mode of the intelligent door lock;
if the current use mode of the intelligent door lock is judged to be the care response mode, obtaining visitor information, and determining the type of a visitor according to the visitor information;
and if the current use mode of the intelligent door lock is judged to be the conventional response mode, acquiring third interactive content, and carrying out voice interaction with the visitor out of the door based on the third interactive content.
Specifically, when voice interaction is performed with a visitor outside a door based on third interactive content, third inquiry content is obtained from the third interactive content, the third inquiry content is synthesized into audio for playing, then reply voice is obtained, the reply voice is converted into a third reply language text and is uploaded to a server, so that the server generates and issues a third response text according to the third reply language text, then the third response text issued by the server is received, and the third response text is synthesized into audio for playing. The third query content may be "do you, what service you can be provided", or "do you, the host is being notified to open the door", or the like.
The setting method of the use mode of the intelligent door lock can be as follows: receiving a response mode preset operation input by a user through a mobile terminal, and controlling the intelligent door lock to open a corresponding response mode, wherein the response mode comprises but is not limited to: care for the answer mode, or regular answer mode.
Before the visiting is known, the caring response mode can be set by the user through the mobile terminal, and the normal response mode can be set in other time periods.
In addition, different response modes can be started based on different time periods, for example, the response mode of access refusal is started from ten o 'clock at night to seven o' clock in the morning next day, and therefore the intelligent experience of the intelligent door lock is improved.
In an optional embodiment, the voice interaction with the visitor is stopped when the smart door lock is opened, or the voice interaction is stopped when the reply voice of the visitor is not collected within a preset time period, and after the voice interaction is stopped for a period of time, the smart door lock can automatically enter a low-power energy-saving state. If the voice interaction stops for 10 seconds, the system enters the dormant low power consumption mode after no voice reply of the visitor.
On the basis of the above embodiments, the voice interaction method of the present application may also support multiple language interactions, such as mandarin, cantonese, english, or regional dialects. The default language type adopted during the language interaction can be set by an inventor in the research and development process, or set by an installation service person of the intelligent door lock during installation, or set by a user of the intelligent door lock in a self-defined manner in a bound intelligent terminal, or set by the user of the intelligent door lock in the self-defined manner in the intelligent door lock.
In the voice interaction process, if the answer voice of the visitor is recognized to be mandarin, then subsequent voice answer will also adopt mandarin answer, if the answer voice of the visitor is recognized to be cantonese, then subsequent voice answer will also adopt cantonese answer to improve the adaptability and personalized service of intelligent door lock, promote user experience.
By applying the technical scheme of the embodiment of the application, the visitor information is obtained, the visitor type is determined based on the visitor information, the corresponding interactive content is called according to the visitor type, and voice interaction is carried out on the visitor outside the door based on the interactive content, so that targeted intelligent voice interaction is realized. If the visitor type is relatives and friends, then carry out voice interaction with relatives and friends outdoors based on first interactive content, if the visitor type is strange visitor, then carry out voice interaction with strange visitor outdoors based on second interactive content to realized the intelligent voice interaction with the visitor of different grade type, played the effect of telling the visitor or pacifying the visitor before visitor's visit intelligent door lock is opened, it is comparatively convenient to use, and intelligent degree is high.
On the basis of original functions, the intelligent door lock can solve the problems that the voice entry is single and rapid to guide and the reply cannot be customized through user-defined voice content, can analyze the voice interaction content according to different voice contents played by visitors in different identities to realize interaction, compensates the monitoring of the visitors and the analysis of the purpose of the visitors, is higher in intelligent degree, and improves user experience.
According to a second aspect of the embodiment of the present invention, a voice interaction device for an intelligent door lock is invented, and the device can be used for executing the voice interaction method for the intelligent door lock described in the corresponding embodiment of the present application, and has corresponding functions and beneficial effects. For details that are not disclosed in the embodiments of the voice interaction apparatus for an intelligent door lock of the present application, please refer to the contents of the voice interaction method for an intelligent door lock in the above embodiments of the present application.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a voice interaction device of an intelligent door lock according to an embodiment of the present invention.
Voice interaction device 800 of intelligence lock includes:
a visitor type determining module 810, configured to obtain visitor information, and determine a visitor type according to the visitor information;
the first interaction module 820 is configured to, if the visitor type is a relatives and friends, obtain first interaction content corresponding to the relatives and friends, and perform voice interaction with the relatives and friends outdoors based on the first interaction content;
and the second interaction module 830 is configured to, if the type of the visitor is an unfamiliar visitor, obtain second interaction content corresponding to the unfamiliar visitor, and perform voice interaction with the unfamiliar visitor outside the door based on the second interaction content.
The voice interaction device of the intelligent door lock obtains the visitor information, determines the visitor type based on the visitor information, calls corresponding interaction content according to the visitor type, and performs voice interaction with an out-of-door visitor based on the interaction content, so that targeted intelligent interaction is achieved. If the visitor is the relatives and friends outdoors, voice interaction is carried out on the visitor and the relatives and friends outdoors based on the first interactive content, if the visitor is strange, voice interaction is carried out on the visitor and strange visitors outdoors based on the second interactive content, therefore, intelligent voice interaction with visitors of different types is achieved, the visitor is informed or soothed when visiting, the use is convenient, and the intelligent degree is high.
In an alternative embodiment, guest type determination module 810 may include:
the visitor characteristic information extraction unit is used for acquiring visitor information and extracting current visitor characteristic information from the visitor information;
and the visitor type judging unit is used for judging whether the current visitor characteristic information is matched with prestored relatives and friends characteristic information, if so, judging that the visitor type is relatives and friends, and if not, judging that the visitor type is an unfamiliar visitor.
In an alternative embodiment, the first interaction module 820 may include:
the first interactive content obtaining unit is used for obtaining first interactive content corresponding to the relatives and friends caring members if the visitor is relatives and friends;
and the first voice interaction unit is used for carrying out voice interaction with relatives and friends outdoors based on the first interaction content.
In an alternative embodiment, the second interaction module 830 may include:
the second interactive content acquisition unit is used for acquiring second interactive content corresponding to the strange visitor if the visitor type is the strange visitor;
and the second voice interaction unit is used for carrying out voice interaction with stranger visitors outside the door based on the second interaction content.
When the voice interaction method of the intelligent door lock is realized, the voice interaction device of the intelligent door lock can acquire corresponding voice interaction content to be played according to the type of the visitor when the visitor visits, so that intelligent voice interaction with different visitors is realized, and the use is convenient.
It should be noted that, when the voice interaction apparatus for an intelligent door lock provided in the foregoing embodiment executes the voice interaction method for an intelligent door lock of the server, only the division of the functional modules is illustrated, and in practical applications, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above.
In addition, the voice interaction device of the intelligent door lock and the voice interaction method of the intelligent door lock provided by the above embodiments belong to the same concept, and the detailed embodying process is referred to in the embodiments and is not described herein again.
According to a third aspect of embodiments of the present invention, an intelligent door lock is provided.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an intelligent door lock according to an embodiment of the present invention.
The smart door lock includes at least one processor 110 and at least one memory 120; the memory 120 is electrically connected to the processor 110 through a communication bus 130; the memory stores a computer program, and the computer program is suitable for being loaded by the processor 110 and executing the voice interaction method of the intelligent door lock according to any one of the above embodiments.
As shown in fig. 6, the memory 120, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an operating application program of the smart device.
The intelligent door lock further comprises a lock, a camera, a doorbell, a sound acquisition device, a visitor information acquisition device and other necessary components, wherein the visitor information acquisition device can be a camera, a sound acquisition device, a fingerprint acquisition device or a finger vein acquisition device.
Optionally, a display screen is further arranged on the intelligent door lock, and is used for displaying relevant information when a user sets the intelligent door lock in a user-defined manner, or displaying the use mode and the use state information of the intelligent door lock, or displaying a language text in the voice interaction process, or displaying an image of the other party in the voice interaction process. The setting of display screen makes intelligent lock more intelligent, and is more senior, improves user experience.
The intelligent door lock can be used for executing the content of the voice interaction method of the intelligent door lock corresponding to the embodiment of the application, and has corresponding functions and beneficial effects.
According to a fourth aspect of the embodiments of the present invention, there is provided an intelligent door lock system.
The intelligent door lock system comprises an intelligent door lock 100, a server 200 and a mobile terminal 300; the intelligent door lock 100 and the mobile terminal are electrically connected with the server 200, and the intelligent door lock 100 performs voice interaction with an out-door visitor through the voice interaction method of the intelligent door lock as described in the above embodiments.
In this embodiment, the processor of the intelligent door lock 100 may be configured to execute the content of the voice interaction method of the intelligent door lock corresponding to the above-mentioned embodiment of the present invention, and has corresponding functions and beneficial effects.
The intelligent door lock 100, the server 200 and the mobile terminal 300 may be connected by wire or wirelessly. If wireless connection is adopted, 4G communication, 5G communication, or WIFI communication connection may be adopted, which is not limited in this embodiment.
The smart door lock 100, the server 200 and the mobile terminal 300 may be connected through a wide area network, a local area network or a near field communication, which is not limited in this embodiment.
According to a fifth aspect of the embodiments of the present application, there is provided a computer-readable storage medium, on which a computer program is stored, the computer program being adapted to be loaded by a processor and to perform operations related to the voice interaction method for an intelligent door lock described in the above embodiments, and having corresponding functions and advantages.
Computer-readable storage media, including both permanent and non-permanent, removable and non-removable media, may implement the information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer-readable storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable storage medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims (12)

1. A voice interaction method of an intelligent door lock is characterized by comprising the following steps:
obtaining visitor information, and determining the type of a visitor according to the visitor information;
if the visitor type is relatives and friends, acquiring first interactive content corresponding to the relatives and friends, and performing voice interaction with the relatives and friends outdoors based on the first interactive content;
and if the visitor type is an unfamiliar visitor, acquiring second interactive content corresponding to the unfamiliar visitor, and carrying out voice interaction with the unfamiliar visitor outside the door based on the second interactive content.
2. The voice interaction method of the intelligent door lock according to claim 1, wherein friend feature information is prestored in the intelligent door lock;
the obtaining of the visitor information and the determining of the visitor type according to the visitor information include:
obtaining visitor information, and extracting current visitor characteristic information from the visitor information;
and judging whether the current visitor characteristic information is matched with prestored relatives and friends characteristic information, if so, judging that the visitor type is relatives and friends, and if not, judging that the visitor type is an unfamiliar visitor.
3. The voice interaction method for the intelligent door lock according to claim 2, wherein the relatives and friends comprise a plurality of relatives and friends caring members, and each relatives and friends caring member is set with a unique relatives and friends identification number;
when the visitor type is a relatives and friends, before the obtaining the first interactive content corresponding to the relatives and friends, the method further includes:
determining a relatives identification number corresponding to the matched relatives characteristic information according to the matched relatives characteristic information and the pre-stored incidence relation between the relatives characteristic information and the relatives identification number so as to determine the relatives identification number corresponding to the current visitor characteristic information;
and reporting the relatives and friends identification number and the visiting event to a server, and sending relatives and friends visiting information to an intelligent terminal bound with the intelligent door lock through the server.
4. The voice interaction method for intelligent door lock according to claim 3,
before the step of obtaining the visitor information and extracting the visitor characteristic information from the visitor information, the method further comprises the following steps:
receiving and storing the association relationship between the relatives and friends feature information and the relatives and friends identification number issued by the server;
the server receives the friend information uploaded by the user through the mobile terminal to obtain the friend characteristic information, and the friend identification number is correspondingly determined according to the friend characteristic information.
5. The voice interaction method for intelligent door lock according to claim 4, wherein the first interactive contents comprise a plurality of care interactive contents, each relatives and friends identification number is set with a corresponding care interactive content,
the obtaining of the first interactive content corresponding to the relatives and friends includes:
and determining the care interactive content corresponding to the relatives and friends identification number according to the incidence relation between the relatives and friends identification number and the care interactive content.
6. The voice interaction method for the intelligent door lock according to any one of claims 1 to 5, wherein the first interaction content comprises a first query content and a first response content;
the voice interaction with the relatives and friends outdoors based on the first interactive content comprises the following steps:
acquiring first inquiry content from the first interactive content, and synthesizing the first inquiry content into audio for playing;
acquiring a parent-friend reply voice, converting the parent-friend reply voice into a first reply language text and uploading the first reply language text to a server, so that the server searches and issues a corresponding first reply text according to the first reply language text;
and receiving the first response text sent by the server, and synthesizing the first response text into audio for playing.
7. The voice interaction method for the intelligent door lock according to any one of claims 1 to 5, wherein the second interactive contents comprise second inquiry contents and second response contents;
the voice interaction with a stranger visitor out of a door based on the second interaction content comprises:
acquiring second inquiry content from the second interactive content, and synthesizing the second inquiry content into audio for playing;
acquiring strange visitor reply voice, converting the strange visitor reply voice into a second reply language text, uploading the second reply language text to the server, and enabling the server to search and issue a corresponding second reply text according to the second reply language text;
and receiving a second response text sent by the server, and synthesizing the second response text into audio for playing.
8. The voice interaction method of the intelligent door lock according to claim 1, further comprising the steps of:
collecting voice interaction content with the visitor, generating an interaction log, storing the interaction log and uploading the interaction log to a server; and/or the presence of a gas in the atmosphere,
collecting voice interaction content with a visitor, and sending the voice interaction content to a mobile terminal bound with an intelligent door lock in real time; and/or the presence of a gas in the gas,
the method comprises the steps of collecting voice interaction content with visitors, extracting visiting information from the voice interaction content, and sending the visiting information to a mobile terminal bound with an intelligent door lock in real time, wherein the visiting information comprises: visiting purpose information, and/or door opening and closing information, and/or visiting again information, and/or visitor informing content.
9. A voice interaction device of an intelligent door lock is characterized by comprising:
the visitor type determining module is used for acquiring visitor information and determining the visitor type according to the visitor information;
the first interaction module is used for acquiring first interaction content corresponding to relatives and friends and carrying out voice interaction with the relatives and friends outdoors based on the first interaction content if the visitor type is relatives and friends;
and the second interaction module is used for acquiring second interaction content corresponding to the strange visitor if the visitor is the strange visitor, and performing voice interaction with the strange visitor outside the door based on the second interaction content.
10. An intelligent door lock is characterized by comprising a processor and a memory; the memory is electrically connected with the processor; wherein the memory has stored thereon a computer program,
the computer program is adapted to be loaded by the processor and to perform the method of voice interaction of an intelligent door lock according to any of claims 1 to 8.
11. An intelligent door lock system is characterized by comprising an intelligent door lock, a server and a mobile terminal;
the intelligent door lock and the mobile terminal are electrically connected with the server,
the intelligent door lock is in voice interaction with an out-door visitor through the voice interaction method of the intelligent door lock as claimed in any one of claims 1 to 8.
12. A computer-readable storage medium, having stored thereon a computer program,
the computer program, when executed by a processor, implements a voice interaction method for an intelligent door lock as claimed in any one of claims 1 to 8.
CN202210978709.3A 2022-08-16 2022-08-16 Voice interaction method and device of intelligent door lock and intelligent door lock Pending CN115331340A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210978709.3A CN115331340A (en) 2022-08-16 2022-08-16 Voice interaction method and device of intelligent door lock and intelligent door lock

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210978709.3A CN115331340A (en) 2022-08-16 2022-08-16 Voice interaction method and device of intelligent door lock and intelligent door lock

Publications (1)

Publication Number Publication Date
CN115331340A true CN115331340A (en) 2022-11-11

Family

ID=83923263

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210978709.3A Pending CN115331340A (en) 2022-08-16 2022-08-16 Voice interaction method and device of intelligent door lock and intelligent door lock

Country Status (1)

Country Link
CN (1) CN115331340A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090305670A1 (en) * 2008-06-10 2009-12-10 Prairie Interactive Messaging System and method for automated knowledge based authentication
CN104282064A (en) * 2014-09-30 2015-01-14 小米科技有限责任公司 Entrance guard response method and entrance guard response device
CN108074310A (en) * 2017-12-21 2018-05-25 广东汇泰龙科技有限公司 Voice interactive method and intelligent lock administration system based on sound identification module
CN108154579A (en) * 2017-12-22 2018-06-12 深圳市天和荣科技有限公司 A kind of intelligent access control system and exchange method that can be interacted with visitor
CN109660767A (en) * 2018-12-29 2019-04-19 成都国科微电子有限公司 A kind of visitor's response method, intelligent doorbell and the system of intelligent doorbell
CN112333429A (en) * 2020-10-28 2021-02-05 重庆电子工程职业学院 Intelligent household access control system
CN113850088A (en) * 2021-09-13 2021-12-28 珠海格力电器股份有限公司 Door inside and outside dialogue processing method and device, processor and cat eye equipment
CN114360533A (en) * 2021-12-20 2022-04-15 日立楼宇技术（广州）有限公司 Interaction method and system based on machine learning, elevator equipment and medium
CN114510144A (en) * 2020-11-16 2022-05-17 上海擎感智能科技有限公司 Interaction method, terminal and computer readable storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090305670A1 (en) * 2008-06-10 2009-12-10 Prairie Interactive Messaging System and method for automated knowledge based authentication
CN104282064A (en) * 2014-09-30 2015-01-14 小米科技有限责任公司 Entrance guard response method and entrance guard response device
CN108074310A (en) * 2017-12-21 2018-05-25 广东汇泰龙科技有限公司 Voice interactive method and intelligent lock administration system based on sound identification module
CN108154579A (en) * 2017-12-22 2018-06-12 深圳市天和荣科技有限公司 A kind of intelligent access control system and exchange method that can be interacted with visitor
CN109660767A (en) * 2018-12-29 2019-04-19 成都国科微电子有限公司 A kind of visitor's response method, intelligent doorbell and the system of intelligent doorbell
CN112333429A (en) * 2020-10-28 2021-02-05 重庆电子工程职业学院 Intelligent household access control system
CN114510144A (en) * 2020-11-16 2022-05-17 上海擎感智能科技有限公司 Interaction method, terminal and computer readable storage medium
CN113850088A (en) * 2021-09-13 2021-12-28 珠海格力电器股份有限公司 Door inside and outside dialogue processing method and device, processor and cat eye equipment
CN114360533A (en) * 2021-12-20 2022-04-15 日立楼宇技术（广州）有限公司 Interaction method and system based on machine learning, elevator equipment and medium

Similar Documents

Publication Publication Date Title
US10540873B2 (en) Multifunction per-room home automation device
CN208444593U (en) The loudspeaker apparatus of shell with vertical orientation
CN107065586B (en) Interactive intelligent home service system and method
JP2020144375A (en) System control method, system, and program
US11893795B2 (en) Interacting with visitors of a connected home environment
CN107564144A (en) A kind of intelligent robot gate control system and control method
CN109791762A (en) The noise of speech interface equipment reduces
US11195408B1 (en) Sending signals for help during an emergency event
JP6745419B1 (en) Methods, systems, and media for providing information about detected events
KR20190031167A (en) Electronic Device and method for controlling the electronic device
CN109495727B (en) Intelligent monitoring method, device and system and readable storage medium
CN111415448A (en) Access control system, method and device and intelligent sound box
CN111862411A (en) Intelligent household door lock control method, device, equipment and storage medium
CN111612958A (en) Intelligent access control method and device, intelligent access control system and electronic equipment
CN110730330B (en) Sound processing method and device, doorbell and computer readable storage medium
US20180367962A1 (en) Two-way communication interface for vision-based monitoring system
US20190156650A1 (en) Information processing system, information processing apparatus, information processing method, and program
CN111754672B (en) Intelligent doorbell identification system
US20210264827A1 (en) Smart interactive display device, smart interactive display system, and interactive display method thereof
CN114519906A (en) Building entrance guard control method and system based on smart home
CN115331340A (en) Voice interaction method and device of intelligent door lock and intelligent door lock
CN111882711A (en) Door lock control method and system, storage medium and electronic device
KR20060102601A (en) Service system and method for providing robot contents
CN108694782B (en) Control method of health sharing cabin and health sharing cabin system
CN114495921A (en) Voice processing method and device and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination