CN108154579B - Intelligent access control system capable of interacting with visitors and interaction method - Google Patents
Intelligent access control system capable of interacting with visitors and interaction method Download PDFInfo
- Publication number
- CN108154579B CN108154579B CN201711402197.1A CN201711402197A CN108154579B CN 108154579 B CN108154579 B CN 108154579B CN 201711402197 A CN201711402197 A CN 201711402197A CN 108154579 B CN108154579 B CN 108154579B
- Authority
- CN
- China
- Prior art keywords
- visitor
- access control
- cloud server
- information
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Computing Systems (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses an intelligent access control system capable of interacting with visitors and an interaction method, wherein the intelligent access control system comprises an access control terminal, a mobile terminal and a cloud server, the access control terminal collects visitor information, the cloud server identifies the intention of the visitors according to the visitor information and selects a corresponding application scene so as to judge whether connection with the mobile terminal of a resident is needed, if connection with the mobile terminal is not needed, the cloud server directly and automatically interacts with the visitors through the access control terminal according to the application scene so as to guide the visitors to complete corresponding operations, and if connection with the mobile terminal is needed, the visitors are guided to input target household information so as to establish connection between the access control terminal and the mobile terminal and enable the visitors to interact with the target household.
Description
Technical Field
The invention relates to an intelligent access control system, in particular to an intelligent access control system capable of intelligently interacting with visitors and an interaction method thereof.
Background
The traditional entrance guard is a simple message triggering system, and the message content is single. When the visitor triggers the trigger, the receiver receives the signal and generates sound to remind the personnel in the house.
The talkback/visual access control system is added with talkback/visual functions on the basis of the traditional access control system, is a point-to-point communication system, can transmit a trigger signal, can transmit voice/image information, enriches the communication content, and improves the mode and efficiency of responding to visitors by a host.
The internet access control expands the channel of information transmission of the talkback/visual access control, can be accessed to the internet, enables any smart phone accessed to the internet to be connected to the access control through the App, prevents the call of a visitor from being missed even if an owner is not at home, and further improves the efficiency of responding the visitor by the owner.
The existing internet access control generally comprises three important parts:
the door access terminal generally comprises a microprocessor module, a camera module, a microphone module, a loudspeaker module and a network (WiFi) module, which are main hardware components. The video data can be recorded through the camera module; the recording and playing of audio data can be realized through the microphone and the loudspeaker module; the recorded audio and video data can be transmitted to the Internet in real time through the network module.
And (4) mobile terminal App. The App can be connected to the entrance guard terminal as long as the mobile terminal is connected to the Internet, so that the functions of viewing videos and two-way audio talkback in real time are realized.
The cloud server is mainly used for communicating data links of the entrance guard terminal and the mobile terminal App, generally, the entrance guard terminal and the mobile terminal App can establish data connection with the cloud server through the Internet, the cloud server can forward data at one end to the other end, and the function of the cloud server is similar to that of a router, so that point-to-point data communication is achieved.
After a visitor presses a call button on the access control, the access control sends a call request to a cloud server, and the cloud server sends the call request to a mobile terminal App associated with the access control in a push message mode; after receiving the message on the App, the master can select to put through to realize real-time conversation with the visitor, and can also select to quickly reply to inform the visitor of inconvenient answering, which is similar to the answering mode of the traditional telephone.
For example, in the case that a courier sends an express delivery to the door and the owner is not at home, the courier presses a call button, all mobile end apps associated with the doorbell receive the push (such as a male owner, a female owner, children and the old), and many people are disturbed; in fact, the courier only needs to put the express to the specified position at the doorway, the courier does not necessarily need to communicate with the owner in real time, and all the family members do not need to be disturbed due to calling.
For example, if a child who is a neighbor and who is a master is getting up to home and the child plays, the child only needs to call the child and does not want to frighten other family members, but at present, once the child initiates a call, all people receive a call request and cannot call a certain person more accurately.
Disclosure of Invention
In order to solve the technical problems, the invention provides the access control terminal system capable of further ascertaining the true intention of the visitor, which provides reference for the decision of subsequent operation, realizes an accurate solution of the intention of the visitor, does not interfere irrelevant residents, and improves the man-machine interaction experience of the access control terminal and the visitor.
The technical scheme of the invention is as follows:
an intelligent access control system capable of interacting with visitors comprises an access control terminal, a mobile terminal and a cloud server; the method is characterized in that: the access control terminal can collect visitor information and send the visitor information to the cloud server; the method comprises the steps that a cloud server recognizes the intention of a visitor according to collected visitor information, selects a corresponding application scene, judges whether connection with a mobile terminal needs to be established or not according to the selected application scene, directly and automatically interacts with the visitor through an access control terminal according to the application scene if connection with the mobile terminal does not need to be established, and enables the access control terminal to be connected with the mobile terminal to enable the visitor to interact with a mobile terminal holder if connection with the mobile terminal needs to be established.
Preferably, the access control terminal, the mobile terminal and the cloud server are connected through the internet.
Preferably, entrance guard's terminal carries out voice interaction through microphone module, loudspeaker module and visitor, visitor information includes voice information, and microphone module collects the voice information of visitor, and loudspeaker module receives from high in the clouds server or mobile terminal's voice interaction information and visitor and carries out the interaction.
Preferably, the cloud server identifies the intention of the visitor according to the voice information of the visitor and selects a corresponding application scene.
Preferably, when the visitor intention is identified as not needing to find a resident, the first application scene is selected, the cloud server judges that connection with the mobile terminal is not needed, and when the visitor intention is identified as finding a resident, the second application scene is selected, and the cloud server judges that connection with the mobile terminal is needed.
Preferably, the access control terminal further comprises a camera module, the visitor information further comprises image or video information, and the camera module collects the image or video information of the visitor.
Preferably, the image or video information is saved as a visit record.
Preferably, the access control terminal further comprises a key module, and the key module is used for guiding the visitor to input voice information.
Preferably, the access control terminal further comprises a key module, and the key module is used for guiding a visitor to input image or video information.
Preferably, the entrance guard terminal further comprises a display module, the display module receives images or video information of the mobile terminal or the cloud server, when the cloud server judges that connection with the mobile terminal is not needed, the display module receives images or video information capable of guiding the visitor to complete subsequent operation from the cloud server, and when the cloud server judges that connection with the mobile terminal is needed, the display module receives video information or image information of a mobile terminal holder from the mobile terminal.
Preferably, after the first application scene is selected, the cloud server sends voice prompt information to the access control terminal to guide the visitor to complete the operation.
Preferably, after the second application scene is selected, the cloud server sends voice prompt information to a loudspeaker of the access control terminal to guide the visitor to input the connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
Preferably, after the visitor completes the operation, the cloud server pushes an operation result information message of the visitor to the mobile terminal.
Preferably, the first application scene is to send a courier or a water.
Preferably, the second application scenario is finding a resident.
Preferably, the access control terminal comprises a key module, a microphone module and a loudspeaker module, wherein the key module is provided with a first key module which does not need to establish an application scene connected between the access control terminal and the mobile terminal, and a second key module which needs to establish a connection between the access control terminal and the mobile terminal; when the visitor operates the first key module, the cloud server recognizes the intention of the visitor as not needing to find a resident, selects a first application scene and judges that connection with the mobile terminal is not needed; when the visitor operates the second key module, the cloud server recognizes the intention of the visitor as that the visitor needs to find the resident, selects the second application scene, and judges that the visitor needs to be connected with the mobile terminal, so that the access control terminal is connected with the mobile terminal.
Preferably, after the first application scene is selected, the cloud server sends prompt information to the access control terminal to guide the visitor to complete the operation.
Preferably, after the second application scene is selected, the cloud server sends prompt information to a loudspeaker of the access control terminal to guide the visitor to input the connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
Preferably, the cloud server constructs an AI program for man-machine interaction with the visitor through a machine learning and big data method, and the AI program analyzes and understands the visitor information to identify the intention of the visitor and selects a corresponding application scene.
Preferably, when the intention of the visitor is identified as no resident, a first application scene is selected, the cloud server judges that connection with the mobile terminal is not needed, and when the intention of the visitor is identified as a resident, a second application scene is selected, and the cloud server judges that connection with the mobile terminal is needed;
the cloud server establishes a frequently visited guest face image information database, each piece of face image information is used as guest identity information, preference configuration is set according to the face image information database, and preference configuration is that a resident selects preferred guest identity information from the frequently visited guest face image information database as a preference group;
and after the second application scene is selected, the cloud server shoots the face image through the camera module of the access control terminal, the matched face image is searched in the preference configuration, and if the matched image is searched, the cloud server controls the access control terminal to be automatically opened.
Preferably, after the second application scene is selected, the cloud server shoots a face image through a camera module of the access control terminal, and the face image is uploaded to the cloud server for storage as a visitor visiting record; each piece of face image information in the frequently visited guest face image information database is a user-defined face image uploaded by a resident through a mobile terminal or a visitor visiting record of a cloud server inquired by the resident through the mobile terminal and extracted from the visiting record.
A visitor intelligent interaction method applied to an access control system comprises an access control terminal, a mobile terminal and a cloud server; the method is characterized in that:
the access control terminal can collect visitor information and send the visitor information to the cloud server;
the method comprises the steps that a cloud server recognizes the intention of a visitor according to collected visitor information, selects a corresponding application scene, judges whether connection with a mobile terminal needs to be established or not according to the selected application scene, directly and automatically interacts with the visitor through an access control terminal according to the application scene if connection with the mobile terminal does not need to be established, and enables the access control terminal to be connected with the mobile terminal to enable the visitor to interact with a mobile terminal holder if connection with the mobile terminal needs to be established.
Preferably, before the entrance guard terminal collects the visitor information, the visitor sends a service request to the cloud server on the entrance guard terminal, and the cloud server sends a voice prompt to the entrance guard terminal to guide the visitor to input the visitor information.
Preferably, when the visitor intention is identified as not needing to find a resident, the first application scene is selected, the cloud server judges that connection with the mobile terminal is not needed, and when the visitor intention is identified as finding a resident, the second application scene is selected, and the cloud server judges that connection with the mobile terminal is needed.
Preferably, visitor information collected by the access control terminal comprises voice information, and the cloud server identifies the intention of the visitor according to the voice information.
Preferably, after the first application scene is selected, the cloud server sends voice prompt information to the access control terminal to guide the visitor to complete the operation.
Preferably, after the second application scene is selected, the cloud server sends voice prompt information to a loudspeaker of the access control terminal to guide the visitor to input the connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
Preferably, after the visitor completes the operation, the cloud server pushes an operation result information message of the visitor to the mobile terminal.
Preferably, the first application scene is to send a courier or a water.
Preferably, the second application scenario is finding a resident.
Preferably, the visitor inputs visitor information through a key module of the access control terminal, the key module comprises a first key module and a second key module, and when the visitor operates the first key module, the cloud server recognizes that the visitor intends to find out that the visitor does not need to find a resident, selects a first application scene, and judges that the visitor does not need to establish connection with the mobile terminal; when the visitor operates the second key module, the cloud server recognizes the intention of the visitor as that the visitor needs to find the resident, selects the second application scene, and judges that the visitor needs to be connected with the mobile terminal, so that the access control terminal is connected with the mobile terminal.
Preferably, the cloud server constructs an AI program for man-machine interaction with the visitor through a machine learning and big data method, and the AI program analyzes and understands the visitor information to identify the intention of the visitor and selects a corresponding application scene.
Preferably, after selecting the second application scene, before the cloud server sends voice prompt information to the loudspeaker at entrance guard terminal, still include:
the cloud server establishes a frequently visited guest face image information database, each piece of face image information is used as guest identity information, preference configuration is set according to the face image information database, and preference configuration is that a resident selects preferred guest identity information from the frequently visited guest face image information database as a preference group;
and after the second application scene is selected, the cloud server shoots the face image through the camera module of the access control terminal, the matched face image is searched in the preference configuration, if the matched image is searched, the cloud server controls the access control terminal to be automatically opened, if the matched image is not searched, voice prompt information is sent to a loudspeaker of the access control terminal, a visitor is guided to input the connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
Preferably, after the second application scene is selected, the cloud server shoots a face image through a camera module of the access control terminal, and the face image is uploaded to the cloud server for storage as a visitor visiting record; each piece of face image information in the frequently visited guest face image information database is a user-defined face image uploaded by a resident through a mobile terminal or a visitor visiting record of a cloud server inquired by the resident through the mobile terminal and extracted from the visiting record.
The technical scheme of the invention brings beneficial effects
According to the invention, different application scenes are selected according to the intention of the visitor so as to select different processing modes, so that the visitor can more accurately meet the own requirements without disturbing irrelevant residents, and better low-threshold user experience is brought by the man-machine interaction between the visitor and the access control through a voice recognition technology.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a block diagram of system modules of an access control system according to the present invention
FIG. 2 shows an embodiment of a door access interaction method according to the present invention
FIG. 3 shows a preferred embodiment of the door access control interaction method of the present invention
FIG. 4 shows an embodiment of the voice prompt of FIG. 3 replaced by a video, image or text
FIG. 5 is an embodiment of directly replacing the manner of determining the application scenario through speech recognition in FIG. 3 with direct keyboard input
Detailed Description
Example one
As shown in fig. 1, the access control system of the invention comprises an access control terminal 1, a mobile terminal 2 and a cloud server 3, which are in data communication through the internet, wherein the access control terminal is used for collecting visitor information, the mobile terminal is used for establishing communication with the access control terminal so as to facilitate interaction between visitors and residents, and the cloud server is used for analyzing and extracting the visitor information, identifying the intention of the visitors and judging whether the visitors need to establish communication with the residents or not;
the access control terminal 1 comprises a microphone, a loudspeaker, a network module and a controller module, but also comprises a camera, a key module, an LED lamp module, a display module and an electric control lock module (in the prior art, not shown in the figure);
the controller module of the access control terminal receives a door opening instruction of the cloud server, and the control module controls the electric control lock module to open the door according to the instruction;
the key module can be a touch screen or a common keyboard and can input numbers and character information, the display screen can be an LCD display screen, modules such as LEDs are used for prompting visitors to operate and flicker, and the network module can be a wifi or 3G/4G module.
The mobile terminal 2 can be mobile equipment which can operate an access control APP (application), such as a mobile phone, a tablet personal computer and a PDA (personal digital assistant);
the cloud server 3 constructs an AI program for man-machine interaction with the visitor through a machine learning and big data method, the AI program analyzes and extracts the real intention of the visitor, selects an application scene conforming to the intention, judges whether connection with the mobile terminal is needed or not according to the application scene, and if the connection with the mobile terminal is not needed, the fact that the visitor does not need to find a resident is shown, for example, the real intention of the visitor may be only the intention of delivering express or water, at the moment, the visitor can enter the residence without opening the access control, and only the cloud server needs to directly send the access control terminal according to the relevant voice interaction data of the application scene of delivering water or water and delivering express to prompt the visitor to finish water delivery or express delivery operation. If the connection with the mobile terminal is required to be established, the visitor finds the resident, most of the visitors find a certain person, so that the visitor does not need to disturb other people and only needs to establish the connection between the access control terminal and the mobile terminal of the resident needing to be found.
The access control terminal collects visitor information, can directly receive voice signals through a microphone, and a visitor inputs voice information of natural language through the guidance of a key module and sends the voice information to the cloud server, the cloud server identifies the voice information of the visitor through an internal AI program, identifies the identity and the intention of the visitor, judges which reference scene the visitor intention is suitable for, and selects the suitable application scene, the application scene is divided into two types, the first type is not required to disturb residents, the second type is required to find residents, therefore, the first application scene can meet the requirement only by the visitor and the access control terminal through intelligent man-machine interaction, the cloud server can meet the simple requirement of the visitor by setting the AI voice identification program, utilizing big data (such as calling a big data method library) and machine learning technology (such as calling a machine learning method library), for example, the method and the system can be used for sending the express and the water only by guiding the visitor to place the express or the water at a designated position, and preferably, the method and the system can be used for sending a short message or pushing the message to a resident after the operation is finished without establishing real-time bidirectional connection. In the second application scenario, only the visitor needs to find the resident to be found, and establish a bidirectional communication connection with the mobile terminal of the visitor, the visitor can input key information of the resident to be found through the keyboard, the key information can be input through voice or input through a keyboard, such as a mobile phone number, a resident name and the like, preferably, the visitor inputs the name of the resident to be found through voice, the cloud server understands and identifies through an AI program to find the mobile terminal bound with the resident name, and sends a request for establishing the bidirectional connection.
The first application scenario may be extended according to the needs of the guest and is not limited to the few defined in this text.
The visitor information may also include image or video information that may be stored as a visit record for the resident to query.
The specific interaction process of the visitor and the entrance guard can be that the visitor inputs voice information through a key module on the entrance guard, a camera module is opened at the same time to record the whole visiting process, video, image information and voice information are sent to a cloud server together, an AI program on the cloud server understands and identifies the intention of the visitor through semantic analysis, when the intention of the visitor is judged to be suitable for a first application scene, namely, a resident is not needed to be found, the cloud server sends voice prompt information to an entrance guard terminal to guide the visitor to complete operations such as water delivery or express delivery, and feeds back the completion result to the cloud server through the key module, the cloud server can broadcast and push the result to all mobile terminal equipment related to the resident in a short message or message mode to guide the visitor to complete the guide information of the first application scene, and is not limited to voice information, the system can also be video, image and text information, namely after the cloud server selects the first application scene, the image, text or video information for guiding the operation of the visitor is sent to a display module of the access control terminal and is displayed through a display screen. When the intention of the visitor is suitable for the second application scenario, that is, when the visitor needs to be found, the cloud server sends voice prompt information to the access control terminal to guide the visitor to input the connection information of the target resident, wherein the connection information may be a mobile phone number or a name, the connection information of the target resident may be input through a key or may be input through voice, and the content may be '131 xxxxxxxx', 'i find xx', 'xx (name)' and the like. The cloud server finds the mobile terminal bound with the mobile terminal according to the connection information, sends a request for establishing bidirectional connection between the access control terminal and the mobile terminal to the APP corresponding to the access control of the mobile terminal, receives the request and selects acceptance or non-acceptance, and when the request is received, the visitor can establish real-time voice connection with the target resident and can control opening and closing of the access control through the APP on the mobile terminal. Preferably, in the second application scenario, the voice connection is established and the video connection is also established at the same time, so that the visitor and the target resident can perform a real-time video call. Preferably, in the second application scenario, the visitor and the resident may not need to establish real-time voice or video, for example, when the cloud server finds the mobile terminal of the target resident according to the connection information input by the visitor, only the visitor needs to be guided to input text or voice information and push the text or voice information to the mobile terminal APP of the target resident, which is similar to text and voice message transmission on WeChat, mainly considering that the target resident may set a setting of no disturbance on the access control APP for inconvenience, and when the target resident sees the message, the access control APP can be controlled to open or not open the door.
In the second application scene, identity authentication of the visitor can be performed, for example, when the cloud server judges the intention of the visitor through a voice technology and selects the second application scene, the cloud server controls a camera of the access control terminal to shoot an image of the visitor to perform face recognition, the cloud server can be connected with a public security system, and the real identity of the visitor is recognized and stored so as to provide a safe visiting record; or the cloud server can establish a database of face image information of frequently-coming visitors, identify whether the current visitor is the frequently-coming visitor, and authenticate the current visitor if the current visitor is the frequently-coming visitor, wherein the frequently-coming visitor can be extracted from the visitor visiting record and set by the resident through the resident, and can be set by the resident through the mobile phone APP; the cloud server extracts identity information of the visitor from the visiting record, the identity information comprises a face photo of the visitor, the resident can selectively add some identity information into a face image information database of the frequent visitor through the mobile terminal APP, each face image in the data corresponds to the identity information of the frequent visitor, and the resident can also add a self-defined face image into the database through uploading of the mobile terminal APP; and identifying whether the visitor is a frequent visitor, wherein when the second type of application scene is selected, the face image recorded by the current visit is searched and compared with the face information of the face image information database of the frequent visitor, and if the face image is searched, the visitor is authenticated as the frequent visitor.
The cloud server can also provide preference visitor setting, when the cloud server identifies that frequent visitors meet the preference visitors, two-way connection with the resident mobile terminal is not needed to be established, the preference setting enables some frequent visitors to be identified as visitors with door opening permission by the resident, therefore, when the visitors visit, the resident is not needed to be disturbed, the cloud server identifies that the frequent visitors meet the preference setting, the entrance guard is automatically opened, and a message push of which frequent visitor visits is pushed to the resident.
The resident can set visitor preference configuration for door opening of the access control terminal through the APP of the mobile terminal, the visitor preference configuration is stored on the cloud server, the preference configuration is based on a face image information database of frequent visitors established by the cloud server, the resident selects visitor identity information capable of automatically opening the door from the face image information database of the frequent visitors and adds preference configuration, the preference configuration is equivalent to selecting some visitor identity information from the database to establish a preference configuration group, when the visitors visit, after the cloud server selects a second application scene, a face picture is shot through a camera of the access control terminal, matched face picture information is searched in the preference configuration group, and after the visitor identity information is found, the cloud server controls the access control terminal to be automatically opened; when the cloud server does not find the matched face picture, prompt information is sent to the access control terminal to prompt the connection information of the target resident to be found, so that the visitor can establish bidirectional connection with the mobile terminal of the target resident through the access control terminal to communicate.
The high in the clouds server passes through network and entrance guard terminal interconnect, in the second application scene, when the high in the clouds server judges that the frequent visitor of preference is automatic to open the door, the high in the clouds server controls the electric control lock module through sending the instruction of opening the door and opens the door for the control module at entrance guard terminal, after the high in the clouds server judges that the frequent visitor of preference or very coming the visitor, set up behind entrance guard terminal and the very big mobile terminal's of target resident family both-way junction, after resident family and visitor communicate, agree to open the door, then resident family sends the instruction of opening the door to the high in the clouds service through mobile terminal APP, the high in the clouds server forwards this instruction of opening the door to entrance guard terminal, the controller module at entrance guard terminal opens according to this instruction of opening.
Example two
The embodiment is different from the first embodiment mainly in that the intention of the visitor is not realized by voice recognition, but is realized by a key module on the access control terminal, for example, the key of the access control terminal may be provided with a plurality of buttons of a default first application scene, that is, may be called a first key module, for example, water delivery and delivery of express, after the visitor presses the key, the cloud server may directly judge that the intention of the visitor is not to find a person, and select the first application scene, the access control terminal is further provided with a button of a second application scene, that is, may be called a second key module, for example, find a person, after the visitor presses the key, the cloud server prompts the visitor to input the connection information of the target resident, the key module of the embodiment has keys capable of inputting numeric and text information in addition to the button selected by the application scene, the key module may be a touch screen and is set by software, but may also be a physical keyboard dedicated to access control.
According to the access control systems of the first embodiment and the second embodiment, a corresponding visitor intelligent interaction method of the access control system can be provided, and the visitor intelligent interaction method utilizes an access control terminal, a mobile terminal and a cloud server to realize intelligent human-computer interaction of a visitor with the access control terminal; such as
The visitor information can be collected through the access control terminal and sent to the cloud server; the method comprises the steps that a cloud server recognizes the intention of a visitor according to collected visitor information, selects a corresponding application scene, judges whether connection with a mobile terminal needs to be established or not according to the selected application scene, directly and automatically interacts with the visitor through an access control terminal according to the application scene if connection with the mobile terminal does not need to be established, and enables the access control terminal to be connected with the mobile terminal to enable the visitor to interact with a mobile terminal holder if connection with the mobile terminal needs to be established.
Before the access control terminal collects visitor information, a service request can be sent to the cloud server by a visitor on the access control terminal, the cloud server sends a voice prompt to the access control terminal to guide the visitor to input the visitor information, as shown in fig. 2, when the visitor is identified, the visitor intends to find a resident, a first application scene is selected, the cloud server judges that connection with the mobile terminal is not needed, when the visitor is identified, a second application scene is selected, and the cloud server judges that connection with the mobile terminal is needed.
The visitor information collected by the access control terminal includes voice information, and the cloud server recognizes the intention of the visitor according to the voice information, as shown in fig. 3, fig. 3 is a preferred embodiment of fig. 2, and the interaction information is implemented in a natural language manner through a voice recognition technology.
And after the first application scene is selected, the cloud server sends voice prompt information to the access control terminal to guide the visitor to complete the operation.
And after the second application scene is selected, the cloud server sends voice prompt information to a loudspeaker of the access control terminal to guide the visitor to input the connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
After the visitor completes the operation, the visitor can send feedback information for completing the operation to the cloud server through the access control terminal, and the cloud server can push a push message for completing the operation of visiting the visitor to the mobile terminal of the resident.
The first application scene is for sending express or water, and the second application scene is for finding a resident, namely an application scene without interaction with the resident.
Fig. 4 is one embodiment of replacing the voice prompt of fig. 3 with a video, image, or text.
The method comprises the steps that the intention of a visitor is identified, the visitor can input visitor information through a key module of an access control terminal without the voice information of the visitor, the key module comprises a first key module and a second key module which respectively correspond to a first application scene and a second application scene, when the visitor operates the first key module, the cloud server identifies the intention of the visitor as not needing to find a resident, selects the first application scene and judges that connection with the mobile terminal is not needed; when the visitor operates the second key module, the cloud server recognizes the intention of the visitor as that the visitor needs to find the resident, selects the second application scene and judges that the visitor needs to establish connection with the mobile terminal, so that the access control terminal is connected with the mobile terminal, the first key module is provided with a water sending key, an express sending key and the like, the number of keys of the first application scene can be increased according to the specific scene which does not need to disturb the resident, when the visitor presses the keys of the first type of application scene, the cloud server selects the first application scene, judges that the two-way connection between the access control and the mobile terminal does not need to be established with the resident, and when the visitor presses the keys of the second application scene, the second application scene is selected, judges that the visitor needs to establish connection with the mobile terminal of the resident, and then prompt information is sent to the access control terminal to guide the visitor to input target resident information.
The cloud server constructs an AI program for man-machine interaction with the visitor through a machine learning and big data method, the AI program analyzes and understands visitor information to identify the intention of the visitor and selects a corresponding application scene.
The above embodiments are merely examples of the present invention, and all schemes that can realize the visitor intention recognition, select an application scene, and determine whether to establish a connection with a resident, so that a visitor can realize convenience and interaction through an access control terminal are within the scope of the present invention.
Claims (20)
1. An intelligent access control system capable of interacting with visitors comprises an access control terminal, a mobile terminal and a cloud server; the method is characterized in that: the access control terminal can collect visitor information and send the visitor information to the cloud server; the method comprises the steps that a cloud server identifies intention of a visitor according to collected visitor information, selects a corresponding application scene, judges whether connection with a mobile terminal needs to be established or not according to the selected application scene, directly and automatically interacts with the visitor through an access control terminal according to the application scene if connection with the mobile terminal does not need to be established, and enables the access control terminal to be connected with the mobile terminal to enable the visitor to interact with a mobile terminal holder if connection with the mobile terminal needs to be established;
the method comprises the steps that an access control terminal collects visitor information, a microphone directly receives voice signals, the visitor inputs voice information of natural language through the guidance of a key module and sends the voice information to a cloud server, the cloud server identifies the voice information of the visitor through a built-in AI program, identifies the identity and the intention of the visitor, judges which reference scene the visitor intention is suitable for, and selects the suitable application scene, wherein the application scene is divided into two types, the first type is that a resident is not required to be disturbed, and the second type is that the resident is required to be found;
after the first application scene is selected, the cloud server sends voice prompt information to the access control terminal to guide the visitor to complete the operation corresponding to the identity intention of the visitor; and after the second application scene is selected, the cloud server sends voice prompt information to a loudspeaker of the access control terminal to guide the visitor to input the connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
2. The intelligent access control system according to claim 1, wherein the access control terminal, the mobile terminal and the cloud server are connected through the internet.
3. The intelligent access control system of claim 1, wherein the access control terminal performs voice interaction with the visitor through a microphone module and a speaker module, the visitor information includes voice information, the microphone module collects the voice information of the visitor, and the speaker module receives the voice interaction information from the cloud server or the mobile terminal to perform interaction with the visitor.
4. The intelligent access control system according to claim 3, wherein the cloud server identifies the intention of the visitor according to the voice information of the visitor and selects a corresponding application scene.
5. The intelligent access control system according to claim 4, wherein when the visitor intention is recognized as not needing to find a resident, a first application scenario is selected, the cloud server determines that connection with the mobile terminal is not needed, and when the visitor intention is recognized as finding a resident, a second application scenario is selected, and the cloud server determines that connection with the mobile terminal is needed.
6. The intelligent access control system of claim 3, wherein the access control terminal further comprises a camera module, the visitor information further comprises image or video information, and the camera module collects the image or video information of the visitor.
7. The intelligent access control system according to claim 3, wherein the access control terminal further comprises a key module, and the key module is used for guiding a visitor to input voice information.
8. The intelligent access control system of claim 3, wherein the access control terminal further comprises a display module, the display module receives an image or video information of the mobile terminal or the cloud server, when the cloud server determines that the connection with the mobile terminal is not required, the display module receives the image or video information capable of guiding the visitor to complete the subsequent operation from the cloud server, and when the cloud server determines that the connection with the mobile terminal is required, the display module receives the video information or image information of the mobile terminal holder from the mobile terminal.
9. The intelligent access control system of claim 5, wherein after the first application scenario is selected, the cloud server sends a voice prompt message to the access control terminal to guide the visitor to complete the operation.
10. The intelligent access control system according to claim 5, wherein after the second application scenario is selected, the cloud server sends a voice prompt message to a speaker of the access control terminal to guide the visitor to input the connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
11. The intelligent access control system of claim 5, wherein the first application scenario is delivery of express or water.
12. The intelligent access control system of claim 5, wherein the second application scenario is finding a resident.
13. The access control system of claim 6, wherein the first application scenario is selected when the visitor is identified as not needing to find a resident, the cloud server determines that no connection with the mobile terminal is needed, and the second application scenario is selected when the visitor is identified as finding a resident, and the cloud server determines that a connection with the mobile terminal is needed;
the cloud server establishes a frequently visited guest face image information database, each piece of face image information is used as guest identity information, preference configuration is set according to the face image information database, and preference configuration is that a resident selects preferred guest identity information from the frequently visited guest face image information database as a preference group;
and after the second application scene is selected, the cloud server shoots the face image through the camera module of the access control terminal, the matched face image is searched in the preference configuration, and if the matched image is searched, the cloud server controls the access control terminal to be automatically opened.
14. The access control system of claim 13, wherein after the second application scene is selected, the cloud server captures a face image through a camera module of the access control terminal, and the face image is uploaded to the cloud server for storage as a visitor visit record; each piece of face image information in the frequently visited guest face image information database is a user-defined face image uploaded by a resident through a mobile terminal or a visitor visiting record of a cloud server inquired by the resident through the mobile terminal and extracted from the visiting record.
15. A visitor intelligent interaction method applied to an access control system comprises an access control terminal, a mobile terminal and a cloud server; the method is characterized in that:
the access control terminal can collect visitor information and send the visitor information to the cloud server;
the method comprises the steps that a cloud server recognizes the intention of a visitor according to collected visitor information, selects a corresponding application scene, judges whether connection with a mobile terminal needs to be established or not according to the selected application scene, directly and automatically interacts with the visitor through an access control terminal according to the application scene if connection with the mobile terminal does not need to be established, and enables the access control terminal to be connected with the mobile terminal to enable the visitor to interact with a mobile terminal holder if connection with the mobile terminal needs to be established.
16. The intelligent visitor interaction method of claim 15, wherein before the entrance guard terminal collects the visitor information, the visitor sends a service request to the cloud server on the entrance guard terminal, and the cloud server sends a voice prompt to the entrance guard terminal to guide the visitor to input the visitor information.
17. The method of claim 16, wherein when the visitor is identified as not intending to find a resident, a first application scenario is selected, the cloud server determines that no connection with the mobile terminal is required, and when the visitor is identified as intending to find a resident, a second application scenario is selected, and the cloud server determines that a connection with the mobile terminal is required.
18. The intelligent visitor interaction method of claim 17, wherein after the second application scenario is selected, the cloud server sends a voice prompt message to a speaker of the access control terminal to guide the visitor to input connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
19. The intelligent visitor interaction method of claim 18, wherein after the second application scenario is selected, before the cloud server sends the voice prompt to the speaker of the access control terminal, the method further comprises:
the cloud server establishes a frequently visited guest face image information database, each piece of face image information is used as guest identity information, preference configuration is set according to the face image information database, and preference configuration is that a resident selects preferred guest identity information from the frequently visited guest face image information database as a preference group;
and after the second application scene is selected, the cloud server shoots the face image through the camera module of the access control terminal, the matched face image is searched in the preference configuration, if the matched image is searched, the cloud server controls the access control terminal to be automatically opened, if the matched image is not searched, voice prompt information is sent to a loudspeaker of the access control terminal, a visitor is guided to input the connection information of the target resident, and the cloud server establishes a voice connection channel between the access control terminal and the mobile terminal of the target resident according to the connection information.
20. The intelligent visitor interaction method according to claim 19, wherein after the second application scenario is selected, the cloud server takes a face image through a camera module of the access control terminal, and the face image is uploaded to the cloud server for storage as a visitor visit record; each piece of face image information in the frequently visited guest face image information database is a user-defined face image uploaded by a resident through a mobile terminal or a visitor visiting record of a cloud server inquired by the resident through the mobile terminal and extracted from the visiting record.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711402197.1A CN108154579B (en) | 2017-12-22 | 2017-12-22 | Intelligent access control system capable of interacting with visitors and interaction method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711402197.1A CN108154579B (en) | 2017-12-22 | 2017-12-22 | Intelligent access control system capable of interacting with visitors and interaction method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108154579A CN108154579A (en) | 2018-06-12 |
| CN108154579B true CN108154579B (en) | 2020-05-22 |
Family
ID=62464937
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711402197.1A Active CN108154579B (en) | 2017-12-22 | 2017-12-22 | Intelligent access control system capable of interacting with visitors and interaction method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108154579B (en) |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108810471A (en) * | 2018-06-14 | 2018-11-13 | 北京奇虎科技有限公司 | A kind of intelligent doorbell, information sharing method and device |
| CN108810472A (en) * | 2018-06-14 | 2018-11-13 | 北京奇虎科技有限公司 | A kind of control method and device of intelligent doorbell, intelligent doorbell |
| CN108777780A (en) * | 2018-06-14 | 2018-11-09 | 北京奇虎科技有限公司 | A kind of intelligent doorbell, intellectual broadcast method and device |
| CN108933929A (en) * | 2018-07-16 | 2018-12-04 | 北京奇虎科技有限公司 | A kind of video monitoring method and security protection detection equipment |
| CN109243026B (en) * | 2018-09-03 | 2022-01-11 | 日立楼宇技术（广州）有限公司 | Visitor management method and system |
| CN109658550A (en) * | 2018-11-01 | 2019-04-19 | 佛山市杰之恒信息科技有限公司 | A kind of Inpatient Area visits system and method |
| CN109754504A (en) * | 2018-12-13 | 2019-05-14 | 深圳市万物联有限公司 | A kind of intelligent access control system |
| CN110400406A (en) * | 2019-07-30 | 2019-11-01 | 深圳市万普拉斯科技有限公司 | Door lock control system, method, display control terminal and door-lock controller |
| CN110634211A (en) * | 2019-08-05 | 2019-12-31 | 深圳市大拿科技有限公司 | Visiting reminding method and related equipment |
| CN110634214B (en) * | 2019-09-18 | 2021-11-26 | 青岛海尔科技有限公司 | Equipment control method and device of Internet of things operating system |
| CN111415448A (en) * | 2019-12-20 | 2020-07-14 | 阿里巴巴集团控股有限公司 | Access control system, method and device and intelligent sound box |
| CN111047761A (en) * | 2019-12-25 | 2020-04-21 | 深圳招商建筑科技有限公司 | Voice interactive visitor identity recognition method and system based on intelligent terminal |
| CN111951452A (en) * | 2020-08-24 | 2020-11-17 | 合肥优恩物联网科技有限公司 | Thousand people thousand faces information push cloud platform based on entrance guard video information gathers |
| CN112008736A (en) * | 2020-08-27 | 2020-12-01 | 上海明略人工智能(集团)有限公司 | Welcome robot allocation method and device, storage medium and electronic device |
| CN112215995A (en) * | 2020-10-15 | 2021-01-12 | 广东科徕尼智能科技有限公司 | Control method and system for remote visual intercom intelligent door lock and storage medium |
| CN112215993A (en) * | 2020-10-15 | 2021-01-12 | 广东科徕尼智能科技有限公司 | Control method and system for remote visual intercom intelligent door lock and storage medium |
| CN113225364B (en) * | 2020-10-29 | 2022-05-27 | 深圳市芯中芯科技有限公司 | AI intelligent monitoring attendance system and method |
| CN112735014A (en) * | 2020-12-25 | 2021-04-30 | 中标慧安信息技术股份有限公司 | Visual talkback method and system based on face recognition |
| CN112995609B (en) * | 2021-03-26 | 2022-09-02 | 内蒙古电子科技有限责任公司 | Visual communication system based on weak current engineering and operation method thereof |
| CN113241078A (en) * | 2021-05-10 | 2021-08-10 | 杭州魔点科技有限公司 | Attendance machine-based voice recognition method and system |
| CN113538760B (en) * | 2021-07-13 | 2023-01-17 | 广东金鸿星智能科技有限公司 | Entrance guard host based on voice recognition and entrance guard control method thereof |
| CN114005210A (en) * | 2021-09-24 | 2022-02-01 | 珠海格力电器股份有限公司 | Safety protection method and safety protection device |
| WO2023136937A1 (en) * | 2022-01-14 | 2023-07-20 | Ademco Inc. | A smart doorbell with temperature sensor |
| CN115331340A (en) * | 2022-08-16 | 2022-11-11 | 广东好太太智能家居有限公司 | Voice interaction method and device of intelligent door lock and intelligent door lock |
| CN115410305A (en) * | 2022-08-26 | 2022-11-29 | 大连爱加加智慧科技有限公司 | Visitor access control management method and system based on two-dimensional code |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853535A (en) * | 2010-05-25 | 2010-10-06 | 无锡中星微电子有限公司 | Door control system and door control management method |
| CN103081453A (en) * | 2010-09-01 | 2013-05-01 | 松下电器产业株式会社 | Intercommunication system |
| KR101419794B1 (en) * | 2014-01-06 | 2014-07-15 | 주식회사 코어셀 | The method for controlling the access of school visitors through the face recognition |
| CN104282064A (en) * | 2014-09-30 | 2015-01-14 | 小米科技有限责任公司 | Entrance guard response method and entrance guard response device |
| CN104754306A (en) * | 2015-04-03 | 2015-07-01 | 厦门狄耐克电子科技有限公司 | Intelligent access control system with analog-to-digital conversion function |
| CN106375641A (en) * | 2016-08-31 | 2017-02-01 | 深圳博科智能科技有限公司 | Home-entry video intercom robot and home-entry video intercom control method |
| CN106846577A (en) * | 2017-01-19 | 2017-06-13 | 泰康保险集团股份有限公司 | Personnel's discrepancy authority control method and device based on recognition of face |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103281223B (en) * | 2013-05-15 | 2016-05-25 | 五邑大学 | A kind of modern intelligent household security system |
| CN104952138A (en) * | 2015-07-21 | 2015-09-30 | 金琥 | Voice interactive access control system and achievement method thereof |
| CN106548543B (en) * | 2016-10-06 | 2019-03-15 | 雷飏 | Access control equipment, user terminal, background system and method for the access control equipment |
| CN106782539A (en) * | 2017-01-16 | 2017-05-31 | 上海智臻智能网络科技股份有限公司 | A kind of intelligent sound exchange method, apparatus and system |
-
2017
- 2017-12-22 CN CN201711402197.1A patent/CN108154579B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853535A (en) * | 2010-05-25 | 2010-10-06 | 无锡中星微电子有限公司 | Door control system and door control management method |
| CN103081453A (en) * | 2010-09-01 | 2013-05-01 | 松下电器产业株式会社 | Intercommunication system |
| KR101419794B1 (en) * | 2014-01-06 | 2014-07-15 | 주식회사 코어셀 | The method for controlling the access of school visitors through the face recognition |
| CN104282064A (en) * | 2014-09-30 | 2015-01-14 | 小米科技有限责任公司 | Entrance guard response method and entrance guard response device |
| CN104754306A (en) * | 2015-04-03 | 2015-07-01 | 厦门狄耐克电子科技有限公司 | Intelligent access control system with analog-to-digital conversion function |
| CN106375641A (en) * | 2016-08-31 | 2017-02-01 | 深圳博科智能科技有限公司 | Home-entry video intercom robot and home-entry video intercom control method |
| CN106846577A (en) * | 2017-01-19 | 2017-06-13 | 泰康保险集团股份有限公司 | Personnel's discrepancy authority control method and device based on recognition of face |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108154579A (en) | 2018-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108154579B (en) | Intelligent access control system capable of interacting with visitors and interaction method | |
| JP2020144375A (en) | System control method, system, and program | |
| CN106504390A (en) | Control method for door lock, apparatus and system | |
| CN105120122A (en) | Alarm method and device | |
| CN106209800B (en) | Equipment Authority sharing method and apparatus | |
| CN107767864B (en) | Method and device for sharing information based on voice and mobile terminal | |
| CN105095873A (en) | Picture sharing method and apparatus | |
| CN106356060A (en) | Voice communication method and device | |
| CN106447877B (en) | Open method, device and the server of smart machine | |
| CN204926231U (en) | Entrance guard and access control system | |
| CN104112129A (en) | Image identification method and apparatus | |
| CN110673896A (en) | Near field communication card activation method and device | |
| CN104378501A (en) | Phone number naming method and device | |
| CN105117207A (en) | Album creating method and apparatus | |
| CN105468767A (en) | Method and device for acquiring calling card information | |
| CN107295149A (en) | A kind for the treatment of method and apparatus of strange phone | |
| CN105207994A (en) | Account number binding method and device | |
| CN105550235A (en) | Information acquisition method and information acquisition apparatuses | |
| CN106209604A (en) | Add the method and device of good friend | |
| CN104899501A (en) | Dialog list display method and device and terminal | |
| KR101746114B1 (en) | Mobile video call system using near field wireless communications and the method thereof | |
| KR101071707B1 (en) | Method for furnishing information in homenetwork system | |
| CN111028835B (en) | Resource replacement method, device, system and computer readable storage medium | |
| CN111882711A (en) | Door lock control method and system, storage medium and electronic device | |
| CN111833506A (en) | Access control system based on indoor and outdoor intelligent terminals and interaction method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |