TW202125165A - Smart intercom system and method for using thereof - Google Patents

Abstract

The present disclosure discloses a smart intercom system. The smart intercom system includes a guest end, a user end, a camera module, at least one mobile device, and a processing module. The camera module records images of the area of the guest end. The mobile device detects a user’s state. The user’s state comprises a sleeping state and an awaking state. The processing module communicates with the guest end, the user end, the camera module, and the mobile device. The processing module has a whitelist, and the processing module recognizes whether the guest in the image recorded by the camera module is in the whitelist or not.

Description

Wisdom intercom system and its use method

The present invention relates to an intercom system, especially a smart intercom system.

With the development and progress of science and technology, people's daily life is closely integrated with science and technology. In recent years, many smart houses have been developed. The purpose of smart houses is to provide a safe, convenient, healthy and comfortable living environment, combining the latest technology in various fields to meet the needs of modern life.

In the development of smart houses, smart walkie-talkies are also one of the key points of development. The traditional way of operation of the walkie-talkie is to ring the doorbell when a visitor comes, and the residents in the house will open the door in person or open the door through the walkie-talkie after hearing the bell ring. However, when the resident is not at home, there is no way to know who is visiting, and the visitor cannot get a response. In addition, residents may also want to give different responses based on their own status or the identity of the visitor. Therefore, how to notify residents of the identity of visiting visitors in time and how to respond to visitors in a timely manner is one of the current development directions of smart walkie-talkies.

The present invention provides a smart intercom system, which solves the problems that the traditional doorbell intercom cannot notify the residents of the visitor's identity in time and cannot respond to the visitor in time.

An embodiment of the present invention provides a smart intercom system, including a guest machine, a user machine, a camera module, at least one mobile device, and a processing module. The camera module is used to photograph the area where the visitor's machine is located. The mobile device is used to detect the physiological state of at least one user, and the physiological state includes a sleeping state and an awake state. The processing module communicates with the visitor, the user machine, the camera module and the mobile device. The processing module stores a whitelist. The processing module is used to identify whether at least one visitor in the image captured by the camera module is listed in the whitelist . When the processing module determines that the visitor is listed in the whitelist and the user is in a sleep state, the processing module is used to control the guest machine to send a first response and control the user machine to send a first reminder. When the processing module determines that the visitor is not listed in the whitelist and the user is in a sleep state, the processing module is used to control the guest machine to send a second response. When the user is awake, the processing module is used to control the user machine to send a second reminder. The first response is different from the second response, and the first reminder is different from the second reminder.

An embodiment of the present invention provides a method for using a smart intercom system, including: activating a visitor's machine; a camera module photographing the area where the visitor's machine is located; at least one mobile device detecting that the physiological state of at least one user is a sleeping state or an awake state; And the processing module determines whether the visitor in the image captured by the camera module is listed in the whitelist. When the processing module determines that the visitor is listed in the whitelist and the user is in a sleep state, the processing module controls the guest machine to send a first response and the user machine to send a first reminder. When the processing module determines that the visitor is not listed in the whitelist and the user is in a sleep state, the processing module controls the guest machine to send a second response. When the user is awake, the processing module controls the user machine to send a second reminder. The first response is different from the second response, and the first reminder is different from the second reminder.

The embodiment of the present invention provides a smart intercom system that recognizes whether a visitor is listed in the whitelist through a processing module, and detects the physiological state of the user through a mobile device. The smart intercom system can be based on the identity of the visitor and the state of the user. Respond to visitors and remind users that someone is coming. The smart intercom system provided by the embodiment of the present invention not only improves the security through identification, but also makes humane judgments based on the identity of the visitor and the physiological state of the user, can notify the user in time, respond to the visitor, and can Respond appropriately to visitors without disturbing users. To achieve the purpose of a safe, convenient, healthy and comfortable smart house, and to create a friendly and harmonious modern society.

The detailed features and advantages of the present invention are described in detail in the following embodiments, and the content is sufficient to enable anyone familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and in accordance with the content disclosed in this specification, the scope of patent application and the drawings Anyone who is familiar with the relevant art can easily understand the related purpose and advantages of the present invention. The following examples further illustrate the viewpoints of the present invention in detail, but do not limit the scope of the present invention by any viewpoint.

First, the first embodiment of the present invention will be explained. Please refer to FIG. 1, which is a schematic diagram of a smart intercom system according to a first embodiment of the present invention. The first embodiment of the present invention provides a smart intercom system 1, which includes a guest machine 11, a user machine 12, a camera module 13, a mobile device 14 and a processing module 15. Among them, the guest machine 11, the user machine 12, the camera module 13 and the mobile device 14 are all communicatively connected to the processing module 15. In detail, in this embodiment, the guest machine 11, the user machine 12, the camera module 13, and the mobile device 14 are all connected to the processing module 15 in a wireless communication manner.

The guest machine 11 and the user machine 12 are used to allow the visitor and the user to communicate with each other. The visitor machine 11 can be installed at the doorway outside the house, and the user machine 12 can be installed indoors. In this embodiment, the guest machine 11 and the user machine 12 are a set of walkie-talkies, and the visitor needs to activate the guest machine 11 when visiting, but it is not limited to this. In other embodiments, the guest machine and the user machine can be any communication devices that can communicate with each other. In other embodiments, the visitor machine can also have the function of automatically sensing the visitor's visit.

The camera module 13 is used to photograph the area where the visitor machine 11 is located. In detail, when a visitor comes, the camera module 13 will photograph the area where the visitor machine 11 is located and the visitors in this area. The camera module 13 can be a monitor, a camera, or a video camera. In this embodiment, the camera module 13 is installed at a position where the area near the visitor machine 11 can be photographed, but it is not limited to this. In other embodiments, the camera module and the visitor machine can be installed in the same body.

The mobile device 14 is used to detect the physiological state of at least one user. The physiological state of the user includes the sleeping state and the awake state. In detail, the mobile device 14 determines that the user is in a sleep state or awake state by detecting the user's pulse, motion, etc. In this embodiment, the mobile device 14 is a wearable bracelet, but it is not limited to this. In other embodiments, the mobile device may be a smart watch or a smart phone, etc., and the mobile device may further determine whether the sleep state is a deep sleep state or a light sleep state.

The processing module 15 stores a white list. The processing module 15 recognizes whether the visitor in the image captured by the camera module 13 is listed in the whitelist. When the processing module 15 determines that the visitor is listed in the whitelist and the user is in a sleep state, the processing module 15 is used to control the guest machine 11 to send a first response and the user machine 12 to send a first reminder. When the processing module 15 determines that the visitor is not listed in the whitelist and the user is in a sleep state, the processing module 15 is used to control the guest machine 11 to send a second response. When the user is awake, the processing module 15 is used to control the user machine 12 to issue a second reminder. Among them, the first response is different from the second response, and the first reminder is different from the second reminder.

In detail, the user can pre-store a white list in the processing module 15, list the people they know or important people in the white list, and store their images and identity data. When a visitor comes, the camera module 13 will photograph the visitor located in the area where the visitor machine 11 is located, and the processing module 15 will identify the captured image of the visitor to determine whether the visitor is listed in the whitelist. When the processing module 15 determines that the visitor is listed in the whitelist and the mobile device 14 detects that the user is asleep, the processing module 15 will control the guest machine 11 to send a first response such as "please wait", and will control The user machine 12 sends a first reminder to remind the user that someone is visiting. At this time, since the visitors listed in the whitelist may be more important visitors, the volume of the first reminder can be higher, and the mobile device 14 can also be vibrated at the same time to wake up the user in the sleep state. When the processing module 15 determines that the visitor is not listed in the whitelist and the mobile device 14 detects that the user is in a sleep state, the processing module 15 controls the guest machine 11 to send a second response such as "the user is inconvenient now". At this time, because the visitors listed in the whitelist may be less important visitors, the user machine 12 does not issue a reminder to avoid disturbing the user's sleep. When a visitor comes and the mobile device 14 detects that the user is awake, the processing module 15 will control the user machine 12 to issue a second reminder. At this time, because the user is in a awake state, the volume of the second reminder may be small, so that the user can hear it.

In addition, the processing module 15 can record the image of the area where the visitor machine 11 is taken by the camera module 13 at any time or at a fixed time, and compare it with a preset image by using image software. When the processing module 15 determines that the difference between the image captured by the camera module 13 and the preset image exceeds a preset value, the processing module 15 will send an abnormal notification to the user machine 12 or the mobile device 14 to remind the user that the visitor machine 11 is near There may be some abnormal conditions that require attention or send someone to check.

Furthermore, in this embodiment, the processing module is a security host. The security host is used to communicate with the security cloud host A. The security host has an alert state and a disarmed state. In detail, the alert state may be a state when the user is not at home, and the disarmed state may be a state when the user is at home. When a visitor visits and activates the guest machine 11 and the security host is in an alert state, that is, when the user is not at home, the security host controls the user machine 12 not to send the first reminder or the second reminder, and instead the mobile device 14 sends out a message such as "Someone is visiting" Security message notification.

Furthermore, the security host may further store a blacklist. When the security host determines that the visitor is listed in the blacklist, the security host issues a first warning to the user machine 12, the mobile device 14 or the security cloud host A. In detail, users can pre-store a blacklist on the security host, put the annoying or dangerous people on the blacklist, and store their images and identity data. In addition, the security company can also cooperate with the police and consumer units to obtain a list of criminals and wanted criminals and add them to the blacklist. When a visitor comes, the camera module 13 will photograph the visitor located in the area where the visitor machine 11 is located, and the security host will recognize the captured image of the visitor to determine whether the visitor is on the blacklist. When the security host judges that the visitor is on the blacklist, the security host issues a first warning such as "Danger" to the user machine 12, mobile device 14 or security cloud host A, so that the user can be alert and respond promptly measure.

Furthermore, when the visitor is a plurality of visitors, at least one of the visitors is listed on the whitelist and at least another of the visitors is listed on the blacklist, the security host sends a second warning to the user machine 12, mobile device 14, or Secure cloud host A. In detail, when multiple visitors come, if someone is listed on the whitelist and someone is listed on the blacklist at the same time, there may be concerns about the visitor being hijacked by dangerous people. At this time, the security host issues a second warning such as "Please note" to the user machine 12, the mobile device 14, or the security cloud host A. In this way, the user can be prevented from being attacked by dangerous persons to ensure user safety, and it can also help the security company or police department to learn the whereabouts of dangerous persons in time, so as to maintain social order and protect people's safety.

Next, the method of using the smart intercom system of the present invention will be explained. Please refer to FIG. 2, which is a flowchart of the use of the smart intercom system according to the first embodiment of the present invention. When the visitor comes, start the visitor machine (S1). The camera module photographs the area where the visitor's machine is located (S2). The mobile device detects that the user's physiological state is the sleeping state or the awake state (S3). The processing module determines whether the visitor in the image captured by the camera module is listed in the whitelist (S4). When the processing module determines that the visitor is listed in the whitelist and the user is in a sleep state, the processing module controls the guest machine to send a first response and the user machine to send a first reminder (S5). When the processing module determines that the visitor is not listed in the whitelist and the user is in a sleep state, the processing module controls the guest machine to send a second response (S6). When the user is awake, the processing module controls the user machine to send a second reminder (S7). In the method of using the smart intercom system, the sequence of the process S2 and the process S3 is not limited to the process S2 first and then the process S3. In other embodiments, the process S2 and the process S3 can also be performed in an interchange order or simultaneously.

To illustrate the second embodiment of the present invention, please refer to FIG. 3, which is a schematic diagram of a smart intercom system according to the second embodiment of the present invention. The second embodiment is similar to the first embodiment, and only the differences are described below. The second embodiment of the present invention provides a smart intercom system 2 including a visitor machine 21, a user machine 22, a camera module 23, a mobile device 24, a processing module 25, and a biometric identification module 26. The visitor machine 21, the user machine 22, the camera module 23, the mobile device 24 and the biometric identification module 26 are all communicatively connected to the processing module 25.

Compared with the first embodiment, the second embodiment further includes a biometric identification module 26. The biometric module 26 is used to collect the biometric characteristics of visitors located in the area of the visitor machine 21. The processing module 25 recognizes whether the visitor is listed in the whitelist according to the biometrics. In detail, the biometric identification module 26 is connected to the processing module 25 in a wireless connection. The user can pre-store a white list in the processing module 25, and the white list includes biological characteristics in addition to images and identity data. The processing module 25 uses the image of the visitor captured by the camera module 23 to determine whether the visitor is listed on the whitelist or blacklist, and can also determine whether the visitor is listed on the basis of the biological characteristics collected by the biometric module 26. In the whitelist or blacklist. In this way, the identification characteristics of visitors are increased, accuracy can be improved, and the occurrence of misjudgments can be reduced.

To illustrate the third embodiment of the present invention, please refer to FIG. 4, which is a schematic diagram of a smart intercom system according to the third embodiment of the present invention. The third embodiment of the present invention provides a smart intercom system 3. The third embodiment is similar to the second embodiment, and only the differences are described below. In this embodiment, the biometric recognition module is a voice module 36. The voice module 36 is connected to the processing module 35 in communication. The voice module 36 is used to record the voiceprint of the visitor located in the area of the visitor machine 31. In detail, the voice module 36 is connected to the processing module 35 in a wireless connection manner. The user can pre-store a white list in the processing module 35, and the white list contains voiceprint information in addition to images and images. The processing module 35 uses the image of the visitor captured by the camera module 33 to determine whether the visitor is listed in the white list or the black list, and can also determine whether the visitor is listed in the white list according to the voiceprint recorded by the voice module 36. List or blacklist. In this way, the identification characteristics of visitors are increased, accuracy can be improved, and the occurrence of misjudgments can be reduced.

To illustrate the fourth embodiment of the present invention, please refer to FIG. 5, which is a schematic diagram of a smart intercom system according to the fourth embodiment of the present invention. The fourth embodiment of the present invention provides a smart intercom system 4. The fourth embodiment is similar to the second embodiment, and only the differences are described below. In this embodiment, the biometric identification module is a fingerprint module 46. The fingerprint module 46 is connected to the processing module 45 in communication. The fingerprint module 46 is used to collect fingerprints of visitors located in the area of the visitor machine 41. In detail, the fingerprint module 46 is connected to the processing module 45 in a wireless connection manner. The user can pre-store a white list in the processing module 45. The white list contains fingerprint information in addition to the image and identity data. The processing module 45 uses the image of the visitor captured by the camera module 43 to determine whether the visitor is on the whitelist or the blacklist, and can also determine whether the visitor is on the whitelist based on the fingerprints collected by the fingerprint module 46 Or in the blacklist. In this way, the identification characteristics of visitors are increased, accuracy can be improved, and the occurrence of misjudgments can be reduced.

The above embodiments are only examples, and the present invention is not limited thereto. In other embodiments, when there are multiple users and at least one of the users is in a sleep state, the processing module uses all users in a sleep state to further determine whether the visitor is listed in the whitelist. When the visitor is not listed in the whitelist, the processing module controls the visitor to send a second response. When the visitor is listed in the white list, the processing module controls the user machine to send a second reminder. In this way, it is possible to avoid disturbing some users who are in a sleep state.

In the embodiment of the present invention, all the components are connected in a wireless connection mode, but it is not limited to this. In other embodiments, the components can also be connected in a wired connection.

The embodiment of the present invention provides a smart intercom system that recognizes whether a visitor is listed in the whitelist through a processing module, and detects the physiological state of the user through a mobile device. The smart intercom system can be based on the identity of the visitor and the state of the user. Respond to visitors and remind users that someone is coming. The smart intercom system provided by the embodiment of the present invention not only improves the security through identification, but also makes humane judgments based on the identity of the visitor and the physiological state of the user, can notify the user in time, respond to the visitor, and can Respond appropriately to visitors without disturbing users. To achieve the purpose of a safe, convenient, healthy and comfortable smart house, and to create a friendly and harmonious modern society.

Although the present invention is disclosed in the foregoing embodiments, it is not intended to limit the present invention. All changes and modifications made without departing from the spirit and scope of the present invention fall within the scope of the patent protection of the present invention. For the scope of protection defined by the present invention, please refer to the attached scope of patent application.

1, 2, 3, 4: Smart intercom system 11, 21, 31, 41: visitor machine 12, 22, 32, 42: user machine 13, 23, 33, 43: camera module 14, 24, 34, 44: mobile devices 15, 25, 35, 45: processing module 26: Biometric Module 36: Voice module 46: Fingerprint module A: Secure the cloud host S1~S7: Process

FIG. 1 is a schematic diagram of a smart intercom system according to the first embodiment of the present invention. Fig. 2 is a flow chart of the use of the smart intercom system according to the first embodiment of the present invention. Fig. 3 is a schematic diagram of a smart intercom system according to a second embodiment of the present invention. Fig. 4 is a schematic diagram of a smart intercom system according to a third embodiment of the present invention. Fig. 5 is a schematic diagram of a smart intercom system according to a fourth embodiment of the present invention.

1: Wisdom intercom system

11: Guest machine

12: User machine

13: camera module

14: mobile device

15: Processing module

A: Secure the cloud host

Claims (10)

A smart intercom system, comprising: a visitor machine; a user machine; a camera module for shooting the area where the visitor machine is located; at least one mobile device for detecting a physiological state of at least one user, the physiological The state includes a sleep state and an awake state; and a processing module, which is communicatively connected to the guest machine, the user machine, the camera module and the at least one mobile device, the processing module stores a white list, and the processing module Used to identify whether at least one visitor in an image shot by the camera module is listed in the white list, when the processing module determines that the at least one visitor is listed in the white list and the at least one user is the sleeper In the state, the processing module is used to control the visitor machine to send a first response and control the user machine to send a first reminder. When the processing module determines that the at least one visitor is not listed in the whitelist and the at least When a user is in the sleep state, the processing module is used to control the guest machine to send a second response, and when the at least one user is in the awake state, the processing module is used to control the user machine to send a second reminder , Wherein the first response is different from the second response, and the first reminder is different from the second reminder. The smart intercom system according to claim 1, wherein the volume of the first reminder is greater than the volume of the second reminder. The smart intercom system according to claim 1, wherein the processing module is a security host, the security host is used to communicate with a security cloud host, and the security host has an alert state and a release state, when the security host When the host is in the alert state, the user machine does not send out the first reminder or the second reminder, and the security host controls the at least one mobile device to send a security message notification. The smart intercom system according to claim 3, wherein the security host further stores a blacklist, and when the security host determines that the at least one visitor is listed in the blacklist, the security host sends a first warning to the security host The user machine, the at least one mobile device, or the secured cloud host. The smart intercom system according to claim 4, wherein when the at least one visitor is a plurality of visitors, at least one of the visitors is listed in the white list and at least another of the visitors is listed in the black list When the list is listed, the security host sends a second warning to the user machine, the at least one mobile device, or the security cloud host. The smart intercom system according to claim 1, wherein when the processing module determines that the difference between the image captured by the camera module and a preset image exceeds a preset value, the processing module sends out an exception notification To the user machine or the at least one mobile device. The smart intercom system according to claim 1, further comprising a biometric identification module communicatively connected to the processing module, and the biometric identification module is used to collect a biometric feature of the at least one visitor located in the area of the visitor machine, The processing module is used for identifying whether the at least one visitor is listed in the white list according to the biological characteristics. The smart intercom system according to claim 7, wherein the biometric module is a voice module, and the voice module is used to record a voiceprint of the at least one visitor located in the area of the visitor machine, and the processing module It is used to identify whether the at least one visitor is listed in the white list according to the voiceprint. The smart intercom system according to claim 7, wherein the biometric module is a fingerprint module, the fingerprint module is used to collect a fingerprint of the at least one visitor located in the area of the visitor machine, and the processing module uses To identify whether the at least one visitor is listed in the white list according to the fingerprint. A method for using a smart intercom system includes: activating a visitor machine; a camera module photographing the area where the visitor machine is located; at least one mobile device detecting that a physiological state of at least one user is a sleeping state or an awake state; And a processing module determines whether at least one visitor in an image captured by the camera module is listed in a white list; when the processing module determines that the at least one visitor is listed in the white list and the at least one user In the sleep state, the processing module controls the guest machine to send a first response and controls a user machine to send a first reminder; when the processing module determines that the at least one visitor is not listed in the whitelist and the When at least one user is in the sleep state, the processing module controls the guest machine to send a second response; when the at least one user is in the awake state, the processing module controls the user machine to send a second reminder; wherein The first response is different from the second response, and the first reminder is different from the second reminder.

Images