JP7467181B2 - Intercom device and intercom system - Google Patents

Description

The present invention relates to an intercom device and an intercom system.

Patent Document 1 discloses an intercom system that has a front door handset with the function of calling and talking to residents, and a room master unit with the function of responding to calls from the front door handset.

JP 2007-267253 A

In the intercom system of Patent Document 1, residents must answer visitors' calls by calling directly, which can lead to privacy and security issues.

The present invention aims to provide an intercom device and an intercom system that can ensure the privacy and security of residents.

In order to achieve the above object, the intercom device of the present invention comprises:
An intercom device comprising: a door slave unit for a visitor to call a resident and a room master unit for the resident to respond to a call from the door slave unit;
The entrance door unit is
a call operation unit that is operated by the visitor when calling the resident;
A microphone for collecting the voice of the visitor;
A camera for capturing an image of the visitor;
having
The room master unit includes:
a control unit that controls the room master unit in response to a call operation from the call operation unit;
A storage unit that stores a plurality of response modes for responding to the visitor;
having
The control unit is
acquiring behavior information regarding the behavior of the visitor from at least one of the voice and the image;
Selecting at least one of the plurality of response modes according to the acquired behavioral information;
At least one of the room master unit and the entrance slave unit is controlled by the at least one answering mode.

According to the above configuration, when a visitor calls, the intercom device can respond differently based on the visitor's actions. This allows the resident to respond appropriately to the visitor without having to talk to the visitor directly. This ensures the privacy and security of the resident.

In addition, in the intercom device of the present invention,
The control unit is
determining whether a risk level of the visitor's behavior is equal to or greater than a threshold based on the behavior information;
The entrance slave unit may be configured to emit a warning message when the degree of danger is determined to be equal to or greater than the threshold value.

According to the above configuration, if a visitor is determined to be a suspicious individual (a person behaving abnormally), a warning message can be emitted from the entrance unit, further improving security.

In addition, the intercom system of the present invention comprises:
The intercom device;
an electronic device connected to the room master unit so as to be able to communicate with the room master unit;
An intercom system comprising:
If the control unit determines that the level of danger remains above the threshold even after the warning message is emitted, it is configured to send an emergency notification signal to the electronic device to display on the display of the electronic device an image of the visitor along with a reporting operation screen that allows a report to be made to the police or a security company.

According to the above configuration, by displaying a report screen together with an image of a visitor on an electronic device (e.g., a resident's smartphone), the user of the electronic device (e.g., a resident's smartphone) can report the visitor to the police or a security company while checking the image of the visitor. This can further improve security.

In addition, in the intercom system of the present invention,
The electronic device may be at least one of a mobile terminal carried by the resident and a terminal device owned by a management company, the police, or a security company.

As an electronic device that displays a report screen along with an image of a visitor, it is preferable that the device is, for example, one of the above.

In addition, the intercom system of the present invention comprises:
The intercom device;
a speaker connected to the room master unit so as to be capable of communicating with the room master unit and capable of responding to interactive voice operations from the resident;
An intercom system comprising:
The control unit is configured to cause the speaker to emit a response result message indicating a result of responding to the visitor using the at least one response mode.

According to the above configuration, the results of the response action taken by the intercom device based on the visitor's behavior are notified through the speaker, making it possible to provide the resident with a record of the response while ensuring the resident's privacy.

The present invention provides an intercom device and an intercom system that can ensure the privacy and security of residents.

1 is a configuration diagram of an intercom system according to an embodiment of the present invention. 2 is a functional block diagram of an entrance slave unit and a room master unit of the intercom device. FIG. 11 is a flowchart for explaining a first operation example of the intercom system. FIG. 13 is a diagram illustrating an example of a display screen displayed on a smartphone. 13 is a flowchart illustrating a second operation example of the intercom system. 13 is a flowchart illustrating a third operation example of the intercom system.

Hereinafter, an example of an intercom system according to an embodiment of the present invention will be described with reference to the drawings.
Fig. 1 is a diagram showing the configuration of an intercom system 100. As shown in Fig. 1, the intercom system 100 includes an intercom device 1 and devices communicatively connected to the intercom device 1, such as an electric lock 4, a delivery box 5, a smartphone 6, and a smart speaker 7.

The intercom device 1 is a device that is installed in a detached house or in each dwelling unit in a collective housing unit such as an apartment building, and is equipped with a front door sub-unit 2 and a room master unit 3. When the intercom device 1 is installed in a collective housing unit such as an apartment building, the collective front door unit installed at the collective front door (entrance) may have all or some of the functions of the front door sub-unit 2.

The entrance sub-unit 2 is used by visitors to call the resident and talk to them. The entrance sub-unit 2 is installed, for example, at the entrance of the house. The room master unit 3 is used by the resident to respond to calls from the entrance sub-unit 2. The room master unit 3 is installed, for example, in a room in the house. The entrance sub-unit 2 and the room master unit 3 are connected to each other so that they can communicate with each other via a signal line L1.

The electric lock 4 is provided on the front door of the house in which the intercom device 1 is installed. The electric lock 4 is communicatively connected to the room master unit 3 via the signal line L2, and locks or unlocks the front door based on a control signal transmitted from the room master unit 3. The delivery box 5 is a box for receiving parcels, and is provided, for example, near the entrance of the house in which the intercom device 1 is installed. The delivery box 5 is communicatively connected to the room master unit 3 via the signal line L2, and is configured to be able to lock or unlock based on a control signal transmitted from the room master unit 3. The electric lock 4 and the delivery box 5 may be wirelessly connected to the room master unit 3.

The smartphone 6 is a mobile terminal (an example of an electronic device) owned by a resident of the house. The smartphone 6 is connected to the room master unit 3 of the intercom device 1 so as to be able to communicate wirelessly. The smartphone 6 can receive, for example, information transmitted from the entrance slave unit 2 to the room master unit 3 via the room master unit 3. The smartphone 6 can also display, for example, information received from the room master unit 3 on the display 6a. Specifically, the smartphone 6 can display, for example, an image of a visitor transmitted from the room master unit 3 on the display 6a. The smartphone 6 can also transmit control signals for controlling the entrance slave unit 2, the electric lock 4, the delivery box 5, etc. to the entrance slave unit 2, the electric lock 4, the delivery box 5, etc. via the room master unit 3.

The smart speaker 7 is placed in the room at a certain distance from where the room master unit 3 of the intercom device 1 is installed. The smart speaker 7 is communicatively connected to the room master unit 3. The smart speaker 7 is a speaker equipped with AI (artificial intelligence) and is capable of responding to interactive voice operations from the resident. The smart speaker 7 is configured to receive information transmitted from the room master unit 3 and emit the received information as sound.

FIG. 2 is a functional block diagram of the entrance slave unit 2 and the room master unit 3 of the intercom device 1. As shown in FIG.
As shown in FIG. 2 , the entrance slave unit 2 includes a call operation unit 21 , a speaker 22 , a microphone 23 , a camera 24 , and a slave unit control unit 25 .

The call operation unit 21 is an operation unit operated by a visitor when calling a resident, and is composed of, for example, a call button. The speaker 22 and microphone 23 constitute a call unit for outputting messages from the resident to the visitor and sending messages from the visitor to the resident. The camera 24 is an imaging device for capturing an image of the visitor. The call operation unit 21, speaker 22, microphone 23, and camera 24 are connected to the handset control unit 25.

The slave control unit 25 is a control unit for controlling the operation of each part of the entrance slave unit 2, and may include, for example, at least one microcontroller including one or more processors and one or more memories, and other electronic circuits including active elements such as transistors and passive elements. The processor is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and/or a TPU (Tensor Processing Unit). The CPU may be composed of multiple CPU cores. The GPU may be composed of multiple GPU cores. The memory includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM may store the entrance slave unit control program. The RAM may temporarily store the entrance slave unit control program. The processor may be configured to load a specified program from a control program stored in the storage device or ROM onto the RAM and execute various processes in cooperation with the RAM. The handset control unit 25 may also be configured with an integrated circuit (hardware resource) such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array). The handset control unit 25 may also be configured with a combination of at least one microcontroller and an integrated circuit. The handset control unit 25 transmits and receives signals to and from the room master unit 3 via the signal line L1.

The room master unit 3 includes a master unit operation unit 31, a speaker 32, a microphone 33, a recording unit 34, a memory unit 35, a display 36, and a master unit control unit 37. The master unit control unit 37 includes a behavior determination unit 41, a response mode selection unit 42, and a message generation unit 43.

The master unit operation unit 31 is an operation unit that is operated by the resident when answering a call from a visitor. By operating the master unit operation unit 31, it is possible, for example, to make a call to the visitor, or to unlock or lock the electric lock 4 on the front door or the delivery box 5. The master unit operation unit 31 is composed, for example, of touch buttons displayed on a touch screen display 36, or push-buttons provided on the housing of the room master unit 3.

The speaker 32 and microphone 33 form a communication section for outputting messages from visitors to residents and sending messages from residents to visitors.

The recording unit 34 is configured to record the voice of a visitor that is collected by the microphone 23 of the entrance sub-unit 2 and transmitted to the room main unit 3. The recording unit 34 may record the voice of a resident that is collected by the microphone 33 of the room main unit 3 and transmitted to the entrance sub-unit 2 separately from the voice collected by the microphone 23 of the entrance sub-unit 2.

The storage unit 35 stores the sound recording data (e.g., the voice of the visitor, the sound generated by the visitor) recorded by the recording unit 34, the image data (e.g., the image of the visitor) captured by the camera 24 of the entrance unit 2, and the like. The storage unit 35 also stores a plurality of response modes for responding to visitors. The response modes include, for example, a normal response mode for responding to normal visitors, a suspicious response mode for responding to suspicious visitors, and a dangerous response mode for responding to dangerous visitors. The storage unit 35 also stores messages from the resident that are sounded toward the visitor. The sounded messages include, for example, a message to make the visitor state his/her name, a message to ask the visitor about the visitor's purpose, and other purpose confirmation messages. For example, warning messages sounded toward suspicious visitors or dangerous visitors are also included. For example, a non-response message that is sent when the resident does not respond (cannot respond) to a call from a visitor is also included. Furthermore, the memory unit 35 stores multiple types of behavioral information related to the behavior of visitors. Each type of behavioral information is stored in association with one of the multiple response modes. Furthermore, each type of behavioral information is stored in association with the risk level of the behavior, which is set in multiple stages (e.g., risk level 1 to risk level 5).

The display 36 displays, for example, an image of a visitor captured by the camera 24 of the entrance unit 2. The display 36 also displays, for example, a reporting operation screen that allows information about a dangerous visitor to be reported to the police or a security company. The display 6a also displays response data to the visitor as text information.

The master unit control unit 37 is a control unit for controlling the operation of each unit of the room master unit 3, and may include, for example, at least one microcontroller including one or more processors and one or more memories, and other electronic circuits including active elements such as transistors and passive elements. The processor is, for example, a CPU, an MPU, a GPU, and/or a TPU. The CPU may be composed of multiple CPU cores. The GPU may be composed of multiple GPU cores. The memory includes a ROM and a RAM. The ROM may store the room master unit control program. The RAM may temporarily store the room master unit control program. The processor may be configured to expand a program specified from the room master unit control program stored in the storage device or ROM onto the RAM and execute various processes in cooperation with the RAM. The master unit control unit 37 may also be configured by an integrated circuit (hardware resource) such as an ASIC or an FPGA. Furthermore, the master unit control unit 37 may be configured by a combination of at least one microcontroller and an integrated circuit.

The parent unit operation unit 31, speaker 32, microphone 33, recording unit 34, memory unit 35, and display 36 are connected to the parent unit control unit 37. The parent unit control unit 37 controls the operation of each of these connected units. The parent unit control unit 37 also transmits and receives signals to and from the entrance slave unit 2 via signal line L1. The parent unit control unit 37 also transmits and receives signals to and from the electric lock 4 and delivery box 5 via signal line L2 (see Figure 1).

The behavior determination unit 41 of the parent unit control unit 37 obtains behavioral information regarding the visitor's behavior from the visitor's voice collected by the speaker 22 and the visitor's image captured by the camera 24, and determines the degree of danger of the visitor's behavior.

The response mode selection unit 42 selects one of the response modes stored in the memory unit 35 based on the behavior information acquired by the behavior determination unit 41.

The message generating unit 43 responds to a call from the call operation unit 21 of the entrance unit 2, and generates a message to confirm the visitor's purpose based on the example messages from the resident stored in the memory unit 35. The message generating unit 43 also generates messages appropriately based on the voice spoken by the visitor or a captured image of the visitor. For example, the message generating unit 43 generates a message to confirm the visitor's purpose, a warning message, or a caution message based on the response mode selected by the response mode selection unit 42.

(First operation example: When a visitor is judged to be dangerous)
Next, a first operation example of the intercom system 100 will be described with reference to FIGS.
Fig. 3 is a flowchart for explaining a first operation example of the intercom system 100. Fig. 4 is a diagram showing an example of a display screen displayed on the display 6a of the smartphone 6.
In this operation example, the operation will be described when a visitor approaches the front door and starts picking the lock.

When a visitor approaches within a predetermined range around the entrance, the camera 24 of the entrance unit 2 captures an image of the approaching visitor (step S10). The camera 24 may be a camera that is set to capture images at all times, or a camera that is activated in response to the movement or heat of an object and begins capturing images.

When a visitor approaches the vicinity of the entrance, the microphone 23 of the entrance unit 2 picks up the voice of the visitor or the sound made by the visitor (step S11). The microphone 23 may be a microphone that is set to a state in which it can collect sound at all times, or it may be a microphone that is activated and starts collecting sound when the camera 24 starts capturing images.

Next, the handset control unit 25 transmits the image data of the visitor captured by the camera 24 and the voice data of the visitor collected by the microphone 23 as visitor information to the room master unit 3 via the signal line L1 (step S12).

When visitor information (image data and audio data) is received from the entrance sub-unit 2, the behavior determination unit 41 in the master unit control unit 37 of the room master unit 3 analyzes the received image data and audio data and obtains behavioral information regarding the visitor's behavior (step S13).
The visitor's behavior information may include, for example, information on actions such as approaching the front door and picking a lock, continuing to knock on the front door, repeatedly pressing the call button, continuing to shout loudly, etc. Furthermore, the visitor's behavior information may include, for example, information on actions such as walking back and forth in front of the front door, staying in front of the front door for a long time, remaining silent even when the resident plays a message confirming the purpose of the visit in response to pressing the call button, etc. Furthermore, the visitor's behavior information may include, for example, information on actions such as pressing the call button while carrying luggage.

Next, the behavior determination unit 41 determines the risk level of the visitor's behavior based on the acquired behavior information (step S14). The risk level of the behavior is set to five levels, for example, from risk level 1 to risk level 5. In the various behavior information of the visitor described above, for example, the act of pressing the call button while carrying luggage is determined to be a low-risk behavior and is set to risk level 1. The acts of walking back and forth in front of the entrance, staying in front of the entrance for a long time, and remaining silent even when the resident side issues a message to confirm the purpose in response to pressing the call button are determined to be medium-risk behavior and are set to risk level 3. The acts of approaching the entrance door to pick a lock, continuing to knock on the entrance door, repeatedly continuing to press the call button, and continuing to shout loudly are determined to be high-risk behavior and are set to risk level 5. In the case of this operation example, since the visitor's behavior is approaching the entrance door to pick a lock, the behavior determination unit 41 determines the risk level of the visitor's behavior to be "risk level 5".

Next, the behavior determination unit 41 determines whether the risk level determined in step S14 is equal to or greater than a preset risk threshold (step S15). In this example, the risk threshold is set to, for example, "risk level 4."

If it is determined in step S15 that the risk level of the visitor's behavior is not equal to or greater than the risk threshold (No in step S15), the parent unit control unit 37 ends the process. Note that examples of operation when the risk level of the visitor is less than the risk threshold, for example, when the risk level is determined to be "Risk Level 3" or "Risk Level 1", will be described in detail in the second or third operation example described below.

On the other hand, if it is determined in step S15 that the risk level of the behavior is equal to or higher than the risk threshold (Yes in step S15), the response mode selection unit 42 of the parent unit control unit 37 selects the risk response mode as the response mode for responding to the visitor from among the multiple response modes stored in the memory unit 35 (step S16). In this operation example, the visitor's risk level ("risk level 5") is determined to be equal to or higher than the risk threshold, and the response mode selection unit 42 selects the risk response mode as the response mode. Note that the behavioral information of a visitor for which the risk response mode is selected includes, in addition to approaching the front door and picking a lock, actions such as continuing to knock on the front door, repeatedly pressing the call button, and continuing to shout loudly.

Next, the parent unit control unit 37 reads out a warning message from among the multiple messages stored in the memory unit 35 based on the selection of the danger response mode, and transmits the warning message to the front door unit 2 via the signal line L1 (step S17). Specifically, the parent unit control unit 37 transmits a warning message to the front door unit 2, such as "If you continue this behavior, we will notify the police (or a security company)."

When the warning message is received from the room master unit 3, the slave unit control unit 25 of the entrance slave unit 2 emits the received warning message ("If you continue this behavior, the police will be notified.") to the visitor from the speaker 22 (step S18).

After emitting the warning message to the visitor, the master unit control unit 37 of the living room master unit 3 acquires behavioral information of the visitor based on the image data and audio data acquired from the entrance slave unit 2 in the behavior determination unit 41, and determines the degree of danger of the visitor's behavior based on the acquired behavioral information (step S19). Although not shown in FIG. 3, the slave unit control unit 25 may resume image capture by the camera 24 and sound collection by the microphone 23 after emitting the warning message, or may continue image capture by the camera 24 and sound collection by the microphone 23 at all times after steps S10 and S11. After emitting the warning message from the speaker 22 of the entrance slave unit 2, the master unit control unit 37 acquires image data captured by the camera 24 and sound data collected by the microphone 23 from the entrance slave unit 2, and acquires behavioral information of the visitor after emitting the warning message based on these data.

Next, the behavior determination unit 41 determines whether the risk of the visitor's behavior remains above the risk threshold even after the warning message is emitted (step S20).

If it is determined in step S20 that the risk level of the visitor's behavior is not maintaining above the risk threshold, i.e., if it is determined that the visitor has stopped picking the front door (No in step S20), the parent unit control unit 37 stops emitting the warning message and ends the process.

On the other hand, if it is determined in step S20 that the risk level of the visitor's behavior remains above the risk threshold (Yes in step S20), the parent unit control unit 37 transmits an emergency notification signal to the smartphone 6 carried by the resident (step S21). The emergency notification signal is a notification signal that notifies the resident that an emergency situation is occurring in the resident's home.

When an emergency notification signal is received, the smartphone 6 displays on its display 6a an image of the visitor captured by the camera 24 of the entrance unit 2 and a report operation screen that allows the user to report an emergency situation to the police or a security company (step S22). FIG. 4 shows an example of an image 61 and a report operation screen 62 displayed on the display 6a of the smartphone 6. The captured image is played by pressing the play button 61a displayed on the display 6a. The image to be played may include audio of the visitor collected by the microphone 23 of the entrance unit 2.

Next, the smartphone 6 determines whether or not the report operation screen 62 has been pressed by the user (step S23). If it is determined that the report operation screen 62 has been pressed (Yes in step S23), the smartphone 6 executes an emergency call to the police or a security company (step S24). This ends the processing of this operation example.

When a warning message is sent to the entrance unit 2 in step S17 and the warning message is emitted from the speaker 22 in step S18, the parent unit control unit 37 may send a signal to the smart speaker 7 indicating that the warning message has been emitted to the visitor. In this case, the smart speaker 7 may report the response result to the resident by emitting a response result message indicating the result of the response, such as "A visitor deemed to be dangerous has arrived, so a warning message has been emitted." If the visitor is not at home, the smart speaker 7 may store the content of the response result so that the resident can hear the response result message after returning home.

If it is determined in step S20 that the risk level of the visitor's behavior is not maintained above the risk threshold, the parent device control unit 37 may stop emitting the warning message and send a notification signal regarding the visitor information to the smartphone 6. In this case, the display 6a of the smartphone 6 may display information such as that a highly dangerous visitor has visited and that an emergency state is not being maintained.

In step S21, the destination to which the parent unit control unit 37 transmits the emergency notification signal is not limited to the resident's smartphone 6, and may be, for example, a terminal device owned by a security company or a terminal device owned by the police. In addition, if the resident's residence is, for example, an apartment building or other collective housing, the destination to which the parent unit control unit 37 transmits the emergency notification signal may be a terminal device in the manager's room or a terminal device of the management company.

In addition, in step S21, the master unit control unit 37 may transmit an emergency notification signal to the resident's smartphone 6 and may also display the captured image 61 and the reporting operation screen 62 as shown in FIG. 4 on the display 36 of the room master unit 3.

In this intercom system 100, various data transmitted and received between the room master unit 3, the entrance slave unit 2, the smartphone 6, and the smart speaker 7 may be stored in an external cloud server.

(Second operation example: When a visitor is judged to be suspicious)
Next, a second operation example of the intercom system 100 will be described with reference to Fig. 5. Fig. 5 is a flowchart for explaining the second operation example of the intercom system 100. In this operation example, the operation when a visitor is walking back and forth in front of the entrance will be described.

Steps S30 to S32 shown in FIG. 5 are the same as steps S10 to S12 in the flowchart shown in FIG. 3, and therefore a detailed description thereof will be omitted.
Next, the behavior determination unit 41 of the master unit 3 of the room master unit 3 acquires behavior information of the visitor (step S33). The behavior information of the visitor acquired in this operation example is information that "the visitor is walking back and forth in front of the entrance."

Next, the behavior determination unit 41 of the parent unit control unit 37 determines the danger level of the visitor's behavior based on the behavior information acquired in step S33 (step S34). In this operation example, the behavior information of the visitor is "the visitor is going back and forth in front of the entrance," so the behavior determination unit 41 determines the danger level of the behavior as "Danger Level 3." Note that, in addition to the behavior of going back and forth in front of the entrance, behavior of a visitor that is determined to be "Danger Level 3" includes, for example, the behavior of staying in front of the entrance for a long time and the behavior of remaining silent even when a message confirming the purpose of the visit is played by the resident in response to pressing the call button.

Next, the behavior determination unit 41 determines whether or not the determined risk level is equal to or higher than a risk threshold value ("risk level 4") (step S35).
In step S35, if it is determined that the risk level of the visitor's behavior is equal to or greater than the risk threshold (Yes in step S35), the process proceeds to step S16 in FIG.

On the other hand, if it is determined in step S35 that the risk level of the visitor's behavior is not equal to or higher than the risk threshold (No in step S35), the parent device control unit 37 determines whether the risk level of the visitor's behavior is equal to or higher than the suspicious threshold (step S36). In this example, the suspicious threshold is set to, for example, "risk level 2."
If it is determined in step S36 that the risk level of the visitor's behavior is not equal to or greater than the suspiciousness threshold (No in step S36), the parent device control unit 37 ends the process. Note that an example of operation in which the risk level of the visitor is less than the suspiciousness threshold, for example, the risk level is determined to be "risk level 1", will be described in detail in the third operation example described later.

On the other hand, if it is determined in step S36 that the risk of the behavior is equal to or greater than the suspicious threshold (Yes in step S36), the response mode selection unit 42 of the parent unit control unit 37 selects the suspicious response mode as the response mode for responding to the visitor (step S37). In this operation example, since the risk of the visitor's behavior is "risk level 3," the risk is determined to be equal to or greater than the suspicious threshold, and the suspicious response mode is selected.

Next, the parent unit control unit 37 reads from the memory unit 35 an alert message to be played to suspicious visitors based on the selection of the suspicious response mode, and transmits the alert message to the front door unit 2 via the signal line L1 (step S38). The parent unit control unit 37 reads from the memory unit 35 an alert message such as "May I help you?" and transmits the alert message to the front door unit 2.

When the warning message is received from the room master unit 3, the slave unit control unit 25 of the entrance slave unit 2 emits the received warning message ("May I help you?") to the visitor from the speaker 22 (step S39).

Next, the parent unit control unit 37 transmits a suspicious person notification signal to the resident's smartphone 6 (step S40). The suspicious person notification signal is a notification signal that notifies the resident that a suspicious visitor has arrived and that a warning message has been sounded to that visitor.

Having received the suspicious person notification signal, the smartphone 6 displays a suspicious person notification screen on the display 6a (step S41). In this case, the display 6a may be configured to play back a captured image of the visitor. This completes the processing of this operation example.

In this operation example, the parent unit control unit 37 may transmit to the smart speaker 7 a message that a warning message has been sounded to the visitor. In that case, the smart speaker 7 reports the response result to the resident by sounding a response result message indicating the result of the response, such as "A visitor who is deemed suspicious has arrived, so a warning message has been sounded."

(Third operation example: When a visitor is determined to be a normal person)
Next, a third operation example of the intercom system 100 will be described with reference to Fig. 6. Fig. 6 is a flow chart for explaining the third operation example of the intercom system 100.
In this operation example, the operation when a delivery person (visitor) comes to deliver a package will be described.

Steps S50 to S52 shown in FIG. 6 are the same as steps S10 to S12 in the flowchart shown in FIG. 3, and therefore a detailed description thereof will be omitted.
Next, the master unit control unit 37 of the room master unit 3 acquires the visitor's behavior information in the behavior determination unit 41 (step S53). In this operation example, the visitor's behavior information acquired is "Press the call button while carrying a package" because the visitor is a delivery person.

Next, the behavior determination unit 41 of the parent unit control unit 37 determines the risk level of the visitor's behavior based on the behavior information acquired in step S53 (step S54). In this operation example, the behavior information of the visitor is "Pressing the call button while carrying luggage," so the behavior determination unit 41 determines the risk level of the behavior as "Risk Level 1." Note that visitor behavior information determined to be "Risk Level 1" includes, in addition to the act of pressing the call button while carrying luggage, for example, the act of pressing the call button without carrying luggage.

Next, the behavior determination unit 41 determines whether or not the determined risk level is equal to or higher than a risk threshold value ("risk level 4") (step S55).
In step S55, if it is determined that the risk level of the visitor's behavior is equal to or higher than the risk threshold (Yes in step S55), the process proceeds to step S16 in FIG.

On the other hand, if it is determined in step S55 that the risk level of the visitor's behavior is not greater than or equal to the risk threshold (No in step S55), the parent unit control unit 37 determines whether the risk level of the visitor's behavior is greater than or equal to the suspicious threshold ("Risk Level 2") (step S56).
In step S56, if it is determined that the risk level of the visitor's behavior is equal to or greater than the suspiciousness threshold (Yes in step S56), the process proceeds to step S37 in FIG.

On the other hand, if it is determined in step S56 that the risk level of the visitor's behavior is not equal to or greater than the suspicious threshold (No in step S56), the response mode selection unit 42 of the parent unit control unit 37 selects the normal response mode as the response mode for responding to the visitor (step S57). In this operation example, since it is determined that the risk level of the visitor's behavior is "risk level 1" and is not equal to or greater than the suspicious threshold, the response mode selection unit 42 selects the normal response mode.

Next, based on the selection of the normal response mode, the parent unit control unit 37 causes the message generation unit 43 to generate a message to be played to normal visitors, and transmits the message to the entrance unit 2 via the signal line L1 (step S58). Based on example messages from the resident stored in the memory unit 35, the message generation unit 43 generates a message such as "Who is this? What is your business?" as the message confirmation message.

When the message confirming the purpose of the call is received from the room master unit 3, the handset control unit 25 of the entrance handset unit 2 plays the received message confirming the purpose of the call ("Who is this? What is your purpose?") to the visitor from the speaker 22 (step S59).
When the visitor responds to the matter confirmation message, the entrance slave unit 2 transmits the visitor's response message to the room master unit 3 (step S60).

When a response message is received, the parent unit control unit 37 emits the response message from the speaker 32 and stores it in the memory unit 35 (step S61). Next, the parent unit control unit 37 transmits the response message stored in the memory unit 35 to the smart speaker 7 (step S62).

When the smart speaker 7 receives the response message from the room master unit 3, the smart speaker 7 generates a message such as "A delivery person has come to deliver your package" as visitor information and emits the message (step S63). This ends the processing of this operation example.

In step S62, the parent device control unit 37 transmits the visitor's response message to the smart speaker 7. Alternatively, or in addition, the parent device control unit 37 may transmit a visitor notification signal to the resident's smartphone 6 to notify the resident that a delivery company has come to deliver a package. In this case, it may be possible to play back a captured image of the visitor on the display 6a of the smartphone 6.

As described above, the intercom device 1 includes a front door sub-unit 2 for a visitor to call a resident and a room master unit 3 for the resident to respond to the call from the front door sub-unit 2. The front door sub-unit 2 includes a call operation unit 21 that a visitor operates when calling a resident, a microphone 23 that collects the visitor's voice, and a camera 24 that captures an image of the visitor. The room master unit 3 includes a master unit control unit 37 that controls the room master unit 3 in response to a call operation from the call operation unit 21, and a memory unit 35 that stores multiple response modes for responding to visitors. The master unit control unit 37 is configured to obtain behavioral information regarding the visitor's behavior from at least one of the voice and the image, select at least one of the multiple response modes according to the obtained behavioral information, and control at least one of the room master unit 3 and the front door sub-unit 2 according to the selected response mode. With this configuration, when a visitor calls, a response mode appropriate for that visitor can be selected from multiple response modes according to behavioral information about the visitor's behavior, and different response actions can be performed for each visitor. This allows the resident to respond appropriately to the visitor without having to talk to the visitor directly. This ensures the privacy and security of the resident.

Furthermore, according to the intercom device 1, the parent unit control unit 37 is configured to determine whether the danger level of the visitor's behavior is equal to or higher than a predetermined threshold based on behavioral information about the visitor's behavior, and to emit a warning message from the entrance sub-unit 2 if the determined danger level is equal to or higher than the predetermined threshold. Therefore, if a visitor is determined to be a dangerous person, a warning message (for example, "If you continue this behavior, we will call the police") is emitted from the entrance sub-unit 2 to the visitor, thereby improving crime prevention.

The intercom system 100 also includes the intercom device 1 as described above, and a smartphone 6 communicably connected to the room master unit 3. The master unit control unit 37 of the intercom device 1 is configured to transmit an emergency notification signal to the smartphone 6 for displaying, on the display 6a of the smartphone 6, a report operation screen 62 that can report to the police or a security company together with an image 61 of the visitor, when it is determined that the risk level of the visitor's behavior remains above the risk threshold even after the warning message is sounded. With this configuration, by displaying the report operation screen 62 on the smartphone 6 together with the image 61 of the visitor, the user of the smartphone 6 can report to the police or a security company while checking the image of the visitor. This can further improve the security of the resident.

The electronic device to which the emergency notification signal is sent may be, in addition to the smartphone 6 carried by the resident, a terminal device owned by a management company, the police, or a security company, for example. By sending the emergency notification signal to these various terminal devices, the security of the resident can be further improved.

The intercom system 100 also includes the intercom device 1 as described above, and a smart speaker 7 communicatively connected to the room master unit 3 and responsive to interactive voice operations from the resident. The master unit control unit 37 is configured to cause the smart speaker 7 to emit a response result message indicating the result of responding to the visitor in at least one response mode. With this configuration, the smart speaker 7 notifies the result of the response action performed by the intercom device 1 in response to the visitor's behavior, making it possible to convey the response record to the resident while ensuring the resident's privacy.

The present invention is not limited to the above-described embodiment, and can be modified, improved, etc. as appropriate. In addition, the material, shape, dimensions, values, form, number, location, etc. of each component in the above-described embodiment are arbitrary and not limited as long as they can achieve the present invention.

1: Intercom device, 2: Entrance handset, 3: Room master unit, 4: Electric lock, 5: Delivery box, 6: Smartphone, 6a: Display, 7: Smart speaker, 21: Call operation unit, 22: Speaker, 23: Microphone, 24: Camera, 25: Handset control unit, 31: Master unit operation unit, 32: Speaker, 33: Microphone, 34: Recording unit, 35: Memory unit, 36: Display, 37: Master unit control unit, 41: Action determination unit, 42: Response mode selection unit, 43: Message generation unit, 61: Captured image, 61a: Playback button, 62: Reporting operation screen, Intercom system 100

Claims (3)

An intercom system including an intercom device having a door sub-unit for a visitor to call a resident and a room master unit for the resident to respond to a call from the door sub-unit, and an electronic device connected to the room master unit so as to be able to communicate therewith,
The entrance door unit is
a call operation unit that is operated by the visitor when calling the resident;
A microphone for collecting the voice of the visitor;
A camera for capturing an image of the visitor;
having
The room master unit includes:
a control unit that controls the room master unit in response to a call operation from the call operation unit;
A storage unit that stores a plurality of response modes for responding to the visitor;
having
The control unit is
acquiring behavior information regarding the behavior of the visitor from at least one of the voice and the image;
Selecting at least one of the plurality of response modes according to the acquired behavioral information;
Controlling at least one of the room master unit and the entrance slave unit according to the at least one answering mode;
determining whether a risk level of the visitor's behavior is equal to or greater than a threshold based on the behavior information;
If it is determined that the degree of danger is equal to or greater than the threshold, a warning message is emitted from the entrance slave unit.
If it is determined that the degree of danger remains equal to or higher than the threshold even after the sound of the warning message is emitted, an emergency notification signal is sent to the electronic device for displaying on a display of the electronic device an image of the visitor and a report operation screen that allows a report to be made to the police or a security company.
The intercom system is configured as follows. The intercom system according to claim 1, wherein the electronic device is at least one of a mobile terminal carried by the resident and a terminal device owned by a management company, the police, or a security company. an intercom device having a door slave unit for a visitor to call a resident and a room master unit for the resident to respond to a call from the door slave unit;
a speaker connected to the room master unit so as to be capable of communicating with the room master unit and capable of responding to interactive voice operations from the resident;
An intercom system comprising:
The entrance door unit is
a call operation unit that is operated by the visitor when calling the resident;
A microphone for collecting the voice of the visitor;
A camera for capturing an image of the visitor;
having
The room master unit includes:
a control unit that controls the room master unit in response to a call operation from the call operation unit;
A storage unit that stores a plurality of response modes for responding to the visitor;
having
The control unit is
acquiring behavior information regarding the behavior of the visitor from at least one of the voice and the image;
Selecting at least one of the plurality of response modes according to the acquired behavioral information;
Controlling at least one of the room master unit and the entrance slave unit according to the at least one answering mode;
emitting, from the speaker, a response result message indicating a result of responding to the visitor in the at least one response mode;
The intercom system is configured as follows.

Images