JP2023018216A - Intercom device and control method thereof - Google Patents

Abstract

To provide an intercom device capable of prompting a visitor to make an appropriate response, and a control method of the intercom.SOLUTION: An intercom device which communicates with a cloud server that collects an IP (Internet Protocol) address of a mobile terminal of a user includes a slave device and a master device. The slave device including a call bell and a speaker is installed outdoor. The master device connected to the slave device is installed indoor. The master device includes a first communication unit and a first control unit. The first communication unit communicates, in response to operation of the call bell, with the cloud server via a router outside the master device, to acquire the IP address of the mobile terminal or terminal position information generated based on the IP address. The first control unit transmits a control signal to the slave device, the control signal causing the speaker to output a message according to the IP address or the terminal position information acquired by the first communication unit.SELECTED DRAWING: Figure 1

Description

The present invention relates to an intercom device and a control method for the intercom device.

Japanese Patent Laying-Open No. 2020-078036 (Patent Document 1) discloses an intercom system. In this interphone system, for example, when a call is made by a visitor, a call is sent to the public network information terminal of the user. Therefore, according to this intercom system, even if the user is absent, the user can answer the call via the public network information terminal (see Patent Document 1).

Japanese Patent Application Laid-Open No. 2020-078036

In the intercom system disclosed in Patent Document 1, when a call operation is performed by a visitor, a call is made to a non-public network information terminal in the home using short-range wireless communication, for example. Sent. If the call is not answered, the call is sent to the public network information terminal using the public network. Thus, in this interphone system, a two-step call is made when the user is absent. However, since the two-stage call takes time, if the resident's response is slow, the visitor may leave during the two-stage call.

SUMMARY OF THE INVENTION The present invention has been made to solve such problems, and an object thereof is to provide an interphone capable of responding quickly while a visitor is waiting and prompting the visitor to take an appropriate action. An object of the present invention is to provide a device and a control method for the intercom device.

An intercom device according to one aspect of the present invention is configured to communicate with a cloud server that collects IP (Internet Protocol) addresses of mobile terminals of users. This intercom device includes a slave unit and a master unit. The handset includes a call bell and a speaker and is installed outdoors. The parent device is connected to the child device and installed indoors. The parent device includes a first communication section and a first control section. The first communication unit communicates with the cloud server via a router external to the master unit in response to the operation of the call bell, and the IP address of the mobile terminal or the terminal location generated based on the IP address. Get information. The first control unit transmits to the slave device a control signal that causes the speaker to output a message corresponding to the IP address or the terminal location information acquired by the first communication unit.

In this intercom device, a speaker outputs a message corresponding to the IP address of the user's mobile terminal or terminal location information in response to the operation of the call bell by the visitor. Therefore, according to this intercom device, since a message corresponding to the user's current position is output from the speaker, it is possible to prompt the visitor to take appropriate measures according to the user's current position.

In the intercom device, the first control unit outputs the first message to the speaker when the IP address is a private IP address or when the terminal location information indicates that the mobile terminal is indoors. When the IP address is a global IP address, or when the terminal location information indicates that the mobile terminal is outdoors, the second message is output to the speaker. You may transmit the control signal which makes it carry out to a sub-station|mobile_unit.

In this intercom device, different messages (first message or second message) are output from the speaker depending on whether the user is estimated to be outdoors or indoors. Therefore, according to this intercom device, it is possible to prompt the visitor to take appropriate measures according to the user's current location (outdoors or indoors).

In the above intercom device, the child device further includes a camera that captures the outdoors and generates image data, and a second communication unit that wirelessly communicates with the first communication unit of the parent device. It is connected to the child device via a transmission line, and between the parent device and the child device, power and control signals are transmitted and received via the transmission line, and wireless communication is performed between the first and second communication units. image data may be transmitted and received.

In this intercom device, transmission and reception of image data between the parent device and the child device are not performed via a two-wire transmission path, but are performed via wireless communication between the first and second communication units. Therefore, according to this intercom device, since image data is transmitted and received by a communication means (wireless communication) having a relatively large communication band, it is possible to smoothly transmit and receive image data between the parent device and the child device. can.

In the above intercom device, the second communication unit is capable of wireless communication with the mobile terminal, the slave device further includes a second control unit that controls the second communication unit, and the master device has a private IP address. , or when the terminal location information indicates that the mobile terminal is indoors, it is possible to set whether image data is to be transmitted from the child device to the parent device or from the child device to the mobile terminal. , and the second control unit may control the second communication unit to transmit the image data to the destination according to the content of the setting.

In this intercom device, when the IP address is a private IP address, or when the terminal location information indicates that the mobile terminal is indoors (when it is estimated that the user is indoors), the image It is possible to set whether data is transmitted from the child device to the parent device or transmitted from the child device to the mobile terminal. Therefore, according to this intercom device, by setting the image data to be transmitted from the slave unit to the mobile terminal when the user is estimated to be indoors, the user is not near the master unit indoors. Even so, the user can easily identify the visitor via the mobile terminal.

In the above intercom device, the first control unit receives the permission signal or the non-permission signal from the mobile terminal via the first communication unit in response to the transmission of the image data to the mobile terminal. In response to the signal, a control signal may be transmitted to the child device to cause the speaker to output a message indicating instructions to the home delivery company.

In this intercom device, a speaker outputs a message indicating an instruction to a home delivery company in response to a signal received from a mobile terminal. Therefore, according to this intercom device, for example, by referring to the image displayed on the mobile terminal and appropriately operating the mobile terminal, the user can appropriately instruct the delivery company.

A control method for an intercom device according to another aspect of the present invention is a control method for an intercom device configured to communicate with a cloud server that collects IP (Internet Protocol) addresses of mobile terminals of users. An intercom device has a call bell and a speaker, and includes a slave unit installed outdoors and a master unit installed indoors connected to the slave unit. The control method of the intercom device is to communicate with the cloud server via the router outside the base unit in response to the operation of the call bell, so that the IP address or the terminal location information generated based on the IP address is obtained. and transmitting from the parent device to the child device a control signal that causes the speaker to output a message corresponding to the acquired IP address or terminal location information.

In this intercom device control method, a message corresponding to the IP address or terminal position information of the user's mobile terminal is output from the speaker in response to the operation of the call bell by the visitor. Therefore, according to this intercom device control method, a message corresponding to the user's current position is output from the speaker, so that the visitor can be urged to take appropriate measures according to the user's current position.

According to the present invention, there is provided an intercom device and a control method for the intercom device, which are capable of prompting the visitor to respond appropriately by making the visitor feel that the resident (user) will respond immediately. be able to.

It is a block diagram which shows the structure of an intercom system typically. It is a block diagram which shows the structure of an intercom apparatus typically. 2 is a block diagram schematically showing the configuration of a cloud server; FIG. 1 is a block diagram schematically showing the configuration of a mobile terminal; FIG. 4 is a flow chart showing the operation procedure in the intercom system until the speaker outputs the first sound; 4 is a flow chart showing an operation procedure in the intercom device until a call operation is performed between the slave unit and the master unit; FIG. 2 is a diagram showing what is used for transmission and reception between a child device and a parent device; 4 is a flow chart showing an operation procedure in the intercom system until a call operation is performed between the slave unit and the mobile terminal; 4 is a flow chart showing an operation procedure in the intercom system until the speaker outputs a second voice; FIG. 10 is a diagram showing an example of an image displayed in step S710 of FIG. 9; FIG.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The same or corresponding parts in the drawings are denoted by the same reference numerals, and the description thereof will not be repeated.

[1. composition]
<1-1. Configuration of intercom system>
FIG. 1 is a block diagram schematically showing the configuration of intercom system 10 including intercom device 50 according to the present embodiment. As shown in FIG. 1 , intercom system 10 includes intercom device 50 , cloud server 300 , and mobile terminal 400 . In the intercom system 10, the intercom device 50, the cloud server 300, and the mobile terminal 400 can communicate with each other via a network (for example, the Internet) N1.

Intercom device 50 includes master device 100 and slave device 200 . Two-way communication is possible between the master device 100 and the slave device 200 , and a call is possible between the master device 100 and the slave device 200 . For example, the parent device 100 is installed in a work area (defined as indoors) such as a user's living space or workplace, and the slave device 200 is installed outside the user's working area such as a living space or workplace (defined as outdoors). is installed in The parent device 100 is operated by, for example, a user, and the child device 200 is operated, for example, by a visitor who comes to the user's home or workplace. When a visitor comes to the user's house, the user and the visitor can talk to each other through master device 100 and slave device 200, respectively.

Base unit 100 connects to network N1 via router 500, for example. Each of cloud server 300 and mobile terminal 400 is also connected to network N1. The cloud server 300 is configured by, for example, a general-purpose computer, and the mobile terminal 400 is configured by, for example, a smartphone, tablet, or mobile PC (Personal Computer).

The owner of mobile terminal 400 is the user of intercom device 50 . Mobile terminal 400 is set to connect to network N1 via router 500 when the user is indoors. In this case, the IP address of mobile terminal 400 becomes the private IP address of router 500 . On the other hand, when the user is outdoors, the mobile terminal 400 connects to the network N1 via, for example, a mobile phone network (eg, 3G, 4G, 5G). In this case, the IP address of mobile terminal 400 is the global IP address.

In intercom system 10 , IP address information of mobile terminal 400 is periodically transmitted to cloud server 300 . Cloud server 300 determines whether the user is indoors or outdoors based on the obtained IP address information, and generates terminal position information indicating the determination result. Specifically, when the obtained IP address information indicates the private IP address of the router 500, it is determined that the user is indoors, and when the obtained IP address information indicates the global IP address, the user is outdoors. Then it is judged. Then, terminal position information indicating the determination result is generated.

In intercom device 50 , when a visitor calls through child device 200 , master device 100 acquires terminal location information from cloud server 300 . In master device 100, control is performed according to the acquired terminal location information. According to this intercom device 50, it is possible to prompt the visitor to take appropriate measures according to the user's current location. Specific control contents of the intercom device 50 will be described later in detail.

<1-2. Configuration of intercom device>
FIG. 2 is a block diagram schematically showing the configuration of the intercom device 50. As shown in FIG. As shown in FIG. 2 , intercom device 50 includes master device 100 and slave device 200 . The parent device 100 and the child device 200 are connected via a two-wire transmission line L1. The transmission line L1 is configured by, for example, a twisted pair line.

Base unit 100 includes first control unit 110, storage unit 120, microphone 130, speaker 140, display 150, operation unit 160, first communication unit 180, and third communication unit 170. there is

The first control unit 110 includes a CPU (Central Processing Unit), memory, etc. (not shown), and is configured to control each component of the parent device 100 . For example, various functions of the master device 100 are realized by the CPU executing a control program of the master device 100 stored in the memory.

The storage unit 120 is configured to store various data. The storage unit 120 stores, for example, image data representing a UI (User Interface) displayed on the display 150 and audio data representing a ringing tone output from the speaker 140 . The storage unit 120 is configured by, for example, at least part of a ROM (Read Only Memory), a RAM (Random Access Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), a hard disk drive, and a solid state drive.

Microphone 130 is configured to convert an input voice into an analog voice signal. This analog audio signal is converted into a digital audio signal (audio data) by, for example, an audio processing circuit (not shown) and transmitted to the child device 200 .

Speaker 140 is configured to convert an analog audio signal into audio and output the audio. For example, a digital audio signal (audio data) received from the child device 200 is converted into an analog audio signal by an audio processing circuit (not shown), and the speaker 140 converts the analog audio signal into audio and outputs it. Also, speaker 140 outputs a ringing tone indicated by the audio data stored in storage unit 120, for example, in a state where base device 100 is receiving a call signal from child device 200. FIG.

Display 150 is configured to display an image. The display 150 is configured by, for example, a monitor such as a liquid crystal monitor or an organic EL (Electro Luminescence) monitor. For example, the display 150 displays an image captured by the slave device 200 .

The operation unit 160 is configured to receive an operation from the user. The operation unit 160 is composed of, for example, a touch panel or physical buttons. For example, when master device 100 receives a call signal from slave device 200, when a predetermined operation (for example, pressing a physical button) is performed via operation unit 160, a call is made between master device 100 and slave device 200. It is possible to make calls in When the operation unit 160 is configured by a touch panel, for example, an operation area for receiving a predetermined operation is displayed on the display 150, and in response to the touch operation from the user, the master device 100 is operated in the same manner as the physical button operation. and communication between the child devices 200 becomes possible.

The first communication unit 180 is configured to communicate with the cloud server 300 and the mobile terminal 400 via the network N1 (FIG. 1). The first communication unit 180 is configured by, for example, a wired LAN (Local Area Network) module or a wireless LAN module.

Third communication unit 170 is configured to transmit and receive control signals to and from child device 200 via transmission line L1. That is, two-way communication is possible between the parent device 100 and the child device 200 via the transmission line L1. Also, the third communication unit 170 is configured to send power to the child device 200 via the transmission line L1. This power is supplied from a power source (not shown) connected to the master device 100 .

Child device 200 includes a second control unit 210, a storage unit 220, a call bell 230, a microphone 240, a speaker 250, a camera 260, a second communication unit 280, and a fourth communication unit 270. there is

The second control unit 210 includes a CPU, memory, etc. (not shown), and is configured to control each component of the child device 200 . For example, various functions of the child device 200 are realized by executing a control program of the child device 200 stored in the memory by the CPU.

The storage unit 220 is configured to store various data. The storage unit 220 stores, for example, audio data output from the speaker 250 . The storage unit 220 is composed of, for example, at least part of a ROM, RAM, EEPROM, hard disk drive, and solid state drive.

Call bell 230 is, for example, a button pressed by a visitor. When the visitor presses the call bell 230, a call signal is transmitted from the slave device 200 to the master device 100 via the transmission line L1.

Microphone 240 is configured to convert input audio into an analog audio signal. This analog audio signal is converted into a digital audio signal (audio data) by, for example, an audio processing circuit (not shown) and transmitted to master device 100 .

The speaker 250 is configured to convert an analog audio signal into audio and output the audio. For example, a digital audio signal (audio data) received from master device 100 is converted into an analog audio signal by an audio processing circuit (not shown), and speaker 250 converts the analog audio signal into audio and outputs it.

Camera 260 is configured to capture moving images and generate image data. When call bell 230 is pressed, image data generated by camera 260 is transmitted from child device 200 to parent device 100 . The transmitted image is displayed on display 150 of master device 100 . In the intercom device 50, the camera 260 always captures an outdoor image, for example. By storing the image data generated through continuous shooting in the storage unit 220, the intercom device 50 can have the function of a surveillance camera. The camera 260 is composed of, for example, a camera module including an image sensor.

The second communication unit 280 is configured to communicate with the cloud server 300 and the mobile terminal 400 via the network N1 (FIG. 1). The second communication unit 280 is configured by, for example, a wireless LAN module. Fourth communication unit 270 is configured to transmit and receive control signals to and from master device 100 via transmission line L1. Further, the fourth communication unit 270 is configured to receive power supply from the master device 100 via the transmission line L1.

<1-3. Cloud server configuration>
FIG. 3 is a block diagram schematically showing the configuration of the cloud server 300. As shown in FIG. As described above, cloud server 300 is implemented by, for example, a general-purpose computer. As shown in FIG. 3 , cloud server 300 includes control unit 310 , communication I/F (interface) 330 , and storage unit 320 .

The control unit 310 includes a CPU, RAM, ROM, etc. (not shown), and is configured to control each component. Communication I/F 330 is configured to communicate with each of intercom device 50 and mobile terminal 400 via network N1. Communication I/F 330 is configured by, for example, a wired LAN module or a wireless LAN module.

The storage unit 320 is, for example, an auxiliary storage device such as a hard disk drive or solid state drive. The storage unit 320 stores, for example, control programs. Various functions of the cloud server 300 are realized by the control program being executed by the CPU of the control unit 310 .

<1-4. Configuration of Mobile Terminal>
FIG. 4 is a block diagram schematically showing the configuration of mobile terminal 400. As shown in FIG. As described above, the mobile terminal 400 is configured by, for example, a smart phone, tablet, mobile PC, or the like. As shown in FIG. 4 , mobile terminal 400 includes control section 410 , communication I/F 430 , display 450 , operation section 440 and storage section 420 .

The control unit 410 includes a CPU, RAM, ROM, etc. (not shown), and is configured to control each component. Communication I/F 430 is configured to communicate with each of cloud server 300 and intercom device 50, for example, via network N1. Communication I/F 430 is configured by, for example, a wired LAN module or a wireless LAN module.

Display 450 is configured to display images. The display 450 is configured by a monitor such as a liquid crystal monitor or an organic EL monitor, for example. The operation unit 440 is configured to receive an operation from the user. The operation unit 440 is composed of, for example, part or all of a touch panel, keyboard, mouse, and microphone.

The storage unit 420 is, for example, an auxiliary storage device such as a solid state drive or hard disk drive. The storage unit 420 is configured to store, for example, control programs. Various functions in mobile terminal 400 are realized by the control program being executed by the CPU of control unit 410 .

[2. motion]
<2-1. First audio output operation in the speaker of the child device>
In the intercom device 50, a message corresponding to the situation is output from the speaker 250 of the handset 200 in order to prompt the visitor to take appropriate measures.

FIG. 5 is a flow chart showing an operation procedure in intercom system 10 until speaker 250 outputs the first sound. With reference to FIG. 5 , the process shown in the flowchart on the left side is executed by second control unit 210 of child device 200 . The process shown in the central flowchart is executed by first control unit 110 of master device 100 . The processing shown in the flowchart on the right side is executed by the control unit 310 of the cloud server 300 .

Referring to the flowchart on the left side of FIG. 5, second control unit 210 of child device 200 determines whether or not call bell 230 installed outdoors (for example, at the entrance) has been pressed by a visitor (step S100). ). If it is determined that call bell 230 has not been pressed (NO in step S100), second control unit 210 waits until call bell 230 is pressed by the visitor.

On the other hand, when it is determined that call bell 230 has been pressed (YES in step S100), second control unit 210 causes fourth communication unit 270 to transmit a call signal to master device 100 via transmission line L1. control (step S110).

After that, second control unit 210 determines whether or not a control signal for speaker 250 (hereinafter also referred to as a “speaker control signal”) has been received from master device 100 via transmission line L1 (step S120). Types of the speaker control signal include, for example, a control signal for causing the speaker 250 to output the first message and a control signal for causing the speaker 250 to output the second message. The first message is, for example, a message to be output when the user's mobile terminal 400 is indoors (when the user is likely to be at home), and the second message is, for example, when the mobile terminal 400 This message should be output when the user is outdoors (when the user is likely not at home).

An example of the first message is a message such as "please wait". If the user is at home, the content of the first message may be brief, as the user can often respond immediately to calls from visitors. On the other hand, as an example of the second message, there is a message such as "I am out of the office, but I am calling you on my mobile phone. Please wait for a while." The second message is devised to make the visitor stay there even if there is no response from the user for a while. Also, in a case where it is not good for crime prevention to know that no one is indoors, an expression such as "The user's personal mobile phone is being called. Please wait until it connects" may be used.

If it is determined in step S 120 that the speaker control signal has not been received from master device 100 (NO in step S 120 ), second control unit 210 waits until the speaker control signal is received from master device 100 . On the other hand, when it is determined that the speaker control signal has been received from master device 100 (YES in step S120), second control unit 210 controls speaker 250 to output a message according to the received speaker control signal. (step S130). That is, the second control unit 210 reads the voice data indicating the message according to the received speaker control signal from the storage unit 220, and causes the speaker 250 to output the message (voice) indicated by the read voice data. Control.

Next, referring to the central flowchart of FIG. 5, first control unit 110 of master device 100 determines whether or not a call signal has been received from slave device 200 via transmission line L1 (step S200). . If it is determined that a calling signal has not been received (NO in step S200), first control unit 110 waits until a calling signal is received from child device 200. FIG.

On the other hand, when it is determined that a call signal has been received from child device 200 (YES in step S200), first control unit 110 outputs a signal for confirming the current location of mobile terminal 400 of the user (hereinafter referred to as "confirmation signal ) to the cloud server 300 (step S210). The confirmation signal is transmitted to cloud server 300 via router 500 and network N1. Information that can specify the user's mobile terminal 400 (hereinafter also referred to as "terminal specifying information") is registered in the master device 100 in advance, for example. For example, terminal identification information is included in the confirmation signal.

After that, the first control unit 110 determines whether information indicating the current location of the user's mobile terminal 400 (terminal location information) has been received from the cloud server 300 via the first communication unit 180 (step S220). . If it is determined that the terminal location information has not been received (NO in step S220), first control unit 110 waits until the terminal location information is received.

On the other hand, when it is determined that the terminal location information has been received (YES in step S220), first control unit 110 causes third communication unit 170 to transmit a speaker control signal corresponding to the terminal location information to child device 200. is controlled (step S230). That is, when the terminal location information indicates that the user's mobile terminal 400 is indoors, the first control unit 110 outputs the speaker control signal for outputting the first message to the speaker 250 of the child device 200. Transmit to slave device 200 . Further, when the terminal location information indicates that the user's mobile terminal 400 is outdoors, the first control unit 110 outputs a speaker control signal for outputting the second message to the speaker 250 of the child device 200. Transmit to slave device 200 .

Next, referring to the flowchart on the right side of FIG. 5, control unit 310 of cloud server 300 determines whether or not a confirmation signal has been received from master device 100 via network N1 (step S300). If it is determined that the confirmation signal has not been received (NO in step S300), control unit 310 waits until the confirmation signal is received.

On the other hand, when it is determined that the confirmation signal has been received (YES in step S300), control unit 310 controls communication I/F 330 so as to transmit the terminal location information regarding mobile terminal 400 of the user to master device 100 ( step S310). Note that, as described above, the cloud server 300 periodically collects the IP address information of the user's mobile terminal 400 . In cloud server 300, terminal location information may be generated periodically as IP address information is collected, or the latest IP address information may be generated in response to receipt of a confirmation signal from master device 100. may be generated based on

In this way, in master device 100, communication with cloud server 300 via router 500 outside master device 100 is performed in response to call bell 230 being operated by the visitor, and the user's mobile terminal is connected to cloud server 300 via router 500 outside master device 100. 400 terminal location information is obtained from the cloud server 300 . Then, in child device 200, a message corresponding to the terminal location information is output from speaker 250. FIG. Therefore, according to the intercom device 50, since a message according to the user's current position is output from the speaker 250, it is possible to prompt the visitor to take appropriate measures according to the user's current position.

Intercom device 50 also outputs different messages (first message or second message) from speaker 250 depending on whether the user is estimated to be outdoors or indoors. Therefore, according to the intercom device 50, by making the visitor feel that the resident (user) will respond immediately, the visitor is urged to respond appropriately according to the user's current location (outdoor or indoor). be able to.

<2-2. Communication operation between the slave unit and the master unit>
In the intercom device 50, when the mobile terminal 400 is indoors (when the user is likely to be at home), it is possible to set whether the call from the slave device 200 is sent to the master device 100 or the mobile terminal 400. is. If the call bell 230 of the child device 200 is pressed by a visitor when the call from the child device 200 is sent to the base device 100 when the mobile terminal 400 is indoors, the child device A call from 200 is sent to base unit 100 .

FIG. 6 is a flow chart showing an operation procedure in intercom device 50 until a call operation is performed between child device 200 and master device 100 . The processing shown in this flowchart is performed after master device 100 receives terminal location information from cloud server 300 in step S220 of FIG. and (2) when intercom device 50 is set to send a call from handset 200 to master device 100 when mobile terminal 400 is indoors. For example, after parent device 100 receives the terminal location information from cloud server 300, first control unit 110 of parent device 100 determines that (1) and (2) are satisfied, and the determination result is sent from parent device 100 to the child device. After being transmitted to the machine 200, the processing shown in this flow chart is executed.

Referring to FIG. 6 , the process shown in the left flowchart is executed by second control unit 210 of child device 200 , and the process shown in the right flowchart is executed by first control unit 110 of parent device 100 .

6, second control unit 210 of child device 200 causes second communication unit 280 to transmit image data generated by camera 260 to master device 100 via wireless communication. is controlled (step S400). For example, image data is transmitted from child device 200 to parent device 100 via router 500 and network N1. As a result, image data generated by photographing the visitor who pressed the call bell 230 is transmitted from the slave device 200 to the master device 100 via wireless communication.

After that, second control unit 210 determines whether or not a call start signal has been received from base unit 100 via transmission line L1 (step S410). As will be described later, the call start signal is transmitted from master device 100 via transmission line L1 when the user performs a predetermined operation (for example, pressing a physical button) via operation unit 160 of master device 100. It is transmitted to the child device 200 .

If it is determined that the call start signal has not been received (NO in step S410), second control unit 210 waits until the call start signal is received. On the other hand, if it is determined that the call start signal has been received (YES in step S410), second control unit 210 executes processing for starting a call via wireless communication (step S460). In the call in step S460, both voice data and image data are transmitted and received via wireless communication. It should be noted that the transmission and reception of audio data may be performed via transmission line L1, and only the transmission and reception of image data may be performed via wireless communication.

Next, referring to the flowchart on the right side of FIG. 6, first control unit 110 of master device 100 determines whether image data has been received from slave device 200 via wireless communication (step S420). If it is determined that image data has not been received from child device 200 (NO in step S420), first control unit 110 waits until image data is received from child device 200. FIG.

On the other hand, if it is determined that the image data has been received from child device 200 (YES in step S420), first control unit 110 controls display 150 to start outputting the moving image indicated by the received image data. (step S430).

First control unit 110 determines whether or not a call start instruction from the user has been received (step S440). For example, it is determined whether or not the user has performed a predetermined operation (for example, pressing a physical button) via the operation unit 160 . If it is determined that the user's call start instruction has not been accepted (NO in step S440), first control unit 110 waits until the user's call start instruction is accepted.

On the other hand, when it is determined that the call start instruction from the user has been accepted (YES in step S440), first control unit 110 causes third communication unit 110 to transmit a call start signal to handset 200 via transmission line L1. 170 (step S450). After that, the first control unit 110 executes processing for starting a call via wireless communication (step S460).

FIG. 7 is a diagram showing what is used for transmission and reception between slave device 200 and master device 100 . As shown in FIG. 7, various control signals are transmitted and received between slave device 200 and master device 100 via transmission line L1. Power is supplied from master device 100 to slave device 200 via transmission line L1. Base device 100 receives power supply from a power supply (not shown), and supplies part of the supplied power to slave device 200 via transmission line L1. In addition, transmission and reception of image data and audio data between slave device 200 and master device 100 are performed via wireless communication.

Thus, in intercom device 50, transmission and reception of image data between master device 100 and slave device 200 are not performed via two-wire transmission line L1, and between first communication unit 180 and second communication unit 280 is performed via wireless communication. Therefore, according to the intercom device 50, since image data is transmitted and received by means of communication (wireless communication) having a relatively large communication band, image data can be smoothly transmitted and received between the parent device 100 and the child device 200. be able to.

<2-3. Communication operation between handset and mobile terminal>
As described above, in the intercom device 50, it is possible to set whether to send a call from the slave device 200 to the master device 100 or the mobile terminal 400 when the mobile device 400 is indoors. If the mobile terminal 400 is indoors and the call from the child device 200 is set to be sent to the mobile terminal 400, or if the mobile terminal 400 is outdoors, the call bell of the child device 200 230 is pressed by the visitor, a call from handset 200 is sent to mobile terminal 400 .

FIG. 8 is a flow chart showing an operation procedure in intercom system 10 until a call operation between handset 200 and mobile terminal 400 is performed. In the process shown in this flowchart, after master device 100 receives terminal location information from cloud server 300 in step S220 of FIG. and (B) setting is made in intercom device 50 to send a call from handset 200 to mobile terminal 400 when mobile terminal 400 is indoors, or (C) terminal location information indicates that the user's mobile terminal 400 is outdoors.

For example, after master device 100 receives the terminal location information from cloud server 300, it is determined by first control unit 110 of master device 100 that (A) and (B) are satisfied, or that (C) is satisfied. After the determination result is transmitted from parent device 100 to child device 200, the processing shown in this flowchart is executed.

With reference to FIG. 8 , the process shown in the left flowchart is executed by second control unit 210 of child device 200 , and the process shown in the right flowchart is executed by control unit 410 of mobile terminal 400 .

Referring to the flowchart on the left side of FIG. 8, second control unit 210 of child device 200 causes second communication unit 280 to transmit image data generated by camera 260 to mobile terminal 400 via wireless communication. is controlled (step S500). For example, image data is transmitted from the child device 200 to the mobile terminal 400 via the router 500 and the network N1. Accordingly, the image data generated by photographing the visitor who pressed the call bell 230 is transmitted from the handset 200 to the mobile terminal 400 via wireless communication.

After that, second control unit 210 determines whether or not a call start signal has been received from base unit 100 via transmission line L1 (step S510). As will be described later, the call start signal is transmitted to the mobile terminal 400 via wireless communication when the user performs a predetermined operation (for example, touching a predetermined area of the display 450) via the operation unit 440 of the mobile terminal 400. 400 to the master device 100, and then transmitted from the master device 100 to the slave device 200 via the transmission line L1. Note that the call start signal does not necessarily need to be transmitted from the mobile terminal 400 to the child device 200 via the master device 100. For example, the call start signal may be directly transmitted from the mobile terminal 400 to the child device 200 via wireless communication. .

If it is determined that the call start signal has not been received (NO in step S510), second control unit 210 waits until the call start signal is received. On the other hand, if it is determined that the call start signal has been received (YES in step S510), second control unit 210 executes processing for starting a call via wireless communication (step S560). In the call in step S560, both voice data and image data are transmitted and received via wireless communication.

Next, referring to the flowchart on the right side of FIG. 8, control unit 410 of mobile terminal 400 determines whether image data has been received from child device 200 via wireless communication (step S520). If it is determined that image data has not been received from child device 200 (NO in step S520), control unit 410 waits until image data is received from child device 200. FIG.

On the other hand, if it is determined that image data has been received from child device 200 (YES in step S520), control unit 410 executes an application (hereinafter referred to as "dedicated application”), and controls the display 450 to start outputting the moving image indicated by the received image data (step S530).

Control unit 410 determines whether or not a call start instruction from the user has been received (step S540). For example, it is determined whether or not the user has performed a predetermined operation (for example, touching a predetermined area of display 450 ) via operation unit 440 . If it is determined that the user's call start instruction has not been accepted (NO in step S540), control unit 410 waits until the user's call start instruction is accepted.

On the other hand, if it is determined that the user's call start instruction has been received (YES in step S540), control unit 410 communicates to transmit a call start signal to child device 200 via transmission line L1 via master device 100. The I/F 430 is controlled (step S550). Thereafter, control unit 410 executes processing for starting a call via wireless communication (step S560).

In this way, in intercom device 50, when the terminal location information indicates that mobile terminal 400 is indoors (when it is estimated that the user is indoors), image data is transmitted from child device 200 to the parent device. It is possible to set whether to transmit to the device 100 or to transmit from the child device 200 to the mobile terminal 400 . Therefore, according to intercom device 50, by setting the image data to be transmitted from handset 200 to mobile terminal 400 when it is estimated that the user is indoors, the user can be located near master device 100 indoors. Even if the user is not at the mobile terminal 400 (for example, when the base unit is installed on the first floor indoors and the user is on the second floor), the user can easily talk to the visitor via the mobile terminal 400. can be done.

<2-4. Second Audio Output Operation in Speaker of Slave Device>
As described above, in the intercom device 50, a message corresponding to the situation is output from the speaker 250 of the handset 200 in order to prompt the visitor to respond appropriately. The second voice output operation is particularly effective when the visitor is a home delivery company.

FIG. 9 is a flow chart showing the operation procedure in intercom system 10 until speaker 250 outputs the second sound. Referring to FIG. 9 , the process shown in the left flowchart is executed by second control unit 210 of child device 200 . The processing shown in the flowchart on the right side is executed by control unit 410 of mobile terminal 400 . It should be noted that, as described above, the camera 260 constantly captures images of the outdoors, for example.

Referring to the flowchart on the left side of FIG. 9, second control unit 210 of child device 200 determines whether or not a visitor (for example, a home delivery company) has been photographed by camera 260 (step S600). The second control unit 210 determines whether or not the visitor has been photographed by the camera 260 based on whether or not the camera 260 has photographed a moving subject having a predetermined area or more, for example. If it is determined that the visitor has not been photographed by camera 260 (NO in step S600), second control unit 210 waits until it is determined that the visitor has been photographed by camera 260. FIG.

On the other hand, when it is determined that the visitor has been photographed by camera 260 (YES in step S600), second control unit 210 starts recording the image photographed by camera 260 in storage unit 220 (step S610). . Further, second control unit 210 controls second communication unit 280 to transmit image data generated by camera 260 to mobile terminal 400 via wireless communication (step S620).

After that, second control unit 210 determines whether or not a speaker control signal has been received from master device 100 via transmission line L1 (step S630). As will be described later, the speaker control signal is transmitted to the mobile terminal 400 via wireless communication when the user performs a predetermined operation (for example, touching a predetermined area of the display 450) via the operation unit 440 of the mobile terminal 400. 400 to the master device 100, and then transmitted from the master device 100 to the slave device 200 via the transmission line L1. Note that the speaker control signal does not necessarily need to be transmitted from mobile terminal 400 to child device 200 via master device 100, and may be directly transmitted from mobile terminal 400 to child device 200 via wireless communication, for example. .

Types of the speaker control signal include, for example, a control signal for causing the speaker 250 to output the third message and a control signal for causing the speaker 250 to output the fourth message. The third message is, for example, a message that should be output if the visitor is a home delivery company, and the fourth message is a message that should be output, for example, if the visitor is not a home delivery company. Note that if the visitor is not a home delivery company, no message may be output from speaker 250 .

An example of the third message is a message such as "Please put the parcel in the delivery box located outdoors". On the other hand, as an example of the fourth message, there is a message such as "There is a possibility that the visited destination is incorrect. Please reconfirm the visited destination." These messages are, for example, messages prompting the courier to take appropriate action.

If it is determined in step S630 that the speaker control signal has not been received from master device 100 (NO in step S630), second control unit 210 waits until the speaker control signal is received from master device 100. FIG. On the other hand, if it is determined that the speaker control signal has been received from master device 100 (YES in step S630), second control unit 210 controls speaker 250 to output a message according to the received speaker control signal. (step S640). That is, the second control unit 210 reads the voice data indicating the message according to the received speaker control signal from the storage unit 220, and causes the speaker 250 to output the message (voice) indicated by the read voice data. Control.

Next, referring to the flowchart on the right side of FIG. 9, control unit 410 of mobile terminal 400 determines whether image data has been received from child device 200 via wireless communication (step S700). If it is determined that image data has not been received from child device 200 (NO in step S700), control unit 410 waits until image data is received from child device 200. FIG.

On the other hand, when it is determined that the image data has been received from child device 200 (YES in step S700), control unit 410 launches the dedicated application and instructs to start outputting the moving image indicated by the received image data. The display 450 is controlled (step S710).

FIG. 10 is a diagram showing an example of the image displayed in step S710 of FIG. As shown in FIG. 10, on display 450, an image captured by camera 260 is displayed in area T1, and icons U1 and U2 are displayed below area T2 surrounding area T1. The icon U1 is an icon that the user should touch when the subject in the captured image is a home delivery company. In other words, the icon U1 is an icon for the user to confirm that the subject is a home delivery company and express permission to put the package into the home delivery box. On the other hand, icon U2 is an icon to be touched by the user when the subject in the captured image is not the home delivery company. That is, the icon U2 is an icon for the user to confirm that the subject is not a home delivery company and express that the delivery of the package to the home delivery box is not permitted.

Referring again to the flowchart on the right side of FIG. 9, control unit 410 determines whether or not selection (touch) of an icon (icon U1 or icon U2) by the user via operation unit 440 has been received (step S720). . If it is determined that selection of an icon by the user has not been accepted (NO in step S720), control unit 410 waits until selection of an icon by the user is accepted.

On the other hand, if it is determined that selection of an icon by the user has been accepted (YES in step S720), control unit 410 communicates to transmit a speaker control signal to slave device 200 via transmission line L1 via master device 100. The I/F 430 is controlled (step S730). For example, when icon U1 is selected by the user, control unit 410 performs control to transmit to master device 100 a speaker control signal (permission signal) that causes speaker 250 to output the third message. In addition, control unit 410 performs control for transmitting a speaker control signal (disapproval signal) for outputting the fourth message to speaker 250 to master device 100 when icon U2 is selected by the user. Each speaker control signal transmitted to master device 100 is transmitted to slave device 200 via transmission line L1. That is, first control unit 110 of base device 100 controls third communication unit 170 to transmit the received speaker control signal (permission signal or non-permission signal) to slave device 200 via transmission line L1. do.

In this way, in intercom device 50, speaker 250 outputs a message indicating an instruction to the delivery company in response to the signal (permission signal or non-permission signal) received from mobile terminal 400. FIG. Therefore, according to the intercom device 50, for example, when the user appropriately operates the mobile terminal 400 with reference to an image displayed on the mobile terminal 400 (for example, the image shown in FIG. 10), an appropriate delivery service for the home delivery company is provided. can be directed to

[3. feature]
As described above, in intercom device 50 according to the present embodiment, in response to call bell 230 being operated by a visitor, a message corresponding to the terminal location information of mobile terminal 400 of the user is output from speaker 250. be. Therefore, according to the intercom device 50, since a message according to the user's current position is output from the speaker 250, it is possible to prompt the visitor to take appropriate measures according to the user's current position.

[4. Modification]
Although the embodiments have been described above, the present invention is not limited to the above embodiments, and various modifications are possible without departing from the scope of the invention. Modifications will be described below.

<4-1>
In intercom system 10 according to the above embodiment, cloud server 300 generates terminal location information based on IP address information of mobile terminal 400 . However, generation of terminal location information does not necessarily have to be performed in cloud server 300 . For example, in response to the call bell 230 being operated by the visitor, the IP address information of the user's mobile terminal 400 is transmitted from the cloud server 300 to the master device 100, and the terminal location is determined by the master device 100 based on the IP address information. Information may be generated. Further, the content of the speaker control signal may be determined based on the IP address information transmitted from cloud server 300 without generating the terminal location information in master device 100 .

<4-2>
In addition, in intercom device 50 according to the above embodiment, the data of the voice output from speaker 250 of handset 200 is stored in storage unit 220 . However, the audio data output from speaker 250 does not necessarily have to be stored in storage unit 220 . For example, audio data output from speaker 250 may be stored in storage unit 120 of master device 100 . In this case, the speaker control signal transmitted from parent device 100 to child device 200 includes the audio signal.

<4-3>
Further, in intercom device 50 according to the above embodiment, wireless communication between first communication unit 180 of base device 100 and second communication unit 280 of child device 200 is performed via router 500 and network N1. It was decided that However, wireless communication between first communication unit 180 of base device 100 and second communication unit 280 of child device 200 does not necessarily have to be performed via router 500 and network N1. For example, the parent device 100 and the child device 200 are paired in advance, and wireless communication between the first communication unit 180 and the second communication unit 280 is performed by a communication method such as Bluetooth (registered trademark) that does not go through the network N1. may be implemented.

10 intercom system 50 intercom device 100 base unit 110 first control unit 120,220,320,420 storage unit 130,240 microphone 140,250 speaker 150,450 display 160,440 operation unit 170 Third Communication Unit 180 First Communication Unit 200 Handset 210 Second Control Unit 230 Call Bell 260 Camera 270 Fourth Communication Unit 280 Second Communication Unit 300 Cloud Server 310,410 Control Unit 330, 430 communication I/F, 400 mobile terminal, 500 router, L1 transmission path, N1 network, T1, T2 areas, U1, U2 icons.

Claims (6)

An intercom device configured to communicate with a cloud server that collects the IP (Internet Protocol) address of a user's mobile terminal,
a handset installed outdoors, including a call bell and a speaker;
A parent device connected to the child device and installed indoors,
The parent device
Acquiring the IP address or terminal position information generated based on the IP address by communicating with the cloud server via a router external to the parent device in response to the operation of the call bell. a first communication unit;
and a first control unit configured to transmit a control signal for causing the speaker to output a message according to the IP address or the terminal location information acquired by the first communication unit, to the slave device. The first control unit is
When the IP address is a private IP address, or when the terminal location information indicates that the mobile terminal is inside the building, the child sends a control signal for outputting a first message to the speaker. machine, while
When the IP address is a global IP address, or when the terminal location information indicates that the mobile terminal is located outdoors, the child sends a control signal for outputting a second message to the speaker. 2. The intercom device of claim 1, which transmits to an aircraft. The child device is
a camera that captures the outdoors and generates image data;
further comprising a second communication unit that wirelessly communicates with the first communication unit of the parent device,
The parent device is connected to the child device via a two-wire transmission line,
Between the parent device and the child device, power and control signals are transmitted and received via the transmission path, and the image data are transmitted and received via wireless communication between the first and second communication units. The intercom device according to claim 2. The second communication unit is capable of wireless communication with the mobile terminal,
The slave device further includes a second control unit that controls the second communication unit,
In the parent device, when the IP address is a private IP address, or when the terminal location information indicates that the mobile terminal exists indoors, the image data is transferred from the child device to the It is possible to set whether to transmit to the parent device or to transmit from the child device to the mobile terminal,
4. The intercom device according to claim 3, wherein said second control unit controls said second communication unit to transmit said image data to a transmission destination according to said setting. When a permission signal or a non-permission signal is received from the mobile terminal via the first communication unit in response to transmission of the image data to the mobile terminal, the first control unit 5. The intercom device according to claim 4, wherein a control signal for outputting a message indicating an instruction to a home delivery company from said speaker is transmitted to said slave unit according to a signal. A control method for an intercom device configured to communicate with a cloud server that collects IP (Internet Protocol) addresses of mobile terminals of users, comprising:
The intercom device is
a handset having a call bell and a speaker and installed outdoors;
A parent device connected to the child device and installed indoors,
The method for controlling the intercom device includes:
By communicating with the cloud server via a router external to the parent device in response to the operation of the call bell, the parent device receives the IP address or the terminal location information generated based on the IP address. causing the machine to acquire;
A control method for an intercom device, comprising the step of transmitting a control signal for causing the speaker to output a message corresponding to the obtained IP address or the terminal location information from the parent device to the child device.

Images