JP7113253B2 - CALLING DEVICE, INFORMATION TERMINAL, CONTROL METHOD FOR INFORMATION TERMINAL, AND PROGRAM - Google Patents

Description

TECHNICAL FIELD The present disclosure generally relates to a calling device, an information terminal, an information terminal control method, and a program, and more particularly to a calling device provided with an imaging unit, an information terminal capable of communicating with the calling device, an information terminal control method, and a program. .

Conventionally, there is a camera-equipped intercom terminal (calling device) provided with a camera (image pickup unit) (see Patent Document 1, for example).

A camera-equipped interphone terminal described in Patent Document 1 includes a communication device and a camera having an imaging device and a lens. A camera-equipped intercom terminal can capture an image of a visitor with a camera. Data captured by the camera is transmitted to an intercom terminal (information terminal) with a monitor. The monitor-equipped intercom terminal displays the data transmitted from the camera-equipped intercom terminal on the display.

JP 2016-158038 A

2. Description of the Related Art In a calling device, it is desired to make it easier to check the appearance of the user of the calling device.

The present disclosure has been made in view of the above reasons, and an object of the present disclosure is to provide a calling device, an information terminal, a control method for the information terminal, and a program that can make it easier to check the appearance of the user of the calling device. It is in.

A calling device according to one aspect of the present disclosure calls an information terminal. The calling device includes an imaging section and a communication section. The imaging unit captures an image. The communication unit can communicate with the information terminal. The communication unit captures a playback image using a first image captured by the imaging unit before a predetermined condition is satisfied and a second image captured by the imaging unit after the predetermined condition is satisfied, and a playback image captured by the imaging unit. and a real-time image, which is a real-time moving image, is transmitted to the information terminal.
A calling device according to one aspect of the present disclosure calls an information terminal. The calling device includes an imaging section and a communication section. The imaging unit captures an image. The communication unit can communicate with the information terminal. The communication unit transmits to the information terminal a first image captured by the imaging unit before a predetermined condition is satisfied and a second image captured by the imaging unit after the predetermined condition is satisfied. The first image is an image captured before the predetermined condition is satisfied and after the person has moved out of the imaging range of the imaging unit after the previous communication between the communication unit and the information terminal has ended. is.

An information terminal according to one aspect of the present disclosure includes a terminal-side communication unit and a display unit. The terminal-side communication unit can communicate with the calling device. The display section displays an image captured by the imaging section of the calling device. The display unit displays the first image after displaying the second image.

A control method for an information terminal according to an aspect of the present disclosure is a control method for an information terminal communicable with the calling device, and includes a communication step and a display step. The communicating step communicates with the paging device. In the displaying step, the image captured by the imaging unit of the calling device is displayed. The displaying step displays the first image after displaying the second image.

A program according to an aspect of the present disclosure causes a computer system to execute the information terminal control method.

The present disclosure has the effect of making it easier to confirm the appearance of the user of the calling device.

FIG. 1 is a block diagram of an intercom system including a calling device according to one embodiment of the present disclosure; FIG. FIG. 2 is an example of the display screen of the display unit of the master unit in the intercom system. FIG. 3 is a time chart of a first operation example of the intercom system; FIG. 4 is a time chart of a second operation example of the intercom system. FIG. 5 is a time chart of a third operation example of the intercom system.

(1) Overview of intercom system An intercom system 10 according to the present embodiment, as shown in FIG. 2 (hereinafter also referred to as parent device 2). The interphone system 10 further includes a control device 3 , a plurality of (two in FIG. 1) doorphones 4 , and a plurality of (two in FIG. 1 ) branching devices 5 . This intercom system 10 is, for example, an intercom system for collective housing that is applied to collective housing such as condominiums. In this intercom system 10 , the slave unit 1 and each master unit 2 communicate with each other via the control device 3 .

Each of the plurality of base units 2 is, for example, a dwelling unit terminal installed in each dwelling unit of an apartment complex. Each parent device 2 is configured to communicate with the child device 1 (for example, call, receive image signals, etc.). Each parent device 2 has a display unit 22 that displays an image (moving image) captured by the imaging unit 11 of the child device 1 .

The handset 1 is, for example, a shared terminal (lobby intercom) installed in a common area of a collective housing such as a lobby. The child device 1 is configured to communicate with each parent device 2 (for example, make a call, transmit an image signal, call the parent device 2, etc.).

The control device 3 is configured to perform call control and relay signals between the child device 1 and each parent device 2 . The control device 3 is installed, for example, in a management room of an apartment complex. For example, when a visitor calls base unit 2 using handset 1 , control device 3 relays signals transmitted and received between handset 1 and base unit 2 .

Each of the plurality of doorphones 4 is installed, for example, at the outer entrance of each dwelling unit of the housing complex. A plurality of intercoms 4 are in one-to-one correspondence with a plurality of base units 2. - 特許庁Each intercom 4 is configured to perform communication (for example, call, transmission of image signals, etc.) with the corresponding base unit 2 .

Each of the plurality of branching devices 5 is inserted into the second trunk line 62 and allows the plurality of base units 2 to be connected to the second trunk line 62 . In this embodiment, the second main line 62 is branched into a plurality of branch lines 63 , and the plurality of turnouts 5 are provided at the branch points of the plurality of branch lines 63 on the second main line 62 . As a result, each base unit 2 can be connected to the second main line 62 via the branching device 5 .

The handset 1 is connected to the control device 3 via the first trunk line 61 . Each base unit 2 is connected to the control device 3 via the second main line 62 , the branch line 63 and the branch 5 . Each door phone 4 is connected to the corresponding master unit 2 via a connection line 64 . Each of the first trunk line 61, the second trunk line 62, the branch line 63, and the connection line 64 is composed of, for example, a twisted pair cable.

The child device 1 includes an imaging unit 11 that captures an image, and a child device side communication unit 12 that can communicate with the parent device 2 . The handset-side communication unit 12 generates a first image P11 (see FIG. 3) captured by the imaging unit 11 before the predetermined condition is satisfied, and a second image P12 (see FIG. 3) captured by the imaging unit 11 after the predetermined condition is satisfied. ) and are transmitted to the base unit 2 .

In addition, the parent device 2 includes a parent device side communication unit 21 that can communicate with the child device 1 and a display unit 22 that displays an image captured by the imaging unit 11 of the child device 1 . The display unit 22 displays the first image P11 after displaying the second image P12 (see FIG. 3).

In the child device 1 of the present embodiment, the imaging unit 11 captures an image before the predetermined condition is satisfied, and transmits the captured first image P11 to the parent device 2 . This makes it easier for the parent device 2 to recognize the user of the child device 1 .

(2) Configuration of Intercom System (2.1) Configuration of Handset First, the configuration of handset 1 (calling device 1) will be described. As shown in FIG. 1, the handset 1 includes an imaging unit 11, a handset-side communication unit 12 (communication unit), a handset-side control unit 13, a handset-side operation unit 14 (operation unit), and an image sensor. It has a processing unit 15 , a storage unit 16 and a sensor 17 . Further, the handset 1 has a call unit (including a speaker and a microphone) and the like for realizing communication with the base device 2 .

The imaging unit 11 is a camera that has an imaging element and is for imaging a subject (a visitor or the like). In this embodiment, the imaging area (field of view) of the imaging unit 11 is set in front of the child device 1 so that when the visitor operates the child device 1 , at least the visitor's face can be captured. In this embodiment, the imaging unit 11 is a camera that captures moving images. Furthermore, in this embodiment, the imaging unit 11 is a camera that captures a color image.

The imaging device is, for example, a two-dimensional image sensor such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The imaging unit 11 forms an image of light from a subject on an imaging surface (light receiving surface) of an imaging element using an optical system such as a lens, and the imaging element converts the light from the subject into an electrical signal. Then, the imaging unit 11 outputs the output signal of the imaging device to the image processing unit 15 as an image signal.

The slave unit side communication unit 12 is a communication interface for communicating with the master unit 2 . The handset side communication section 12 is connected to the control device 3 via the first main line 61 . In FIG. 1, the first trunk line 61 is indicated by a single line. The child device side communication unit 12 is configured to be able to communicate bidirectionally with the parent device 2 via a communication unit 32 (described later) of the control device 3 . The slave unit side communication unit 12 is configured to transmit a communication signal to the master unit 2 . Communication signals include audio signals, image signals, control signals, and the like. Further, the handset-side communication unit 12 receives a communication signal transmitted from the base unit 2 via the communication unit 32 and demodulates the received communication signal to obtain an audio signal or the like. The audio signal is output to the calling section via the handset side control section 13 .

The handset-side operation unit 14 is configured to receive an operation from a person (for example, a visitor). The handset side operation unit 14 is an input interface having, for example, a plurality of push button switches, a touch panel, and the like. The visitor calls the base unit 2 provided in the dwelling unit to be visited by performing a calling operation for inputting, for example, the dwelling unit number of the dwelling unit to be visited, on the handset side operation unit 14 .

The image processing unit 15 is configured to receive an image signal output from the imaging unit 11 and process an image (moving image) included in the image signal by signal processing. The image processing unit 15 is implemented by a device such as a DSP (Digital Signal Processor) or FPGA (Field-Programmable Gate Array).

The handset-side control unit 13 is composed of, for example, a microcomputer mainly composed of a CPU (Central Processing Unit) and a memory. The microcomputer functions as the child device side control section 13 by executing the program stored in the memory by the CPU. The program executed by the CPU is pre-recorded in the memory of the microcomputer here, but may be recorded in a recording medium such as a memory card and provided, or may be provided through an electric communication line such as the Internet. .

The handset-side control section 13 is configured to control the imaging section 11 and the handset-side communication section 12 . Further, the child device side control section 13 is configured to control the image processing section 15 .

The handset-side control section 13 controls the imaging section 11 to cause the imaging section 11 to capture an image (moving image). In this embodiment, when a predetermined condition is satisfied, the child device side control section 13 causes the image processing section 15 to generate a playback image P10 (see FIGS. 2 and 3). The playback image P10 is data obtained by recording a moving image captured by the imaging unit 11 before communication with the master device 2 is started. In this embodiment, the predetermined condition includes a condition that the handset-side operation unit 14 accepts the calling operation. More specifically, the predetermined condition includes a condition that handset-side operation unit 14 accepts the first call operation. A calling operation is an operation for calling base unit 2 . In the present embodiment, the calling operation is an operation of inputting the home unit number of the visit destination to the handset-side operation unit 14 . The first operation of the call operation (hereinafter also referred to as the start of the call operation) is an operation of inputting the first letter (initial letter) of the dwelling unit number. For example, if the number of the home to be visited is "123", the input of "1" is the first call operation.

The image processing unit 15 generates a playback image P10 using the first image P11 captured by the imaging unit 11 before the predetermined condition is satisfied and the second image P12 captured by the imaging unit 11 after the predetermined condition is satisfied. (see Figure 3). The terms "before the predetermined condition is established" and "after the predetermined condition is established" include the point in time when the predetermined condition is established.

At least one of the first image P11 and the second image P12 is a moving image. In this embodiment, both the first image P11 and the second image P12 are moving images. More specifically, the first image P11 and the second image P12 are moving images that are continuous in time series. In other words, the first image P11 is a moving image captured by the imaging unit 11 before the visitor starts the calling operation on the handset-side operation unit 14 . The second image P<b>12 is a moving image captured by the imaging unit 11 after the visitor started the calling operation on the handset-side operation unit 14 . The playback image P10 (the first image P11, the second image P12) generated by the child device-side control section 13 is transmitted to the parent device 2 via the child device-side communication section 12. FIG.

Further, when child device 1 and parent device 2 are ready for communication, child device-side control unit 13 causes real-time image P20, which is a real-time moving image captured by imaging unit 11, to be transmitted to parent device 2. .

By controlling the child device-side communication unit 12, the child device-side control unit 13 causes the child device-side communication unit 12 to transmit a communication signal to the parent device 2, and causes the child device-side communication unit 12 to transmit a communication signal from the parent device 2 receive communication signals. A communication signal to the base unit 2 includes an audio signal, an image signal, a control signal, and the like. Also, the communication signal from the base unit 2 includes an audio signal, a control signal, and the like.

The handset-side control unit 13 controls the image processing unit 15 to process an image (moving image) included in the image signal from the imaging unit 11 . The image processed by the image processing section 15 is transmitted from the child device side communication section 12 to the parent device 2 .

The storage unit 16 is composed of a readable/writable memory. The storage unit 16 is, for example, a flash memory. The storage unit 16 stores images (moving images) captured by the imaging unit 11 . Note that when the amount of data stored in the storage unit 16 exceeds a predetermined amount, the data with the oldest date and time of creation are deleted.

In this embodiment, the storage unit 16 is provided outside the child device-side control unit 13 , but may be provided inside the child device-side control unit 13 . That is, the storage unit 16 may be a built-in memory of the child device side control unit 13 .

The sensor 17 is, for example, a pyroelectric infrared sensor, and detects a person or the like by detecting the amount of change in infrared rays that occurs when the person or the like moves. Sensor 17 is configured to detect the presence of a person in the space where handset 1 is provided. Specifically, the detection range of the sensor 17 is set in front of the handset 1 so that a person (for example, a visitor) who operates the handset-side operation section 14 of the handset 1 can be detected. Note that the sensor 17 may not be included in the child device 1 , or may be provided separately from the child device 1 and configured to output a detection signal to the child device 1 .

Further, the sensor 17 is not limited to an infrared sensor, and may be an ultrasonic sensor using ultrasonic waves, a visible light sensor using visible light, or the like, or a combination thereof. Also, a camera or the like may be used instead of the human sensor.

(2.2) Configuration of Master Device Next, the configuration of the master device 2 (information terminal 2) will be described. As shown in FIG. 1, the base unit 2 includes a base unit side communication unit 21 (terminal side communication unit), a display unit 22, a base unit side control unit 23, a base unit side operation unit 24, and an image processing unit. 25 , a storage unit 26 and a notification unit 27 . Further, the base unit 2 has a call unit (including a speaker and a microphone) and the like for realizing a call between the handset 1 and the door phone 4 .

The master device side communication unit 21 is a communication interface for communicating with the slave device 1 and the intercom 4 . The base unit side communication section 21 is connected to the control device 3 via the second main line 62 , the branch line 63 and the branch switch 5 . In FIG. 1, the second main line 62 and the branch line 63 are indicated by one line. The parent device side communication unit 21 is configured to be able to communicate bidirectionally with the child device 1 via the communication unit 32 of the control device 3 . The parent device side communication unit 21 is configured to transmit a communication signal to the child device 1 . The communication signals include audio signals, control signals, and the like. In addition, the master-side communication unit 21 receives a communication signal transmitted from the handset 1 via the communication unit 32, and demodulates the received communication signal to obtain an audio signal, an image signal, and the like. The audio signal is output to the call section via the base-side control section 23 , and the image signal is output to the display section 22 via the base-side control section 23 .

The display unit 22 is configured to display an image from the image processing unit 25 (for example, a moving image captured by the imaging unit 11 of the handset 1). The display unit 22 is, for example, a liquid crystal display. Here, when the master device 2 has a touch panel display, the touch panel display serves both as the display unit 22 and the master device side operation unit 24 .

The master-side operation unit 24 is configured to receive an operation by a person (here, a resident of the dwelling unit). When a predetermined operation (for example, a push operation) is performed on the master unit-side operation unit 24 while the master unit-side communication unit 21 is receiving a call signal for calling the resident, the slave unit 1 and Voice communication with the base unit 2 becomes possible.

The image processing unit 25 is configured to receive the image signal from the child device 1 received by the parent device side communication unit 21 and process the image (moving image) included in the image signal by signal processing. The image processing unit 25 is configured, for example, to perform synthesis processing for synthesizing a plurality of images (moving images). In this embodiment, the image processing unit 25 synthesizes the playback image P10, which is a past moving image, and the real-time image P20, which is a real-time image, in the synthesizing process to create one image (moving image). The image processing unit 25 is implemented by a device such as a DSP or FPGA, for example.

The master-side control unit 23 is configured by, for example, a microcomputer having a CPU and a memory as main components. The microcomputer functions as the master-side controller 23 by the CPU executing the program stored in the memory. The program executed by the CPU is pre-recorded in the memory of the microcomputer here, but may be recorded in a recording medium such as a memory card and provided, or may be provided through an electric communication line such as the Internet. .

The base-side control section 23 is configured to control the base-side communication section 21 and the display section 22 . Further, the master-side control section 23 is configured to control the image processing section 25 .

Base-side control section 23 controls base-side communication section 21 to cause base-side communication section 21 to transmit a communication signal to handset 1 and to cause base-side communication section 21 to transmit a signal from handset 1 to handset 1 . to receive the communication signal of A communication signal to the handset 1 includes an audio signal, a control signal, and the like. Also, the communication signal from the handset 1 includes an audio signal, an image signal, a control signal, and the like.

By controlling the display unit 22 , the parent device-side control unit 23 causes the display unit 22 to display the image sent from the child device 1 . In this embodiment, as shown in FIG. 2, a single image obtained by synthesizing a playback image P10 before starting communication with the child device 1 and a real-time image P20 after starting communication with the child device 1 is displayed. Displayed on the display unit 22 . FIG. 2 shows an example of displaying a synthesized image of the playback image P10 and the real-time image P20 on the display screen 220 of the display unit 22. As shown in FIG. In FIG. 2, on the display screen 220, the playback image P10 is displayed small and the real-time image P20 is displayed large. By operating the master-side operation unit 24, it is possible to switch the display areas of the playback image P10 and the real-time image P20, display only the playback image P10, or display only the real-time image P20. For example, the entire display screen 220 can display only the real-time image P20 or only the playback image P10. In this case, it is possible to switch from the display of the real-time image P20 to the display of the playback image P10 or from the display of the playback image P10 to the display of the real-time image P20 by operating the master-side operation unit 24. can. Further, by operating the parent device side operation unit 24, only the first image P11 of the playback image P10 may be displayed once or repeatedly, or only the second image P12 may be displayed once or repeatedly. good. Also, the playback image P10 transmitted from the handset 1 is stored in the storage unit 26, so that the playback image P10 can be reviewed later.

The master-side controller 23 controls the image processor 25 to perform synthesizing processing for synthesizing the playback image P10 and the real-time image P20. An image processed (synthesized) by the image processing unit 25 is displayed on the display unit 22 .

The storage unit 26 is composed of a readable/writable memory. The storage unit 26 is, for example, a flash memory. The storage unit 26 stores the playback image P10 sent from the child device 1. FIG. Also, the storage unit 26 may store the real-time image P20 sent from the handset 1 . Although the storage unit 26 is provided outside the parent device-side control unit 23 in this embodiment, it may be provided inside the parent device-side control unit 23 . That is, the storage unit 26 may be a built-in memory of the parent device side control unit 23 .

The notification unit 27 is configured to output a ringing tone, for example. When there is a call from the handset 1, the base-side control section 23 causes the notification section 27 to output a ringing tone at a predetermined timing. In other words, when there is a call from handset 1, base-side control section 23 causes notification section 27 to perform a notification operation of notifying that handset 1 has called. Note that the notification unit 27 may be configured to output voice instead of the ringing tone.

(2.3) Configuration of Control Device Next, the configuration of the control device 3 will be described. The control device 3 has a signal processing section 31 and a communication section 32 as shown in FIG.

The communication unit 32 is a communication interface for communicating with the child device 1 and the parent device 2 . The communication unit 32 is connected to the handset 1 via the first trunk line 61 . Also, the communication unit 32 is connected to the main unit 2 via the second main line 62 , the branch line 63 and the branch device 5 . The communication unit 32 is configured to be able to communicate bidirectionally with the child device side communication unit 12 of the child device 1 . Further, the communication unit 32 is configured to be able to communicate bi-directionally with the base unit side communication unit 21 of the base unit 2 . That is, the communication section 32 is configured to relay communication between the parent device side communication section 21 and the child device side communication section 12 . Therefore, the communication section 32 relays the communication signal transmitted from the handset-side communication section 12 of the handset 1 and transmits the signal to the multiple bases 2 . Here, the communication signal transmitted from the handset 1 includes information (for example, an address) for specifying the base 2 as a transmission destination. Therefore, of the plurality of base units 2, only the base unit 2 whose self-assigned address matches the address included in the communication signal can receive the communication signal. Further, the communication unit 32 relays a communication signal transmitted from each of the plurality of master devices 2 and transmits the signal to the slave device 1 .

The signal processing unit 31 is configured by, for example, a microcomputer having a CPU and a memory as main components. The microcomputer functions as the signal processing unit 31 by executing the program stored in the memory by the CPU. The program executed by the CPU is pre-recorded in the memory of the microcomputer here, but may be recorded in a recording medium such as a memory card and provided, or may be provided through an electric communication line such as the Internet. .

The signal processing section 31 is configured to control the communication section 32 . Specifically, the signal processing unit 31 controls the communication unit 32 to cause the plurality of master devices 2 to transmit the communication signal transmitted from the slave device 1, and from each of the plurality of master devices 2 The communication signal to be transmitted is caused to be transmitted to the handset 1 .

(3) Operation of Intercom System (3.1) First Operation Example Next, a first operation example of the intercom system 10 according to the present embodiment will be described with reference to FIG. Here, an example will be described in which a visitor performs a calling operation on the handset 1 and a resident responds to the call. In addition, "imaging" in FIG. 3 represents a situation in which the imaging unit 11 is imaging an image (moving image). “Transmission” in FIG. 3 represents a state in which an image captured by the imaging unit 11 is transmitted from the slave device 1 to the master device 2 . "Receive" in FIG. 3 indicates a situation in which an image transmitted from the handset 1 is received. “Display” in FIG. 3 represents a situation in which an image received by master device 2 is displayed on display unit 22 . Note that in FIG. 3, execution intervals during which imaging, transmission, reception, and display are performed are indicated by solid lines, and stop intervals during which imaging, transmission, reception, and display are not performed are indicated by dashed lines. Also, in FIG. 3, hatched sections in execution sections of imaging and display represent sections in which the first image P11, the second image P12, and the real-time image P20 are respectively captured or displayed. The same applies to FIGS. 4 and 5 below.

A visitor approaches the handset 1 and enters the detection range of the sensor 17 at time t1 in order to perform a call operation to call the base unit 2 of the dwelling to be visited. When the sensor 17 detects a person (visitor), the handset-side control section 13 causes the imaging section 11 to start capturing an image (moving image). Also, at this time, the child device-side control unit 13 causes the storage unit 16 to store (record) the moving image captured by the imaging unit 11 .

At time t<b>3 , the visitor starts a calling operation on the handset-side operation unit 14 of handset 1 . That is, at time t3, the visitor inputs the first letter (initial) of the dwelling unit number to be visited. At time t5, the call operation ends. The termination of the call operation is the operation of pressing the call button after inputting the dwelling unit number. When the calling operation is completed, the handset 1 and the base unit 2 corresponding to the input dwelling unit number are ready for communication via the control device 3 . Strictly speaking, there is a time lag from the end of the calling operation to the establishment of communication between the handset 1 and the base 2, but this time lag will be ignored here.

Here, at time t3, a predetermined condition is established when the handset-side operation unit 14 accepts the first call operation. When a predetermined condition is satisfied, the child device-side control section 13 causes the image processing section 15 to generate a playback image P10.

The image processing unit 15 generates a playback image P10 using the first image P11 captured by the imaging unit 11 before the predetermined condition is satisfied and the second image P12 captured by the imaging unit 11 after the predetermined condition is satisfied. do. The first image P11 is a moving image captured by the imaging unit 11 before the time t3 when the visitor started calling operation on the handset side operation unit 14 . The second image P<b>12 is a moving image captured by the imaging unit 11 after time t<b>3 when the visitor started the calling operation on the handset-side operation unit 14 .

In this embodiment, the first image P11 is a moving image from time t2, which is a first period T1 (for example, three seconds) before time t3 when the predetermined condition is satisfied, to time t3 when the predetermined condition is satisfied. Here, it is assumed that time t2 is later than time t1 when the sensor 17 detects a person (visitor). Therefore, the first image P11 is an image captured before the predetermined condition is satisfied and after the presence of a person in the space in which the handset 1 is provided is detected. The first image P11 is an image captured a predetermined time (first period T1) before the predetermined condition is established. Note that the first period T1 is not limited to 3 seconds, and may be a time length different from 3 seconds.

In this embodiment, the second image P12 is a moving image from time t3 when the predetermined condition is satisfied to time t4 after a second period T2 (for example, two seconds). Here, it is assumed that time t4 is before time t5 at which the visitor ends the calling operation. In addition, the second period T2 is not limited to two seconds, and may be a time length different from two seconds.

In other words, the first image P11 and the second image P12 are continuous moving images in time series. In other words, the playback image P10 is a moving image from time t2, which is a first period T1 before time t3 when the predetermined condition is satisfied, to time t4, which is a second period T2 after time t3 when the predetermined condition is satisfied.

The image processing unit 15 extracts a moving image from time t2 to time t4 from the moving images stored in the storage unit 16 and generates a playback image P10.

Further, as shown in FIG. 3, in the present embodiment, the image processing unit 15 replaces the chronological order of the first image P11 and the second image P12 to generate the playback image P10. That is, the playback image P10 is arranged in the order of the second image P12 and the first image P11 from the top.

Child device-side control unit 13 causes playback image P10 generated by image processing unit 15 to be transmitted to parent device 2 (time t5). Further, when child device 1 and parent device 2 are ready for communication, child device-side control unit 13 causes real-time image P20, which is a real-time moving image captured by imaging unit 11, to be transmitted to parent device 2. .

In base unit 2, communication with cordless handset 1 becomes possible, and when a call signal from cordless handset 1 is received, base unit side control unit 23 notifies unit 27 that there is a call from cordless handset 1. (time t5). Further, the parent device-side control section 23 causes the storage section 26 to store (record) the playback image P10 transmitted from the child device 1 .

The master-side control section 23 causes the image processing section 25 to generate a composite image of the playback image P10 and the real-time image P20, and causes the display section 22 to display the composite image (see FIG. 2). The playback image P10 is arranged in the order of the second image P12 and the first image P11 from the top. Therefore, the first image P11 is displayed (reproduced) on the display unit 22 after the second image P12 is displayed (reproduced). Also, since the playback image P10 is a short-time moving image, it is repeatedly displayed. That is, the first image P11 and the second image P12 are alternately and repeatedly displayed (reproduced).

After time t5, the resident who sees the image displayed on the display unit 22 (composite image of the playback image P10 and the real-time image P20) performs a predetermined operation (for example, a pressing operation) on the master unit side operation unit 24. ), a state in which a voice call can be made between the slave device 1 and the master device 2 is established.

When the person (visitor) disappears from the detection range of the sensor 17 after communication between the child device 1 and the parent device 2 ends, the child device side control section 13 causes the imaging section 11 to stop imaging. Note that the slave device-side control section 13 may cause the imaging section 11 to stop imaging when the communication between the slave device 1 and the master device 2 is completed.

As described above, in the handset 1 (calling device 1) of the present embodiment, the imaging unit 11 starts imaging before the predetermined condition is established, that is, before the first call operation is accepted. Then, handset 1 sends images (first image P11, second image P12) captured by imaging unit 11 before and after the establishment of a predetermined condition, that is, before and after receiving the first operation of the calling operation, to master device 2 (information terminal 2). ). Therefore, the user (resident) of base unit 2 can easily confirm the appearance, behavior, etc. of the user (visitor) of handset 1 before performing the calling operation. In addition, since the second image P12 shows the visitor making a call to the handset 1, the visitor's face can be easily recognized.

Also, the playback image P10 is stored in the storage unit 26 of the base unit 2, so that the resident can check the visitor later. For example, in the master device 2, when a call is received from the slave device 1 while the resident is absent, the resident operates the master device side operation unit 24 to display the playback image P10 stored in the storage unit 26. It can be displayed (reproduced) on the display unit 22 . At this time, in order to select the playback image P10 to be reproduced, a thumbnail image of the playback image P10 is displayed on the display unit 22 for each call or for each visitor, and the user (resident) of the base unit 2 can operate the thumbnail image. A playback image P10 corresponding to the thumbnail image selected based on the display unit 22 is displayed (reproduced). The thumbnail image of the playback image P10 is a still image extracted from the playback image P10. In this embodiment, the thumbnail image of the playback image P10 is the still image of the first frame in the playback image P10. In the present embodiment, the playback images P10 are arranged in the order of the second image P12 after the start of the call operation and the first image P11 before the start of the call operation. Therefore, the thumbnail image of the playback image P10 becomes a still image when the visitor starts the calling operation. This increases the possibility that the thumbnail image shows the visitor's face, making it easier for the resident to confirm who the visitor is when he or she is away.

When displaying (reproducing) the playback image P10 corresponding to the selected thumbnail image on the display unit 22, the master-side control unit 23 reproduces the first image P11 and the second image P12 in this order. In other words, the second image P12 is reproduced after the reproduction of the first image P11 earlier in chronological order. As a result, the user (resident) of the base unit 2 can confirm the appearance of the visitor approaching the handset 1 and operating it in chronological order, making it easier to confirm the behavior of the visitor.

Note that the parent device-side control section 23 may be configured to be able to set a section to be reproduced in the playback image 10 corresponding to the selected thumbnail image. For example, the parent device-side control unit 23 may reproduce only the first image P11, may reproduce only the second image P12, or may reproduce the first image P11 and the second image P12 according to the setting. may be reproduced in whole or in part. These settings may be made in the main unit 2, or may be made in an external device such as the sub unit 1 or the control room master unit.

(3.2) Second Operation Example Next, a second operation example of the intercom system 10 according to the present embodiment will be described with reference to FIG.

A visitor approaches the handset 1 in order to perform a calling operation to call the base unit 2 of the dwelling to be visited, and the visitor enters the detection range of the sensor 17 at time t11. When the sensor 17 detects a person (visitor), the handset-side control section 13 causes the imaging section 11 to start capturing an image (moving image).

In this operation example, the call operation is started (predetermined condition is satisfied) at time t12 after the sensor 17 detects a person (time t11) until the first period T1 elapses. In this case, the image processing unit 15 sets the moving image from the time t11 when the imaging unit 11 starts capturing the moving image to the time t12 when the calling operation starts as the first image P11. Therefore, in this operation example, the time length of the first image P11 is shorter than the first period T1.

In this operation example, the call operation ends at time t13 before time t14 when the second period T2 has elapsed after the visitor started the call operation (time t12). In this case, handset-side control section 13 suspends communication with base unit 2 until time t14 after the calling operation is completed. That is, the handset-side control unit 13 does not communicate with the base unit 2 until the second time period T2 elapses after the predetermined condition is satisfied (time t12). The image processing unit 15 sets the moving image from time t12 at which the calling operation is started to time t14 at which the second period T2 has elapsed as the second image P12. Therefore, in this operation example, the time length of the second image P12 is the same time length as the second period T2, as in the first operation example.

The handset-side controller 13 starts communication with the base unit 2 at time t14 to transmit a call signal, a playback image P10, a real-time image P20, and the like. In the parent device 2, the synthesized image of the playback image P10 and the real-time image P20 transmitted from the child device 1 is displayed on the display section 22 (see FIG. 2).

Thus, in this operation example, the first image P11 is generated even if the period from when the sensor 17 detects a person to when the calling operation is started is shorter than the first period T1. . Therefore, the user (resident) of base unit 2 can confirm the appearance, behavior, etc. of the user (visitor) of handset 1 before performing the calling operation.

Further, in this operation example, even if the period from the start to the end of the calling operation (from time t12 to time t13) is shorter than the second period T2, the main unit 2 and communication is put on hold. As a result, the time length of the second image P12 is ensured, and the resident can easily check the appearance, behavior, etc. of the visitor after the start of the calling operation.

In this operation example, communication with base unit 2 is suspended until time t14 when second period T2 elapses, but the present invention is not limited to this. Handset-side control section 13 may start communication with base unit 2 at time t13 when the call operation ends. In this case, the image processing unit 15 sets the moving image from the time t12 when the call operation is started to the time t13 when the call operation is finished as the second image P12. As a result, it is possible to shorten the time until the communication between handset 1 and base unit 2 is started after the calling operation is finished. In addition, changing the camera settings (for example, zoom, backlight correction, etc.) during the second image P12 by operating the master device 2 is suppressed.

(3.3) Third Operation Example Next, a third operation example of the intercom system 10 according to the present embodiment will be described with reference to FIG.

A plurality of visitors may use the handset 1 in succession. Here, the case where the second visitor uses the handset 1 after the first visitor uses the handset 1 will be described.

At time t21, the call between the first visitor and the resident of the place visited by the first visitor ends, and the communication between handset 1 and master device 2 (first master device 2) ends. At this time, it is assumed that the second visitor is waiting by handset 1 and is within the detection range of sensor 17 . Therefore, even after communication between child device 1 and first parent device 2 ends, imaging unit 11 continues to capture moving images.

After the first visitor leaves from in front of handset 1, the second visitor moves in front of handset 1 and starts calling operation to call base unit 2 (second base unit 2) (time t23). ).

In this operation example, from time t22 when the communication between handset 1 and first base unit 2 is completed and the first visitor leaves handset 1, the second visitor starts calling operation (predetermined condition is established) is shorter than the first period T1. In this case, the image processing unit 15 sets the moving image from when the first visitor leaves the handset 1 to when the second visitor starts calling operation as the first image P11. Specifically, the image processing unit 15 has a human detection function that detects a person included in the image captured by the imaging unit 11 . The image processing unit 15 determines that the person has left the handset 1 when the person leaves the imaging range of the imaging unit 11 .

In this operation example, the image processing unit 15 determines that the person (first visitor) has left the imaging range of the imaging unit 11 at time t22. The image processing unit 15 sets the moving image from the time t22 when the person leaves the imaging range of the imaging unit 11 to the time t23 when the second visitor starts calling operation as the first image P11. Therefore, in this operation example, the time length of the first image P11 is shorter than the first period T1.

That is, in this operation example, the first image P11 is an image captured before the predetermined condition is satisfied and after the previous communication between the child device side communication unit 12 and the first parent device 2 is completed. . Specifically, the first image P<b>11 is before the predetermined condition is satisfied, and when the previous communication between the handset-side communication unit 12 and the first base unit 2 has ended and the person is outside the imaging range of the imaging unit 11 . It is an image captured after the (first visitor) has moved.

Also, at time t24, the calling operation by the second visitor ends. At time t25, child device 1 and second parent device 2 become communicable, and child device 1 transmits a call signal, playback image P10, real-time image P20, and the like. In the parent device 2, the synthesized image of the playback image P10 and the real-time image P20 transmitted from the child device 1 is displayed on the display section 22 (see FIG. 2).

Thus, in this operation example, the first image P11 is a moving image from when the first visitor moves out of the imaging range of the imaging unit 11 until when the second visitor starts the calling operation. Therefore, the first visitor is prevented from appearing in the first image P11.

Termination of communication between the handset 1 and the base unit 2 is not limited to the case where the resident operates the base unit-side operation unit 24 of the base unit 2 to end the call (communication). cancels the call of base unit 2. For example, when the resident of the visiting destination is not at home, the visitor performs an operation on the handset side operation unit 14 to stop calling the master device 2, and communication between the handset 1 and the master device 2 is performed. ends.

In this operation example, the first image P11 is the moving image from when the person moves out of the imaging range of the imaging unit 11 to when the call operation is started, but the first image P11 is not limited to this. The first image P11 may be a moving image from a predetermined time after the end of the previous communication (time t21) to the start of the calling operation (time t23). In other words, the first image P11 is an image captured before the predetermined condition is satisfied and after a predetermined period of time or more has elapsed since the previous communication between the handset-side communication unit 12 and the first base unit 2 was completed. be.

In this case, the image processing unit 15 does not have to have a human detection function, and the configuration can be simplified.

(4) Modifications The above-described embodiment is merely one of various embodiments of the present disclosure, and various modifications are possible according to design and the like as long as the object of the present disclosure can be achieved. Modifications of the intercom system 10 according to the embodiment are listed below. Modifications described below can be applied in combination as appropriate.

A function similar to that of the parent device 2 (information terminal 2) according to the embodiment is embodied by a control method of the parent device 2 (information terminal 2), a (computer) program, or a non-temporary recording medium recording the program. may

The control method of the master device 2 is a control method of the master device 2 (information terminal 2) capable of communicating with the slave device 1 (calling device 1), and includes a communication step and a display step. In the communication step, communication with the handset 1 is performed. In the display step, the image captured by the imaging unit 11 of the handset 1 is displayed. Also, in the display step, the first image P11 is displayed after the second image P12 is displayed.

Further, the program causes the computer system to execute the control method of master device 2 .

In the intercom system 10, a computer system is included in the handset side control section 13, the image processing section 15, the master side control section 23, the image processing section 25, and the like. A computer system is mainly composed of a processor and a memory as hardware. The processor executes programs recorded in the memory of the computer system, thereby realizing the functions of the child device side control section 13, the image processing section 15, the parent device side control section 23, the image processing section 25, and the like. The program may be recorded in advance in the memory of the computer system, may be provided through an electric communication line, or may be recorded in a non-temporary recording medium such as a computer system-readable memory card, optical disk, or hard disk drive. may be provided. A processor in a computer system consists of one or more electronic circuits, including semiconductor integrated circuits (ICs) or large scale integrated circuits (LSIs). A plurality of electronic circuits may be integrated into one chip, or may be distributed over a plurality of chips. A plurality of chips may be integrated in one device, or may be distributed in a plurality of devices. Some functions of the intercom system 10 may be realized by the cloud (cloud computing).

In the example described above, the image processing unit 15 of the child device 1 generates the playback image P10 using the first image P11 and the second image P12, but the image processing unit 25 of the parent device 2 A playback image P10 may be generated.

Further, in the playback image P10, the order from the top is not limited to the order of the second image P12 and the first image P11, and the order from the top may be the first image P11 and the second image P12. In this case, the first image P11 and the second image P12 are displayed (reproduced) on the display unit 22 of the master device 2 in this order.

Also, in the example described above, both the first image P11 and the second image P12 are moving images, but the first image P11 and the second image P12 may be still images. In this case, the imaging unit 11 may capture a plurality of still images as the first image P11. Further, the imaging unit 11 may capture a plurality of still images as the second image P12.

Also, in the above example, the predetermined condition includes the condition that the handset-side operation unit 14 accepts (the first operation of) the call operation, but the condition is not limited to this. For example, the predetermined conditions include the condition that the proximity sensor provided in the child device 1 detects a person (visitor) standing in front of the child device 1, the image processing unit 15 of the child device 1 is A condition such as recognizing the face of a person (visitor) included in the captured image may be included.

Further, in the above example, a case where the handset 1 (calling device 1) is a lobby intercom provided in a common area of a collective housing has been described as an example, but the handset 1 is a door phone installed at the outer entrance of a dwelling unit. (Entrance handset) may be used. Further, although the case where the facility to which the intercom system 10 is applied is an apartment complex has been described as an example, the facility to which the intercom system 10 is applied may be a detached house, an office building, a commercial facility, or a hotel. , hospitals, factories, schools, nursing homes, and the like.

(summary)
A calling device (1) according to a first aspect is a device for calling an information terminal (2), and includes an imaging section (11) and a communication section (child side communication section 12). An imaging unit (11) captures an image. The communication unit (12) provides a first image (P11) captured by the imaging unit (11) before the predetermined condition is satisfied, a second image (P12) captured by the imaging unit (11) after the predetermined condition is satisfied, is sent to the information terminal (2).

According to this aspect, the first image (P11) and the second image (P12) captured by the imaging unit (11) before and after the predetermined condition is satisfied are transmitted to the information terminal (2). ), it becomes easy to confirm the appearance of the user of the calling device (1).

The calling device (1) according to the second mode further comprises an operation unit (14) for receiving a calling operation for calling the information terminal (2) in the first mode. The predetermined condition includes a condition that the operation unit (handset-side operation unit 14) accepts the calling operation.

According to this aspect, the user of the calling device (1) can confirm the calling operation on the information terminal (2).

In the calling device (1) according to the third aspect, in the second aspect, the predetermined condition includes the condition that the operation unit (14) accepts the first call operation.

According to this aspect, the user of the calling device (1) can confirm the calling operation on the information terminal (2).

In the calling device (1) according to the fourth aspect, in any one of the first to third aspects, at least one of the first image (P11) and the second image (P12) is a moving image.

According to this aspect, it becomes easier to check the behavior of the user of the calling device (1).

In the calling device (1) according to the fifth aspect, in any one of the first to fourth aspects, the first image (P11) and the second image (P12) are moving images that are continuous in time series.

According to this aspect, it becomes easier to check the behavior of the user of the calling device (1).

In the calling device (1) according to the sixth aspect, in any one of the first to fifth aspects, the first image (P11) is before the predetermined condition is established, and the calling device (1) is provided 4 is an image captured after detection of the presence of a person in space.

According to this aspect, the first image (P11) is captured after detecting the presence of a person in the space in which the calling device (1) is installed, so there is a high possibility that the person will be captured.

In the calling device (1) according to the seventh aspect, in any one of the first to sixth aspects, the first image (P11) is an image captured a predetermined time (first period T1) before the predetermined condition is established. is.

According to this aspect, since the first image (P11) is captured a predetermined time (first period T1) before the predetermined condition is established, it becomes easier to confirm the appearance of the user of the calling device (1).

In the calling device (1) according to the eighth aspect, in any one of the first to seventh aspects, the first image (P11) is before the predetermined condition is established, and the communication unit (12) and the information terminal ( 2) is an image captured after the previous communication with .

According to this aspect, the person using the calling device (1) at the time of the previous communication is prevented from appearing in the first image (P11).

In the calling device (1) according to the ninth aspect, in any one of the first to eighth aspects, the first image (P11) is before the predetermined condition is established, and the communication unit (12) and the information terminal ( 2) is an image captured after a predetermined period of time or more has elapsed from the end of the previous communication with 2).

According to this aspect, the person using the calling device (1) at the time of the previous communication is prevented from appearing in the first image (P11).

In the calling device (1) according to the tenth aspect, in any one of the first to ninth aspects, the first image (P11) is before the predetermined condition is established, and the communication unit (12) and the information terminal ( 2) is an image captured after the person moved out of the imaging range of the imaging unit (11) after the previous communication with the imaging unit (11) was completed.

According to this aspect, the person using the calling device (1) at the time of the previous communication is prevented from appearing in the first image (P11).

In the calling device (1) according to the eleventh aspect, in any one of the first to tenth aspects, the communication unit (12) displays the first image after a predetermined time (second period T2) after the predetermined condition is established. (P11) and the second image (P12) are transmitted to the information terminal (2).

According to this aspect, the time for capturing the second image (P12) is ensured, making it easier to confirm the appearance of the user of the calling device (1).

An information terminal (2) according to the twelfth aspect includes a terminal side communication section (base side communication section 21) and a display section (22). A terminal-side communication unit (21) can communicate with the calling device (1) of any one of the first to eleventh modes. A display unit (22) displays an image captured by the imaging unit (11) of the calling device (1). Also, the display unit (22) displays the first image (P11) after displaying the second image (P12).

According to this aspect, it becomes easier to confirm the appearance of the user of the calling device (1) on the information terminal (2).

A control method for an information terminal (2) according to a thirteenth aspect is a control method for a control terminal capable of communicating with the calling device (1) according to any one of the first to eleventh aspects. The information terminal (2) control method includes a communication step and a display step. The communication step communicates with the calling device (1). In the display step, the image picked up by the imaging unit (11) of the calling device (1) is displayed. Also, in the display step, the first image (P11) is displayed after the second image (P12) is displayed.

According to this aspect, it becomes easier to confirm the appearance of the user of the calling device (1) on the information terminal (2).

A program according to a fourteenth aspect causes a computer system to execute a control method for an information terminal (2) according to the thirteenth aspect.

According to this aspect, it becomes easier to confirm the appearance of the user of the calling device (1) on the information terminal (2).

1 calling device 2 information terminal 11 imaging unit 12 handset side communication unit (communication unit)
P11 1st image P12 2nd image 14 Handset side operation unit (operation unit)
21 parent device side communication unit (terminal side communication unit)
22 Display

Claims (15)

A calling device for calling an information terminal,
an imaging unit that captures an image;
and a communication unit capable of communicating with the information terminal,
The communication unit captures a playback image using a first image captured by the imaging unit before a predetermined condition is satisfied and a second image captured by the imaging unit after the predetermined condition is satisfied, and a playback image captured by the imaging unit. and a real-time image, which is a real-time moving image, to the information terminal;
calling device. Further comprising an operation unit that receives a call operation for calling the information terminal,
The predetermined condition includes a condition that the operation unit accepts the call operation,
2. A paging device as claimed in claim 1. 3. The calling device according to claim 2, wherein said predetermined condition includes a condition that said operation unit accepts the first operation of said calling operation. at least one of the first image and the second image is a moving image;
A calling device according to any one of claims 1 to 3. wherein the first image and the second image are continuous moving images in time series;
A paging device according to any one of claims 1 to 4. The first image is an image captured before the predetermined condition is established and after detection of the presence of a person in the space in which the calling device is provided.
A paging device according to any one of claims 1-5. The first image is an image captured a predetermined time before the predetermined condition is established.
A paging device according to any one of claims 1-6. The first image is an image captured before the predetermined condition is established and after the previous communication between the communication unit and the information terminal is completed.
A paging device according to any one of claims 1-7. The first image is an image captured before the predetermined condition is satisfied and after a predetermined time or more has elapsed since the end of the previous communication between the communication unit and the information terminal.
A paging device according to any one of claims 1-8. The first image is an image captured before the predetermined condition is satisfied and after the person has moved out of the imaging range of the imaging unit after the previous communication between the communication unit and the information terminal has ended. is
A paging device according to any one of claims 1-9. The communication unit transmits the first image and the second image to the information terminal a predetermined time after the predetermined condition is established.
A paging device according to any one of claims 1-10. A calling device for calling an information terminal,
an imaging unit that captures an image;
and a communication unit capable of communicating with the information terminal,
the communication unit transmits to the information terminal a first image captured by the imaging unit before a predetermined condition is satisfied and a second image captured by the imaging unit after the predetermined condition is satisfied;
The first image is an image captured before the predetermined condition is satisfied and after the person has moved out of the imaging range of the imaging unit after the previous communication between the communication unit and the information terminal has ended. is
calling device. a terminal-side communication unit capable of communicating with the calling device according to any one of claims 1 to 12;
a display unit for displaying an image captured by the imaging unit of the calling device,
The display unit displays the first image after displaying the second image.
Information terminal. A control method for an information terminal capable of communicating with the calling device according to any one of claims 1 to 12,
a communication step of communicating with the paging device;
a display step of displaying an image captured by the imaging unit of the calling device;
In the displaying step, the first image is displayed after displaying the second image.
Information terminal control method. A program for causing a computer system to execute the information terminal control method according to claim 14.

Images