TWI794478B - Calling device, telecommunication device, control method of telecommunication device, and program - Google Patents

Abstract

The purpose of this disclosure is to provide a calling device, an information terminal, a control method and a program for an information terminal that can easily confirm the image of the user of the calling device. A calling device (1) is a device for calling an information terminal (2), and includes a camera unit (11) and a handset-side communication unit (12). The imaging unit (11) captures images. The communication unit (12) sends the first image taken by the imaging unit (11) before the establishment of the specific condition and the second image taken by the imaging unit (11) after the establishment of the specific condition to the information terminal (2) .

Description

Calling device, information terminal, control method and program for information terminal

This disclosure generally relates to a calling device, an information terminal, a control method and program for an information terminal, and more specifically relates to a calling device equipped with a camera, an information terminal capable of communicating with the calling device, and a control method for an information terminal and programs.

Conventionally, for example, as shown in Japanese Patent Application Laid-Open No. 2016-158038 (hereinafter referred to as "Document 1"), there has been a camera-attached intercom terminal (calling device) equipped with a camera (imaging unit).

The walkie-talkie terminal with a camera described in Document 1 includes a communication device, and a camera having an imaging element and a lens. In the walkie-talkie terminal with a camera, visitors can be photographed by the camera. The data captured by the camera is sent to the walkie-talkie terminal (information terminal) attached to the monitor. In the walkie-talkie terminal with a monitor, the data sent from the walkie-talkie terminal with a camera is displayed on the monitor.

In the paging device, it is desired to easily confirm the image of the user of the paging device.

This disclosure was made in view of the above-mentioned reasons, and an object thereof is to provide a call device, an information terminal, a control method and a program for an information terminal that can easily confirm the image of the user of the call device.

A calling device of an aspect of the present disclosure calls an information terminal. The calling device described above includes an imaging unit and a communication unit. The imaging unit captures an image. The communication unit can communicate with the information terminal. The communication unit transmits the first image captured by the imaging unit before the establishment of the specific condition and the second image captured by the imaging unit after the establishment of the specific condition to the information terminal.

An information terminal according to an aspect of the present disclosure includes a terminal-side communication unit and a display unit. The terminal-side communication unit can communicate with the calling device. The display unit displays an image captured by the imaging unit of the calling device. The display unit displays the first image after displaying the second image.

An information terminal control method according to an aspect of the present disclosure is a control method for an information terminal capable of communicating with the above-mentioned calling device, and includes a communication step and a display step. In the communication step, communication is performed with the calling device. In the display step, an image captured by the imaging unit of the calling device is displayed. In the display step, the first image is displayed after the second image is displayed.

The program of an aspect of the present disclosure enables a computer system to execute the above-mentioned information terminal control method.

(1) Overview of the walkie-talkie system The walkie-talkie system 10 of the present embodiment, as shown in FIG. 1 , includes a calling device 1 (hereinafter, also referred to as a sub-unit 1 ), and a plurality of (two in FIG. 1 ) information terminals 2 (hereinafter, also referred to as a main unit 2 ). ). The intercom system 10 further includes a control device 3 , a plurality of (two in FIG. 1 ) doorbells 4 , and a plurality of (two in FIG. 1 ) splitters 5 . The intercom system 10 is, for example, an intercom system for condominiums such as condominiums. In this intercom system 10 , slave units 1 communicate with each master unit 2 via a control device 3 .

Each of the plurality of master machines 2 is, for example, a resident terminal installed in each resident of a condominium. Each master unit 2 is configured to communicate with the slave unit 1 (for example, talk, receive image signals, etc.). Each master unit 2 has a display unit 22 for displaying an image (moving image) captured by the imaging unit 11 of the slave unit 1 .

The handset 1 is, for example, a shared terminal (lobby intercom) installed in a shared part of a condominium such as a lobby. The slave unit 1 is configured to communicate with each master unit 2 (for example, a call, transmission of an image signal, calling of the master unit 2, etc.).

The control device 3 is configured to perform call control and relay signals between the slave units 1 and each master unit 2 . The control device 3 is installed in, for example, a management room of a condominium. For example, the control device 3 relays the signal sent and received between the slave phone 1 and the master phone 2 when a visitor uses the slave phone 1 to call the master phone 2 .

Each of the plurality of doorbells 4 is set, for example, at the entrance outside each household of a collective housing. A plurality of doorbells 4 are in one-to-one correspondence with a plurality of master machines 2 . Each doorbell 4 is configured to communicate with the corresponding base unit 2 (for example, talking, sending image signals, etc.).

Each of the plurality of splitters 5 is inserted into the second trunk line 62 , and a plurality of master machines 2 can be connected to the second trunk line 62 . In this embodiment, a plurality of branch lines 63 are branched from the second main line 62 , and a plurality of splitters 5 are respectively installed at the branch points of the plurality of branch lines 63 of the second main line 62 . Thereby, each master machine 2 can be connected to the second trunk line 62 via the splitter 5 .

The slave machine 1 is connected to the control device 3 via the first trunk line 61 . Each main machine 2 is connected to the control device 3 via the second trunk line 62 , the branch line 63 and the branch unit 5 . Each doorbell 4 is connected to the corresponding master machine 2 via the connecting wire 64 . Each of the first main line 61 , the second main line 62 , the branch line 63 and the connecting line 64 includes, for example, a twisted pair cable.

The slave unit 1 includes an imaging unit 11 for capturing images, and a slave side communication unit 12 capable of communicating with the master unit 2 . The slave-side communication unit 12 combines the first image P11 (refer to FIG. 3 ) captured by the imaging unit 11 before the establishment of the specific condition, and the second image P12 (refer to FIG. 3 ) captured by the imaging unit 11 after the establishment of the specific condition. ) to the master machine 2.

Furthermore, the main unit 2 includes a main unit side communication unit 21 capable of communicating with the sub unit 1 , and a display unit 22 for displaying an image captured by the imaging unit 11 of the sub unit 1 . The display part 22 displays the 1st image P11 (refer FIG. 3) after displaying the 2nd image P12.

In the slave machine 1 of this embodiment, the imaging unit 11 captures an image before a specific condition is met, and transmits the captured first image P11 to the master machine 2 . Thereby, in the main machine 2, the image of the user of the slave machine 1 can be easily confirmed.

(2) Composition of the walkie-talkie system (2.1) Composition of handsets First, the configuration of the slave 1 (calling device 1) will be described. As shown in FIG. 1 , the slave 1 has an imaging unit 11, a slave side communication unit 12 (communication unit), a slave side control unit 13, a slave side operation unit 14 (operation unit), an image processing unit 15, a memory Part 16, and sensor 17. Furthermore, the slave unit 1 has a communication unit (including a speaker and a microphone) for communicating with the base unit 2 .

The imaging unit 11 is a camera that has an imaging element and is used to photograph a subject (visitor, etc.). In this embodiment, in order to capture at least the visitor's face when the visitor operates the handset 1, the imaging area (field of view) of the imaging unit 11 is set in front of the handset 1. In this embodiment, the imaging unit 11 is a camera that captures moving images. Furthermore, in the present embodiment, the imaging unit 11 is a camera that captures a color image.

The imaging element is, for example, a two-dimensional image sensor such as a CCD (Charge Coupled Devices: Charge Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor: Complementary Metal-Oxide Semiconductor) image sensor. The imaging unit 11 forms an image of the light from the subject on the imaging surface (light-receiving surface) of the imaging element through an optical system such as a lens, and converts the light from the subject into an electrical signal by the imaging element. Then, the imaging unit 11 outputs the output signal of the imaging element to the image processing unit 15 as an image signal.

The slave side communication unit 12 is a communication interface for communicating with the master machine 2 . The slave side communication unit 12 is connected to the control device 3 via the first trunk line 61 . In FIG. 1 , the first main line 61 is represented by one line. The slave-side communication unit 12 is configured to perform two-way communication with the master unit 2 via a communication unit 32 (described later) of the control device 3 . The slave side communication unit 12 is configured to transmit a communication signal to the master machine 2 . Communication signals include audio signals, image signals, and control signals. Also, the slave side communication unit 12 receives a communication signal transmitted from the main unit 2 via the communication unit 32, and obtains a voice signal and the like by demodulating the received communication signal. The audio signal is output to the communication unit via the slave side control unit 13 .

Handset-side operating unit 14 is configured to be operated by a recipient (for example, a visitor, etc.). The slave-side operation unit 14 has, for example, input interfaces such as a plurality of push button switches and a touch panel. The visitor calls the base phone 2 installed in the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the resident of the visitor a call operation, for example, and the caller is called.

The image processing unit 15 is configured to receive the image signal output from the imaging unit 11, and process an image (moving image) included in the image signal through signal processing. The image processing unit 15 is realized, for example, by a device such as a DSP (Digital Signal Processor) or an FPGA (Field-Programmable Gate Array: Field-Programmable Gate Array).

The slave side control unit 13 is constituted by, for example, a microcomputer including a CPU (Central Processing Uni: Central Processing Unit) and a memory as main components. And, the microcomputer functions as the slave-side control unit 13 by the CPU executing the programs stored in the memory. The program executed by the CPU is pre-recorded in the memory of the microcomputer here, but it may be provided by being recorded on a recording medium such as a memory card, or provided through an electrical communication line such as the Internet.

The slave side control unit 13 is configured to control the imaging unit 11 and the slave side communication unit 12 . Furthermore, the slave side control unit 13 is configured to control the image processing unit 15 .

The slave side control unit 13 causes the imaging unit 11 to capture an image (moving image) by controlling the imaging unit 11 . In this embodiment, the slave side control unit 13 causes the image processing unit 15 to generate the playback image P10 (see FIGS. 2 and 3 ) when a specific condition is met. The playback image P10 refers to the data of the moving image captured by the recording and imaging unit 11 before the communication with the base unit 2 is started. In this embodiment, the specific condition includes a condition that the operation unit 14 on the slave side accepts a call operation. More specifically, the specific condition includes the condition of the first operation of the operation unit 14 on the slave side to accept the calling operation. The call operation refers to the operation for calling the base machine 2 . In this embodiment, the calling operation refers to the operation of inputting the house number of the access target to the operation unit 14 on the side of the handset. The first operation of calling operation (hereinafter also referred to as the start of calling operation) refers to the operation of inputting the first character (initial character) of the household number. For example, when the resident number of the access target is "123", the input of "1" is the first operation of the calling operation.

The image processing unit 15 uses the first image P11 captured by the imaging unit 11 before the establishment of the specific condition, and the second image P12 captured by the imaging unit 11 after the establishment of the specific condition to generate a playback image P10 (refer to FIG. 3 ). The terms "before the establishment of the specific condition" and "after the establishment of the specific condition" mentioned here include the point in time when the specific condition is established.

At least one of the first image P11 and the second image P12 is a moving image. In this embodiment, both the first image P11 and the second image P12 are moving images. More specifically, the first image P11 and the second image P12 are continuous moving images in time series. That is, the first image P11 is a moving image captured by the imaging unit 11 before the visitor starts the calling operation on the handset-side operation unit 14 . The second image P12 is a moving image captured by the imaging unit 11 after the visitor starts the calling operation on the handset-side operation unit 14 . The playback image P10 (first image P11 and second image P12 ) generated by the slave side control unit 13 is sent to the master machine 2 via the slave side communication unit 12 .

Also, when the slave unit 1 and the master unit 2 are in a state where they can communicate, the slave side control unit 13 transmits the real-time moving image captured by the imaging unit 11 , that is, the real-time image P20 to the master unit 2 .

The slave side control unit 13 controls the slave side communication unit 12 to make the slave side communication unit 12 transmit a communication signal to the master machine 2 and make the slave side communication unit 12 receive a communication signal from the master machine 2 . The communication signals leading to the master machine 2 include audio signals, image signals, and control signals. In addition, the communication signal from the master machine 2 includes voice signals, control signals, and the like.

The slave side control unit 13 controls the image processing unit 15 to cause the image processing unit 15 to process an image (moving image) included in the image signal from the imaging unit 11 . The image processed by the image processing unit 15 is sent from the slave side communication unit 12 to the master unit 2 .

The memory unit 16 is composed of a readable and writable memory. The memory unit 16 is, for example, a flash memory. The memory unit 16 stores images (moving images) captured by the imaging unit 11 . In addition, if the amount of data stored in the memory unit 16 exceeds a certain amount, the data whose creation date is older will be deleted.

In the present embodiment, the storage unit 16 is provided outside the slave side control unit 13 , but may be provided inside the slave side control unit 13 . That is, the storage unit 16 may also be a built-in memory of the slave-side control unit 13 .

The sensor 17 is, for example, a pyroelectric infrared sensor, and detects a person by detecting the amount of change of infrared rays generated when the person moves. The sensor 17 is configured to detect the presence of a person in the space where the handset 1 is installed. Specifically, the detection range of the sensor 17 is set in front of the handset 1 so that a person (eg, a visitor) who operates the handset side operation portion 14 of the handset 1 can be detected. In addition, the sensor 17 may not be included in the constituent elements of the slave 1 , or may be installed separately from the slave 1 and output a detection signal to the slave 1 .

Also, the sensor 17 is not limited to an infrared sensor, and may be, for example, an ultrasonic sensor utilizing ultrasonic waves, or a visible light sensor utilizing visible light, or a combination thereof. Also, instead of the human body sensor, a camera or the like may be used.

(2.2) Composition of the main unit Next, the configuration of the main machine 2 (information terminal 2) will be described. As shown in FIG. 1, the main machine 2 has a main machine side communication unit 21 (terminal side communication unit), a display unit 22, a main machine side control unit 23, a main machine side operation unit 24, an image processing unit 25, a memory unit 26, and a notification unit. 27. Furthermore, the base unit 2 has a communication unit (including a speaker and a microphone) for communicating with the slave unit 1 and the doorbell 4 .

The communication unit 21 on the main machine side is a communication interface for communicating with the slave machine 1 and the doorbell 4 . The master-side communication unit 21 is connected to the control device 3 via the second main line 62 , the branch line 63 , and the splitter 5 . In FIG. 1 , the second main line 62 and the branch line 63 are represented by one line. The master machine side communication unit 21 is configured to be able to perform two-way communication with the slave machine 1 via the communication unit 32 of the control device 3 . The main machine side communication unit 21 is configured to transmit a communication signal to the slave machine 1 . Communication signals include voice signals and control signals. Also, the master side communication unit 21 receives the communication signal transmitted from the slave unit 1 via the communication unit 32 , and obtains audio signals, image signals, etc. by demodulating the received communication signals. The audio signal is output to the communication unit via the master-side control unit 23 , and the image signal is output to the display unit 22 through the master-side control unit 23 .

The display unit 22 is configured to display images from the image processing unit 25 (for example, moving images captured by the imaging unit 11 of the slave 1). The display unit 22 is, for example, a liquid crystal display. Here, when the main machine 2 is equipped with a touch panel display, the touch panel display doubles as the display unit 22 and the main machine side operation unit 24 .

The operation unit 24 on the main machine side is configured to be operated by the recipient (here, the resident in the household). If a specific operation (for example, pressing operation) is performed on the main machine side operation part 24 in the state where the main machine side communication part 21 receives a call signal for calling an occupant, then it becomes possible to communicate between the child machine 1 and the main machine 2. The status of voice calls.

The image processing unit 25 is configured to receive the image signal from the slave unit 1 received by the master unit side communication unit 21, and process an image (moving image) included in the image signal by signal processing. The image processing unit 25 is configured, for example, to perform synthesis processing for synthesizing a plurality of images (moving images). In the present embodiment, the image processing unit 25 synthesizes the replay image P10, which is a past moving image, and the real-time image P20, which is an immediate image, to create one image (moving image) in the synthesis process. The image processing unit 25 is realized by devices such as DSP and FPGA, for example.

The main machine side control unit 23 is constituted by, for example, a microcomputer mainly composed of a CPU and a memory. And, the microcomputer functions as the main machine side control unit 23 by the CPU executing the programs stored in the memory. The program executed by the CPU is pre-recorded in the memory of the microcomputer here, but it can also be provided by being recorded on a recording medium such as a memory card, or provided through an electrical communication line such as the Internet.

The main machine side control unit 23 is configured to control the main machine side communication unit 21 and the display unit 22 . Furthermore, the master-side control unit 23 is configured to control the image processing unit 25 .

The main machine side control unit 23 controls the main machine side communication unit 21 to make the main machine side communication unit 21 transmit a communication signal to the child machine 1 and make the main machine side communication unit 21 receive a communication signal from the child machine 1 . The communication signals leading to the handset 1 include voice signals and control signals. Also, the communication signals from the slave 1 include audio signals, image signals, and control signals.

The main machine side control unit 23 controls the display unit 22 to cause the display unit 22 to display the image transmitted from the slave machine 1 . In the present embodiment, as shown in FIG. 2 , the display unit 22 displays one image obtained by synthesizing the replay image P10 before the communication with the slave unit 1 and the real-time image P20 after the communication with the slave unit 1 starts. . FIG. 2 shows an example of displaying a composite image of the playback image P10 and the real-time image P20 on the display screen 220 of the display unit 22 . In FIG. 2 , on the display screen 220 , the playback image P10 is displayed in a reduced size, and the live image P20 is displayed in an enlarged size. By operating the operation unit 24 on the main machine side, the display areas of the replay image P10 and the real-time image P20 can be switched, only the replay image P10 can be displayed, and only the real-time image P20 can be displayed. For example, only the real-time image P20 or only the playback image P10 may be displayed on the entire display screen 220 . In this case, switching from the display of the real-time image P20 to the display of the playback image P10, or from the display of the playback image P10 to the display of the real-time image P20 can be performed by operating the operation unit 24 on the main machine side. switch. In addition, by operating the operation unit 24 on the main machine side, the first image P11 can be displayed only once or repeatedly in the playback image P10, and the second image P12 can be displayed only once or repeatedly. In addition, the playback image P10 transmitted from the handset 1 can be stored in the memory unit 26, and the playback image P10 can be viewed later.

The master-side control unit 23 controls the image processing unit 25 to cause the image processing unit 25 to perform synthesis processing for combining the replay image P10 and the live image P20 . The image processed (synthesized) by the image processing unit 25 is displayed on the display unit 22 .

The memory unit 26 is composed of a readable and writable memory. The memory unit 26 is, for example, a flash memory. The storage unit 26 stores the playback image P10 transmitted from the slave unit 1 . In addition, the storage unit 26 may also store the real-time image P20 transmitted from the slave device 1 . In this embodiment, the memory unit 26 is provided outside the main machine side control unit 23 , but may be provided inside the main machine side control unit 23 . That is, the storage unit 26 can also be a built-in memory of the control unit 23 on the main machine side.

The notification unit 27 is configured to output, for example, a call sound. If there is a call from the slave unit 1, the base unit side control unit 23 causes the notification unit 27 to output a call tone at a specific timing. In other words, when there is a call from the slave unit 1 , the base unit side control unit 23 causes the notification unit 27 to perform a notification operation for notifying that the call from the slave unit 1 has occurred. In addition, the notification unit 27 may be configured to output not only a call sound but also a voice.

(2.3) The composition of the control device Next, the configuration of the control device 3 will be described. The control device 3 has a signal processing unit 31 and a communication unit 32 as shown in FIG. 1 .

The communication unit 32 is a communication interface for communicating with the slave unit 1 and the master unit 2 . The communication unit 32 is connected to the slave unit 1 via the first trunk line 61 . Furthermore, the communication unit 32 is connected to the main machine 2 via the second main line 62 , the branch line 63 , and the splitter 5 . The communication unit 32 is configured to perform bidirectional communication with the child-side communication unit 12 of the child machine 1 . In addition, the communication unit 32 is configured to perform bidirectional communication with the main unit side communication unit 21 of the main unit 2 . That is, the communication unit 32 is configured to relay the communication between the master side communication unit 21 and the slave side communication unit 12 . Therefore, the communication unit 32 relays the communication signal transmitted from the slave side communication unit 12 of the slave unit 1 and transmits it to the plurality of master units 2 . Here, the communication signal transmitted from the slave unit 1 includes information (for example, address, etc.) for specifying the master unit 2 to be sent. Therefore, among the plurality of master machines 2, only the master machine 2 whose address is assigned to itself matches the address included in the communication signal can receive the communication signal. In addition, the communication unit 32 relays the communication signal transmitted from each of the plurality of master units 2 and transmits it to the slave unit 1 .

The signal processing unit 31 is constituted by, for example, a microcomputer including a CPU and a memory as main components. And, the microcomputer functions as the signal processing unit 31 by the CPU executing the programs stored in the memory. The program executed by the CPU is pre-recorded in the memory of the microcomputer here, but it may be provided by being recorded on a recording medium such as a memory card, or provided through an electrical communication line such as the Internet.

The signal processing unit 31 is configured to control the communication unit 32 . Specifically, the signal processing unit 31 transmits the communication signal sent from the slave unit 1 to the plurality of master units 2 by controlling the communication unit 32 , and transmits the communication signal transmitted from each of the plurality of master units 2 to the slave unit 1 .

(3) Actions of the walkie-talkie system (3.1) The first operation example Next, a first example of operation of the intercom system 10 of this embodiment will be described with reference to FIG. 3 . Here, the case where a visitor performs a call operation on the handset 1 and the resident responds to the call is described as an example. In addition, "photographing" in FIG. 3 shows a case where the image pickup unit 11 takes an image (moving image). "Sending" in FIG. 3 indicates the state of transmitting the image captured by the camera unit 11 from the slave unit 1 to the master unit 2 . "Receive" in FIG. 3 indicates that the image transmitted from the slave 1 is received. "Display" in FIG. 3 shows that the image received by the main machine 2 is displayed on the display unit 22 . In addition, in FIG. 3 , the execution period of each of imaging, transmission, reception, and display is indicated by a solid line, and the stop period of each of imaging, transmission, reception, and display is indicated by a dotted line. In addition, in FIG. 3 , the hatched section in the shooting or displaying execution section indicates the section for shooting or displaying each of the first image P11 , the second image P12 , and the real-time image P20 . Hereinafter, the same applies to FIGS. 4 and 5 .

In order to call the base phone 2 of the resident of the visiting target, the visitor approaches the handset 1, and the visitor enters the detection range of the sensor 17 at time t1. When the sensor 17 detects a person (visitor), the slave side control unit 13 causes the imaging unit 11 to start capturing an image (moving image). Also, at this time, the slave side control unit 13 stores (records) the moving image captured by the imaging unit 11 in the storage unit 16 .

At time t3, the visitor starts a calling operation on the handset-side operation unit 14 of the handset 1 . That is, at time t3, the visitor inputs the first character (initial character) of the household number of the visiting target. At time t5, the calling operation ends. The end of the call operation refers to the action of pressing the call button after entering the household number. When the calling operation is completed, the slave machine 1 and the base machine 2 corresponding to the input house number are in a state where they can communicate via the control device 3 . Strictly speaking, there is a time lag between the end of the call operation and the establishment of communication between the slave unit 1 and the master unit 2, but this time lag will be ignored for the description here.

Here, at time t3, the specific condition is established by the first operation of the slave-side operation unit 14 accepting the calling operation. The slave side control unit 13 causes the image processing unit 15 to generate the playback image P10 when a specific condition is satisfied.

The image processing unit 15 generates a playback image P10 using the first image P11 captured by the imaging unit 11 before the establishment of the specific condition and the second image P12 captured by the imaging unit 11 after the establishment of the specific condition. The first image P11 is a moving image captured by the imaging unit 11 before the time t3 when the visitor starts the calling operation on the handset-side operation unit 14 . The second image P12 is a moving image captured by the imaging unit 11 after the time t3 when the visitor starts the calling operation on the handset-side operation unit 14 .

In this embodiment, the first image P11 is a moving image from time t2 (for example, 3 seconds) before the time t3 when the specific condition is satisfied to the time t3 when the specific condition is satisfied. Here, the time t2 is set to be later than the time t1 when the sensor 17 detects a person (visitor). Therefore, the first image P11 is an image taken after detecting the presence of a person in the space where the slave device 1 is installed before the specific condition is established. Moreover, the 1st image P11 is an image captured before the predetermined time (1st period T1) from the establishment of a specific condition. In addition, the first period T1 is not limited to 3 seconds, and may be a time length different from 3 seconds.

In the present embodiment, the second image P12 is a moving image from the time t3 when the specific condition is satisfied to the time t4 after the second period T2 (for example, 2 seconds). Here, time t4 is set to be earlier than time t5 when the caller finishes the calling operation. In addition, the second period T2 is not limited to 2 seconds, and may be a time length different from 2 seconds.

That is, the first image P11 and the second image P12 are continuous moving images in time series. In other words, the playback image P10 is a moving image from the time t2 before the first period T1 of the time t3 when the specific condition is satisfied to the time t4 after the second period T2 of the time t3 when the specific condition is satisfied.

The image processing unit 15 extracts the dynamic images from time t2 to time t4 from the dynamic images stored in the memory unit 16 to generate the playback image P10 .

Also, as shown in FIG. 3 , in the present embodiment, the image processing unit 15 replaces the time-series order of the first image P11 and the second image P12 to generate a playback image P10 . That is, the playback images P10 are arranged in the order of the second image P12 and the first image P11 from the top.

When the calling operation is completed and the slave unit 1 and the master unit 2 are in a state where communication is possible, the slave side control unit 13 transmits the playback image P10 generated by the image processing unit 15 to the master unit 2 (time t5). Also, when the slave unit 1 and the master unit 2 are in a state where they can communicate, the slave side control unit 13 transmits the real-time moving image captured by the imaging unit 11 , that is, the real-time image P20 to the master unit 2 .

When the master unit 2 becomes communicable with the slave unit 1 and receives a call signal from the slave unit 1, the master unit side control unit 23 notifies the notification unit 27 of the call from the slave unit 1 (time t5). Also, the main machine side control unit 23 memorizes (records) the playback image P10 transmitted from the slave machine 1 in the memory unit 26 .

The master side control unit 23 causes the image processing unit 25 to generate a composite image of the playback image P10 and the live image P20, and causes the display unit 22 to display the composite image (see FIG. 2 ). The playback pictures P10 are arranged in the order of the second picture P12 and the first picture P11 from the top. Therefore, on the display unit 22 , the first image P11 is displayed (played) after the second image P12 is displayed (played). In addition, the playback image P10 is a short-term moving image, so it is repeatedly displayed. That is, the first image P11 and the second image P12 are alternately and repeatedly displayed (played back).

After time t5, when the resident watching the image displayed on the display unit 22 (composite image of the playback image P10 and the real-time image P20) performs a specific operation (for example, pressing operation) on the operation unit 24 on the main machine side, And it becomes the state where voice communication can be carried out between the slave unit 1 and the base unit 2 .

And, after the communication between the slave unit 1 and the master unit 2 ends, if a person (visitor) disappears from the detection range of the sensor 17, the slave side control unit 13 stops the imaging unit 11 from taking pictures. In addition, when the communication between the slave unit 1 and the master unit 2 ends, the slave side control unit 13 can stop the imaging unit 11 from taking pictures.

In this way, before the slave unit 1 (calling device 1) of the present embodiment satisfies a specific condition, that is, before the first operation of accepting a calling operation, the imaging unit 11 starts shooting. And, the slave machine 1 sends the images (the first image P11 and the second image P12) captured by the imaging unit 11 before and after the establishment of the specific condition, that is, before and after the first operation of accepting the call operation, to the main machine 2 (information terminal 2). Therefore, the user (resident) of the main machine 2 can easily confirm the image, behavior, etc. of the user (visitor) of the slave machine 1 before performing a calling operation. In addition, since the image of the visitor performing the calling operation to the handset 1 is shown on the second image P12, it is easy to confirm the visitor's face.

Also, the playback image P10 is stored in the memory unit 26 of the main machine 2, and the resident can confirm the visitor later. For example, in the main machine 2, when there is a call from the slave machine 1 while the occupant is away, the occupant can operate the main machine side operation unit 24 to cause the display unit 22 to display (play) the playback image P10 stored in the memory unit 26. . At this time, in order to select the replay image P10 to be played, a thumbnail image of the replay image P10 is displayed on the display unit 22 for each call or for each visitor, which is based on the operation of the user (resident) of the main machine 2. The playback image P10 corresponding to the selected thumbnail image is displayed (played) on the display unit 22 . The thumbnail image of the playback image P10 refers to a still image extracted from the playback image P10. In this embodiment, the thumbnail image of the playback image P10 is a still image of the first frame of the playback image P10. In the present embodiment, the playback images P10 are arranged in the order of the second image P12 after the start of the call operation and the first image P11 before the start of the call operation from the beginning. Therefore, the thumbnail image of the playback image P10 becomes a still image when the caller starts the calling operation. Thereby, there is a high possibility that the face of the visitor is reflected on the thumbnail image, and it is easy for the resident to confirm who the visitor who came to visit while absent is.

Moreover, when displaying (playing) the replay image P10 corresponding to the selected thumbnail image on the display unit 22, the master-side control unit 23 plays the first image P11 and the second image P12 sequentially. That is, the second image P12 is played after the first image P11 that is chronologically preceding is played. Thereby, the user (occupant) of the main machine 2 can confirm the image of the visitor approaching and operating the slave machine 1 in time series, and it is easy to confirm the visitor's behavior and the like.

In addition, the master-side control unit 23 may also be configured to set a playback interval in the playback image P10 corresponding to the selected thumbnail image. For example, the master side control unit 23 may play only the first image P11, only the second image P12, or all or a part of the first image P11 and the second image P12 according to settings. These settings can be performed on the main machine 2, or on external devices such as the slave machine 1 or the main machine in the management room.

(3.2) The second operation example Next, a second operation example of the intercom system 10 of this embodiment will be described with reference to FIG. 4 .

In order to call the base phone 2 of the resident of the visiting target, the visitor approaches the handset 1, and the visitor enters the detection range of the sensor 17 at time t11. When the sensor 17 detects a person (visitor), the slave side control unit 13 causes the imaging unit 11 to start capturing an image (moving image).

In this operation example, the calling operation is started at time t12 after the sensor 17 detects a person (time t11) and the first period T1 elapses (the specific condition is satisfied). In this case, the image processing unit 15 sets the moving image from the time t11 when the imaging unit 11 starts capturing the moving image to the time t12 when the calling operation starts as the first image P11 . Therefore, in this operation example, the time length of the first image P11 is shorter than the first period T1.

In addition, in this operation example, the call operation is terminated at time t13 before time t14 when the second period T2 elapses since the visitor started the call operation (time t12). In this case, the slave side control unit 13 suspends the communication with the master machine 2 until time t14 after the calling operation is completed. That is, the slave machine side control unit 13 does not communicate with the master machine 2 until the second period T2 elapses after the specific condition is satisfied (time t12 ). The image processing unit 15 sets the moving image from the time t12 when the calling operation is started to the time t14 when the second period T2 elapses as the second image P12. Therefore, in this operation example, the time length of the second image P12 is the same as the time length of the second period T2 as in the first operation example.

The slave side control unit 13 starts communicating with the master machine 2 at time t14, and sends a call signal, playback image P10, live image P20, and the like. In the main machine 2, a composite image of the replay image P10 and the live image P20 sent from the slave machine 1 is displayed on the display unit 22 (see FIG. 2 ).

Thus, in this operation example, the first image P11 is generated even when the sensor 17 detects that the period from when the person starts the calling operation is shorter than the first period T1. Therefore, the user (resident) of the main machine 2 can confirm the image, behavior, etc. of the user (visitor) of the slave machine 1 before performing a calling operation.

Also, in this operation example, even when the period from the start to the end of the calling operation (time t12 to time t13) is shorter than the second period T2, the communication with the master machine 2 is suspended until the second period T2 passes. Thereby, the time length of the 2nd image P12 is ensured, and it becomes easy for a resident to confirm the visitor's image, behavior, etc. after the start of a calling operation.

In addition, in this operation example, although the communication with the main machine 2 is suspended until time t14 when the second period T2 elapses, it is not limited thereto. The slave side control unit 13 may also start communication with the master unit 2 at time t13 when the calling operation ends. In this case, the image processing unit 15 sets the moving image from the time t12 when the call operation starts to the time t13 when the call operation ends, as the second image P12. Thereby, the time from the end of the call operation to the start of communication between the slave unit 1 and the master unit 2 can be shortened. In addition, by the operation of the main computer 2, it is suppressed to change the setting of the camera (for example, zoom, backlight correction, etc.) in the middle of the second image P12.

(3.3) The third operation example Next, a third operation example of the intercom system 10 of this embodiment will be described with reference to FIG. 5 .

There are situations where a plurality of visitors use the handset 1 continuously. Here, the case where the second visitor uses the handset 1 after the first visitor uses the handset 1 will be described.

At time t21, the communication between the first visitor and the resident of the first visitor's visit destination ends, and the communication between the slave 1 and the master 2 (first master 2) ends. At this time, the second visitor waits near the handset 1 and is set within the detection range of the sensor 17 . Therefore, after the communication between the slave unit 1 and the first master unit 2 is completed, the shooting of moving images by the imaging unit 11 continues.

After the first visitor leaves from the sub-unit 1, the second visitor moves to the front of the sub-unit 1, and starts a calling operation for calling the main unit 2 (second main unit 2) (time t23).

In this action example, the communication between the slave unit 1 and the first base unit 2 is completed, from the time t22 when the first visitor retreats from the slave unit 1 to the time t23 when the second visitor starts calling (the specific condition is met). The period is shorter than the first period T1. In this case, the image processing unit 15 sets the moving image from when the first visitor retreats from the handset 1 to when the second visitor starts the calling operation as the first image P11. Specifically, the image processing unit 15 has a person detection function for detecting a person included in an image captured by the imaging unit 11 using an image recognition technique. If the person disappears from the shooting range of the camera unit 11 , the image processing unit 15 judges that the person moves away from the slave machine 1 .

In this operation example, at time t22 , the image processing unit 15 judges that the person (first visitor) has disappeared from the imaging range of the imaging unit 11 . The image processing unit 15 sets the moving image from the time t22 when the person disappears from the imaging range of the imaging unit 11 to the time t23 when the second visitor starts calling operation as the first image P11. Therefore, in this operation example, the time length of the first image P11 is shorter than the first period T1.

That is, in this operation example, the first image P11 is an image captured before the specific condition is established and after the last communication between the slave side communication unit 12 and the first master machine 2 is completed. Specifically, the first image P11 is before the establishment of the specific condition, and the last communication between the slave side communication unit 12 and the first base unit 2 is completed, and the person (the first visitor) is out of the shooting range of the imaging unit 11 After moving, the captured image.

Also, at time t24, the calling operation of the second visitor ends. At time t25, the sub-unit 1 and the second base unit 2 are in a communication-capable state, and the sub-unit 1 sends a call signal, a playback image P10, a real-time image P20, and the like. In the main machine 2, a composite image of the replay image P10 and the live image P20 sent from the slave machine 1 is displayed on the display unit 22 (see FIG. 2 ).

Thus, in this operation example, the first image P11 is a moving image after the first visitor moves out of the imaging range of the imaging unit 11 until the second visitor starts the call operation. Therefore, the first visitor is suppressed from being displayed on the first image P11.

The termination of the communication between the slave unit 1 and the master unit 2 is not limited to the case where the occupant performs an operation on the master unit side operation part 24 of the master unit 2 to end the call (communication), but also includes the situation where the visitor terminates the call of the master unit 2. For example, when the resident of the visiting target goes out, if the visitor operates the operation unit 14 on the slave side to stop the call of the master unit 2, the communication between the slave unit 1 and the master unit 2 ends.

In addition, in this operation example, although the moving image after the person moves out of the imaging range of the imaging unit 11 until the call operation starts is set as the first image P11, the present invention is not limited thereto. The first image P11 may be a moving image from the end of the previous communication (time t21) to the start of the call operation (time t23) after a certain time. In other words, the first image P11 is an image taken after a specific time or more has elapsed since the last communication between the slave-side communication unit 12 and the first master device 2 before the specific condition is met.

In this case, the image processing unit 15 does not need to have a human body detection function, and the configuration can be simplified.

(4) Variation example The above-mentioned embodiment is only one of various embodiments of the present disclosure, and various changes can be made according to the design and the like as long as the purpose of the present disclosure is achieved. Hereinafter, the modification examples of the intercom system 10 of embodiment are enumerated. Modifications described below can be applied in combination as appropriate.

The same function as the main machine 2 (information terminal 2) of the embodiment can also be embodied by the control method of the main machine 2 (information terminal 2), a (computer) program, or a non-transitory recording medium for recording the program.

The control method of the main machine 2 is the control method of the main machine 2 (information terminal 2) capable of communicating with the slave machine 1 (calling device 1), and includes a communication step and a display step. In the communication step, communicate with the slave 1. In the display step, an image captured by the imaging unit 11 of the slave 1 is displayed. In addition, in the display step, the first image P11 is displayed after the second image P12 is displayed.

Also, the program makes the computer system execute the control method of the main machine 2 .

In the intercom system 10, a computer system is included in the slave side control unit 13, the image processing unit 15, the main unit side control unit 23, the image processing unit 25, and the like. The computer system uses the processor and memory as the hardware as the main components. The processor executes the programs recorded in the memory of the computer system to realize the functions of the slave side control unit 13 , the image processing unit 15 , the master side control unit 23 , and the image processing unit 25 . The program can be pre-recorded in the memory of the computer system, provided through an electrical communication line, or recorded in a non-transitory recording medium such as a memory card, optical disc, or hard disk drive that can be read by the computer system. The processor of a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC: Integrated Circuit) or a large scale integrated circuit (LSI: Large Scale Integration). A plurality of electronic circuits can be concentrated on one chip, or dispersed on a plurality of chips. A plurality of chips may be concentrated in one device, or dispersed in a plurality of devices. Part of the functions of the walkie-talkie system 10 can also be realized by cloud computing (cloud computing).

Also, in the above example, the image processing unit 15 of the slave unit 1 uses the first image P11 and the second image P12 to generate the playback image P10, but the image processing unit 25 of the master unit 2 can also generate the playback image P10 .

Also, the order from the beginning of the playback image P10 is not limited to the order of the second image P12 and the first image P11, and may be the order of the first image P11 and the second image P12 from the beginning. . In this case, the first image P11 and the second image P12 are sequentially displayed (played) on the display unit 22 of the main machine 2 .

Also, in the above example, both the first image P11 and the second image P12 are moving images, but the first image P11 and the second image P12 may also be still images. In this case, the imaging unit 11 may capture a plurality of still images as the first image P11. In addition, the imaging unit 11 may capture a plurality of still images as the second image P12.

In addition, in the above-mentioned example, although the specific condition includes the condition that the operation unit 14 on the slave side accepts the call operation (the first operation), it is not limited to this condition. For example, in specific conditions, it may also include the condition that the proximity sensor installed in the handset 1 detects a person (visitor) standing in front of the handset 1, and the image processing unit 15 of the handset 1 recognizes the image captured by the camera unit 11. The condition of the face of the person (visitor) included in the image, etc.

Also, in the above-mentioned example, although the case where the handset 1 (calling device 1) is an intercom installed in the hall of the common part of the apartment complex is taken as an example for illustration, the handset 1 can also be a doorbell installed at the entrance outside the resident. (Gateway handset). Also, although the case where the facility using the walkie-talkie system 10 is an example of a collective housing is described, the facility using the walkie-talkie system 10 can be a single-family house, or an office building, a commercial facility, a hotel, a hospital, a factory, a school and Elderly housing, etc.

(Summarize) A calling device (1) of a first aspect is a device for calling an information terminal (2), and includes an imaging unit (11) and a communication unit (slave side communication unit 12). The imaging unit (11) captures images. The communication unit (12) sends the first image (P11) taken by the imaging unit (11) before the establishment of the specific condition and the second image (P12) taken by the imaging unit (11) after the establishment of the specific condition to Information terminal (2).

According to this aspect, since the first image (P11) and the second image (P12) captured by the imaging unit (11) before and after the specified condition are met are sent to the information terminal (2), the information terminal (2) Among them, it is easy to confirm the image of the user of the calling device (1).

The call device (1) of the second aspect is in the first aspect, and further includes an operation unit (14) for receiving a call operation for calling the information terminal (2). The specific condition includes a condition that the operation unit (the operation unit 14 on the handset side) accepts a call operation.

According to this aspect, the image of the user of the calling device (1) performing the calling operation can be confirmed on the information terminal (2).

The paging device (1) of the third aspect is in the second aspect, and the specific condition includes the condition of the first operation of the operation unit (14) accepting the paging operation.

According to this aspect, the image of the user of the calling device (1) performing the calling operation can be confirmed on the information terminal (2).

In the paging device (1) of the fourth aspect, in any one of the first to third aspects, at least one of the first image (P11) and the second image (P12) is a dynamic image.

According to this aspect, it is easy to confirm the behavior of the user of the calling device (1).

The calling device (1) of the fifth aspect is in any one of the first to fourth aspects, the first image (P11) and the second image (P12) are dynamic images continuous in time series .

According to this aspect, it is easy to confirm the behavior of the user of the calling device (1).

The calling device (1) of the sixth aspect is in any one of the first to fifth aspects, the first image (P11) is before the establishment of a specific condition, and the detection is provided with the calling device (1) Images taken after the presence of people in the space.

According to this aspect, since the first image ( P11 ) is captured after detecting the presence of a person in the space where the paging device ( 1 ) is installed, there is a high possibility of showing a person.

The calling device (1) of the seventh aspect is in any one of the first to sixth aspects, and the first image (P11) is from the establishment of a specific condition to a specific time (first period T1) Images taken.

According to this aspect, since the first image ( P11 ) is taken from the establishment of the specific condition until the specific time (first period T1 ), it is easy to confirm the image of the user of the calling device ( 1 ).

The call device (1) of the eighth aspect is in any one of the first to seventh aspects, the first image (P11) is before the establishment of a specific condition, and the communication part (12) and the information terminal (2) Images taken after the last communication ended.

According to this aspect, the person who used the paging device (1) at the time of the previous communication is suppressed from being reflected on the first image (P11).

The calling device (1) of the 9th aspect is in any one of the 1st to the 8th aspect, the first image (P11) is before the establishment of the specific condition, and from the communication department (12) and the information The image captured by the terminal (2) after a certain period of time has elapsed since the last communication.

According to this aspect, the person who used the paging device (1) at the time of the previous communication is suppressed from being reflected on the first image (P11).

The call device (1) of the 10th aspect is in any one of the 1st to 9th aspects, the first image (P11) is before the establishment of a specific condition, and the communication part (12) and the information terminal ( 2) The image captured after the last communication ended and the person moved out of the shooting range of the camera unit (11).

According to this aspect, the person who used the paging device (1) at the time of the previous communication is suppressed from being reflected on the first image (P11).

The calling device (1) of the 11th aspect is any one of the 1st to 10th aspects, the communication unit (12) sends the first The image (P11) and the second image (P12) are sent to the information terminal (2).

According to this aspect, the time for capturing the second image (P12) is ensured, and it is easy to confirm the image of the user of the calling device (1).

An information terminal (2) of a twelfth aspect includes a terminal-side communication unit (main machine-side communication unit 21) and a display unit (22). The terminal-side communication unit (21) can communicate with the calling device (1) of any one of the first to eleventh aspects. The display unit (22) displays images captured by the camera unit (11) of the paging device (1). Also, the display unit (22) displays the first image (P11) after displaying the second image (P12).

According to this aspect, the image of the user of the calling device (1) can be easily confirmed on the information terminal (2).

The control method of the information terminal (2) of the 13th aspect is the control method of the control terminal which can communicate with the call device (1) of any one of the 1st to 11th aspects. A control method for an information terminal (2), including a communication step and a display step. In the communication step, communication is performed with the calling device (1). In the displaying step, the image captured by the imaging unit (11) of the paging device (1) is displayed. Also, in the display step, the first image is displayed (P11) after the second image is displayed (P12).

According to this aspect, in the information terminal (2), it is easy to confirm the image of the user of the calling device (1).

The program of the 14th aspect causes the computer system to execute the control method of the information terminal (2) of the 13th aspect.

According to this aspect, in the information terminal (2), it is easy to confirm the image of the user of the calling device (1).

1‧‧‧Calling device (handset) 2‧‧‧information terminal (main machine) 3‧‧‧Control device 4‧‧‧Doorbell 5‧‧‧Splitter 10‧‧‧intercom system 11‧‧‧camera department 12‧‧‧Handset Side Communication Department (Communication Department) 13‧‧‧Slave side control unit 14‧‧‧Submachine side operation part (operation part) 15‧‧‧Image Processing Department 16‧‧‧memory 17‧‧‧Sensor 21‧‧‧Master side communication part (terminal side communication part) 22‧‧‧Display 23‧‧‧Master side control unit 24‧‧‧Master machine side operation part 25‧‧‧Image Processing Department 26‧‧‧memory 27‧‧‧Notification Department 31‧‧‧Signal Processing Department 32‧‧‧Department of Communications 61‧‧‧Route 1 62‧‧‧The second main line 63‧‧‧branch line 64‧‧‧connection line 220‧‧‧display screen P10‧‧‧Playback image P11‧‧‧1st image P12‧‧‧2nd image P20‧‧‧live image T1‧‧‧1st period T2‧‧‧2nd period t1～t5‧‧‧Time t11～t14‧‧‧time t21～t25‧‧‧time

FIG. 1 is a block diagram of an intercom system including a calling device according to an embodiment of the present disclosure. Fig. 2 is an example of the display screen of the display unit of the master unit of the intercom system as above. Fig. 3 is a timing diagram of the first operation example of the intercom system as above. Fig. 4 is a timing diagram of the second operation example of the intercom system as above. Fig. 5 is a timing diagram of the third operation example of the intercom system as above.

1‧‧‧Calling device (handset)

2‧‧‧information terminal (main machine)

3‧‧‧Control device

4‧‧‧Doorbell

5‧‧‧Splitter

10‧‧‧intercom system

11‧‧‧camera department

12‧‧‧Handset Side Communication Department (Communication Department)

13‧‧‧Slave side control unit

14‧‧‧Submachine side operation part (operation part)

15‧‧‧Image Processing Department

16‧‧‧memory

17‧‧‧Sensor

21‧‧‧Master side communication part (terminal side communication part)

22‧‧‧Display

23‧‧‧Master side control unit

24‧‧‧Master machine side operation part

25‧‧‧Image Processing Department

26‧‧‧memory

27‧‧‧Notification Department

31‧‧‧Signal Processing Department

32‧‧‧Department of Communications

61‧‧‧Route 1

62‧‧‧The second main line

63‧‧‧branch line

64‧‧‧connection line

Claims (14)

A calling device, which is a calling device for calling an information terminal, and includes: an imaging unit, which captures images; and a communication unit, which can communicate with the above-mentioned information terminal; and the above-mentioned communication unit sends the following images to the above-mentioned information terminal : Playback images using the first image and the second image, wherein the first image is captured and recorded by the above-mentioned camera unit before the establishment of the specific condition, and the second image is after the establishment of the above-mentioned specific condition Photographed and videotaped by the aforementioned camera unit; and real-time images, which are real-time moving images captured by the aforementioned camera unit. The call device according to claim 1, further comprising: an operation unit that accepts a call operation for calling the information terminal; and the specific condition includes a condition that the operation unit accepts the call operation. The paging device according to claim 2, wherein the specific condition includes the following condition: the operation unit accepts the first operation of the paging operation. The paging device according to claim 1, wherein at least one of the first image and the second image is a dynamic image. Such as the calling device of claim 1, wherein The above-mentioned first image and the above-mentioned second image are continuous moving images in time series. The paging device according to any one of claims 1 to 5, wherein the first image is an image taken after the presence of a person in the space where the paging device is installed is detected before the above-mentioned specific condition is satisfied. The paging device according to any one of claims 1 to 5, wherein the above-mentioned first image is an image taken from the establishment of the above-mentioned specific condition to a specific time before. The paging device according to any one of claims 1 to 5, wherein the first image is an image captured before the above-mentioned specific condition is established and after the last communication between the above-mentioned communication unit and the above-mentioned information terminal is completed. The calling device according to any one of claims 1 to 5, wherein the first image is created before the above-mentioned specific condition is established, and after a specific time has elapsed since the last communication between the above-mentioned communication unit and the above-mentioned information terminal. Images taken. The paging device according to any one of claims 1 to 5, wherein the first image is taken by a person to the imaging unit before the above-mentioned specific condition is established, and the last communication between the communication unit and the information terminal is completed. Image taken after moving outside the range. The paging device according to any one of claims 1 to 5, wherein the communication unit transmits the first image and the second image to the information terminal after the specified condition is established and a specified time has elapsed. An information terminal comprising: a terminal-side communication unit capable of communicating with the calling device according to any one of claims 1 to 11; and a display unit displaying an image captured by the imaging unit of the calling device; and the above-mentioned The display unit displays the first image after displaying the second image. A control method of an information terminal, which is a control method of an information terminal capable of communicating with the call device of any one of claims 1 to 11, and includes: a communication step of communicating with the above call device; and a display step, It displays an image captured by the imaging unit of the calling device; and in the display step, after displaying the second image, the first image is displayed. A program that causes a computer system to execute the information terminal control method of claim 13.

Images