JP2024044749A - Message processing system, information terminal control method, message processing method, message processing program, and information terminal control program - Google Patents

Abstract

[Problem] To appropriately acquire information using an information terminal. [Solution] A message processing system 100 has a first terminal (common entrance device 11) installed at the entrance of a facility, and a second terminal (base unit 22a) installed inside the facility and capable of two-way communication with the first terminal. The system also includes a memory unit that stores message information related to a visitor's message acquired by the first terminal before the two-way communication between the first terminal and the second terminal begins, and an output unit that outputs the message information stored in the memory unit to a third terminal different from the second terminal via a public line. [Selected Figure] Figure 1

Description

The present disclosure relates to a business processing system that uses an intercom for making calls between a common entrance and a residential unit, a method for controlling an information terminal, a method for processing a business, a program for processing a business, and a program for controlling an information terminal.

Conventionally, intercom systems are installed in many collective facilities such as condominiums and apartments. These intercom systems generally include a hallway intercom installed at the common entrance, and an intercom master unit and door phone installed in each residence, and visitors use the hallway intercom to call the intercom master unit of the residence they are visiting and make a call.

Patent document 1 shows that convenience can be improved by having the intercom master unit pick up the visitor's voice while the visitor is calling the intercom master unit.

JP2019-193234A

Here, there is a demand for intercom systems that allow users to use information terminals such as smartphones in the same way as intercom master units. In this case, it is necessary to consider the case where the information terminal is used outside the home, and in such cases, there is a demand for the terminal to be operated in a way that does not adversely affect the surroundings.

The message processing system according to the present disclosure includes a first terminal provided at the entrance of a facility, a second terminal provided inside the facility and capable of two-way communication with the first terminal, a memory unit that stores message information related to a visitor's message acquired by the first terminal before the two-way communication between the first terminal and the second terminal is started, and an output unit that outputs the message information stored in the memory unit to a third terminal different from the second terminal via a public line.

Furthermore, the information terminal control method according to the present disclosure enables communication via a public line to an intercom system including a first terminal provided at the entrance of a facility and a second terminal provided inside the facility. A method for controlling an information terminal, the method comprising: acquiring business information regarding a visitor's business acquired by the first terminal before starting a two-way conversation with the second terminal; and the acquired business information. and a reporting step of reporting information.

Further, the business processing system according to the present disclosure is capable of conducting a call between a first terminal provided at the entrance of a facility and a second terminal provided inside the facility and capable of two-way communication with the first terminal. A business processing system for processing business matters, the business matter relating to business matters of a visitor acquired at the first terminal before the start of the two-way conversation between the first terminal and the second terminal. an acquisition unit that acquires information, a storage unit that stores the business information acquired by the acquisition unit, and the business information stored in the storage unit is transmitted to the second terminal via a public line. and an output unit that outputs to a different third terminal.

The present disclosure also relates to a program for the above-mentioned business processing system and information terminal control method.

This disclosure makes it possible to quickly obtain appropriate information about a visitor's purpose, etc.

1 is a diagram showing a schematic diagram of an overall configuration of a message processing system according to an embodiment; FIG. 2 is a functional block diagram of the common entrance device according to the embodiment. A block diagram showing the configuration of a master unit 22a of a dwelling unit in an embodiment of the present invention. 1 is a block diagram showing a configuration of an information terminal according to an embodiment; 10 is a flowchart showing the processing performed by the common entrance apparatus according to the embodiment when a visitor arrives. 11 is a flowchart showing a process performed by the parent unit when a visitor visits the parent unit according to the embodiment. 10 is a flowchart showing a process performed by an information terminal according to the embodiment when a visitor visits the information terminal. 12 is a flowchart illustrating a process of adding response candidates to a business request of the information terminal according to the embodiment.

Embodiments of the present disclosure will be described below with reference to the drawings. Note that the following embodiments do not limit the present disclosure, and configurations that selectively combine multiple examples are also included in the present disclosure.

The main body of the system and device of the present disclosure includes a computer. When this computer executes the program, the main functions of the system and device of the present disclosure and the method using the same are realized. A computer includes, as its main hardware configuration, a processor that operates according to a program. The type of processor does not matter as long as it can implement the above functions by executing a program. A processor is comprised of one or more electronic circuits, including integrated circuits (ICs) or large scale integrated circuits (LSIs). A plurality of electronic circuits may be integrated on one chip or may be provided on a plurality of chips. A plurality of chips may be integrated into one device, or may be provided in a plurality of devices. Further, the program is stored in a computer-readable non-transitory storage medium such as a ROM, an optical disk, or a hard disk drive. The program may be stored in the storage medium in advance, or may be supplied to the storage medium via a wide area communication network including the Internet.

"overall structure"
FIG. 1 is a diagram schematically showing the overall configuration of a business processing system 100, which is an example of an embodiment.

The message processing system includes an intercom system 1 installed in a collective facility such as an apartment building, and a management system 3 and an information terminal 4 connected to the intercom system 1 via a communication line 2. In this disclosure, the information terminal 4 is also referred to as a third terminal.

The intercom system 1 is a system that processes the business of visitors in a collective facility. The intercom system 1 is connected to an external management system 3 through a communication line 2 such as the Internet that uses a public line such as a telephone line. Further, an information terminal 4 such as a smartphone, a mobile phone, or a notebook computer is connected to the communication line 2, and the information terminal 4 functions as a terminal similar to a base unit 22a of an intercom described later.

The intercom system 1 is a system installed in a collective facility such as a condominium, and includes a common entrance device 11 installed at a common entrance, an intercom base unit 22a installed in each residential unit that is exclusive to each resident, and various other devices. and a control device 30 that performs control.

The common entrance of the collective facility includes a common entrance device 11 where visitors can have conversations with residents, a key detection device 12 that detects the card keys of visitors and residents, and an entrance door 13 that is the entrance to the collective facility. , an electric lock 14 for locking and unlocking the entrance door 13 is provided. Note that the common entrance device 11 is also called a lobby intercom or the like, and is also called a first terminal in this disclosure.

Each dwelling unit in the complex is provided with an intercom master unit (hereinafter referred to as master unit) 22a, a front door slave unit 22b, and a router 22c for connecting the master unit 22a to an information terminal 4 via a communication line 2. In this disclosure, the master unit 22a is also referred to as a second terminal.

The entrance slave unit 22b can perform two-way communication with the master unit 22a, just like the common entrance device 11. The router 22c is for connecting to the external communication line 2, and can be used to connect various information devices such as PCs (personal computers) installed in each residence to the communication line 2. Various sensors and devices installed in the rooms may also be connected to the master unit 22a, allowing information from these devices to be exchanged with the outside world.

The control device 30 is composed of a computer and performs various data processing. The control device 30 is connected to the common entrance device 11, the main device 22a of the dwelling unit, and also connected to the control room main device 15, which is expected to be used by a manager or the like. Further, the communication line 2 is connected to the control device 30 via a gateway 61 and a router 62, so that the control device 30 can communicate with the outside. Note that the control device 30 can store various types of data here. Note that the information may be stored in another device within the intercom system 1, a database connected to the intercom system 1, or the like.

A management system 3 connected to the communication line 2 includes a management server 3a, and performs various management of a plurality of collective facilities and the like. The management system 3 can also include the control device 30, and can also be formed as a system on the cloud. Further, at least a part or all of the management system 3 may be included in the intercom system 1. Note that the management system 3 normally executes various management tasks regarding the business processing systems in a plurality of collective facilities.

In addition, it is preferable that the information terminal 4 is portable by the resident, and the same operations as those of the parent unit 22a can be performed on the devices connected to the parent unit 22a from outside the collective facility via the parent unit 22a. The information terminal 4 can also be connected to the communication line 2 via the parent unit 22a and the control device 30.

The common entrance device 11, the master unit 22a, the management room master unit 15, the management server 3a, and the information terminal 4 are all terminals that handle information processing, and are connected to form the message processing system 100. The message processing system 100 also functions as a voice information output system.

"facility"
Examples of collective facilities to which the intercom system 1 is applied include residential complexes such as condominiums, dormitories, and company housing, but any facility with a common entrance may be used and is not limited to collective housing. The intercom system 1 can also be applied to non-residential collective facilities consisting of multiple facilities (multiple companies, departments, departments, etc.) such as offices, factories, research facilities, medical facilities, accommodation facilities, etc. be. Additionally, the facility may be a single-family home or a non-residential facility.

"Common entrance device"
The common entrance is provided with a common entrance device 11, which is a common entrance device for calling each dwelling unit. The common entrance device 11 is used by a person (referred to as a visitor) who visits the dwelling unit. The visitor can call the dwelling unit (e.g., the dwelling unit number) by inputting the dwelling unit to be visited into the common entrance device 11. The common entrance is also provided with a front door 13 and an electric lock 14 for locking the front door 13. The electric lock 14 is, for example, an auto-lock device that automatically locks the front door 13 when the front door 13 is closed, and the electric lock 14 is locked and unlocked under the control of the control device 30. The front door 13 is, for example, an automatic door, and is basically in a locked state under normal circumstances. The common entrance device 11 is connected to the control device 30 as well as the master unit 22a of each dwelling unit so as to be able to communicate with each other.

The common entrance device 11 is installed outside the entrance door 13 of the common entrance, and a visitor uses the common entrance device 11 to call the residence to be visited and inform them of his/her visit. The resident can confirm the visitor using the base unit 22a, operate the base unit 22a to unlock the electric lock 14, and make the entrance door 13 openable.

In the example shown in FIG. 1, a key detection device 12 is installed at a common entrance. The key detection device 12 is composed of, for example, an IC card reader, and when it detects a pre-registered card key, the electric lock 14 is unlocked and the entrance door 13 is opened.

2 is a functional block diagram of the common entrance device 11. The common entrance device 11 has a communication unit 120, which is connected to the control device 30, and necessary information is exchanged by communication. This connection may be wired or wireless. The communication unit 120 is connected to a processing unit 121. The processing unit 121 is a computer consisting of a processor, memory, etc., and performs various information processing by executing various programs, and controls connected devices by various signals according to the results. It also includes a memory unit 121a that stores video and audio about the message obtained by the camera 112 and microphone 114, an output unit 121b that outputs the message stored in the memory unit 121a to the outside via the communication unit 120, and a setting unit 121c that stores settings such as whether to inquire about the message and whether to record or film the message. Note that information about the message, including the video and audio about the message, is called message information.

A camera 112, a human sensor 113, a microphone 114, a monitor 115, and a speaker 116 are connected to the processing unit 121. The human sensor 113 detects when a visitor approaches, and records images and sounds of the visitor. At the same time, necessary displays and sounds are output from the microphone 114, monitor 115, and speaker 116.

The processing unit 121 is also connected to the input unit 110. The input unit 110 includes a numeric keypad 110a, a call button 110b, and function keys 110c. For example, a room number can be input using the numeric keypad 110a, and an intercom for the corresponding room can be called using the call button 110b. Various functions can be set to the function key 110c.

"Parent unit"
3 is a block diagram showing the configuration of the master unit 22a. The master unit 22a of each house is connected to a line 122 extending from the control device 30.

Line 122 may be a wired line or a wireless line. A processing unit 204 is connected to the line 122 via a communication unit 202 in the base unit 22a. The processing unit 204 is composed of a computer and manages various data processing. The communication unit 202 uses the line 122 to perform necessary processing for data exchange performed by the processing unit 204 with other external devices. Furthermore, the above-mentioned entrance handset 22b and router 22c are also connected to the communication unit 202, and the communication unit 202 performs necessary processing for data exchange. The base device 22a, like the communal entrance device 11, can perform two-way communication such as a phone call with the entrance slave device 22b.

An input section 206 and a microphone 208 are connected to the processing section 204 as input means. The input unit 206 is for inputting character data and the like, and can include input keys and a touch panel. Furthermore, the microphone 208 can input audio. Furthermore, a camera may be provided so that images can also be input.

Further, a monitor 210 and a speaker 212 are connected to the processing unit 204 as output means, from which video and audio can be output. Note that the monitor 210 can be used as a display unit when using a touch panel.

Further, in this example, a storage unit 144 is connected to the processing unit 134, and can store business information including video and audio.

Furthermore, the processing unit 134 includes an analysis unit 134a, and can, for example, recognize voice data and generate text data.

"Information terminal"
FIG. 4 is a block diagram showing the configuration of the information terminal 4. As shown in FIG. The information terminal 4 communicates with the base unit 22a via the communication line 2, and can make calls with the communal entrance device 11 on behalf of the base unit 22a. Note that it may also be possible to make a call or the like with the entrance handset 22b.

It is preferable that the information terminal 4 is constituted by a mobile device capable of wireless communication, such as a smartphone. Here, the information terminal 4 can achieve various functions like a general-purpose computer by registering applications, etc., but FIG. 4 shows the configuration when it functions as an intercom terminal. That is, the information terminal 4 according to the present embodiment has a predetermined application program installed therein, and by executing the application program, it connects to the base device 22a and uses the communal entrance device 11 instead of the base device 22a. can communicate with.

The information terminal 4 as an intercom terminal has a configuration similar to that of the parent unit 22a, but a smartphone or the like is a portable terminal, and the communication unit 402 is capable of wireless communication. The communication unit 402 is connected to a processing unit 404. To the processing unit 404, an input unit 406 and a microphone 408 are connected as input means, and a monitor 410 and a speaker 412 are connected as output means, and a memory unit 414 for storing various information is also connected. The information terminal 4 has such a configuration and has the same functions as the parent unit 22a. The processing unit 404 also has an analysis unit 404a and a setting unit 404b. The analysis unit 404a performs voice recognition, etc., recognizes text from voice data, analyzes the recognized text, and determines the message type, which is the content of the message. Setting unit 404b stores information such as whether output from speaker 412 is permitted (whether or not to output audio) and a table of candidate responses according to the subject (type). If there are multiple candidate responses for one subject, they are prioritized, and this priority can be updated through learning. Furthermore, it is preferable that the user be able to edit the candidate responses as appropriate, change, add, or delete them. Note that the silent mode setting on a smartphone or the like can also be used to set whether or not to output audio.

"Processing with common entrance equipment"
FIG. 5 is a flowchart showing the processing performed by the processing unit 121 of the communal entrance device 11 at the time of a visit. Note that this process is performed on the premise that the setting unit 112c of the processing unit 121 has been set to inquire about the business and to record/record the business. Depending on the user's settings, it is also possible to disable business inquiries and recording.

The common entrance device 11 determines whether a visitor is approaching based on the detection results of the human presence sensor 113 (see FIG. 2) (S11). If the determination in S11 is YES, guidance is output (S12). This guidance instructs the visitor to enter the room number of the visitor and press the call button 110b.

It is determined whether the visitor has input the room number and call button 110b within a specified time (S13), and if the determination is YES, a call signal is output to the master unit 22a of the dwelling unit identified by the room number to make a call (S14). Note that if the determinations of S11 and S13 are NO, the process returns to the determination of S11.

At this point, a call is made to the base unit 22a, and while waiting for a response from the base unit 22a, the caller is inquired about the purpose of the call (S15). This inquiry is made by voice from the speaker 116, but images and text regarding the inquiry may also be output to the monitor 115.

In addition, the monitor 115 can display candidates for the type of visitor's purpose. The candidates include "visit with appointment," "package delivery," "door-to-door sales," "survey," "visit to acquaintance," etc., and it is advisable to allow selection via a touch panel.

Then, in response to the inquiry about the business, the microphone 114 and the camera 112 acquire audio and video of the business and store them in the storage unit 121a (S16). Further, in the case of selecting the above-mentioned candidates, it is not necessary to acquire business information using audio and video, or it may be acquired together with at least one of audio and video.

Then, when the message is acquired and stored, the message is transmitted from the output unit 121b to the base unit 22a of the called residence (S17). Note that the transmission in S17 may be performed in parallel with the storage in S16.

Next, it is determined whether there is a response from the base unit 22a within a predetermined time (S18). Although this response is from the base device 22a, it may also be a response from the information terminal 4.

If the determination in S18 is YES, a two-way conversation is made with the responding terminal (base unit 22a or information terminal 4) (S19). That is, a normal intercom call is performed in which video and audio are transmitted from the communal entrance device 11 side and audio is transmitted from the base unit 22a side (S19).

If there is a response during the process of inquiring about the message, obtaining the message information, and sending the message in S15 to S17, the process may be interrupted and the process may proceed to S19, or the process may be completed up to sending the message in S17 before proceeding to communication in S19. In this case, too, it is recommended that the audio and video of the message be stored for a predetermined period of time. Also, the process may be set not to inquire about the message in S15, in which case the call in S14 is answered and the process proceeds to determining whether there is a response in S18.

Furthermore, if there is no business input in S16 or if a business is selected, it is preferable to proceed directly to the determination in S18.

Further, when requesting input of a business, the call in S14 is performed when the business is input, and if no business is input, the call at the base unit 22a does not need to be performed. In this case, the video and audio may be stored so that they can be played back as appropriate on the base unit 22a.

If the determination in S18 is NO, the system notifies the caller that the call cannot be transferred. In other words, the system notifies the caller by audio or video that communication via the intercom is not possible. Also, for example, if the callee has set the answering machine to answering, the system may request the caller to input a message for answering, and if one is input, the message may be acquired and stored.

This message may also be sent to the master unit 22a of the residence and stored therein. In the common entrance device 11, the stored matters and messages are usually stored in the master unit 22a and do not need to be saved, but they may be saved for a specified period of time so that they can be sent when requested.

"Processing on the parent unit of the residence"
FIG. 6 is a flow chart showing the process performed by the processor 204 of the base unit 22a when a visitor comes.

The base unit 22a determines whether a call from the communal entrance device 11 has been received (S31). This is a determination as to whether a calling signal from the communal entrance device 11 has been received. If the determination in S31 is NO, this determination is repeated, and in the case of YES, the system of the base unit 22a is started up and the video and audio of the business sent from the communal entrance device 11 is received (S32 ). That is, before a response is input to the base unit 22a and a two-way conversation is started, the business request sent from the communal entrance device 11 is received.

Furthermore, following or in parallel with the reception of the message in S32, a ring tone is output from the speaker 212, and the received message video and audio are output from the monitor 210 and the speaker 212 (S33). The transmitted message video and audio are stored in the memory unit 214.

The stored message video and audio are then transmitted to the registered information terminal 4 (S34). In other words, the resident of the residence can pre-register an information terminal 4 that will respond instead of the base unit 22a.

Next, it is determined whether there is a response from the master device 22a or the registered information terminal 4 within a predetermined time (S35). If the determination in S35 is YES, a two-way call (video and audio call) is made between the base unit 22a and the common entrance device 11 (S36).

If the communication in S36 is completed and the determination in S35 is NO, the process ends. Note that if the information terminal 4 responds during the determination within the predetermined time in S35, the process can be ended even within the predetermined time.

"Processing on information terminals"
FIG. 7 is a flowchart showing the process performed by the processor 404 of the information terminal 4 when a visitor arrives.

It is determined whether a call has been received from the common entrance device 11 (S41). This is a determination as to whether a call signal has been received from the common entrance device 11 via the parent unit 22a in which the information terminal 4 is registered. If the determination in S41 is NO, this determination is repeated.

If the determination in S41 is YES, the information terminal 4 determines whether message reception is valid (S42). That is, depending on the application program registered in the information terminal 4, it is possible to set whether message reception is enabled or disabled, and this setting is checked. If the user does not need to receive business matters, this setting can be disabled, and the business information will not be received, and the process will proceed to step S47, where it is determined whether another terminal has responded.

If the determination in S42 is YES, the video and audio of the message sent via the parent unit 22a are received, and a message playback button is displayed (S43). That is, the message sent following the transmission of the call signal is received, and the message playback button is displayed on the monitor 410 at that time. For example, the text "Do you want to play the message?" is displayed in an operable state. In this embodiment, it is assumed that the information terminal 4 employs a touch panel as the input unit 406, and an operation is detected by touching a displayed button, but other physical button operations, etc. may also be used.

When the user operates the message playback button and the answer is YES in S44, it is determined whether playback with audio (playback with audio output), that is, audio output from the speaker is permitted (S45). This determination can be made by displaying an audio output/non-audio output setting button to set whether to output audio, similar to the playback button, and by operating this button. Alternatively, the determination may be made according to preset audio output conditions. For example, if the information terminal 4 is set to a mode that prohibits or suppresses audio output, such as manner mode, it can be determined that audio is not being played. As a result, depending on the settings for normal use of the information terminal 4, it is possible to output audio when the user is at home, and to prohibit audio output when audio output is not desirable, without any special operations. Note that, for example, depending on whether or not an earphone device is connected to the information terminal 4, the presence or absence of audio output may be set. In this case, for example, if an earphone device is connected, audio output may be provided. Furthermore, even when the information terminal 4 is in the manner mode, audio output may be provided if an earphone device is connected.

Here, the determination as to whether or not audio output is possible in S45 may be made while confirming the necessity of receiving the message in S42, or while the message is being reproduced (notified) in S46 (while the notification is being executed). ), the audio output may also be disabled.

If the determination in S45 is YES, the video and audio for the business received in S42 are played back and output from the monitor 410 and speaker 412 (S46). This notifies the user of the task.

When playback in S46 has ended or when the determinations in S42 and S44 are NO, it is determined whether another terminal has responded (S47). Here, the other terminals are assumed to be the master unit 22a and other information terminals 4 registered to the master unit 22a. The predetermined time is a predetermined time from the end of message playback.

If the determination in S47 is NO, that is, the other terminal has not responded, is there an input of an instruction for the information terminal 4 to respond within a predetermined time, that is, to make a call (two-way call) with the common entrance device 11? is determined (S48). Here, within the predetermined time of S48, it is preferable to control the information terminal 4 of the other terminals such that the one that inputs the response earlier performs the two-way conversation with the common entrance device.

If the determination in S48 is YES, a two-way call, i.e., a video and audio call, is performed with the common entrance device 11 (S49). Normally, the video and audio of the common entrance device 11 are played on the information terminal 4, and only the audio is supplied from the information terminal 4 to the common entrance device 11.

When the two-way call in S49 ends, and when the answer is YES in S47 or NO in S48, that is, when the other terminal responds, or when there is no response from the information terminal 4, the process ends.

If the answer is NO in S45, i.e., if voice playback is not to be performed, the analysis unit 404a performs a voice recognition process, generates text about the subject (subject text), and displays the subject text on the monitor 410 (S50). In addition, the recognized subject is identified as belonging to one of the pre-stored subject types.

Then, from a table or the like registered in the setting unit 404b, response message candidates (hereinafter referred to as "response candidates") that are preset corresponding to the identified type of business are read out. Here, first, it is determined whether there are multiple response candidates to be read out (S51). If the determination in S51 is YES, the priority order is read out for a plurality of response candidates, and the priority order for display is assigned (S52). That is, the display order of a plurality of response candidates is determined, and if the number of candidates is greater than a predetermined display number, response candidates to be displayed are selected based on the priority order.

If the display content is determined in S52, or if there are not multiple candidates in S51, response candidates for the determined subject are displayed (S53).

For example, in the case of a package delivery, the system recognizes the voice of the message "This is XX Transport. We are here to deliver your package," and reads out the following response candidates stored in correspondence with this message and displays them in the order of priority that has been set.
1. I'll open it now. Please leave it in front of your entrance.
2. Please put it in the delivery mailbox next to the shared entrance.
3. I can't receive it right now. Please reschedule.

As described above, if there are many possible responses and the number exceeds the number that can be displayed, it is advisable to display only the top number of possible responses according to the set priority order by displaying a "Show all" button or the like, and to display and select response candidates that are not displayed upon request. Also, a "Enter text" button may be provided to allow the response to be entered as text.

In this example, in S56, the priority order is learned from time to time and updated. For example, in dwelling unit A, the above 1. is often selected, so it has the highest priority, but in dwelling unit B, the above 2. is often selected, so it has the highest priority, and in this case the display order will be different between the two.

Next, it is determined whether a candidate response has been selected (S54). The response is usually selected by input from a touch panel. If the determination in S52 is YES, a response corresponding to the selected candidate response is transmitted (S55). This response is, for example, text data, and is sent to the common entrance apparatus 11 via the master unit 22a and displayed on the monitor 115 here. Note that, although the candidate responses are displayed as text on the information terminal 4, audio data may also be stored in the memory unit 414 and sent to the common entrance apparatus 11. In this case, the selected response is output as audio in the common entrance apparatus 11.

When the response transmission in S55 is completed, the selection results of the response candidates are learned, the priority is updated (S56), and the process ends.

Here, the common entrance device 11 can convert the received response text into voice and output the voice. Also, the information terminal 4 can be in a muted state, in a two-way call state, and the information terminal 4 can input text and perform the exchange multiple times.

If the answer is NO in S52, the process moves to S48 to determine whether or not there is a response when voice is present. If there is a response in S48, then two-way communication with voice occurs in S49. On the other hand, if there is no response in S48, then the result is NO in S48 and the process ends, so if voice cannot be used, it is best to end the process without responding.

If another terminal responds during steps S50 to S53, it is considered appropriate for the other terminal to respond normally, and therefore the processing on the information terminal 4 should be terminated.

Further, in FIG. 7, only when the determination of playback with audio in S45 is NO, the message text and response candidates are displayed. However, even if the message with audio is played back (S46) when the determination in S45 is YES, the processes from displaying the message text (S50) to updating the priority order (S56) may be performed. That is, by superimposing the message on the screen on which playback with audio is being performed or displaying text on a separate screen, response candidates can be displayed, selected, sent, etc. in the same way even when there is no audio.

Furthermore, the user may be allowed to add candidate replies to a message. Figure 8 is a flowchart showing the process of adding candidate replies to a message.

First, it is determined whether maintenance has been requested (S61), and if the answer is YES, a maintenance menu is displayed (S62). This maintenance menu includes the addition of response candidates for the request.

It is determined whether adding a reply candidate has been selected (S63), and if YES, it is determined whether the subject for which a reply candidate is to be added has been selected (S64). That is, when adding a reply candidate has been selected, the types of subjects are displayed, and the user selects the subject for which a reply candidate is to be added.

When a subject is selected in S64, the user is prompted to select whether to input text or voice response candidates, and the result is determined (S65).

If text input is selected in S65, text input by the user is accepted (S67). Then, it is determined whether to perform speech conversion (S67), and if NO, the input text is registered as a response candidate for the corresponding business (S68).

If the determination in S65 is voice input, voice input (recording of voice) regarding the response candidate is accepted (S69). Then, an inquiry is made as to whether sound quality conversion is necessary, and if YES, the sound quality is converted (S70), and if NO, no sound quality conversion is performed, and response candidates for the input voice are registered (S72).

Here, in the audio conversion in S69, the recorded audio data is converted into other predetermined audio. As the predetermined voice, a male voice, a female voice, a gender-neutral voice obtained by computer voice synthesis, a voice created by a combination of pre-recorded voices, etc. can be employed.

If the judgement at S63 or S64 is NO, no response candidate is added and the process ends. If the judgement at S67 is YES, the process proceeds to S72 and the voice-changed response candidate is registered.

In this way, the added response candidate is additionally stored in the setting unit 404b in association with the selected subject. The added response candidate may be automatically set to the first priority, or may be set to any priority.

When the process in FIG. 7 is completed, an add candidate button may be displayed, allowing additional response candidates to be input.

"Effect of embodiment"
As described above, in this embodiment, when a business is input in the communal entrance device 11, a business playback button is displayed on the information terminal 4, and in response to this, the business can be heard.

The system can also interpret the voice message and convert it to text for display. This means that the visitor's message can be confirmed in text along with the visitor's video. This means that the message can be confirmed even in situations where audio output is not desirable.

Since the audio output can be turned on and off according to the settings of the manner mode, etc. as a normal state in the information terminal 4, there is no need to take the trouble of setting the audio on and off.

Furthermore, since response candidates are displayed, a response can be input without voice. In addition, regarding the selection of response candidates, an option of key input has been added, and if this option is selected, the response can also be input in text. Therefore, it is possible to respond to the communal entrance device 11 without outputting or generating sound.

In this way, the common entrance device 11 can prompt the visitor to input the type of matter, or the common entrance device 11 or the information terminal 4 can interpret the voice of the matter and determine the type of matter.

If the type of message is known, the response message types can be narrowed down to only the appropriate ones, making it easier to select a response and more convenient to use.

Furthermore, the operation of selecting a response message may be troublesome and time-consuming. Therefore, the display order (priority order) of response messages can be changed by the following means.

"Other Configurations"
7 and 8, the processing when a message is received at the information terminal 4 (processing including message playback, display of the message text, display of candidate responses, and registration of candidate responses) has been described. However, such processing in Fig. 7 and 8 can also be performed in the base unit 22a. That is, the base unit 22a can also display text and display candidate responses for selection, instead of outputting normal audio and video. Furthermore, it can also be made possible to add candidate responses as appropriate.

It analyzes and authenticates the video captured by the camera, recognizes the type of visitor's business, and outputs a response message according to the visitor's business. For example, it may be possible to recognize the delivery company based on the uniform, etc., and in this case, display the response message "please leave the package" at the top of the list. Furthermore, it is also possible to register face recognition data in advance for family members, etc., and allow the visitor to identify them using the registered data and set the priority order of response messages.

Further, the communal entrance device 11 can acquire and analyze the video and audio of the message sent, and create response message candidates. For example, when it recognizes "I'm home," it can generate "Welcome back."

Furthermore, it is also possible to allow the user to record a response message. This can be registered by voice input from the microphone of the information terminal 4, but it may also be converted to mechanical voice as a privacy measure, or text input may be converted to recorded voice or mechanical voice.

In addition, by registering a specific application on the information terminal 4, it is possible to watch recorded video and play back video and audio of the subject recorded on the common entrance device 11. Furthermore, when playback of the video and audio of the subject is completed, they can be automatically deleted on the information terminal 4 and stored on the parent unit 22a or stored for a specific period of time on the common entrance device 11.

In addition, the system will learn the results of your response message selections and can change the display order of recommended response messages based on how frequently you use them.

In this embodiment, when a visitor arrives, the common entrance device 11 automatically acquires the business information, but this function can also be turned off. In that case, a response input may be requested in response to the call. A two-way conversation may be started in response to input of a response. For example, if a family member is scheduled to return home, it is recommended to turn off acquisition of business information.

Furthermore, in this case, the display order of the list of response messages displayed on the information terminal 4 can be changed.

Although the message information has been described as including both audio and video, the message information may be audio only.

In addition, the audio and video may be of different timing as the message information. For example, the common entrance device 11 may acquire and transmit an image at a different timing from when the message was acquired, such as acquiring video without audio before the message inquiry and transmitting it to the parent unit 22a, or acquiring only video when the common entrance device 11 is outputting audio such as the voice of the message inquiry. The common entrance device 11 may constantly acquire audio and video when it detects a person using the human presence sensor 113.

Furthermore, the parts described as images are not limited to normal video images, but may be still images or a series of still images at a predetermined interval.

The present embodiment has been described on the assumption that the common entrance device 11 of a collective facility is used. However, when the system of the present disclosure is applied to a facility such as a detached house, the business information may be acquired by a device corresponding to the entrance handset 22b instead of the common entrance device 11. Furthermore, even in a collective facility, the business information may be acquired by the entrance handset 22b. That is, the entryway handset 22b can acquire business information and transmit it to the master device 22a, and the information terminal 4 can also respond to the entranceway handset 22b.

The present disclosure is further illustrated by the following embodiments.
Configuration 1: A message processing system comprising: a first terminal provided at an entrance of a facility; a second terminal provided inside the facility and capable of two-way communication with the first terminal; a memory unit that stores message information regarding a visitor's message acquired by the first terminal before the two-way communication between the first terminal and the second terminal begins; and an output unit that outputs the message information stored in the memory unit to a third terminal different from the second terminal via a public line.
Configuration 2: The message processing system described in configuration 1, wherein the memory unit and the output unit are provided in the first terminal, and the message information is output from the first terminal and then sent to the third terminal via the second terminal and the public line.
Configuration 3: The message processing system according to configuration 1 or 2, wherein the message information includes a voice of a visitor to the facility acquired at the first terminal.
Configuration 4: A message processing system described in any one of configurations 1 to 3, wherein the message information can be notified from the third terminal while the third terminal is being called in conjunction with a call from the first terminal to the second terminal.
Configuration 5: The message processing system according to configuration 4, wherein the message information can be notified from the third terminal based on an operation on the third terminal.
Configuration 6: A message processing system that processes messages in a call between a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, the message processing system comprising: the first terminal; an acquisition unit that acquires message information regarding a visitor's message acquired by the first terminal before the two-way communication with the second terminal begins; a memory unit that stores the message information acquired by the acquisition unit; and an output unit that outputs the message information stored in the memory unit to a third terminal different from the second terminal via a public line.
In configuration 6, a message processing system including any one of configurations 2 to 5.
Configuration 7: A method for controlling an information terminal capable of communicating via a public line with an intercom system including a first terminal installed at an entrance of a facility and a second terminal installed inside the facility, the method comprising the steps of: acquiring message information regarding a visitor's message acquired by the first terminal before starting a two-way call with the second terminal; and reporting the acquired message information.
Configuration 8: The method of controlling an information terminal according to configuration 7, wherein the business information includes a voice of a visitor to the facility, which is acquired by the first terminal.
Configuration 9: A method for controlling an information terminal as described in configuration 7 or 8, wherein the first terminal, when making a call to start the two-way call with the second terminal, also makes a call to the information terminal, and the notification step is executable during the call.
Configuration 10: The method for controlling an information terminal according to any one of configurations 7 to 9, wherein the notification step is made executable based on a user's operation on the information terminal.
Configuration 11: A method for controlling an information terminal according to any one of configurations 7 to 10, comprising a step of displaying a setting for enabling or disabling audio output from a speaker of the information terminal while confirming the necessity for executing the notification step or while the notification step is being executed.
Configuration 12: A method for controlling an information terminal described in any one of claims 7 to 11, further comprising setting the audio output to be enabled or disabled based on whether a silent mode in the information terminal is enabled or disabled, which sets the audio output to be enabled or disabled.
Configuration 13: The method for controlling an information terminal according to any one of configurations 7 to 12, further comprising the step of displaying reply candidates to the business information.
Configuration 14: A method for processing messages of an intercom system including a first terminal installed at an entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal,
A message processing method comprising the steps of: acquiring message information regarding a visitor's message at the first terminal before starting the two-way call between the first terminal and the second terminal; storing the acquired message information; and outputting the stored message information to a third terminal different from the second terminal via a public line.
The method for processing a message according to configuration 14, further comprising any one of configurations 2 to 5.
Configuration 15: A message processing program for an intercom including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, the message processing program causing the intercom to acquire message information regarding a visitor's message at the first terminal before the two-way communication between the first terminal and the second terminal begins, store the acquired message information, and output the stored message information to a third terminal different from the second terminal via a public line.
In configuration 15, a message processing program further including the items in configurations 2 to 5.
Configuration 16: A message processing program used in a message processing system that processes messages in a call between a first terminal installed at the entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, the message processing system acquiring message information regarding a visitor's message at the first terminal before the two-way communication between the first terminal and the second terminal begins, storing the acquired message information, and outputting the stored message information to a third terminal different from the second terminal via a public line.
In configuration 16, the message processing system further includes the items in configurations 2 to 5.
Configuration 17: A control program for an information terminal capable of communicating via a public line with an intercom system including a first terminal installed at the entrance of a facility and a second terminal installed inside the facility, the control program for the information terminal causing the information terminal to obtain message information regarding a visitor's message that the first terminal obtained before starting a two-way call with the second terminal, and to report the obtained message information.
In configuration 17, the information terminal control program further includes the items in configurations 8 to 13.

1: Intercom system 2: Communication line 4: Information terminal (third terminal)
11: Common entrance device (1st terminal)
22a: Base device (second terminal)
100: Message processing system

Claims (17)

A first terminal provided at the entrance of the facility;
A second terminal installed inside the facility and capable of two-way communication with the first terminal;
a storage unit configured to store business information regarding a business of a visitor, the business information being acquired by the first terminal before the two-way communication between the first terminal and the second terminal is started;
an output unit that outputs the business information stored in the storage unit to a third terminal different from the second terminal via a public line;
A message processing system comprising: The storage unit and the output unit are provided in the first terminal, and after the business information is output from the first terminal, it is sent to the third terminal via the second terminal and the public line. The business processing system according to claim 1. 3. The business processing system according to claim 1, wherein the business information includes a voice of a visitor to the facility acquired by the first terminal. The business processing system according to claim 1 or 2, wherein the business information can be reported from the third terminal while the third terminal is being called in response to a call from the first terminal to the second terminal. . The message processing system according to claim 4, wherein the message information can be notified from the third terminal based on an operation on the third terminal. A message processing system for processing messages in a call between a first terminal installed at an entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal,
an acquisition unit that acquires matter information regarding a matter of a visitor acquired in the first terminal before the two-way communication between the first terminal and the second terminal is started;
a storage unit that stores the task information acquired by the acquisition unit;
an output unit that outputs the business information stored in the storage unit to a third terminal different from the second terminal via a public line;
A message processing system comprising: A method for controlling an information terminal capable of communicating with an intercom system including a first terminal provided at an entrance of a facility and a second terminal provided inside the facility via a public line, comprising:
acquiring information on a visitor's business that is acquired by the first terminal before starting a two-way call with the second terminal;
a notification step of notifying the acquired business information;
The control method for an information terminal comprising the steps of: The business information includes the voice of a visitor to the facility, which is acquired by the first terminal.
The method for controlling an information terminal according to claim 7. When making a call to start the two-way communication with the second terminal, the first terminal also makes a call to the information terminal, and the notifying step is executable during the call.
A method for controlling an information terminal according to claim 7. making the notification step executable based on a user's operation on the information terminal;
The method for controlling an information terminal according to claim 7. a step of displaying a setting for enabling or disabling a sound output from a speaker of the information terminal while confirming whether or not the execution of the notification step is necessary or during the execution of the notification step;
A method for controlling an information terminal according to claim 7. setting the voice output to be valid or invalid based on the validity or invalidity of a manner mode for setting the voice output to be valid or invalid in the information terminal;
The method for controlling an information terminal according to claim 7. a step of displaying reply candidates to the business information;
A method for controlling an information terminal according to claim 7. A method for processing messages in an intercom system including a first terminal installed at an entrance of a facility and a second terminal installed inside the facility and capable of two-way communication with the first terminal, comprising:
acquiring, at the first terminal, matter information regarding a matter of a visitor before the two-way communication between the first terminal and the second terminal is started;
storing the acquired business information;
outputting the stored message information to a third terminal different from the second terminal via a public line;
A method for processing a request. A message processing program for an intercom system including a first terminal provided at an entrance of a facility and a second terminal provided inside the facility and capable of two-way communication with the first terminal,
The intercom system includes:
before the two-way communication between the first terminal and the second terminal is started, the first terminal acquires matter information related to a matter of a visitor;
storing the acquired business information;
outputting the stored message information to a third terminal different from the second terminal via a public line;
Message processing program. Used in a matter processing system that processes matters in a call between a first terminal provided at the entrance of a facility and a second terminal provided inside the facility and capable of two-way communication with the first terminal. A message processing program that
In the task processing system,
Before starting the two-way conversation between the first terminal and the second terminal, causing the first terminal to acquire business information regarding the visitor's business;
storing the acquired business information;
outputting the stored business information to a third terminal different from the second terminal via a public line;
A message processing system equipped with. A control program for an information terminal capable of communicating via a public line with an intercom system including a first terminal provided at the entrance of a facility and a second terminal provided inside the facility,
To the information terminal,
causing the first terminal to acquire business information regarding the visitor's business acquired before starting a two-way conversation with the second terminal;
Announce the acquired business information;
Information terminal control program.

Images