CN113923304A

CN113923304A - Communication terminal device, control device, communication control method, and control storage medium

Info

Publication number: CN113923304A
Application number: CN202110770024.5A
Authority: CN
Inventors: 三谷昌达
Original assignee: Sharp Corp
Current assignee: Sharp Corp
Priority date: 2020-07-08
Filing date: 2021-07-06
Publication date: 2022-01-11
Also published as: JP2022015268A; US20220014625A1

Abstract

The communication terminal device includes at least one control device and at least one communication device, the control device executes the following processing: an identification process of identifying an attribute of another communication terminal device, which is capable of communicating with the own communication terminal device and to which an attribute is set; and a transmission process of transmitting a call request to the other communication terminal devices identified as having a second attribute different from a first attribute set in the communication terminal device, via the communication devices, respectively, without transmitting a call request to the other communication terminal devices identified as having the first attribute.

Description

Communication terminal device, control device, communication control method, and control storage medium

Technical Field

The invention relates to a communication terminal device, a control device, a communication control method and a control storage medium.

Background

Calls using communication terminal devices are widely performed in various scenes, and methods of performing various call controls according to the use have been developed. For example, japanese patent application laid-open No. 11-298608 discloses a control system for calling all telephones in a group including a particular telephone when the telephone does not respond when an extension call is made from the particular telephone to another telephone in an extension call system using a push-button telephone.

Disclosure of Invention

Recently, there has been a demand for a person to be treated to avoid face-to-face contact and a person to be treated when global spread of virus infection is triggered.

For example, in the front desk of a conventional hotel, a plurality of customers are generally dealt with by a plurality of responders (receptionists), but in such a system, there is a possibility that the customers may be infected by a face-to-face treatment, and thus there is a demand for a non-face-to-face treatment.

Here, if a control system is introduced, for example, in japanese patent application laid-open No. 11-298608, and a customer makes an intercom call with a person in charge via a telephone set provided at a front desk, it is possible to avoid the customer and the person in charge from facing each other and to take a response. However, since the extension telephone can communicate with a department other than the person in charge, there is a possibility that the customer may be confused by making a wrong call to another department.

In addition, it is possible to use a communication terminal device such as a general mobile phone instead of the intercom system, and to cope with the non-face. However, in this case, the communication terminal device provided may be used for communication with an unintended person.

An object of one embodiment of the present invention is to realize a communication terminal device or the like that allows a responder to easily respond to a responder in a non-face-to-face manner and that is not easily used for unintended applications.

In order to solve the above problem, a communication terminal apparatus according to an aspect of the present invention includes at least one control apparatus and at least one communication apparatus, the control apparatus executing: an identification process of identifying an attribute of each of other communication terminal apparatuses which can communicate with the own apparatus and to which an attribute is set; and a transmission process of transmitting a call request via the communication device to each of the other communication terminal devices identified as a second attribute different from a first attribute set in the own device, and not transmitting a call request to the other communication terminal device identified as the first attribute.

In order to solve the above-described problem, a control device according to one aspect of the present invention is a control device that controls an operation of a communication terminal device, is capable of communicating with the communication device, and includes an identification unit that identifies attributes of other communication terminal devices to which the attributes are set, respectively; and a transmission control unit that transmits a call request to each of the other communication terminal devices identified as having a second attribute different from the first attribute set in the communication terminal device, and does not transmit a call request to the other communication terminal device identified as having the first attribute.

In order to solve the above-described problem, a communication control method according to an aspect of the present invention is a communication control method for controlling communication between a plurality of communication terminal devices each having an attribute set therein, by any one of the communication terminal devices or by an information processing device capable of communicating with the communication terminal device, the method including an identification step of identifying the attributes of the plurality of communication terminal devices; and a transmission step of, when a communication terminal device of a transmission source of a call request among the plurality of communication terminal devices is identified as a first attribute, transmitting the call request to each of the communication terminal devices identified as a second attribute different from the first attribute, wherein the transmission step does not transmit the call request to the communication terminal device identified as the first attribute.

According to one embodiment of the present invention, the person to be responded can easily be responded to by the person to be responded in a non-face-to-face manner. Further, the communication terminal device according to one embodiment of the present invention is difficult to be used for unintended applications.

Drawings

Fig. 1 is a block diagram showing an example of a configuration of a main part of a communication terminal apparatus according to a first embodiment of the present invention.

Fig. 2 is a diagram showing an outline of a communication system according to an embodiment of the present invention.

Fig. 3 is a diagram showing an example of device management information.

Fig. 4 is a diagram showing an example of a transmission operation reception screen displayed by the communication terminal apparatus.

Fig. 5 is a flowchart showing an example of a process from the setting of the operation mode of the communication terminal apparatus to the registration of a communication partner.

Fig. 6 is a flowchart showing an example of processing executed by the communication terminal apparatus at the time of transmission.

Fig. 7 is a flowchart showing an example of processing executed when the communication terminal apparatus receives a call request.

Fig. 8 is a diagram showing an example of a process for automatically transmitting a call request from a communication terminal device in client mode upon detection of an artificial chance.

Fig. 9 is a schematic diagram showing call control in a communication system according to a second embodiment of the present invention.

Detailed Description

[ first embodiment ]

(System constitution)

Fig. 2 is a diagram showing an outline of a communication system according to an embodiment of the present invention. As shown in the figure, the communication system includes communication terminal devices 1a to 1c operating in a client mode (first attribute); communication

terminal devices

1A and 1B operating in the host mode (second attribute). Hereinafter, when it is not necessary to distinguish the communication terminal devices 1A to 1c, 1A, and 1B, only the communication terminal device 1 will be described. As described above, in the communication terminal apparatus 1, either one of the attributes, i.e., the client mode or the host mode, is set, and processing according to the set attribute is performed.

In the illustrated example, the communication terminal device 1A is a robot-type communication terminal device, and the

communication terminal devices

1B, 1c, 1A, and 1B are all smartphones. Of course, these are merely examples, and any communication terminal device can be applied as long as it can be used for a call of any system. The number of communication terminal apparatuses included in the communication system is not limited to the illustrated example, as long as it is a plurality of communication terminal apparatuses.

The communication terminal apparatus 1 operating in the client mode performs group transmission (dialing) to the communication terminal apparatus 1 operating in the host mode. The group transmission means that a plurality of communication terminal apparatuses 1 simultaneously make a call request. The communication terminal apparatus 1 that receives the group transmission notifies the incoming call by sound, light, vibration, or a combination of these. In the communication terminal apparatus 1, the party that has first performed the receiving operation and the communication terminal apparatus 1 of the transmission source are in a state of being able to communicate with each other. For example, when the communication terminal device 1A transmits a call request, the call request is a group transmission to which both the communication

terminal devices

1A and 1B operating in the master mode are to be transmitted.

Further, the communication terminal device 1 operating in the client mode does not transmit a communication request to the other communication terminal devices 1 operating in the client mode. For example, the communication terminal device 1a operates in the client mode, and therefore, a communication request is not transmitted to the communication

terminal devices

1b and 1c that also operate in the client mode. Therefore, the communication

terminal devices

1a and 1b and 1a and 1c do not become a state in which a call can be made.

On the other hand, the communication terminal device 1 operating in the host mode can transmit a communication request to the communication terminal device 1 operating in the client mode. When the communication terminal apparatus 1 receives the communication request, it is in a state in which a call can be made via the communication terminal apparatus 1. For example, as shown in the figure, if the communication terminal apparatus 1B operating in the master mode is used, it is possible to make a call with the communication terminal apparatus 1c, and similarly, it is also possible to make a call with the

communication terminal apparatuses

1a and 1B. Further, when the communication terminal apparatus 1B is used, it is possible to make a call with the communication terminal apparatus 1A operating in the master mode, similarly to the own apparatus.

According to such a communication system, for example, in the customer service industry, the medical institution, or the like, it is possible to easily implement a non-face-to-face response. For example, customers of a hotel may use the communication terminal devices 1A to 1c, and the responders of the hotel may use the

communication terminal devices

1A and 1B.

In this case, when the customer has a person who deals with in the event, the customer transmits the information to the group of communication

terminal devices

1A and 1B using any one of the communication terminal devices 1A to 1c, and can speak with any person who deals with by using any one of them. Further, since no call request is transmitted between the communication terminal devices 1a to 1c, no undesired call is made between customers. Further, the person who deals with the communication can also use the

communication terminal device

1A or 1B to communicate with a specific customer or other person who deals with the communication.

(device constitution)

The configuration of the communication terminal apparatus 1 will be described in detail with reference to fig. 1. Fig. 1 is a block diagram showing an example of a main part configuration of a communication terminal apparatus 1. As shown in the drawing, the communication terminal apparatus 1 includes: a control unit 10, a storage unit 11, a communication unit 12, a display unit 13, an input unit 14, and an imaging unit 15. The storage unit 11, the communication unit 12, the display unit 13, the input unit 14, and the imaging unit 15 may be provided outside the communication terminal device 1. The communication terminal device 1 includes, in addition to the illustrated modules, a voice input unit that receives a voice input from a user of the communication terminal device, a voice output unit that outputs a voice, and the like.

The control unit 10 comprehensively controls each unit of the communication terminal apparatus 1. The control unit 10 includes a mode setting unit 101, a local ID generation unit 102, a device search unit 103, a device registration unit 104, a mode recognition unit 105, a display control unit 106, a transmission control unit 107, a reception control unit 108, and a person detection unit 109. The functions of these units can be realized by using an arbitrary control device such as one or more CPUs (Central Processing units).

The storage unit 11 stores various data used by the communication terminal apparatus 1, and in the example of fig. 1, the device management information 111 is stored in the storage unit 11. The function of the storage unit 11 can be realized by one or more arbitrary storage devices. The communication unit 12 is a device for causing the communication terminal device 1 to communicate with another device (specifically, another communication terminal device 1), and the function of the communication unit 12 can be realized by one or a plurality of arbitrary communication devices.

The display unit 13 displays an image, and the function of the display unit 13 can be realized by an arbitrary display device. The input unit 14 is used for the communication terminal device 1 to receive the input operation by the user. For example, when the communication terminal device 1 has a touch panel, the functions of the display unit 13 and the input unit 14 are realized by the touch panel. The imaging unit 15 can capture images such as moving images and still images, and the function of the imaging unit 15 can be realized by an arbitrary imaging device such as a camera.

The mode setting unit 101 sets an operation mode of the device. As described above, the operation mode set by the mode setting unit 101 is either the client mode or the host mode. The operation mode may be set by any method. For example, the mode setting unit 101 may set the operation mode according to a selection by the user of the device.

For example, when the functions of the control unit 10 are realized by installing application software (hereinafter, simply referred to as "application") in the communication terminal device 1, an application for the client mode and an application for the host mode may be prepared separately. In this case, the mode setting unit 101 in the application for client mode sets the operation mode of the application itself to client mode, and the mode setting unit 101 in the application for host mode sets the operation mode of the application itself to host mode.

The local ID generation unit 102 generates a local device ID. The id (identification) is identification information for identifying the communication terminal apparatus 1 from the other communication terminal apparatus. The local ID generation unit 102 may generate a device ID including information indicating the local operation mode set by the mode setting unit 101. In this case, the device ID is information for identifying the own device, and is also information indicating an operation mode of the own device. An example of the device ID will be described later based on fig. 3.

The device search unit 103 searches for another communication terminal apparatus 1 that can communicate with the device itself. For example, it is assumed that each communication terminal apparatus 1 performs communication via a common network (for example, a local area network). In this case, the device search unit 103 may detect a device with a predetermined device ID set therein as the communication terminal apparatus 1 from among devices connected to the network connected to the device.

The device registration unit 104 registers the other communication terminal apparatus 1 capable of communicating with the own apparatus in the device management information 111. As described above, since the device search unit 103 detects another communication terminal apparatus 1 that can communicate with the own apparatus, the device registration unit 104 registers the communication terminal apparatus 1 detected by the device search unit 103.

The pattern recognition unit 105 recognizes the attributes of the own device and the other communication terminal devices 1. More specifically, the pattern recognition unit 105 recognizes whether the operation pattern of the own communication terminal apparatus and the other communication terminal apparatuses 1 is the client mode or the host mode. For example, the pattern recognition unit 105 may recognize the operation pattern of each communication terminal apparatus 1 by referring to the device management information 111, which will be described in detail later.

The display control unit 106 causes the display unit 13 to display an image. For example, the display control unit 106 causes the display unit 13 to display a UI (User Interface) screen when the User of the own device performs a transmission operation of a call request.

The transmission control unit 107 performs transmission processing for transmitting a call request via the communication unit 12. The function of the transmission control unit 107 differs depending on the operation mode of the own device. Specifically, when the own communication terminal apparatus is in the client mode, the transmission control unit 107 transmits a call request to each of the other communication terminal apparatuses 1 which the mode recognition unit 105 recognizes as the master mode. That is, the transmission control unit 107 performs group transmission to each communication terminal apparatus 1 in the master mode. Further, when the own communication terminal apparatus is in the client mode, the transmission control unit 107 does not transmit a call request to another communication terminal apparatus 1 which the pattern recognition unit 105 recognizes as the client mode.

On the other hand, when the own communication terminal apparatus is in the master mode, the transmission control unit 107 transmits a call request to one of the other communication terminal apparatuses 1 designated by the own user. That is, when the host device is in the master mode, the transmission control unit 107 transmits to the designated one communication terminal apparatus 1 regardless of the operation mode of the transmission destination.

When the own device receives a call request, the reception control unit 108 performs a reception process of starting a call with the communication terminal device of the transmission source of the call request. The function of the reception control unit 108 differs depending on its own operation mode. Specifically, when the local device is in the client mode, if the human detection unit 109 detects a human in the vicinity of the local device when a call request is received, the reception control unit 108 starts a call regardless of the operation of the local user. On the other hand, when the host device is in the master mode, the reception control unit 108 starts a call in response to a reception operation by the user of the host device. Further, a function of starting a call that is not related to a receiving operation by the user is not necessarily required, and a call may be started with the receiving operation by the user as a trigger in any operation mode.

The person detection unit 109 detects persons around the device. Here, the surrounding means a range of a degree to which a call can be made through the local device, and is, for example, a range within several meters from the local device. Specifically, the person detection unit 109 detects a person by analyzing the image of the periphery of the device captured by the image capture unit 15. As a method of detecting a person, any method can be applied, and the method is not limited to this example. For example, an infrared sensor or the like may be used to detect a person. Further, the human detection unit 109 may be omitted when control based on the result of human detection is not necessary.

The device management information 111 is information for managing each communication terminal apparatus 1 that can communicate with the own apparatus. As described above, the device registration unit 104 registers each communication terminal apparatus 1 that can communicate with the own apparatus in the device management information 111. Further, information indicating the operation mode of each communication terminal apparatus 1 is also registered in the device management information 111. Details of the device management information 111 will be described later based on fig. 3.

(example of device management information)

Fig. 3 is a diagram showing an example of the device management information 111. More specifically, fig. 3 shows device management information 111A stored in the communication terminal apparatus 1A in the client mode and device management information 111A stored in the communication terminal apparatus 1A in the host mode.

The device management information 111a stores an ID (identification information) such as "Spe _021_ yy" as the own ID of the communication terminal apparatus 1 a. Further, the device ID ("Nor _001_ xyz", "Nor _032_ xxx", "Spe _987_ zz") of the communication terminal apparatus 1 detected by the communication terminal apparatus 1a (more specifically, the device search unit 103) is stored as the detection device ID.

The character string "Spe" contained in these device IDs represents client mode. Further, a character string "Nor" contained in these device IDs indicates the host mode. Therefore, a device ID such as "Spe _021_ yy" of the communication terminal apparatus 1a indicates that the communication terminal apparatus 1a is in the client mode. Thus, by including predetermined information in the device ID, the device search unit 103 can detect the communication terminal apparatus 1 as a candidate of a call target based on the information.

The pattern recognition unit 105 of the communication terminal apparatus 1a can recognize the operation pattern of the own apparatus and the operation pattern of the other communication terminal apparatuses 1 by referring to the device management information 111 a. The transmission control unit 107 of the communication terminal apparatus 1a can perform transmission control based on the recognition result of the operation pattern by the pattern recognition unit 105.

As described above, for example, the pattern recognition unit 105 referring to the device management information 111a of fig. 3 recognizes the own device as the client pattern. The mode recognition unit 105 recognizes "Nor _001_ xyz" and "Nor _032_ xxx" of the 3 detected communication terminal apparatuses 1 as the master mode, and recognizes "Spe _987_ zzz" as the client mode.

At this time, when a transmission operation is performed on the communication terminal device 1a, the transmission control unit 107 performs group transmission to both of "Nor _001_ xyz" and "Nor _032_ xxx". On the other hand, the transmission control unit 107 does not transmit to "Spe _987_ zzz". In this way, since the device ID of the communication terminal apparatus 1 in the client mode is not transmitted to the communication terminal apparatus 1 in the client mode, the device ID of the communication terminal apparatus 1 in the client mode does not have to be registered in the device management information 111 a.

On the other hand, in the device management information 111A, "Nor _001_ xyz" is stored as the own ID, and "Nor _032_ xxx", "Spe _21_ yy", and "Spe _987_ zzz" are stored as the detection device ID. Therefore, the pattern recognition unit 105 of the communication terminal apparatus 1A recognizes that the own apparatus is in the master mode. In addition, among the detected 3 communication terminal apparatuses 1, "Nor _032_ xxx" is recognized as the master mode, and "Spe _021_ yy" and "Spe _987_ zzz" are recognized as the client mode.

In this case, the transmission control unit 107 of the communication terminal device 1A can transmit to any one of "Nor _032_ xxx", "Spe _21_ yy", and "Spe _987_ zzz". Thus, by using the

device management information

111A and 111A shown in fig. 3, the transmission control shown in fig. 2 can be performed.

The device management information 111 is not limited to the example shown in fig. 3 as long as it is a data structure capable of identifying the operation mode of each communication terminal apparatus 1. For example, the device management information 111 may have a data structure in which information indicating an operation mode of the communication terminal apparatus 1 is associated with the device ID of the communication terminal apparatus 1. In this case, it is not necessary to include information indicating the operation mode in the device ID.

(example of reception Screen for Transmission operation)

As described above, the communication terminal apparatus 1 differs in the transmission destination depending on whether it is in the client mode or the host mode. Therefore, the communication terminal device 1 preferably differs the reception screen of the transmission operation between the client mode and the host mode.

Fig. 4 is a diagram showing an example of a transmission operation reception screen displayed by the communication terminal apparatus 1. More specifically, fig. 4 shows an example of a transmission operation acceptance screen displayed by the communication terminal device 1b in the client mode and an example of a transmission destination selection screen displayed by the communication terminal device 1A in the host mode.

An object X including a character "send" is displayed on the reception screen of the communication terminal device 1b shown in fig. 4. Further, a message M1 for prompting an input operation to the object X is displayed on the reception screen. By displaying such an acceptance screen, the user of the communication terminal apparatus 1b can easily understand the operation required for the call using the communication terminal apparatus 1 b.

Further, if the transmission control unit 107 is configured to perform group transmission to the communication terminal apparatus 1 in the host mode upon an input operation to the object X, the user can perform group transmission by one key. For example, if the communication terminal device 1b displaying such a reception screen is installed in the foreground of a business or the like, and the communication terminal device 1 in the host mode can be carried by each person who can deal with the visitor, smooth handling of the visitor can be realized in a non-face-to-face manner.

On the other hand, on the reception screen of the communication terminal device 1A shown in fig. 4, a list L of communication terminal devices 1 that are candidates of transmission destinations is displayed. The communication terminal apparatus 1 included in the list L is a device which can communicate with the communication terminal apparatus 1A detected by the device search unit 103. Further, a message M2 for prompting an operation for selecting a destination is displayed on the reception screen. By displaying such a selection screen, the user of the communication terminal device 1A can select a desired communication terminal device 1 and smoothly perform an operation of transmitting to the communication terminal device 1.

In the selection screen of the communication terminal apparatus 1A in fig. 4, the name of the communication terminal apparatus 1 is displayed instead of the device ID as in the device management information 111A in fig. 3. In the case of displaying such a name, a desired name may be registered in advance in association with the device ID.

(flow of processing: setting of own machine mode to registration)

A process flow in which the communication terminal apparatus 1 sets the operation mode of the own apparatus and registers another communication terminal apparatus 1 as a communication target will be described with reference to fig. 5. Fig. 5 is a flowchart showing an example of processing from the setting of the operation mode of the communication apparatus to the registration of the communication partner. The processing in fig. 5 may be performed at any timing before the call is made using the communication terminal apparatus 1. For example, in the communication terminal apparatus 1, the processing of fig. 5 may be performed when an application for realizing each function of the control unit 10 is first started.

In S1, the mode setting unit 101 sets the operation mode of the device. For example, the mode setting unit 101 may cause the user to select the operation mode by displaying a screen or the like presenting selection of any one of the host mode and the client mode on the display unit 13.

In S2, the local ID generation unit 102 determines whether the host mode or the client mode is set in S1. Here, if it is determined that the host mode is set (yes in S2), the process proceeds to S3, and if it is determined that the client mode is set (no in S2), the process proceeds to S6.

In S3, the local ID generation unit 102 generates a local ID for the host mode, and stores the local ID in the device management information 111. As described with reference to fig. 3, the local ID for the host mode includes information indicating that the host mode is the host mode. In addition, instead of generating the own ID including the information indicating the master mode, the own ID generation unit 102 may store the information indicating the master mode in association with the generated own ID.

In S4, the device search unit 103 searches for another communication terminal apparatus 1 that can communicate with the own apparatus. The search targets are both the communication terminal device 1 in the host mode and the communication terminal device 1 in the client mode. For example, the device search unit 103 may detect, as the communication terminal apparatus 1, a device in which a device ID of the host mode or the client mode is set from among devices connected to a local area network connected to the communication terminal apparatus.

In S5, the device registration unit 104 registers each communication terminal apparatus 1 detected in S4 in the device management information 111, thereby ending the processing of fig. 5. Specifically, in S5, the device registration unit 104 stores the device ID of the communication terminal apparatus 1 detected in S4 as the detected device ID of the device management information 111 (see fig. 3). The device registration unit 104 may notify the communication terminal apparatus 1 storing the device ID of the own device ID and store the own device ID.

In S5, it is not necessary to register all communication terminal apparatuses 1 detected in S4. For example, the device registration unit 104 may display a list of the detected communication terminal apparatuses 1 on the display unit 13, and register only the communication terminal apparatus 1 selected by the user of the device.

In S6, the local ID generation unit 102 generates a local ID for the client mode, and stores the local ID in the device management information 111. As described with reference to fig. 3, the local ID for the client mode includes information indicating that the client mode is the client mode. In addition, instead of generating a local ID including information indicating that the local ID is in the client mode, the local ID generation unit 102 may store information indicating that the local ID is in the client mode in association with the generated local ID.

In S7, the device search unit 103 searches for another communication terminal apparatus 1 that can communicate with the own apparatus. The search target is the communication terminal apparatus 1 of the host mode. Then, the process proceeds to S5, and each communication terminal apparatus 1 detected in S7 is registered in the device management information 111 by the device registration section 104. Further, as in S5 performed after S4, it is not necessary to register all communication terminal devices 1 detected in S7.

As described above, in the communication system using the communication terminal apparatuses 1, it is possible to realize a non-face-to-face response by a simple operation of registering the device ID in each communication terminal apparatus 1 without introducing the extension system as in the conventional technique described above.

(addition of communication terminal device)

As described above, after registering the communication terminal apparatus 1 in the device management information 111, the communication terminal apparatus 1 can be added. In the case where a plurality of master mode communication terminal apparatuses 1 are registered, one of them (for example, the apparatus initially registered or the apparatus designated by the user) may be used as the master, and the other may be used as the slave, and the master may manage the respective slaves.

In this case, the master of the communication terminal apparatus 1 in the master mode may detect another communication terminal apparatus 1 in the master mode by the device search unit 103, and register the detected communication terminal apparatus 1 in the device management information 111 by the device registration unit 104. In this case, the master transmits the own ID to the registered communication terminal apparatus 1 and registers the own ID.

In addition, when a new communication terminal apparatus 1 is added as a slave unit of the master unit mode, the user of the new communication terminal apparatus 1 may detect the communication terminal apparatus 1 which is the master unit and is the master unit through the device search unit 103, and register the detected communication terminal apparatus 1 in the device management information 111 through the device registration unit 104. In this case, the slave unit transmits the own ID to the master unit and registers the own ID.

(flow of processing: sending time)

A flow of processing (communication control method) executed by the communication terminal apparatus 1 at the time of transmission is described based on fig. 6. Fig. 6 is a flowchart showing an example of processing executed by the communication terminal apparatus 1 at the time of transmission. Since the processing after transmission is the same as the general call control, the processing up to transmission is shown in fig. 6.

In S11 (recognition step), the pattern recognition unit 105 refers to the device management information 111 and recognizes the operation pattern of each communication terminal apparatus 1 that can communicate with the own apparatus. Before the processing of S11, the device search unit 103 may search for a device and the device registration unit 104 may register each detected communication terminal apparatus 1 in the device management information 111. This enables transmission of a call request with the device management information 111 set to the latest state.

In S12, the pattern recognition unit 105 determines whether or not the host computer is in the master mode. Here, if it is determined that the host mode is the host mode (yes in S12), the process proceeds to S13. On the other hand, if it is determined to be the client mode (no in S12), the process proceeds to S16.

In S13, the display control unit 106 causes the display unit 13 to display a destination selection screen. The screen may be a screen displayed on the communication terminal device 1A in fig. 4. In this case, the display control unit 106 may display the name, ID, and the like of each communication terminal apparatus 1 registered in the device management information 111 as candidates of the transmission destination.

In S14, the transmission control unit 107 receives a selection operation of a transmission destination via the input unit 14. Then, in S15, the transmission control unit 107 transmits a call request to the selected destination. Then, if a reception operation is performed at the transmission destination, a call state is entered.

In S16, the display control unit 106 causes the display unit 13 to display a screen for accepting the transmission operation. The screen may be a screen displayed on the communication terminal apparatus 1b in fig. 4. Next, in S17, the transmission control unit 107 receives a transmission operation via the input unit 14. When the reception screen displayed in the communication terminal device 1b of fig. 4 is displayed, the input operation to the object X is a transmission operation.

In S18 (transmission step), the transmission control unit 107 transmits a call request to each of the communication terminal devices 1 in the master mode. Specifically, the transmission control unit 107 transmits a call request to each of the communication terminal apparatuses 1 registered in the device management information 111, the communication terminal apparatuses 1 each having a device ID indicating the master mode. In S18, the transmission control unit 107 does not transmit a call request to the communication terminal device 1 in client mode. When a receiving operation is performed in any of the communication terminal apparatuses 1 in the master mode, a communication with the communication terminal apparatus 1 is enabled.

(procedure of treatment: at the time of reception)

A flow of processing executed by the communication terminal apparatus 1 when receiving a call request is described based on fig. 7. Fig. 7 is a flowchart showing an example of processing executed by the communication terminal apparatus 1 when receiving a call request. Since the processing after the call start is the same as the general call control, only the processing until the call start is shown in fig. 7.

In S21, the pattern recognition unit 105 refers to the device management information 111 to recognize the operation pattern of the own device. Then, in S22, the pattern recognition unit 105 determines whether or not the own device is in the master mode. Here, if it is determined as the host mode (yes in S22), the process proceeds to S23. On the other hand, when it is determined to be the client mode (no in S22), the process proceeds to S25.

In S23, the reception control unit 108 determines whether or not the reception operation has been accepted. Here, when determining that the reception operation has been accepted (yes in S23), the reception controller 108 proceeds to the process of S24, and starts a call with the communication terminal device 1 that has transmitted the call request. On the other hand, if the reception operation cannot be confirmed (no in S23), the reception operation is continuously waited for. If the call request is terminated before the determination of yes in S23, the process is terminated without starting the call.

At S25, the person detection unit 109 determines whether or not there is a person around the own vehicle based on the image of the surroundings of the own vehicle captured by the imaging unit 15. If it is determined that there is a person (yes in S25), the process proceeds to S24, and the reception controller 108 starts a call.

On the other hand, if it is determined that there is no person (no in S25), the determination of S25 is performed again after a predetermined time. If the call request is terminated before the determination of "yes" in S25, the process is terminated without starting the call.

As described above, when a call request is received from another communication terminal apparatus 1 in the master mode, the communication terminal apparatus 1 in the client mode may execute a reception process for starting a call with the other communication terminal apparatus 1 without being operated by the user of the communication terminal apparatus. This enables the user of the communication terminal device 1 in the client mode to start a call with the user of the communication terminal device 1 in the host mode without any operation.

In the example of fig. 7, the reception is automatically performed on the condition that there is a person around the communication terminal apparatus 1 in the client mode, but the reception may be automatically performed without confirming the presence or absence of the person. For example, in the case where the user of the communication terminal device 1 in the client mode is a hospital inpatient and cannot move from the bed, if the communication terminal device 1 is set in advance at the bedside, the user is always in the vicinity of the communication terminal device 1, and therefore, it is not necessary to check whether or not there is a person. With this configuration, for example, a medical staff such as a doctor or a nurse can easily make a call, transfer, or the like to a patient using the communication terminal device 1 in the master mode.

In the communication terminal apparatus 1 of the master mode, when the person detection unit 109 detects a person at the time of receiving a call request, the reception process may be executed. Such a configuration can be applied to a case where a person or the like is not always disposed at the installation location of the host mode communication terminal device 1. For example, if the communication terminal device 1 in the host mode is installed at a plurality of locations where the responder is performing a service, the responder can smoothly start a call with the responder through the communication terminal device 1 at the location where the responder is located when receiving a call request from the responder.

(automatic transmission from communication terminal device in client mode)

The transmission processing of the call request from the communication terminal apparatus 1 in the client mode may be automatically performed without any operation by the user. This is explained based on fig. 8. Fig. 8 is a diagram showing an example of a process of automatically transmitting a call request from the communication terminal apparatus 1 in the client mode when human detection is triggered.

In the example of fig. 8, the robot-type communication terminal device 1a detects a visitor. Then, the communication terminal device 1A outputs a predetermined response message M3 in voice form when the visitor is detected, and performs group transmission to the

communication terminal devices

1A and 1B in the host mode. In this case, the communication terminal device 1a performs the detection of a person in the same manner as S25 in fig. 7, and then performs the processing of S11, S12, and S18 in fig. 6.

Thus, when either of the

communication terminal apparatuses

1A and 1B receives a call and performs a reception operation, the communication terminal apparatus 1A can communicate with the other communication terminal apparatus performing the reception operation. Therefore, the visitor can start the user session with the

communication terminal apparatus

1A or 1B via the communication terminal apparatus 1A only by approaching the communication terminal apparatus 1A.

In the example of fig. 8, the users of both

communication terminal apparatuses

1A and 1B communicate with the visitor via the same communication terminal apparatus 1A. Therefore, the communication terminal apparatus 1A can also convert and output the voice of the users of the

communication terminal apparatuses

1A and 1B. For example, the communication terminal apparatus 1A may convert the voice quality of the voice of the users of the

communication terminal apparatuses

1A and 1B to a voice quality close to the voice uttered by the own apparatus and output the voice. Thus, it is the users of the

communication terminal apparatuses

1A and 1B that actually make a call, but the visitor can be given the impression that they are speaking with the robot.

The communication terminal apparatus 1 in the client mode may automatically transmit a call request when the distance between the own apparatus and the user of the own apparatus is approaching, that is, the distance between the own apparatus and the user becomes shorter with the elapse of time. In this case, the communication terminal apparatus 1 may detect that the user is approaching by analyzing the image captured by the image capturing unit 15. According to this configuration, even if someone is already around the communication terminal device 1 in the client mode, the group transmission is automatically performed when another person approaches the communication terminal device 1 in the client mode, and therefore, the communication terminal device is suitable for the response of the foreground or the like.

Further, the communication terminal apparatus 1 in the client mode may automatically transmit a call request when the distance between the communication terminal apparatus and the user of the communication terminal apparatus approaches a threshold value or less. This is useful when, for example, a patient in a hospital contacts a healthcare practitioner who carries the communication terminal device 1 in the host mode using the communication terminal device 1 in the client mode. This is because, according to this configuration, when the patient wants to contact the healthcare professional due to a sudden change in physical condition or the like, the communication terminal apparatus 1 in the client mode can transmit the call request without any operation.

Further, the communication terminal apparatus 1 in the client mode may automatically transmit a call request when no person is detected for a predetermined time around the apparatus. In this case, when the communication terminal device 1 in the host mode receives the call request, the communication terminal device 1 in the client mode outputs a predetermined message, for example, a message indicating that no one is present around.

Specifically, the communication terminal device 1 in the client mode may be configured such that the person detection unit 109 determines whether or not a person is present at a predetermined cycle. Further, the transmission control unit 107 may be configured to perform group transmission to each communication terminal device 1 in the master mode when the determination result of the human detection unit 109 indicates that no human exists around the communication terminal device for a predetermined time period. This configuration can be used for monitoring the subject person, for example.

In addition, the communication terminal device 1 in the client mode may detect the occurrence of a predetermined event by analyzing the image captured by the image capturing unit 15, and automatically transmit a call request. For example, when the communication terminal apparatus 1 in the client mode is set in a hospital room or the like, a sudden change in the body of the patient may be detected by image analysis, and a call request may be automatically transmitted. For such detection, for example, a learned model constructed by machine learning using images of patients in various states as training data may be applied.

(switching of operation mode)

The mode setting unit 101 may switch the operation mode according to a user operation or the like to the own device after setting the operation mode to the client mode or the host mode. Thus, for example, when the communication terminal apparatus 1 in the client mode fails or becomes insufficient, the communication terminal apparatus 1 in the host mode may be switched to the client mode instead of the failed device.

However, when the communication terminal device 1 in the client mode can be freely switched to the host mode, it becomes possible to freely talk with the communication terminal device 1 in the other client mode. Therefore, when switching the communication terminal device 1 from the client mode to the host mode, it is preferable to limit the users who can perform the switching by performing authentication or the like by a password or the like.

[ second embodiment ]

Other embodiments of the present invention will be described below. For convenience of explanation, members having the same functions as those described in the above embodiments are given the same reference numerals, and the explanation thereof will not be repeated.

In the present embodiment, an example in which the server 3 performs call control between the communication terminal apparatuses 1 will be described. Fig. 9 is a diagram showing an outline of call control in the communication system according to the present embodiment. The server 3 is an information processing device that performs packet processing of each communication terminal device 1 and communication control between the communication terminal devices 1. The information processing apparatus may also be referred to as a computer.

The server 3 includes a control unit, a storage unit, a communication unit, and the like as in the communication terminal device 1, and these functions can be realized by one or more control devices, storage devices, communication devices, and the like. The server 3 executes a communication control method described below, thereby realizing call control similar to that of the first embodiment.

In the communication system of the present embodiment, each communication terminal device 1 in the host mode and the client mode is registered in the server 3. Specifically, the server 3 may store the device IDs of the communication terminal apparatuses 1 in association with each other for a group of the communication terminal apparatuses 1 in the host mode and the client mode. In addition, when the device ID does not include information indicating the operation mode, the information indicating the operation mode may be stored in association with each other.

An example of transmission of a call request from the communication terminal device 1a in the client mode is shown on the upper side of fig. 9. The transmission control unit 107 of the communication terminal apparatus 1a transmits a call request when a predetermined condition, such as reception of a transmission operation by a user of the communication terminal apparatus or detection of people around the communication terminal apparatus, is satisfied. The transmission destination of the call request is the server 3. The transmission control unit 107 also transmits the own ID recognized by the pattern recognition unit 105 together with the call request.

The control device of the server 3 that has received the call request and the own ID of the communication terminal device 1a specifies the communication terminal device 1 associated with the own ID from among the communication terminal devices 1 registered in advance. Further, the control device of the server 3 may perform a device search when receiving a call request, and may identify the detected communication terminal device 1 as a candidate for the communication destination of the communication terminal device 1 a.

Next, the control device of the server 3 recognizes the operation mode of each communication terminal device 1 thus determined (recognition step), and specifies all the communication terminal devices 1 in the master mode among the communication terminal devices 1. In the example of fig. 9, it is assumed that the

communication terminal apparatuses

1A and 1B are determined as the communication terminal apparatus 1 of the host mode.

The control device of the server 3 of the host mode

communication terminal devices

1A and 1B registered in association with the client mode communication terminal device 1A is specified, and group transmission is performed to these

communication terminal devices

1A and 1B (transmission step).

When a receiving operation is performed by either one of the

communication terminal apparatuses

1A and 1B, the control device of the server 3 sets the communication terminal apparatus that has performed the receiving operation among the

communication terminal apparatuses

1A and 1B and the communication terminal apparatus 1A to a state in which a call can be made.

Through the above processing, as in the first embodiment, the transmission from the communication terminal apparatus 1 in the client mode can be a group transmission for all the communication terminal apparatuses 1 in the host mode.

Fig. 9 shows an example in which a call request is transmitted from the communication terminal device 1A in the host mode to the communication terminal device 1A in the client mode on the lower side. Although not shown, the communication terminal apparatus 1A in the master mode notifies the server 3 of the own ID before transmission, and acquires the device ID of each communication terminal apparatus 1 grouped with the communication terminal apparatus 1A from the server 3.

The transmission control unit 107 of the communication terminal device 1A transmits a call request when a predetermined condition, such as a designation operation of the communication terminal device 1 as a transmission destination or a reception transmission operation, is satisfied by a user of the communication terminal device. The transmission destination of the call request is the server 3. The transmission control unit 107 also transmits the own ID recognized by the pattern recognition unit 105 and the device ID of the communication terminal apparatus 1a together with the call request.

The control device of the server 3 makes a communication request to the communication terminal device 1A based on the above-described respective information received from the communication terminal device 1A. When a receiving operation is performed in the communication terminal device 1A, the control device of the server 3 sets the communication terminal device 1A and the communication terminal device 1A to a state in which a call can be made.

Through the above processing, as in the first embodiment 1, it is possible to designate 1 transmission from the communication terminal apparatus 1 in the host mode as a transmission to be targeted from the communication terminal apparatus 1 in the client mode. Similarly, the communication terminal apparatus 1 in the master mode can designate 1 from the other communication terminal apparatuses 1 in the master mode as a target and transmit a call request.

[ modified example ]

In the above-described embodiment, an example has been described in which the communication terminal apparatus 1 in the client mode cannot select a transmission destination so that the communication terminal apparatus 1 in the client mode does not transmit a call request to another communication terminal apparatus 1 in the client mode (see fig. 4). However, as a method for not transmitting a call request from the communication terminal apparatus 1 in the client mode to the other communication terminal apparatus 1 in the client mode, any method can be adopted, and the method is not limited to this example.

For example, the communication terminal device 1 in the client mode may display a list including the detected other communication terminal devices 1, but the communication terminal device 1 in the client mode cannot be selected by a display method such as graying. Further, the communication terminal device 1 in the client mode may be selected from the list, but when selected, a message that cannot be transmitted to the communication terminal device 1 may be notified by display, voice, or the like.

In addition, for example, the communication terminal device 1 in the client mode may be allowed to transmit a call request to another communication terminal device 1 in the client mode, but the receiving side may automatically reject the call. With this configuration, a call can be prevented from being made between the communication terminal devices 1 in the client mode.

The call of the communication terminal apparatus 1 may be a call of only voice or a so-called video call in which images of both parties are displayed. The communication terminal apparatus 1 may be a portable apparatus or a fixed apparatus.

[ implementation by software ]

The control blocks of the communication terminal apparatus 1 and the server 3 (particularly, the respective units included in the control unit) may be implemented by logic circuits (hardware) formed in an integrated circuit (IC chip) or the like, or may be implemented by software.

In the latter case, the communication terminal device 1 and the server 3 are provided with a computer that executes commands of a control program as software for realizing the respective functions. The computer includes, for example, at least one processor (control device) and at least one computer-readable storage medium storing the control program. In the computer, the object of the present invention is achieved by the processor reading the control program from the storage medium and executing the control program. As the processor, for example, a CPU can be used. As the storage medium, a "non-transitory tangible medium" such as a rom (read Only memory) or the like, or a magnetic tape, a magnetic disk, a card, a semiconductor memory, a programmable logic circuit, or the like may be used. Further, a ram (random Access memory) or the like for expanding the control program is further included. Further, the program may be supplied to the computer via an arbitrary transmission medium (a communication network, a broadcast wave, or the like) capable of transmitting the control program. An embodiment of the present invention can also be realized by a method of electronically transmitting a data signal embedded in a carrier wave that embodies the control program.

[ conclusion ]

A communication terminal device 1 according to a first aspect of the present invention includes at least one control device and at least one communication device. The control device executes an identification process of identifying an attribute of the other communication terminal device 1 for each of the other communication terminal devices 1 to which the attribute can be set with the communication terminal device 1. Further, the control device executes a transmission process of transmitting a call request via the communication device for each of the other communication terminal devices 1 identified as a second attribute (host mode) different from the first attribute (client mode) set in the control device itself. On the other hand, the control device does not transmit a call request to the other communication terminal device 1 identified as the first attribute.

According to the above configuration, since the transmission processing is executed for each of the other communication terminal devices 1 identified as the second attribute, the user of the communication terminal device 1 of the first attribute can talk with the user as long as any one of the communication terminal devices 1 of the second attribute responds to the talk request. Therefore, it is possible to allow the person to be responded to use the communication terminal device 1 having the first attribute and allow a plurality of persons to be responded to use the communication terminal devices 1 having the second attribute, thereby facilitating non-face-to-face response.

Further, according to the above configuration, the call request is not transmitted to the other communication terminal apparatus 1 identified as the first attribute. Therefore, the user of the communication terminal apparatus 1 of the first attribute cannot use the communication terminal apparatus 1 to communicate with the user of the other communication terminal apparatus 1 of the first attribute. This makes it possible to make it difficult for the communication terminal apparatus 1 to be used for unintended purposes.

The communication terminal device 1 according to the second aspect of the present invention is the communication terminal device according to the first aspect, and the control device may execute a reception process of starting a call with another communication terminal device 1 regardless of an operation of a user of the control device when a call request is received from the another communication terminal device 1 as the second attribute.

Thus, when there is a call request from the user of the communication terminal device 1 of the second attribute, the user of the communication terminal device 1 of the first attribute can smoothly start a call with the user of the communication terminal device 1 of the second attribute without performing any operation. For example, the communication terminal device 1 of the first attribute may be installed in a ward, and a doctor or a nurse may carry the communication terminal device 1 of the second attribute, so that the doctor or the nurse can smoothly transfer the communication terminal device to the patient. In this case, even if the patient is unfamiliar with the operation of the communication terminal device 1, the call can be started, and therefore, a case where the patient is disconnected from the telephone can be avoided.

A communication terminal apparatus 1 according to a third aspect of the present invention is the communication terminal apparatus according to the first or second aspect, wherein the control device may execute the transmission process when a human trigger is detected around the control device. According to this configuration, when a person approaches the communication terminal device 1 set to the first attribute (client mode), the transmission process is executed for each of the other communication terminal devices 1 identified as the second attribute (master mode).

Thus, the user of the communication terminal device 1 having the first attribute can smoothly start a call with any one of the users of the communication terminal devices 1 having the second attribute without performing any operation. For example, the communication terminal device 1 having the first attribute may be set in the foreground or the like, and the communication terminal device 1 having the second attribute may be carried by each of the users, so that the user can smoothly respond to the incoming call without any user operation.

A communication terminal apparatus 1 according to a fourth aspect of the present invention is the communication terminal apparatus according to the first or second aspect, wherein the control device may execute the transmission process when no human trigger is detected for a predetermined time or more around the control device. This makes it possible for the user of the communication terminal device 1 of the second attribute to recognize that the user of the communication terminal device 1 of the first attribute is away from the installation location of the communication terminal device 1 and that no one is present around the communication terminal device 1.

A control device according to a fifth aspect of the present invention is a control device that controls an operation of a communication terminal device 1, and includes an identification unit (pattern recognition unit 105) that identifies an attribute of another communication terminal device 1 for each of the other communication terminal devices that can communicate with the communication device 1 and have attributes set therein; and a transmission control unit 107 that transmits a call request to each of the other communication terminal apparatuses 1 identified as having a second attribute different from the first attribute set in the communication terminal apparatus 1, and does not transmit a call request to the other communication terminal apparatus identified as having the first attribute. According to the control device, the same effects as those of the first aspect can be obtained.

A communication control device according to a sixth aspect of the present invention is a communication control method for controlling communication between a plurality of communication terminal devices 1 each having an attribute set therein, by any one of the communication terminal devices or by an information processing device capable of communicating with the communication terminal device, including an identification step of identifying the attributes of the plurality of communication terminal devices 1; and a transmission step of, in a case where, among the plurality of communication terminal apparatuses, a communication terminal apparatus 1 identified as a transmission source of a call request is identified as a first attribute, transmitting the call request to each of the communication terminal apparatuses identified as a second attribute different from the first attribute, wherein, in the transmission step, the call request is not transmitted to the communication terminal apparatus identified as the first attribute. According to the above configuration, the same effects as those of the first aspect can be obtained.

In this case, a control program for realizing the communication terminal device 1 or the information processing device by a computer by operating the computer as each unit (software element) provided in the communication terminal device 1 and the information processing device, and a computer-readable recording medium storing the program are also included in the scope of the present invention.

The present invention is not limited to the above embodiments, and various modifications can be made within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments are also included in the technical scope of the present invention. Further, new technical features can be formed by combining the technical methods disclosed in the respective embodiments.

Claims

1. A communication terminal device having at least one control device and at least one communication device,

the control device executes the following processing:

an identification process of identifying an attribute of another communication terminal device, for each of the other communication terminal devices which can communicate with the own communication terminal device and to which an attribute is set;

a transmission process of transmitting a call request to each of the other communication terminal apparatuses identified as having a second attribute different from the first attribute set in the own apparatus via the communication apparatus,

the control device does not transmit a call request to the other communication terminal device identified as the first attribute.

2. The communication terminal apparatus according to claim 1,

the control device executes a reception process of starting a call with the other communication terminal device regardless of an operation of a user of the control device when receiving a call request from the other communication terminal device as the second attribute.

3. The communication terminal apparatus according to claim 1 or 2,

the control device executes the transmission processing upon detecting a human trigger around the device.

4. The communication terminal apparatus according to claim 1 or 2,

the control device executes the transmission processing when no human trigger is detected for a predetermined time or more around the control device.

5. A control device for controlling an operation of a communication terminal device, comprising:

an identification unit that identifies an attribute of each of other communication terminal devices, each of which is capable of communicating with the communication terminal device and has an attribute set thereto;

and a transmission control unit that transmits a call request to each of the other communication terminal apparatuses identified as having a second attribute different from a first attribute set in the communication terminal apparatus, and does not transmit a call request to the other communication terminal apparatus identified as having the first attribute.

6. A communication control method for controlling communication between a plurality of communication terminal apparatuses, each of which has an attribute set thereto, by any one of the communication terminal apparatuses or by an information processing apparatus capable of communicating with the communication terminal apparatus, the communication control method comprising:

an identification step of identifying attributes of the plurality of communication terminal apparatuses; and

a transmission step of transmitting, in a case where a communication terminal apparatus of a transmission source of a call request among the plurality of communication terminal apparatuses is identified as a first attribute, the call request to each of the communication terminal apparatuses identified as a second attribute different from the first attribute,

in the transmitting step, a call request is not transmitted to the communication terminal apparatus identified as the first attribute.

7. A storage medium storing a control program for causing a computer to function as the control device according to claim 5,

the storage medium stores a control program for causing a computer to function as the identification unit and the transmission control unit.