JP2020202541A - Communication system - Google Patents

Abstract

To provide a communication system capable of simply delivering a whiff of a user and the atmosphere to other users in a remote place.SOLUTION: A communication system comprises a first portable communication terminal recognizing a gesture, a first stationary device collecting ambient voices, and a second portable communication terminal. The first stationary device transmits first data based on the ambient voices to the first portable communication terminal. When it receives the first data and recognizes a gesture, the first portable communication terminal transmits second data based on the gesture to the second portable communication terminal in preference to the first data. When it receives the first data but does not recognize a gesture, the first portable communication terminal transmits the first data to the second portable communication terminal. When it receives data from the first portable communication terminal, the second portable communication terminal operates on the basis of the received data.SELECTED DRAWING: Figure 1

Description

The present invention relates to a communication system.

The value of family communication is increasing, and the development of devices and systems that convey a sense of connection to families living in remote areas is becoming active. Such devices and systems provide a sense of connection through voice and image communication, which makes it difficult for elderly families living in remote areas to operate. However, it is thought that a sense of connection can be obtained not only by voice and images, but also by simply communicating the sign that the family is at home, the appearance of the family being together, and daily greetings.

In this regard, a technique relating to a communication terminal system that conveys a sense of connection is disclosed (see, for example, Patent Document 1). In the technique described in Patent Document 1, one communication terminal transmits information about the presence of a person, an operation pattern: A, or the environment detected by a sensor to the other communication terminal via a communication network. Then, when the other communication terminal receives information from one communication terminal, the other communication terminal operates according to the information.

JP-A-2002-314707

In the technology described in Patent Document 1, a communication terminal that conveys a sense of connection is left at home. Therefore, in the technique described in Patent Document 1, the information detected by the sensor cannot be transmitted to the other communication terminal unless there is a person in the vicinity of one communication terminal.

The present invention has been made in consideration of such circumstances, and an object of the present invention is to provide a communication system capable of easily communicating a user's sign and the atmosphere of the place to another user in a remote place. It is one of.

The communication system according to the present invention adopts the following configuration.

One aspect (1) of the present invention includes a first communication unit that performs long-distance communication and short-range communication, a first operation unit that operates based on data received by the first communication unit, and a user's gesture. A first portable communication terminal having at least a first recognition unit that recognizes the above, a second communication unit that performs short-range communication with the first portable communication terminal, and a first stationary device having at least a sound collecting unit. A second portable communication terminal having at least a third communication unit that performs long-distance communication and short-range communication and a second operation unit that operates based on data received by the third communication unit. When the second communication unit can communicate with the first portable communication terminal by using short-range communication, the first portable communication terminal uses the first data based on the voice collected by the sound collecting unit. When the first data is received from the first stationary device and the gesture is recognized by the first recognition unit, the first communication unit has priority over the first data. , When the second data based on the gesture recognized by the first recognition unit is transmitted to the second portable communication terminal by using long-distance communication and the first data is received from the first stationary device. When the gesture is not recognized by the first recognition unit, the first data is transmitted to the second portable communication terminal using long-distance communication, and the second operation unit is the third communication unit. When data is received from the first portable communication terminal, it is a communication system that operates based on the data received by the third communication unit.

The aspect (2) is the first operation based on the fourth communication unit that performs long-distance communication and short-range communication and the data received by the fourth communication unit in the communication system of the above-mentioned (1) aspect. A third portable communication terminal having at least a third moving unit and a second recognition unit that recognizes a user's gesture is further provided, and the fourth communication unit is a third based on the gesture recognized by the second recognition unit. Data is transmitted to the second portable communication terminal using long-distance communication, and the first portable communication terminal or the third portable communication terminal causes the first data to be transmitted to the second portable communication terminal. When the gesture is recognized by the second recognition unit at the time of transmission, the third data is transmitted to the second portable communication terminal rather than the first data is transmitted to the second portable communication terminal. Priority is given to sending.

The aspect (3) is the first operation based on the fourth communication unit that performs long-distance communication and short-range communication and the data received by the fourth communication unit in the communication system of the above-mentioned aspect (1). A third portable communication terminal having at least a third moving unit and a second recognition unit that recognizes a user's gesture is further provided, and the fourth communication unit is a third based on the gesture recognized by the second recognition unit. Data is transmitted to the second portable communication terminal using long-distance communication, and the first portable communication terminal or the third portable communication terminal has the type of gesture recognized by the first recognition unit. , The data of either the second data or the third data is preferentially transmitted to the second portable communication terminal based on the type of gesture recognized by the second recognition unit. is there.

In the communication system of the above-described aspect (3), the type of the gesture includes a first type of gesture that is regularly performed and a second type of gesture that is performed irregularly. Including, the first portable communication terminal or the third portable communication terminal transmits data based on the second type of gesture rather than transmitting data based on the first type of gesture. It is a priority.

The aspect (5) further includes a plurality of the second portable communication terminals in the communication system according to the above (3) or (4), and the first portable communication terminal is provided by the first recognition unit. Depending on the type of gesture recognized, the second data is transmitted to some of the second portable communication terminals among the plurality of second portable communication terminals, or all the second portable communication terminals. It determines whether to transmit the second data to the user.

According to any of the above-described aspects (1) to (5), the sign of the user and the atmosphere of the place can be easily transmitted to another user in a remote place.

It is the schematic of the structure of the communication system 1 which concerns on 1st Embodiment. It is a figure which shows an example of the structure of the portable communication terminal 100 which concerns on 1st Embodiment. It is a figure which shows an example of the hardware structure of the portable communication terminal 100 which concerns on 1st Embodiment. It is a figure which shows an example of the structure of the stationary apparatus 200 which concerns on 1st Embodiment. It is a figure which shows an example of the 1st scene of communication. It is a sequence diagram which shows an example of the flow of a series of processing of the communication system 1 which concerns on 1st Embodiment. It is a flowchart which shows an example of the flow of a series of processing of the stationary apparatus 200 which concerns on 1st Embodiment. It is a figure for demonstrating the method of generating communication data. It is a flowchart which shows an example of the flow of a series of processing of the portable communication terminal 100 which concerns on 1st Embodiment. It is a figure for demonstrating the method of generating the gesture data. It is a figure which shows an example of the 2nd scene of communication. It is a flowchart which shows an example of the flow of a series of processing of the stationary apparatus 200-A which concerns on 2nd Embodiment. It is a flowchart which shows an example of the flow of a series of processing of the portable communication terminal 100-A which concerns on 2nd Embodiment. It is a figure which shows another example of the 2nd scene of communication. It is a figure which shows an example of the 3rd scene of communication. It is a flowchart which shows an example of the flow of a series of processing of the portable communication terminal 100-A which concerns on 3rd Embodiment.

Hereinafter, embodiments of the communication system of the present invention will be described with reference to the drawings.

<First Embodiment>
[Overall configuration example of communication system 1]
FIG. 1 is a schematic diagram of the configuration of the communication system 1 according to the first embodiment. The communication system 1 is a system for communicating between users at different bases by a simple method.

The communication system 1 includes, for example, a plurality of portable communication terminals 100 and a plurality of stationary devices 200. In FIG. 1, three portable communication terminals 100-A1, 100-A2, 100-A3, and a stationary device 200-A are arranged at the base A, and two portable communication terminals 100-B1, 100 are arranged at the base B. An arrangement example of the communication system 1 in which the −B2 and the stationary device 200-B are arranged is shown.

Reference numerals below the hyphen in the portable communication terminal 100 and the stationary device 200 are identifiers for distinguishing the plurality of portable communication terminals 100, the plurality of stationary devices 200, and the plurality of bases. Hereinafter, when it is not distinguished which portable communication terminal 100 is, it is simply referred to as a portable communication terminal 100, and when it is not distinguished which stationary device 200 it is, it is simply referred to as a stationary device 200. There is.

The portable communication terminal 100 is a terminal device that can be carried by a user belonging to each base. The stationary device 200 is arranged at each base. The portable communication terminal 100 and the stationary device 200 existing at the same base transmit and receive data by short-range communication. Short-range communication is, for example, wireless communication with a short communication distance such as Wi-Fi or Bluetooth (registered trademark, hereinafter omitted).

In FIG. 1, each of the portable communication terminals 100-A1 to 100-A3 transmits and receives data to and from the stationary device 200-A by short-range communication, and the portable communication terminals 100-B1 and 100-B2 are shown. Each of the above shows how data is transmitted and received to and from the stationary device 200-B by short-range communication.

Further, the portable communication terminals 100 transmit and receive data by wide area communication (also referred to as long-distance communication or long-distance communication). Wide-area communication is wireless communication via networks including, for example, cellular networks, the Internet, WAN (Wide Area Network), LAN (Local Area Network), etc., and is wireless communication having a longer communication distance than short-range communication. is there.

FIG. 1 shows how each of the portable communication terminals 100-A1 to 100-A3 transmits and receives data to and from each of the portable communication terminals 100-B1 and 100-B2 by wide area communication. ..

When the portable communication terminals 100 existing at the same base send and receive data, either short-range communication or wide-area communication is performed depending on the position of each portable communication terminal 100. .. More specifically, when the respective portable communication terminals 100 are within the communication range of each other's short-range communication, the portable communication terminals 100 transmit and receive data by short-range communication, and at least one of them is transmitted and received. When the portable communication terminal 100 does not exist in the short-range communication communication range of the other portable communication terminal 100, the portable communication terminals 100 transmit and receive data by wide area communication.

In the communication system 1, the portable communication terminals 100 located at different bases send and receive data by wide area communication, so that a feeling (sense of connection) that users belonging to each base are connected and communicating can be obtained. Will be. Communication that gives a sense of connection is, for example, making the presence of a user at one base feel as a "sign" to a user at the other base, or "greeting", "calling", or "voice" to dodge between users. An act or action such as "calling" is expressed by voice, vibration, or other output mode.

The communication system 1 causes the portable communication terminal 100 belonging to another base to perform an operation based on the environmental sound in the base where the stationary device 200 is arranged or the environmental sound in the vicinity thereof. In this way, it is possible to obtain a sense of connection that makes you feel a "sign". For example, suppose that each of a plurality of users existing in the base A carries a portable communication terminal 100-A and gathers in a room where a stationary device 200-A is arranged to chat or play. In this case, the stationary device 200-A collects the environmental sound of the room, and the data based on the collected sound (hereinafter referred to as communication data) is collected from the plurality of portable communication terminals 100-A. Send to that communication terminal. When the portable communication terminal 100-A receives the communication data, the portable communication terminal 100-A transfers the received communication data to the portable communication terminal 100-B of the base B. When the portable communication terminal 100-B of the base B receives communication data from the portable communication terminal 100 of another base, the portable communication terminal 100-B operates based on the received communication data. As a result, the sign of the user existing in the base A can be transmitted to the user existing in the base B.

Further, in the communication system 1, "greeting" or "calling" is performed by causing the other portable communication terminal 100 to perform an operation indicating the content (meaning) of communication that the user of the portable communication terminal 100 wants to convey to another user. , I am trying to get a sense of connection that makes me feel that "calling" is being done. More specifically, each user performs an operation representing the content (meaning) of the communication to be conveyed to the portable communication terminal 100 carried by the user, thereby expressing the content of the operated communication. The data is transmitted to another portable communication terminal 100. Here, the operations that the user performs on the portable communication terminal 100 in order to convey the content of communication include, for example, holding and shaking with a hand, touching with a hand, tapping with a hand, and turning with a hand. This is an operation that gives an external stimulus to the communication terminal 100. When the user performs an operation representing the content of communication, the portable communication terminal 100 transmits communication data representing the content of the operated communication to another portable communication terminal 100. Then, the other portable communication terminal 100 operates based on the received communication data.

For example, when the user of the portable communication terminal 100-A1 wants to convey the regular greeting "Good morning" to the user of the portable communication terminal 100-B1 or the user of the portable communication terminal 100-B2, the portable communication terminal 100- The user of A1 holds the portable communication terminal 100-A1 by hand and shakes it up and down a predetermined number of times. As a result, the portable communication terminal 100-A1 transmits the communication data representing the greeting "Good morning" to the portable communication terminal 100-B1 and the portable communication terminal 100-B2. Then, the portable communication terminal 100-B1 and the portable communication terminal 100-B2 that have received the communication data receive a greeting "Good morning" from the portable communication terminal 100-A1 by the operation of changing vibration, light, sound, and the like. Notify each user that it has been sent. When the user of the portable communication terminal 100-B1 responds to the greeting "Good morning", the user of the portable communication terminal 100-B1 hits the portable communication terminal 100-B1 a predetermined number of times. As a result, the portable communication terminal 100-B1 transmits communication data representing a response to the greeting "Good morning" to the portable communication terminal 100-A1. Then, the portable communication terminal 100-A1 that has received the communication data receives a response to the greeting "Good morning" from the portable communication terminal 100-B1 by the operation of changing vibration, light, sound, and the like. , Notify the user.

Further, for example, when the user of the portable communication terminal 100-A1 wants to convey an irregular call "How are you?" To the user of the portable communication terminal 100-B1 or the user of the portable communication terminal 100-B2, the mobile phone The user of the type communication terminal 100-A1 touches the portable communication terminal 100-A1 a predetermined number of times. As a result, the portable communication terminal 100-A1 transmits communication data representing a voice saying "How are you?" To the portable communication terminal 100-B1 and the portable communication terminal 100-B2. Then, the portable communication terminal 100-B1 and the portable communication terminal 100-B2 that have received the communication data are asked "How are you?" From the portable communication terminal 100-A1 by the operation corresponding to the received communication data. Notify each user that it has been sent. When the user of the portable communication terminal 100-B2 responds "I'm fine" to this "How are you?", The user of the portable communication terminal 100-B2 is the portable communication terminal 100-B2. Hold it in your hand and turn it a predetermined number of times. As a result, the portable communication terminal 100-B2 transmits communication data indicating a response of "I'm fine" to the portable communication terminal 100-A1. Then, the portable communication terminal 100-A1 that has received the communication data says "I'm fine" to the voice "How are you?" From the portable communication terminal 100-B2 by the operation corresponding to the received communication data. Notify the user that a response has been sent.

In the communication system 1, the contents of communication such as the above-mentioned regular "greeting", irregular "calling", and "calling" are conveyed to all other users or specific other users. Can be done. In the communication system 1, the operation performed by the user on the portable communication terminal 100 differs depending on whether the content of the same communication is directed to all other users or a specific other user. For example, when the user of the portable communication terminal 100-A1 wants to convey the greeting "Good morning" to all other users (the user of the portable communication terminal 100-B1 and the user of the portable communication terminal 100-B2), the mobile phone The user of the type communication terminal 100-A1 holds the portable communication terminal 100-A1 by hand and shakes it up and down a predetermined number of times. Further, for example, when the user of the portable communication terminal 100-A1 wants to convey the greeting "Good morning" only to the user of the portable communication terminal 100-B2, the user of the portable communication terminal 100-A1 is the portable communication terminal. Hold 100-A1 in your hand and shake it left and right a predetermined number of times.

As described above, in the communication system 1, the users of the portable communication terminal 100 can communicate with each other by a simple operation on the portable communication terminal 100 and the operation of the portable communication terminal 100.

The operation performed on the portable communication terminal 100 to convey the content of communication, that is, the correspondence between the content of communication and the operation may be predetermined for each content of communication, or may be set by the user ( Addition, deletion, change, update) may be possible.

[Configuration example of portable communication terminal 100]
Next, the configuration of the portable communication terminal 100 included in the communication system 1 will be described. FIG. 2 is a diagram showing an example of the configuration of the portable communication terminal 100 according to the first embodiment.

The portable communication terminal 100 includes, for example, an electrostatic sensor 110, an acceleration sensor 112, an attitude sensor 114, a drive device 120, an LED (light emitting diode) 122, a speaker 124, a vibrator 126, and the like. It includes a signal processing unit 130, a communication module 140, a power receiving coil 150, a charging circuit 160, and a battery 170. The drive device 120, the LED 122, the speaker 124, and the vibrator 126 are examples of the “moving unit”.

The electrostatic sensor 110 detects the capacitance of a capacitor pseudo-formed by the portable communication terminal 100 and the object when the object approaches the portable communication terminal 100. The electrostatic sensor 110 outputs a signal indicating the detected capacitance to the signal processing unit 130.

The acceleration sensor 112 detects the acceleration of the three axes acting on the portable communication terminal 100. The acceleration sensor 112 outputs a signal indicating the magnitude and direction (that is, acceleration vector) of the detected acceleration to the signal processing unit 130.

The posture sensor 114 detects the posture of the portable communication terminal 100. The attitude sensor 114 includes an angular velocity sensor, a gyro sensor, and the like that can detect the angular velocities of each of the three axes. The attitude sensor 114 outputs a signal indicating the attitude obtained in consideration of the detected change in the angular velocity and the gravitational acceleration to the signal processing unit 130.

The drive device 120 operates according to the control signal (instruction signal) output by the signal processing unit 130. The drive device 120 includes, for example, two drive wheels (not shown) for moving the portable communication terminal 100 itself, and two drive motors (not shown) in which each drive wheel is fixed to a rotating shaft. The drive device 120 changes the speed and direction of moving the portable communication terminal 100 itself by independently changing the rotation speed and the rotation direction of the rotation shaft of each drive motor.

The LED 122 is issued in response to a control signal (instruction signal) output by the signal processing unit 130. For example, the LED 122 repeatedly blinks in a pattern corresponding to the control signal, or lights up with a light of a color corresponding to the control signal. The LED 122 is not limited to one light emitting diode. For example, the LED 122 may be composed of a plurality of light emitting diodes. Further, the LED 122 may be a small liquid crystal display device.

The speaker 124 outputs voice corresponding to the control signal (instruction signal) output by the signal processing unit 130. For example, the speaker 124 changes the sound output time or the pitch according to the control signal. The speaker 124 is, for example, a piezoelectric speaker or a piezoelectric buzzer.

The vibrator 126 vibrates according to the control signal (instruction signal) output by the signal processing unit 130. For example, the vibrator 126 repeats vibration in a pattern corresponding to a control signal, or changes the duration of vibration according to a control signal.

The signal processing unit 130 controls the entire portable communication terminal 100. The signal processing unit 130 includes, for example, a detection signal analysis unit 131, a transmission signal generation unit 133, a reception signal recognition unit 135, and an operation command unit 137. The signal processing unit 130 is an example of a “recognition unit”.

The signal processing unit 130 is, for example, a storage device (a storage device including a non-transient storage medium) that stores a hardware processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) and a program (software). When the processor executes the program, the functions of each component are realized.

In addition, some or all of the components included in the signal processing unit 130 are hardware (circuit unit; circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), and FPGA (Field-Programmable Gate Array). , Etc.), or the functions of the respective components may be realized by the cooperation of software and hardware. In addition, some or all of the components included in the signal processing unit 130 may realize the functions of the respective components by a dedicated LSI.

The program (software) may be stored in advance in a storage device (a storage device including a non-transient storage medium) such as a ROM (Read Only Memory), a RAM (Random Access Memory), or a flash memory. Further, the program (software) may be downloaded in advance from another computer device by short-range communication or wide-area communication and installed in the storage device included in the portable communication terminal 100.

The detection signal analysis unit 131 performs an operation on the portable communication terminal 100 by the user based on the signals output by each of the electrostatic sensor 110, the acceleration sensor 112, and the attitude sensor 114, that is, the user performs another operation. Analyze the content of the communication you want to convey to the user. The detection signal analysis unit 131 outputs information (hereinafter, referred to as analysis information) representing the result of the analyzed communication content to the transmission signal generation unit 133.

The transmission signal generation unit 133 generates communication data representing the content of communication that one user wants to convey to another user, based on the analysis information output by the detection signal analysis unit 131. The transmission signal generation unit 133 includes the identification information (ID) of the portable communication terminal 100 in the generated communication data. The transmission signal generation unit 133 controls the communication module 140 and transmits the generated communication data to another portable communication terminal 100 by wide area communication.

When the communication module 140 receives communication data from another portable communication terminal 100, the reception signal recognition unit 135 recognizes the content of communication transmitted by the user of the other portable communication terminal 100 based on the communication data. To do. Further, the received signal recognition unit 135 recognizes the ID of the portable communication terminal 100 included in the communication data. The received signal recognition unit 135 outputs information (hereinafter, referred to as recognition information) that combines the recognized communication content and the ID to the operation command unit 137.

When the communication module 140 receives communication data from each of the plurality of portable communication terminals 100, the reception signal recognition unit 135 may output each recognition information to the operation command unit 137, or is based on the content of the communication. The recognition information having the highest operation priority may be sequentially output to the operation command unit 137, or each recognition information to which the operation priority information is added may be output to the operation command unit 137. As a result, the operation command unit 137 gives priority to the operation based on any one of the recognition information, or performs the operation based on each recognition information in a predetermined order, the drive device 120, the LED 122, the speaker 124, and the vibrator. Let each of the 126 perform.

Further, the reception signal recognition unit 135 may output the recognition information to the transmission signal generation unit 133. In response to this, the transmission signal generation unit 133 controls the communication module 140 and transmits the recognition information output by the reception signal recognition unit 135 to the stationary device 200 by short-range communication. That is, the transmission signal generation unit 133 transfers the recognition information output by the reception signal recognition unit 135 to the stationary device 200. The reception signal recognition unit 135 may output the recognition information that has not been output to the operation command unit 137 to the transmission signal generation unit 133.

Further, when the communication module 140 receives the communication data from the stationary device 200 by short-range communication, the reception signal recognition unit 135 outputs the communication data to the transmission signal generation unit 133. In response to this, the transmission signal generation unit 133 controls the communication module 140 and transfers the communication data output by the reception signal recognition unit 135 to another portable communication terminal 100 by wide area communication. At this time, the transmission signal generation unit 133 includes the ID of the portable communication terminal 100 in the communication data to be transferred.

The operation command unit 137 controls (instructs) the operation of each of the drive device 120, the LED 122, the speaker 124, and the vibrator 126 based on the recognition information output by the received signal recognition unit 135 (instruction signal). ) Is output. That is, the operation command unit 137 is a control signal for causing each of the drive device 120, the LED 122, the speaker 124, and the vibrator 126 to perform an operation representing the content of communication transmitted by the user of the other portable communication terminal 100. (Instruction signal) is output.

The communication module 140 includes, for example, a transmission unit 142 and a reception unit 144. The transmission unit 142 transmits data by wide area communication and short range communication. The transmission unit 142 transmits the communication data output by the signal processing unit 130 (more specifically, the transmission signal generation unit 133) to another portable communication terminal 100 by wide area communication. The receiving unit 144 receives data by wide area communication and short range communication. The receiving unit 144 receives communication data from the portable communication terminal 100 of another base by wide area communication, and outputs the received communication data to the signal processing unit 130 (more specifically, the received signal recognition unit 135). Further, the receiving unit 144 receives the communication data from the stationary device 200 by short-range communication, and outputs the received communication data to the receiving signal recognition unit 135.

Note that, in FIG. 1, the communication module 140 has been described as including a transmitting unit 142 and a receiving unit 144 for communicating in wide area communication and short range communication, respectively, but the present invention is not limited to this. For example, the communication module 140 may include a transmitting unit and a receiving unit for wide area communication and a transmitting unit and a receiving unit for short-range communication, respectively.

The battery 170 supplies electric power to each component included in the portable communication terminal 100. The battery 170 is, for example, a secondary battery such as a nickel-hydrogen battery or a lithium-ion battery. The battery 170 may be a capacitor such as an electric double layer capacitor, a composite battery in which a secondary battery and a capacitor are combined, or the like.

The power receiving coil 150 is a coil for charging the battery 170 in a non-contact manner. The power receiving coil 150 converts the magnetic field generated by the stationary device 200 into electric power and outputs the electric power to the charging circuit 160 to receive the electric power supplied from the stationary device 200 in a non-contact manner. The power receiving coil 150 supplies the received power to the charging circuit 160.

The charging circuit 160 charges the battery 170 with the electric power supplied by the power receiving coil 150.

In the communication system 1, communication data may be simultaneously transmitted to the portable communication terminal 100 from a plurality of other portable communication terminals 100. In this case, the portable communication terminal 100 once receives the communication data transmitted by each of the other portable communication terminals 100. Then, the portable communication terminal 100 executes an operation representing the content of any one communication according to the type of each received communication data, or executes an operation representing the content of the communication in a predetermined order. .. In the portable communication terminal 100, the received signal recognition unit 135 recognizes the type of each received communication data, that is, the content of the communication represented by the communication data, and selects and outputs the recognition information to be output to the operation command unit 137. By controlling, the execution of actions that represent the content of communication and the order in which the actions are executed are controlled.

For example, when the regular "greeting" communication data and the irregular "calling" communication data are transmitted at the same time, the portable communication terminal 100 operates to represent the content of the irregular "calling" communication. Priority is given to execution. Further, for example, when the regular "greeting" communication data for a specific user and the regular "greeting" communication data for all users are transmitted at the same time, the portable communication terminal 100 uses the portable communication terminal 100 for the specific user. Priority is given to the operation that expresses the content of the regular "greeting" communication. In addition, for example, when communication data based on voice data that collects environmental sounds and communication data based on specific utterances such as "greeting", "calling", and "calling" are transmitted at the same time, it is portable. The communication terminal 100 may preferentially process communication data based on utterances.

Further, the portable communication terminal 100 temporarily stores the received communication data in a queue format, and after the operation representing the content of the preferentially executed communication is completed, the content of the other communication data stored. You may perform the operation representing. That is, the portable communication terminal 100 may execute an operation representing the contents of communication data simultaneously transmitted from a plurality of other portable communication terminals 100 with a time lag.

Further, when the portable communication terminal 100 executes an operation representing the content of any one communication, the communication data that does not execute the operation is transferred to another portable communication terminal 100 belonging to the same base, and the other portable communication terminal 100 is used. The communication terminal 100 may be made to execute an operation representing the content of communication. At this time, the portable communication terminal 100 transmits each received communication data to the stationary device 200.

Then, the stationary device 200 allocates each communication data to a plurality of portable communication terminals 100 belonging to the same base based on a predetermined rule. Each portable communication terminal 100 executes an operation representing the content of communication transmitted by any of the portable communication terminals 100 assigned by the stationary device 200.

More specifically, when communication data is simultaneously transmitted from a plurality of other portable communication terminals 100, the received signal recognition unit 135 included in the signal processing unit 130 transmits the respective communication data. The recognition information of the terminal 100 is output to the transmission signal generation unit 133.

At this time, the reception signal recognition unit 135 may output the recognition information as well as the information requesting the selection of the portable communication terminal 100 to the transmission signal generation unit 133. The transmission signal generation unit 133 included in the signal processing unit 130 outputs each recognition information output by the reception signal recognition unit 135 to the communication module 140, and causes the stationary device 200 to transmit the respective recognition information by short-range communication.

That is, the transmission signal generation unit 133 transfers the recognition information of the portable communication terminal 100 that has simultaneously transmitted the communication data output by the reception signal recognition unit 135 to the stationary device 200. As a result, the stationary device 200 allocates the recognition information for executing the operation to the plurality of portable communication terminals 100 belonging to the same base based on a predetermined rule, and each of the assigned recognition information is obtained by short-range communication. It is transmitted to the portable communication terminal 100.

The predetermined rule is, for example, the order in which the electric power stored in the battery 170 is the largest among the portable communication terminals 100 for which pairing has been established. Therefore, when allocating recognition information to each portable communication terminal 100 belonging to the same base, the stationary device 200 operates to represent the content of communication in order from the portable communication terminal 100 having the largest amount of power stored in the battery 170. Allocate recognition information that consumes a large amount of power.

The reception signal recognition unit 135 of each portable communication terminal 100 to which the recognition information is assigned receives the assigned recognition information, and then outputs the received recognition information to the operation command unit 137. As a result, the operation command unit 137 performs an operation representing the recognition information output by the received signal recognition unit 135, that is, the content of the communication transmitted by the assigned portable communication terminal 100, the drive device 120, the LED 122, and the speaker. Let each of 124 and the vibrator 126 execute.

[Structural example of portable communication terminal 100]
Next, the hardware structure of the portable communication terminal 100 will be described. FIG. 3 is a diagram showing an example of the hardware structure of the portable communication terminal 100 according to the first embodiment. FIG. 3 shows an example of the ball-shaped portable communication terminal 100. In the structure of the ball-shaped portable communication terminal 100 shown in FIG. 3, a module in which each component of the portable communication terminal 100 shown in FIG. 2 is assembled in a spherical outer shell 101 (hereinafter, "Main unit module") is stored. Note that FIG. 3 shows some of the components of the portable communication terminal 100 shown in FIG.

The outer shell 101 is a translucent plastic case through which the light of the LED 122 is transmitted. The outer shell 101 has a size that can be held by a user, for example, a diameter of about 40 [mm]. Each of the two drive wheels configured as the drive device 120 is in contact with the inner surface of the outer shell 101. Further, a weight 102 is attached to the lower part of the main body module so that the posture of the main body module becomes substantially constant within the outer shell 101. With such a structure, in the portable communication terminal 100, each drive wheel is independently driven when performing an operation based on the received communication data. As a result, the main body module travels on the inner surface of the outer shell 101 in a stable posture. As a result, in the portable communication terminal 100, the entire body including the outer shell 101 behaves as if it is moving based on the received communication data. For example, if the two drive wheels are rotated in the same direction at the same speed, the entire body including the outer shell 101 will roll, and if the two drive wheels are rotated in the same direction at different speeds, the outer shell 101 will be included. The whole runs in a curve and rolls. Further, for example, when the two drive wheels are rotated in different directions at the same speed, the entire body including the outer shell 101 rotates on the spot.

The portable communication terminal 100 performs an operation when notifying the user of the content of communication transmitted by another portable communication terminal 100 near the base to which the portable communication terminal 100 itself belongs (near the stationary device 200). Switch depending on whether it exists or not. More specifically, when the portable communication terminal 100 exists near the base, the content of the communication is notified to the user by operating the drive device 120 and traveling so as to roll. However, even when notifying the user of the content of the same communication, if the portable communication terminal 100 is in a state of being carried by the user, the driving device 120 is not operated, and the LED 122 emits light and the speaker. The content of communication is notified to the user only by the sounding by the 124 and the vibration operation by the vibrator 126. That is, the portable communication terminal 100 limits the operation for notifying the user of the content of communication depending on whether or not it exists near the base to which it belongs. As a result, the portable communication terminal 100 is placed in a place where it is expected to fall, such as on a table, when the user who has traveled with the portable communication terminal 100 goes out. Even in such a case, it is possible to avoid a situation in which the user suddenly runs and falls in order to notify the user of the content of the received communication. It should be noted that the portable communication terminal 100 can determine whether or not it exists near the base to which it belongs, depending on whether or not short-range communication with the stationary device 200 is possible.

[Configuration example of stationary device 200]
Next, the configuration of the stationary device 200 included in the communication system 1 will be described. FIG. 4 is a diagram showing an example of the configuration of the stationary device 200 according to the first embodiment.

The stationary device 200 includes a microphone 210, a signal processing unit 220, a communication module 230, a power supply 240, a power supply circuit 250, and a power transmission coil 260.

The microphone 210 collects environmental sounds in or around the base where the stationary device 200 is arranged. The microphone 210 outputs the voice signal of the collected environmental sound to the signal processing unit 220. The microphone 210 is an example of a “sound collecting unit”.

The signal processing unit 220 controls the entire stationary device 200. The signal processing unit 220 includes a voice conversion unit 222, a transmission signal generation unit 224, and a communication terminal selection unit 226.

The signal processing unit 220 includes, for example, a hardware processor such as a CPU or GPU and a storage device (a storage device including a non-transient storage medium) that stores a program (software), and the processor executes the program. As a result, the functions of each component are realized. Further, some or all of the components included in the signal processing unit 220 may be realized by hardware such as LSI, ASIC, FPGA (circuit unit; including circuitry), or a collaboration between software and hardware. The function of each component may be realized by the operation. Further, some or all of the components included in the signal processing unit 220 may be realized by a dedicated LSI. Here, the program (software) is stored in advance in a storage device (a storage device including a non-transient storage medium) included in the stationary device 200 such as a ROM, RAM, HDD (Hard Disk Drive), and flash memory. Alternatively, it is stored in a removable storage medium (non-transient storage medium) such as a DVD or a CD-ROM, and the storage medium is attached to a drive device included in the stationary device 200 to be mounted on the stationary device. It may be installed in the storage device included in the 200. Further, the program (software) may be downloaded in advance from another computer device by short-range communication or wide-area communication, and installed in the storage device included in the stationary device 200.

The voice conversion unit 222 converts the environmental sound signal (analog signal) output by the microphone 210 into a digital format data signal. The audio converter 222 is, for example, an analog / digital converter (A / D converter). The voice conversion unit 222 outputs the voice data converted into a digital format to the transmission signal generation unit 224.

The voice conversion unit 222 may perform various signal processing such as noise removal and signal amplification at the time of analog / digital conversion. For example, the environmental sounds collected by the microphone 210 include footsteps, speaking voices, door opening / closing sounds, operating sounds of washing machines and vacuum cleaners, sounds output from televisions and stereos, and other living sounds generated in daily life. Is included. In this case, the voice conversion unit 222 removes the operation sound of the home electric appliance not related to the operation pattern of the person (user): A as noise, and makes the user feel a "sign" of being in the vicinity of the stationary device 200 (a sound (a sign). For example, footsteps, speaking voice, etc.) may be extracted only. For example, the voice conversion unit 222 may use a function by AI (Artificial Intelligence) to extract only sounds that make a "sign" such as footsteps and speech.

The transmission signal generation unit 224 generates communication data based on the voice data output by the voice conversion unit 222, that is, the environmental sound of the base where the stationary device 200 is arranged. The transmission signal generation unit 224 may associate the identification information (ID) of the stationary device 200 with the generated communication data.

The transmission signal generation unit 224 controls the communication module 230 and transmits the generated communication data to the portable communication terminal 100 at the same base by short-range communication. In response to this, the portable communication terminal 100 transfers the received communication data to the portable communication terminal 100 of another base by wide area communication.

The communication module 230 uses the signal processing unit 220 (more specifically, the information processing unit 220 (more specifically)) to input information of the portable communication terminal 100 of another base where the pairing of short-range communication is established and the short-range communication can be performed. , Output to the communication terminal selection unit 226). The communication module 230 includes, for example, a transmission unit 232 and a reception unit 234.

The transmission unit 232 transmits data by short-range communication. The transmission unit 232 transmits the communication data generated by the signal processing unit 220 (more specifically, the transmission signal generation unit 224) to the portable communication terminal 100 by short-range communication. The receiving unit 234 receives data by short-range communication. The receiving unit 234 receives various information transmitted by the portable communication terminal 100 by short-range communication, and outputs the received information to the signal processing unit 220.

The power supply 240 supplies power to each component of the stationary device 200. The power supply 240 is, for example, a commercial power supply.

The power supply circuit 250 outputs the power supplied by the power supply 240 to the power transmission coil 260 as power for charging the battery 170 included in the portable communication terminal 100.

The power transmission coil 260 is a coil for transmitting electric power for charging the battery 170 included in the portable communication terminal 100 in a non-contact manner. The power transmission coil 260 generates a magnetic field corresponding to the electric power output by the power supply circuit 250. The power transmission coil 260 transmits electric power to the power receiving coil 150 included in the portable communication terminal 100 existing in the generated magnetic field. The power transmission coil 260 is not limited to the number of portable communication terminals 100 that transmit electric power. That is, the power transmission coil 260 may have a function (capacity) of transmitting electric power to a plurality of portable communication terminals 100 at the same time.

[Communication; 1st scene]
Next, an example of the first scene in which communication is performed by the communication system 1 will be described. FIG. 5 is a diagram showing an example of a first scene of communication.

In the communication system 1 shown in FIG. 5, one portable communication terminal 100-A and one stationary device 200-A are arranged at the base A, and one portable communication terminal 100-B and one stationary device are arranged at the base B. 200-B is arranged. For example, base A is the home of a child and his parents, and base B is the home of a child's grandparents who live in the home of base A. Incidentally, station A and B need not be physically separable point as houses, for example, a point within the communication area of the stationary apparatus 200-A of the short-range communication R _A, stationary device 200- point and may be regarded in the communication area R _B of the short-range communication of B.

The portable communication terminal 100-A is an example of the "first portable communication terminal", the stationary device 200-A is an example of the "first stationary device", and the portable communication terminal 100-B is the "second mobile communication terminal". This is an example of a "type communication terminal". The communication module 140 included in the portable communication terminal 100-A is an example of the "first communication unit", and the communication module 230 included in the stationary device 200-A is an example of the "second communication unit". The communication module 140 included in the 100-B is an example of the "third communication unit". The signal processing unit 130 included in the portable communication terminal 100-A is an example of the "first recognition unit".

Further, the drive device 120, LED 122, speaker 124, and vibrator 126 included in the portable communication terminal 100-A are examples of the "first operating unit", and the drive device 120, LED 122 included in the portable communication terminal 100-B. , Speaker 124, and vibrator 126 are examples of the "second operating unit".

At the base A, a portable communication terminal 100-A exists in the short-range communication communication area _{RA of} the stationary device 200-A, and the stationary device 200-A and the portable communication terminal 100-A are paired with each other. The ring has been established and short-range communication is possible. Further, the base B, there are portable communication terminal 100-B to the stationary apparatus short-distance communication of a communication area in _{R B} in 200-B is a stationary device 200-B with a portable communication terminal 100-B is Pairing has been established with each other, and short-range communication is possible.

In such a first scene, the communication system 1 performs the following series of processes. FIG. 6 is a sequence diagram showing an example of a series of processing flows of the communication system 1 according to the first embodiment.

First, the stationary device 200-A provided at the base A waits until the microphone 210-A collects the environmental sound (child's voice, footsteps, etc.) (step S100), and the microphone 210-A collects the environmental sound. When the sound is collected, communication data is generated from the voice data of the environmental sound, and the generated communication data is transmitted to the paired portable communication terminal 100-A (step S102). When the pairing with the portable communication terminal 100-A is not established because the portable communication terminal 100-A exists outside the communication area _RA , the stationary device 200-A communicates the communication data with the portable communication terminal 100-A. Do not send to terminal 100-A.

When the portable communication terminal 100-A paired with the stationary device 200-A receives the communication data, the portable communication terminal 100-A transfers the communication data to the portable communication terminal 100-B of the base B by wide area communication (step S104). When the portable communication terminal 100-B of the base B receives the communication data from the portable communication terminal 100-A of the base A, the drive device 120 is operated or the LED 122 is made to emit light based on the communication data. The speaker 124 is made to output sound, and the vibrator 126 is vibrated (step S106). As a result, the grandparents of the base B can know that the grandchildren and children at the base A far away are living well by operating the portable communication terminal 100-B.

In the above-described sequence, the method of transmitting communication data from the base A to the base B has been described, but the same applies to the method of transmitting the communication data from the base B to the base A. For example, the stationary device 200-B provided at the base B waits until the microphone 210-B collects the environmental sound (step S110), and when the microphone 210-B collects the environmental sound, the environmental sound is heard. Communication data is generated from the voice data, and the generated communication data is transmitted to the paired portable communication terminal 100-B (step S112).

When the portable communication terminal 100-B paired with the stationary device 200-B receives the communication data, the portable communication terminal 100-B transfers the communication data to the portable communication terminal 100-A of the base A by wide area communication (step S114). When the portable communication terminal 100-A of the base A receives the communication data from the portable communication terminal 100-B of the base B, the drive device 120 is operated or the LED 122 is made to emit light based on the communication data. The speaker 124 is made to output sound, and the vibrator 126 is vibrated (step S116).

[Processing flow of stationary equipment]
Hereinafter, a series of processing flows of the stationary device 200 will be described with reference to a flowchart. FIG. 7 is a flowchart showing an example of a series of processing flows of the stationary device 200 according to the first embodiment. The processing of this flowchart may be repeated at a predetermined cycle.

First, the transmission signal generation unit 224 determines whether or not the pairing of short-range communication with the portable communication terminal 100 has been established (step S200).

When pairing with the portable communication terminal 100 is established, the transmission signal generation unit 224 determines whether or not the environmental sound has been collected by the microphone 210 (step S202). For example, the transmission signal generation unit 224 determines that when an audio signal is input from the microphone 210, the environmental sound is collected by the microphone 210.

Next, when the environmental sound is collected by the microphone 210, that is, when the audio signal of the environmental sound is input from the microphone 210, the audio conversion unit 222 performs AD conversion on the audio signal and uses the digital signal. Generate some audio data (step S204). At this time, the voice conversion unit 222 may remove noise such as the operating sound of the home electric appliance.

Next, the transmission signal generation unit 224 generates communication data based on the voice data generated by the voice conversion unit 222 (step S206). For example, the transmission signal generation unit 224 analyzes the voice data, determines the nature and type of sound such as sound pressure and frequency, and further determines the activity status of people in the base according to the nature and type of sound. judge. Then, the transmission signal generation unit 224 generates communication data based on the determination results.

FIG. 8 is a diagram for explaining a method of generating communication data. For example, when the portable communication terminal 100 does not exist in the communication range of the short-range communication and the pairing with the portable communication terminal 100 is not established, the transmission signal generation unit 224 shows a scene showing the activity status. It is determined that it is Z. Scene Z shows, for example, a scene in which a user carrying a portable communication terminal 100 goes out of a base. When the transmission signal generation unit 224 determines that the scene is Z, the transmission signal generation unit 224 does not generate any communication data. In this case, since the communication data is not transmitted to the portable communication terminal 100 of the other base via the portable communication terminal 100 in the own base, the portable communication terminal 100 of the other base emits light or makes a sound. , Maintain a state (operation pattern: A0 in the figure) that does not vibrate or move.

Further, for example, when the portable communication terminal 100 exists in the communication range of short-range communication and the pairing with the portable communication terminal 100 is established, the transmission signal generation unit 224 determines the nature and type of sound. Determine the scene based on it.

For example, when an environmental sound having an extremely low sound pressure level (a loudness that can be regarded as noise) is collected by the microphone 210, the transmission signal generation unit 224 is more active than the scene Z in the user's activity status. Judged as scene Y. Scene Y shows, for example, a scene such as at bedtime in which sounds that make people feel a sign such as speaking voice and footsteps are not generated. When the transmission signal generation unit 224 determines that the scene Y is determined, the transmission signal generation unit 224 generates the communication data of the pattern A and transmits this to the portable communication terminal 100 of another base via the portable communication terminal 100 in the own base. The portable communication terminal 100 that has received the communication data of the pattern A blinks relatively slowly in a gentle color (for example, blue) to indicate that a user at another base is sleeping, for example. At this time, the portable communication terminal 100 does not perform other operations such as making a sound, vibrating, or moving (operation pattern: A1 in the figure).

Further, for example, when the sound pressure level is relatively low and the low frequency environmental sound is collected by the microphone 210, the transmission signal generation unit 224 determines that the user's activity status is more active than the scene Y. .. Scene X shows, for example, a scene in which a person walks in a room and only footsteps are generated. When the transmission signal generation unit 224 determines that the scene X is determined, the transmission signal generation unit 224 generates the communication data of the pattern B and transmits this to the portable communication terminal 100 of another base via the portable communication terminal 100 in the own base. The portable communication terminal 100 that has received the communication data of the pattern B operates more violently than the case of the pattern A, for example, to indicate that a user at another base is awake. For example, the portable communication terminal 100 has a color (for example, green) different from that of the pattern A, and blinks faster, longer, or with a larger brightness than that of the pattern A. At this time, the portable communication terminal 100 may make a sound, vibrate, or move (operation pattern: A2 in the figure).

Further, for example, when the sound pressure level is higher than that of the scene X and the environmental sound having a frequency of about 500 to 1000 [Hz] is collected by the microphone 210, the transmission signal generation unit 224 is more active than the scene X. It is determined that the scene W is in an active situation. Scene W shows, for example, a scene in which users are talking to each other or watching TV. When the transmission signal generation unit 224 determines that the scene W is determined, the transmission signal generation unit 224 generates communication data of pattern C and transmits this to the portable communication terminal 100 of another base via the portable communication terminal 100 in the own base. The portable communication terminal 100 that has received the communication data of the pattern C operates more violently than that of the pattern B, for example. For example, the portable communication terminal 100 has the same color as that of the pattern B, and blinks faster, longer, or with a larger brightness than that of the pattern B. At this time, the portable communication terminal 100 may make a louder sound, vibrate violently, or move faster than in the pattern B (operation pattern: A3 in the figure).

Further, for example, when an environmental sound having a sound pressure level higher than that of the scene W is collected by the microphone 210, the transmission signal generation unit 224 determines that the scene V has a more active user activity than the scene W. Scene V shows, for example, a scene in which a child is running around or playing with a toy that makes a sound. When the transmission signal generation unit 224 determines that the scene V is determined, the transmission signal generation unit 224 generates communication data of the pattern D and transmits this to the portable communication terminal 100 of another base via the portable communication terminal 100 in the own base. The portable communication terminal 100 that has received the communication data of the pattern D operates more violently than that of the pattern C, for example. For example, the portable communication terminal 100 has the same color as that of the patterns B and C, and blinks faster, longer, or with a larger brightness than that of the pattern C. At this time, the portable communication terminal 100 may make a louder sound, vibrate violently, or move faster than in the pattern C (operation pattern: A4 in the figure).

Returning to the description of the flowchart of FIG. 7. Next, when the transmission signal generation unit 224 generates communication data, it controls the communication module 230 and transmits the generated communication data to the portable communication terminal 100 at its own base by short-range communication (step S208). In response to this, the portable communication terminal 100 at the own base transfers the received communication data to the portable communication terminal 100 at another base by wide area communication. This ends the processing of this flowchart.

[Processing flow of portable communication terminal]
Hereinafter, a series of processing flows of the portable communication terminal 100 will be described with reference to a flowchart. FIG. 9 is a flowchart showing an example of a series of processing flows of the portable communication terminal 100 according to the first embodiment. The processing of this flowchart may be repeated at a predetermined cycle when pairing of short-range communication with the stationary device 200 is established.

First, the transmission signal generation unit 133 determines whether or not the communication module 140 has received communication data from the stationary device 200 at its own base (step S300).

When the communication data is not received by the communication module 140, the transmission signal generation unit 133 outputs a signal output by the detection signal analysis unit 131 to a part or all of the electrostatic sensor 110, the acceleration sensor 112, and the attitude sensor 114. Based on this, it is determined whether or not the gesture is recognized (detected) (step S302). As described above, the gesture is an operation or operation performed by the user on the portable communication terminal 100 in order to communicate with the user at the other base. Specifically, the gesture is an operation or operation such that a part of the user's body comes into contact with the portable communication terminal 100, such as touching, shaking, or hitting.

For example, the transmission signal generation unit 133 determines that the detection signal analysis unit 131 has recognized the gesture when the detection signal analysis unit 131 generates analysis information which is the analysis result of the communication content and the analysis information is output. If the analysis information is not output by the detection signal analysis unit 131, it is determined that the detection signal analysis unit 131 does not recognize the gesture.

When the transmission signal generation unit 133 determines that the detection signal analysis unit 131 does not recognize the gesture, the transmission signal generation unit 133 ends the process of this flowchart.

On the other hand, when the transmission signal generation unit 133 determines that the detection signal analysis unit 131 has recognized the gesture, the transmission signal generation unit 133 is based on the analysis information input from the detection signal analysis unit 131, and the communication data representing the content of the gesture (hereinafter, the gesture). (Referred to as data) is generated (step S304).

FIG. 10 is a diagram for explaining a method of generating gesture data. For example, the transmission signal generation unit 133 generates gesture data of an operation pattern according to the type of gesture. As described above, the types of gestures include gestures that are performed regularly such as greetings at the time of waking up or at bedtime, and gestures that are performed irregularly. Regular gestures are gestures that are likely to be performed at a certain time zone, and non-regular gestures are gestures that are likely to be performed regardless of the time zone. As shown in the illustrated example, each of the regular gesture and the non-regular gesture may include one or more types of gestures. The portable communication terminal 100 that has received the gesture data performs an operation according to the operation pattern of the gesture data. That is, the portable communication terminal 100 that has received the gesture data changes its operation according to the type of gesture. Regular gestures are an example of "first-class gestures", and non-regular gestures are an example of "second-class gestures".

Returning to the description of the flowchart of FIG. Next, the transmission signal generation unit 133 controls the communication module 140 and transmits the generated gesture data to the portable communication terminal 100 of another base by wide area communication (step S306).

On the other hand, when the transmission signal generation unit 133 determines in the processing of S300 that the communication data has been received by the communication module 140, the detection signal analysis unit 131 detects the electrostatic sensor 110 and the acceleration sensor 112 in the same manner as in the processing of S302. , And, based on the signal output by a part or all of the attitude sensor 114, it is determined whether or not the gesture is recognized (step S308).

When the transmission signal generation unit 133 determines that the detection signal analysis unit 131 does not recognize the gesture, the transmission signal generation unit 133 controls the communication module 140 and transmits the communication data received from the stationary device 200 of the own base to the other base by wide area communication. Transfer to the portable communication terminal 100 (step S310).

On the other hand, when the transmission signal generation unit 133 determines that the detection signal analysis unit 131 has recognized the gesture, the transmission signal generation unit 133 generates gesture data based on the analysis information input from the detection signal analysis unit 131 (step S312).

Next, the transmission signal generation unit 133 gives priority to the gesture data among the communication data received from the stationary device 200 at the own base and the generated gesture data and transmits the gesture data to the portable communication terminal 100 at the other base. (Step S314). As a result, the portable communication terminal 100 at another base can be made to perform the operation according to the gesture with priority over the operation according to the environmental sound such as footsteps and conversation. As a result, it is possible to prioritize communication with a clear intention of gesture.

Next, the transmission signal generation unit 133 determines whether or not the transmission of the gesture data is completed to the portable communication terminal 100 of the other base (step S316), and if the transmission of the gesture data is completed, S310. The communication data that has been waiting for transmission in order to prioritize the transmission of the gesture data is transferred to the portable communication terminal 100 of another base. This ends the processing of this flowchart.

According to the first embodiment described above, the stationary device 200-A located at one of the two bases A generates communication data from the surrounding environmental sound, and the generated communication data is the same. The data is transmitted to the portable communication terminal 100-B of the other base B via the portable communication terminal 100-A of the base A. When the portable communication terminal 100-B of the other base B receives the communication data from the portable communication terminal 100-A of the other base A, the portable communication terminal 100-B emits light or makes a sound based on the received communication data. Performs actions such as, vibrating, and moving. Further, the portable communication terminal 100-A of one of the bases A receives communication data (an example of the first data) based on the environmental sound from the stationary device 200-A of the own base A, and the portable communication terminal 100-A is the own unit (portable). When a user makes a touch operation gesture such as touching or hitting the communication terminal 100-A), the gesture data (an example of the second data) based on the gesture is used as the stationary device 200- of the own base A. The communication data received from A is prioritized and transmitted to the portable communication terminal 100-B of another base B. As a result, it is possible to easily convey the user's sign and the atmosphere of the place to other users in the remote place in a non-verbal manner, and to smoothly communicate with the user in the remote place.

<Second Embodiment>
Hereinafter, the second embodiment will be described. In the first embodiment described above, one portable communication terminal 100-A and one stationary device 200-A are arranged at one of the two bases A, and one portable communication is arranged at the other base B. The first scene in which the terminal 100-B and one stationary device 200-B are arranged has been mainly described. On the other hand, in the second embodiment, a plurality of portable communication terminals 100-A and one stationary device 200-A are arranged at one base A, and one portable communication terminal 100- at the other base B. The second scene in which B and one stationary device 200-B are arranged will be described. Hereinafter, the differences from the first embodiment will be mainly described, and the points common to the first embodiment will be omitted. In the description of the second embodiment, the same parts as those of the first embodiment will be described with the same reference numerals.

[Communication; Second scene]
FIG. 11 is a diagram showing an example of a second scene of communication. In the figure, 100-A1 represents the first portable communication terminal, and 100-A2 represents the second portable communication terminal. Hereinafter, the portable communication terminal having the reference numeral "100-A1" will be referred to as a main communication terminal, and the portable communication terminal having the reference numeral "100-A2" will be referred to as a sub communication terminal.

The main communication terminal 100-A1 includes, for example, an electrostatic sensor 110-A1, an acceleration sensor 112-A1, an attitude sensor 114-A1, a drive device 120-A1, an LED 122-A1, and a speaker 124-A1. It includes a vibrator 126-A1, a signal processing unit 130-A1, a communication module 140-A1, a power receiving coil 150-A1, a charging circuit 160-A1, and a battery 170-A1.

The sub-communication terminal 100-A2 includes, for example, an electrostatic sensor 110-A2, an acceleration sensor 112-A2, an attitude sensor 114-A2, a drive device 120-A2, an LED 122-A2, and a speaker 124-A2. It includes a vibrator 126-A2, a signal processing unit 130-A2, a communication module 140-A2, a power receiving coil 150-A2, a charging circuit 160-A2, and a battery 170-A2.

The main communication terminal 100-A1 at the base A is an example of the "first portable communication terminal", the sub communication terminal 100-A2 is an example of the "third portable communication terminal", and the portable communication terminal at the base B. 100-B is an example of a "second portable communication terminal". The signal processing unit 130-A2 of the sub communication terminal 100-A2 is an example of the "second recognition unit", the communication module 140-A2 is an example of the "fourth communication unit", and the drive device 120-A2 and the LED 122- The A2, the speaker 124-A2, and the vibrator 126-A2 are examples of the "third operating unit". The gesture data of the gesture recognized by the main communication terminal 100-A1 is an example of "second data", and the gesture data of the gesture recognized by the sub communication terminal 100-A2 is an example of "third data".

In offices A, the stationary device communication range of the short-range communications 200-A in _{R A,} and the main communication terminal 100-A1 and the sub communication terminal 100-A2 is present. In such a case, the stationary device 200-A performs short-range communication with one or both of the main communication terminal 100-A1 and the sub communication terminal 100-A2.

For example, in the second scene, the user makes a gesture of contact operation on one of the communication terminals of the main communication terminal 100-A1 and the sub communication terminal 100-A2. In such a second scene, the stationary device 200-A transmits communication data to another base via one of the main communication terminal 100-A1 and the sub communication terminal 100-A2, which is not gestured. When transmitting to the portable communication terminal 100-B of B, the portable communication terminal 100-B of another base B receives communication data from each of two different communication terminals existing in the same base A. ..

In the present embodiment, when communication data based on environmental sound is transmitted from one mobile terminal existing in the base A and gesture data based on the gesture is transmitted from the other mobile terminal existing in the base A, the base The stationary device 200-A existing in A mediates the main communication terminal 100-A1 and the sub communication terminal 100-A2 by determining the priority of transmission of the data.

Specifically, the stationary device 200-A transmits communication data to the portable communication terminal 100-B of the other base B via one of the communication terminals of the own base A, and the other of the own base B. When the gesture is recognized by the communication terminal, the transmission of the gesture data to the portable communication terminal 100-B is prioritized over the transmission of the communication data to the portable communication terminal 100-B. The main communication terminal 100-A1 and the sub communication terminal 100-A2 are arbitrated.

In the second scene, each device of the base A performs the following series of processing. FIG. 12 is a flowchart showing an example of a series of processing flows of the stationary device 200-A according to the second embodiment. The processing of this flowchart may be repeated at a predetermined cycle.

First, the transmission signal generation unit 224 determines whether or not pairing of short-range communication has been established between the main communication terminal 100-A1 and the sub communication terminal 100-A2 (step S400).

When pairing with the main communication terminal 100-A1 and the sub communication terminal 100-A2 is established, the transmission signal generation unit 224 determines whether or not the environmental sound is collected by the microphone 210 (step S402).

Next, when the environmental sound is collected by the microphone 210, that is, when the audio signal of the environmental sound is input from the microphone 210, the audio conversion unit 222 performs AD conversion on the audio signal and uses the digital signal. Generate some audio data (step S404).

Next, the transmission signal generation unit 224 generates communication data based on the voice data generated by the voice conversion unit 222 (step S406).

Next, the transmission signal generation unit 224 determines whether or not the communication module 230 has received the flag information from one of the main communication terminal 100-A1 and the sub communication terminal 100-A2. Whether or not it is determined (step S408). The flag information is information indicating that the portable communication terminal 100 has recognized the gesture. The portable communication terminal 100 that generated the flag information can be regarded as having performed the gesture operation by the user. Hereinafter, as an example, the sub-communication terminal 100-A2 will be described as transmitting the flag information.

When the communication module 230 does not receive or does not receive the flag information from the sub communication terminal 100-A2, the transmission signal generation unit 224 transmits the generated communication data to the main communication terminal 100-A1 by short-range communication. Transmit (step S410).

On the other hand, when the communication module 230 receives the flag information from the sub communication terminal 100-A2 or receives the flag information, the transmission signal generation unit 224 further transmits the transmission completion information from the sub communication terminal 100-A2. It is determined whether or not the signal has been received (step S412). The transmission completion information is information indicating that the communication terminal, which is the transmission source of the flag information, has transmitted the gesture data to the portable communication terminal 100 of another base. For example, when the communication module 230 does not receive the transmission completion information from the sub communication terminal 100-A2, the sub communication terminal 100-A2 still transmits gesture data to the portable communication terminal 100-B of the other base B. Indicates that the transmission has not been completed.

When the communication module 230 receives the transmission completion information from the sub communication terminal 100-A2, the transmission signal generation unit 224 proceeds to the process of S410 and transmits the communication data to the main communication terminal 100-A1 by short-range communication. That is, the transmission signal generation unit 224 stands by without transmitting the communication data to the main communication terminal 100-A1 until the sub communication terminal 100-A2 transmits the gesture data. This ends the processing of this flowchart.

FIG. 13 is a flowchart showing an example of a series of processing flows of the portable communication terminal 100-A according to the second embodiment. The processing of this flowchart is repeated by the main communication terminal 100-A1 and the sub communication terminal 100-A2 at a predetermined cycle.

First, the transmission signal generation unit 133 determines whether or not the detection signal analysis unit 131 has recognized the gesture (step S500).

When the transmission signal generation unit 133 determines that the detection signal analysis unit 131 does not recognize the gesture, the transmission signal generation unit 133 determines whether or not the communication module 140 has received the communication data from the stationary device 200-A of the own base A ( Step S502).

When the communication data is received by the communication module 140, the transmission signal generation unit 133 controls the communication module 140 and transfers the communication data to the portable communication terminal 100-B of the other base B (step S504).

On the other hand, when the transmission signal generation unit 133 determines that the detection signal analysis unit 131 has recognized the gesture, the transmission signal generation unit 133 controls the communication module 140 and transmits the flag information to the stationary device 200-A of the own base A (step S506). ).

Next, the transmission signal generation unit 133 generates gesture data based on the analysis information input from the detection signal analysis unit 131 (step S508).

Next, the transmission signal generation unit 133 controls the communication module 140 to transmit the gesture data to the portable communication terminal 100-B of the other base B (step S510).

Next, the transmission signal generation unit 133 controls the communication module 140 to transmit the transmission completion information to the stationary device 200-A of the own base A (step S512). This ends the processing of this flowchart.

According to the second embodiment described above, when the stationary device 200-A transmits the communication data to the portable communication terminal 100-B of the other base B via one of the communication terminals of the own base A, When the gesture is recognized by the other communication terminal of the own base B, the gesture data may be transmitted to the portable communication terminal 100-B rather than the communication data being transmitted to the portable communication terminal 100-B. The portable communication terminal 100-A of the own base A is arbitrated so as to be prioritized. This makes it possible to communicate more smoothly with users in remote areas.

<Modified example of the second embodiment>
Hereinafter, a modified example of the second embodiment will be described. FIG. 14 is a diagram showing another example of the second scene of communication. In the illustrated example, the user makes a contact operation gesture to both the communication terminals of the main communication terminal 100-A1 and the sub communication terminal 100-A2. In such a second scene, the stationary device 200-A performs main communication based on the type of gesture recognized by the main communication terminal 100-A1 and the type of gesture recognized by the sub communication terminal 100-A2. Priority is given to transmitting gesture data from the sub-communication terminal 100-A2 to the portable communication terminal 100-B rather than transmitting gesture data from the terminal 100-A1 to the portable communication terminal 100-B. Or, rather than transmitting the gesture data from the sub communication terminal 100-A2 to the portable communication terminal 100-B, the gesture data is transmitted from the main communication terminal 100-A1 to the portable communication terminal 100-B. It is decided whether to give priority to the main communication terminal 100-A1 and the sub communication terminal 100-A2.

For example, when the type of gesture recognized by the main communication terminal 100-A1 is a regular gesture and the type of gesture recognized by the sub communication terminal 100-A2 is an atypical gesture, the stationary device 200 -A transmits gesture data from the sub communication terminal 100-A2 to the portable communication terminal 100-B rather than transmitting gesture data from the main communication terminal 100-A1 to the portable communication terminal 100-B. Give priority to sending. That is, the stationary device 200-A gives priority to transmitting the gesture data based on the irregular gesture rather than transmitting the gesture data based on the regular gesture. In this way, in order to determine the priority when transmitting the gesture data to the portable communication terminal 100 of another base according to the type of the gesture performed for communication, it is smoother with the user in the remote place. You can communicate.

<Third Embodiment>
Hereinafter, the third embodiment will be described. In the third embodiment, one portable communication terminal 100-A and one stationary device 200-A are arranged at one of the two bases A, and a plurality of portable communication terminals 100-A are arranged at the other base B. The third scene in which B and one stationary device 200-B are arranged will be described. Hereinafter, the differences between the first embodiment and the second embodiment will be mainly described, and the points common to the first embodiment and the second embodiment will be omitted. In the description of the third embodiment, the same parts as those of the first embodiment and the second embodiment will be described with the same reference numerals.

[Communication; 3rd scene]
FIG. 15 is a diagram showing an example of a third scene of communication. In the figure, 100-B1 represents the first portable communication terminal, and 100-B2 represents the second portable communication terminal. Similar to the second embodiment described above, hereinafter, the portable communication terminal having the reference numeral "100-B1" is referred to as a main communication terminal, and the portable communication terminal having "100-B2" is referred to as a sub. It will be referred to as a communication terminal.

The main communication terminal 100-B1 includes, for example, an electrostatic sensor 110-B1, an acceleration sensor 112-B1, an attitude sensor 114-B1, a drive device 120-B1, an LED 122-B1, and a speaker 124-B1. It includes a vibrator 126-B1, a signal processing unit 130-B1, a communication module 140-B1, a power receiving coil 150-B1, a charging circuit 160-B1, and a battery 170-B1.

The sub-communication terminal 100-B2 includes, for example, an electrostatic sensor 110-B2, an acceleration sensor 112-B2, an attitude sensor 114-B2, a drive device 120-B2, an LED 122-B2, a speaker 124-B2, and the like. It includes a vibrator 126-B2, a signal processing unit 130-B2, a communication module 140-B2, a power receiving coil 150-B2, a charging circuit 160-B2, and a battery 170-B2.

In offices A, the stationary device communication range of the short-range communications 200-A in _{R A,} and the main communication terminal 100-A1 and the sub communication terminal 100-A2 is present. In such a case, the stationary device 200-A performs short-range communication with one or both of the main communication terminal 100-A1 and the sub communication terminal 100-A2.

For example, in the third scene, the user makes a contact operation gesture to the portable communication terminal 100-A of the base A. In such a third scene, does the portable communication terminal 100-A set the gesture data transmission target to either the main communication terminal 100-B1 or the sub communication terminal 100-B2 existing at the base B? Or decide whether to use both. The portable communication terminal 100-A transmits gesture data to a part of the plurality of portable communication terminals 100-B, or transmits gesture data to all of the plurality of portable communication terminals 100-B, depending on the determination result of the transmission target.

Further, instead of the portable communication terminal 100-A determining the transmission target of the gesture data, the stationary device 200-A may determine the transmission target of the gesture data. In this case, the portable communication terminal 100-A transmits gesture data to a part of the plurality of portable communication terminals 100-B, or to all of them, depending on the determination result of the transmission target by the stationary device 200-A. Send gesture data.

FIG. 16 is a flowchart showing an example of a series of processing flows of the portable communication terminal 100-A according to the third embodiment. The processing of this flowchart is repeated at a predetermined cycle.

First, the transmission signal generation unit 133 determines whether or not the detection signal analysis unit 131 has recognized the gesture (step S600).

When the transmission signal generation unit 133 determines that the detection signal analysis unit 131 does not recognize the gesture, the transmission signal generation unit 133 determines whether or not the communication module 140 has received the communication data from the stationary device 200-A of the own base A ( Step S602).

When the communication data is received by the communication module 140, the transmission signal generation unit 133 controls the communication module 140 and transfers the communication data to the portable communication terminal 100-B of the other base B (step S604).

On the other hand, when the transmission signal generation unit 133 determines that the detection signal analysis unit 131 has recognized the gesture, the transmission signal generation unit 133 controls the communication module 140 and transmits the flag information to the stationary device 200-A of the own base A (step S606). ).

Next, the transmission signal generation unit 133 generates gesture data based on the analysis information input from the detection signal analysis unit 131 (step S608).

Next, the transmission signal generation unit 133 determines the transmission target of the gesture data according to the type of the gesture recognized by the detection signal analysis unit 131 (step S610).

For example, if the type of gesture recognized by the detection signal analysis unit 131 is an atypical gesture for the purpose of communicating with a specific individual in the base B, the transmission signal generation unit 133 has a plurality of gestures existing in the base B. Among the portable communication terminals 100-B of the above, some of the portable communication terminals 100-B that can be carried by a specific individual are determined as the target for transmitting gesture data, and the type of gesture recognized by the detection signal analysis unit 131 is In the case of a regular or atypical gesture that is not intended for communication with a specific individual, all the portable communication terminals 100-B existing in the base B are determined as the gesture data transmission target.

Next, the transmission signal generation unit 133 controls the communication module 140 with respect to the portable communication terminal 100-B determined as the transmission target among the plurality of portable communication terminals 100-B existing in the other base B. And the gesture data is transmitted (step S612).

Next, the transmission signal generation unit 133 controls the communication module 140 to transmit the transmission completion information to the stationary device 200-A of the own base A (step S614). This ends the processing of this flowchart.

According to the third embodiment described above, when a plurality of portable communication terminals 100-B exist in one base B, the type of gesture recognized by the portable communication terminal 100-A of the other base A is selected. Correspondingly, in order to determine the transmission target of gesture data from a plurality of portable communication terminals 100-B, it is possible to communicate with a specific individual at a remote location or with an unspecified user. It is possible to realize communication more smoothly.

Although the embodiments for carrying out the present invention have been described above using the embodiments, the present invention is not limited to these embodiments, and various modifications and substitutions are made without departing from the gist of the present invention. Can be added.

1 ... Communication system 100, 100-A1, 100-A2, 100-B1, 100-B2 ... Portable communication terminal 110 ... Electrostatic sensor 112 ... Accelerometer 114 ... Attitude sensor 120 ... Drive device 122 ... LED
124 ... Speaker 126 ... Vibrator 130 ... Signal processing unit 131 ... Detection signal analysis unit 133 ... Transmission signal generation unit 135 ... Received signal recognition unit 137 ... Operation command unit 140 ...・ ・ Communication module 142 ・ ・ ・ Transmitter 144 ・ ・ ・ Receiver 150 ・ ・ ・ Power receiving coil 160 ・ ・ ・ Charging circuit 170 ・ ・ ・ Battery 200, 200-A, 200-B ・ ・ ・ Stationary device 210, 210 -A ... Microphone 220 ... Signal processing unit 222 ... Voice conversion unit 224 ... Transmission signal generation unit 226 ... Communication terminal selection unit 230 ... Communication module 232 ... Transmission unit 234.・ ・ Receiver 240 ・ ・ ・ Power supply 250 ・ ・ ・ Power supply circuit 260 ・ ・ ・ Transmission coil

Claims (5)

At least a first communication unit that performs long-distance communication and short-range communication, a first operation unit that operates based on data received by the first communication unit, and a first recognition unit that recognizes a user's gesture. The first portable communication terminal that has
A second communication unit that performs short-range communication with the first portable communication terminal, and a first stationary device having at least a sound collecting unit.
A second portable communication terminal having at least a third communication unit that performs long-distance communication and short-range communication, and a second operation unit that operates based on data received by the third communication unit.
With
When the second communication unit can communicate with the first portable communication terminal by using short-range communication, the second communication unit transfers the first data based on the voice collected by the sound collection unit to the first portable communication terminal. Send and
When the first communication unit receives the first data from the first stationary device and the gesture is recognized by the first recognition unit, the first communication unit gives priority to the first data. When the second data based on the gesture recognized by the recognition unit is transmitted to the second portable communication terminal using long-distance communication and the first data is received from the first stationary device, the first When the gesture is not recognized by the recognition unit, the first data is transmitted to the second portable communication terminal using long-distance communication.
When the third communication unit receives data from the first portable communication terminal, the second operation unit operates based on the data received by the third communication unit.
Communication system. At least a fourth communication unit that performs long-distance communication and short-range communication, a third operation unit that operates based on data received by the fourth communication unit, and a second recognition unit that recognizes a user's gesture. Further equipped with a third portable communication terminal to have
The fourth communication unit transmits the third data based on the gesture recognized by the second recognition unit to the second portable communication terminal using long-distance communication.
The first portable communication terminal or the third portable communication terminal is said to be said when the gesture is recognized by the second recognition unit when the first data is transmitted to the second portable communication terminal. Priority is given to transmitting the third data to the second portable communication terminal rather than transmitting the first data to the second portable communication terminal.
The communication system according to claim 1. At least a fourth communication unit that performs long-distance communication and short-range communication, a third operation unit that operates based on data received by the fourth communication unit, and a second recognition unit that recognizes a user's gesture. Further equipped with a third portable communication terminal to have
The fourth communication unit transmits the third data based on the gesture recognized by the second recognition unit to the second portable communication terminal using long-distance communication.
The first portable communication terminal or the third portable communication terminal is based on the type of gesture recognized by the first recognition unit and the type of gesture recognized by the second recognition unit. Priority is given to one of the two data and the third data, and the data is transmitted to the second portable communication terminal.
The communication system according to claim 1. The types of gestures include a first type of gesture that is performed regularly and a second type of gesture that is performed irregularly.
The first portable communication terminal or the third portable communication terminal gives priority to transmitting data based on the second type of gesture rather than transmitting data based on the first type of gesture.
The communication system according to claim 3. Further equipped with a plurality of the second portable communication terminals,
The first portable communication terminal may be a part of the second portable communication terminal among the plurality of second portable communication terminals according to the type of gesture recognized by the first recognition unit. Decide whether to send the data or to send the second data to all the second portable communication terminals.
The communication system according to claim 3 or 4.

Images