JP2005012819A - Communication support system, communication terminal, motion control data storage terminal and program for terminal, and method of communication support - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication support system which can express emotion and ambience in detail that is hard to explain through a text or a phone conversation. <P>SOLUTION: A robot 100 is connected to the Internet 199 through a home gateway 200. The home gateway 200 inputs a motion as an angle data when the robot 100 is operated, generates the motion control data based on the inputted angle data, inputs a voice as a data and transmits the generated motion control data and the inputted voice data to other home gateway 200, and on the other hand, receives the motion control data and the voice data, controls the motion of the robot 100 based on the received motion control data and outputs a voice based on the received voice data. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a voice communication system, and a terminal, program, and method applied to the system, and in particular, a communication support system, a communication terminal, and an operation that can express in detail emotions and atmospheres that are difficult to be transmitted in sentences and calls. The present invention relates to a control data storage terminal, a terminal program, and a communication support method.

Communication tools that connect remote locations include telephone, wireless, e-mail, and chat. In particular, electronic mail and chat are common on the Internet. However, in communication by e-mail and chat, since communication is mainly made of characters, it is difficult to convey emotions and atmospheres that are difficult to convey in sentences.
Conventionally, as a technique for performing communication using messages such as e-mail and chat, for example, a communication method disclosed in Patent Document 1, an e-mail transmitting / receiving apparatus disclosed in Patent Document 2, and an electronic disclosed in Patent Document 3 There was a mail transmission / reception device. In addition, there are an information processing apparatus disclosed in Patent Document 4, an email attachment data processing method disclosed in Patent Document 5, and an automatic transmission control method for email disclosed in Patent Document 6. Further, there is an electronic mail transmission method disclosed in Patent Document 7, an electronic mail incoming notification device disclosed in Patent Document 8, and a mobile phone receiver disclosed in Patent Document 9.

The inventions described in Patent Documents 1 to 3 detect a specific keyword or emoticon from an e-mail or chat message, and cause the character robot to perform an action according to the detected keyword or the like.
In the invention described in Patent Document 4, a robot is used to simplify the operation of information equipment. As one example of use, there is a function of notifying through a robot when an e-mail is received.

The inventions described in Patent Documents 5 to 7 are designed to allow a virtual electronic pet to send and receive electronic mail. Electronic pets can be bred by repeatedly sending and receiving e-mails, making the sending and receiving of e-mails interesting.
The invention described in Patent Document 8 includes an animal type robot imitating an animal, and notifies the arrival of an e-mail by the action and sound of the animal type robot.

The invention described in Patent Document 9 proposes a mobile phone receiver. When a radio wave at the time of incoming call is detected, it is possible to generate a sound from an incoming machine imitating a doll or the like.
JP 2000-76167 A JP 2002-7291 A JP 2002-91886 A JP 2000-135384 A Japanese Patent Laid-Open No. 11-15758 JP 11-65965 A JP 2000-207312 A JP 2001-14233 A JP 2001-237916 A

  As described above, in each of the inventions described in Patent Documents 1 to 3, the character-type robot is caused to perform an action according to a specific keyword included in the message, so that an emotion or atmosphere that is difficult to be transmitted in the text is obtained. Trying to express. However, when specific keywords are not included, or when specific keywords are embedded in an inappropriate position in the message, it is not possible to express emotions and atmospheres that are difficult to convey in text. .

In addition, in the inventions described in Patent Documents 4, 8, and 9, since an incoming call is notified through a robot, similarly, emotions and atmospheres that are difficult to convey in sentences are expressed in detail. It was difficult.
In addition, in the inventions described in Patent Documents 5 to 7, only a virtual electronic pet is allowed to send and receive e-mails. Similarly, emotions and atmospheres that are difficult to convey in sentences are described in detail. It was difficult to express.

  Therefore, the present invention has been made paying attention to such unsolved problems of the conventional technology, a communication support system capable of expressing in detail emotions and atmospheres that are difficult to communicate in sentences and calls, An object is to provide a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method.

[Invention 1] In order to achieve the above object, a communication support system of Invention 1 comprises:
A communication support system in which a plurality of communication terminals are communicably connected and voice communication is performed between the communication terminals.
The communication terminal includes an operation body that is physically operable, an operation detection unit that detects the operation when the operation body is operated by an external action, and the operation based on a detection result of the operation detection unit. Motion control data generating means for generating motion control data for controlling body movement, voice input means for inputting voice as data, motion control data generated by the motion control data generating means, and voice input means Data transmitting means for transmitting the input voice data to the other communication terminal, data receiving means for receiving the operation control data and the voice data, and the operation body based on the operation control data received by the data receiving means And a voice output based on the voice data received by the data receiving means. And having an audio output means that.

  With such a configuration, when the user speaks while moving the moving body, the movement of the moving body is detected by the movement detecting unit, and the voice of the user is input as data by the voice input unit. Then, the operation control data generating unit generates operation control data based on the detection result of the operation detecting unit, and the data transmitting unit transmits the generated operation control data and the input voice data to another communication terminal. The

In other communication terminals, when the operation control data and the voice data are received by the data receiving unit, the operation of the operating unit is controlled by the operating unit control unit based on the received operation control data, and received by the voice output unit. Audio is output based on the audio data.
As a result, it is possible to talk with the other party of communication while being accompanied by the action of the moving body, so that it is possible to express emotions and atmospheres that are difficult to convey in sentences and calls compared to conventional methods in a relatively detailed manner. can get.

  Here, the operation control data may be any information as long as it is information for controlling the operation of the operation body. For example, the operation control data includes information indicating the operation amount of the operation body, or the operation pattern of the operation body. Are included in advance, and information for specifying one of the operation patterns is included. Hereinafter, the same applies to the communication terminal of the invention 10 to 12, the operation control data storage terminal of the invention 13, the terminal program of the invention 14 to 17, and the communication support method of the invention 18.

Further, part or all of the motion detection means, motion control data generation means, voice input means, data transmission means, data reception means, motion body control means, and voice output means may be provided integrally with the motion body. The operating body may be provided separately.
In addition, the communication terminal may be configured only by the operating body, or may be configured in combination by a combination of the operating body and other devices. In the former case, the operation control data generation means, voice input means, data transmission means, data reception means, action body control means and sound output means are provided integrally with the action body. In the latter case, for example, a communication terminal provided with a part or all of these means and an operating body can be communicably connected.

[Invention 2] Furthermore, the communication support system of Invention 2 is the communication support system of Invention 1,
The operation timing of the operating body and the output timing of the voice in the one communication terminal that is the communication counterpart, the operation detection timing of the operating body and the input timing of the voice in the other communication terminal that is the communication counterpart Is characterized by being synchronized.

With such a configuration, the operation timing and voice output timing of the operating body in one communication terminal that is the other party of communication, the operation detection timing and voice input of the operating body in the other communication terminal that is the other party of communication Timing is synchronized. That is, in one communication terminal that is a communication partner, the operation body operates and a sound is output at a timing that is synchronized with the timing when the other party that is the communication partner moves the operation body and the time when the sound is emitted.
Thereby, since the operation timing of the operating body is synchronized with the communication partner in accordance with the talk, it is possible to obtain an effect that it is possible to express emotions and atmospheres that are difficult to convey in sentences and calls in more detail.

[Invention 3] Furthermore, the communication support system of Invention 3 is the communication support system of any one of Inventions 1 and 2,
The communication terminal has an operating body display means for displaying a virtual operating body that is virtually operable,
The action body control means controls the operation of the virtual action body based on the action control data received by the data receiving means so as to be the same action as the action of the action body or an operation linked thereto. It is characterized by.
With such a configuration, when the communication terminal receives the motion control data and the voice data, the motion body control means controls the motion of the motion body, and based on the received motion control data, the motion body control means controls the motion body. The operation of the virtual operation body is controlled so as to be the same operation as the operation or a linked operation.

[Invention 4] Furthermore, the communication support system of Invention 4 is the communication support system of Invention 3,
The action body control means controls the action of the first virtual action body based on the action control data generated by the action control data generation means, and based on the action control data received by the data reception means, The movement of the second virtual movement body is controlled so as to be the same movement as the movement of the body or a linked movement.

With such a configuration, when the communication terminal receives the motion control data and the voice data, the motion body control means controls the motion of the first virtual motion body based on the generated motion control data. Based on the received operation control data, the operation of the second virtual operation body is controlled so as to be the same operation as the operation of the operation body or an operation linked thereto.
As a result, in the action object display means, the first virtual action object represents the action of the own action object, and the second virtual action object represents the action of the other action object. Then, it is possible to express emotions and atmospheres that are difficult to communicate in more detail.

[Invention 5] Furthermore, the communication support system of Invention 5 is the communication support system of any one of Inventions 3 and 4,
The action body display means is any one of a 2D display for displaying the virtual action body in a plane and a 3D display for displaying the virtual action body in a three-dimensional manner.
With such a configuration, the virtual operation body is displayed two-dimensionally or three-dimensionally on the 2D display or the 3D display.

[Invention 6] Furthermore, the communication support system of Invention 6 is the communication support system of any one of Inventions 1 to 5,
The communication terminal includes an operation object type determination unit that determines a type of an operation object of the communication terminal that is a communication partner, and an operation control data received by the data reception unit based on a determination result of the operation object type determination unit. Operation control data conversion means for converting
The motion control data conversion means determines that the type of the action body of the communication terminal that is the other party of communication is different from the type of action body of the communication terminal based on the determination result of the action body type determination means. In some cases, the operation control data received by the data receiving means is converted into operation control data for an operating body of the communication terminal.

  If it is such a structure, in a communication terminal, if operation control data and audio | voice data are received, the type of the operation body of the communication terminal used as the other party of communication will be determined by the operation body type determination means. Then, based on the determination result, when it is determined that the type of the operating body of the communication terminal that is the other party of communication is different from the type of the operating body of the communication terminal, the operation control data conversion unit receives the received operation. The control data is converted into motion control data for the motion body of the communication terminal, and the motion body control means controls the motion of the motion body based on the converted motion control data.

  As a result, even if the type of action body that the other party of communication has differs from the type of action body that the other party has, each action body operates as if it is communicating using the same type of action body. As a result, it is possible to reduce the possibility of damaging emotions and atmospheres that are difficult to convey in sentences and calls.

[Invention 7] The communication support system of Invention 7 is the communication support system of any one of Inventions 1 to 5,
The communication terminal is an operation body type determination unit that determines a type of an operation body of the communication terminal that is a communication partner, and an operation generated by the operation control data generation unit based on a determination result of the operation body type determination unit Operation control data conversion means for converting control data;
The motion control data conversion means determines that the type of the action body of the communication terminal that is the other party of communication is different from the type of action body of the communication terminal based on the determination result of the action body type determination means. In some cases, the motion control data generated by the motion control data generating means is converted into motion control data for the motion body of the communication terminal which is a communication partner.

  With such a configuration, in the communication terminal, the action object type determination means determines the action object type of the communication terminal that is the other party of communication. Then, based on the determination result, when it is determined that the type of the operating body of the communication terminal serving as the communication partner is different from the type of the operating body of the communication terminal, the operation control data conversion unit generates The operation control data is converted into operation control data for an operating body of a communication terminal that is a communication partner, and the converted operation control data and input voice data are transmitted to another communication terminal by the data transmission means.

[Invention 8] Furthermore, the communication support system of Invention 8 is the communication support system of any one of Inventions 6 and 7,
A conversion table storage means for storing an operation control data conversion table in which the operation control data for a specific type of operation object and the operation control data for an operation object of a type different from the specific type are associated;
The operation control data conversion unit converts the operation control data with reference to an operation control data conversion table of the conversion table storage unit.

With such a configuration, the operation control data conversion unit converts the operation control data by referring to the operation control data conversion table in the conversion table storage unit.
Here, the conversion table storage unit may be provided in the communication terminal, but is not limited thereto, and may be provided in a terminal other than the communication terminal. In the latter case, for example, it can be configured as a database server or a network storage.

[Invention 9] Furthermore, the communication support system of the invention 9 is the communication support system of any one of the inventions 1 to 8,
The operation control data storage terminal for storing the operation control data is connected to be communicable,
The operation control data storage terminal has operation control data storage means for storing the operation control data, and operation control data providing means for providing operation control data of the operation control data storage means to the communication terminal,
When the operation control data providing means receives the operation control data provision request, the operation control data providing means reads the operation control data related to the received provision request from the operation control data storage means, and reads the read operation control data in the provision request. It is sent to the communication terminal that is the sender,
The communication terminal has operation control data acquisition means for acquiring the operation control data from the operation control data storage terminal,
The data transmission means transmits the operation control data acquired by the operation control data acquisition means and the voice data input by the voice input means to the other communication terminal.

With such a configuration, in the communication terminal, the operation control data acquisition means transmits a request for providing the operation control data to the operation control data storage terminal.
In the operation control data storage terminal, when the provision request is received, the operation control data providing unit reads the operation control data related to the received provision request from the operation control data storage unit, and the read operation control data is the provision request. Is transmitted to the communication terminal that is the transmission source of.

In the communication terminal, when the operation control data is received, the received operation control data and the input voice data are transmitted to another communication terminal by the data transmission means.
This makes it possible to operate the operation body possessed by the other party of the communication by using the operation control data storage terminal without moving the operation body, thereby reducing the trouble of performing communication. Can also be obtained.

[Invention 10] On the other hand, in order to achieve the above object, a communication terminal of Invention 10 includes:
A communication terminal that is communicably connected to a communication terminal and performs voice communication,
An operation body that is physically operable, an operation detection means for detecting the operation when the operation body is operated by an external action, and controlling the operation of the operation body based on a detection result of the operation detection means Operation control data generating means for generating operation control data for performing, voice input means for inputting voice as data, operation control data generated by the operation control data generating means, and voice data input by the voice input means And a data transmission means for transmitting to the other communication terminal.

  With such a configuration, when the user speaks while moving the moving body, the movement of the moving body is detected by the movement detecting unit, and the voice of the user is input as data by the voice input unit. Then, the operation control data generating unit generates operation control data based on the detection result of the operation detecting unit, and the data transmitting unit transmits the generated operation control data and the input voice data to another communication terminal. The

In other communication terminals, when the operation control data and the voice data are received by the data receiving unit, the operation of the operating unit is controlled by the operating unit control unit based on the received operation control data, and received by the voice output unit. Audio is output based on the audio data.
As a result, it is possible to talk with the other party of communication while being accompanied by the action of the moving body, so that it is possible to express emotions and atmospheres that are difficult to convey in sentences and calls compared to conventional methods in a relatively detailed manner. can get.

Here, part or all of the motion detection means, motion control data generation means, voice input means, and data transmission means may be provided integrally with the action body, or may be provided separately from the action body. . The same applies to the terminal program of the invention 14 below.
In addition, the communication terminal may be configured only by the operating body, or may be configured in combination by a combination of the operating body and other devices. In the former case, the operation control data generation means, the voice input means, and the data transmission means are provided integrally with the operation body. In the latter case, for example, a communication terminal provided with a part or all of these means and an operating body can be communicably connected. The same applies to the terminal program of the invention 14 below.

[Invention 11] Furthermore, the communication terminal of Invention 11 is
A communication terminal that is communicably connected to a communication terminal and performs voice communication,
An operating body that is physically operable, data receiving means for receiving operation control data and audio data for controlling the operation of the operating body, and the operating body based on the operation control data received by the data receiving means And a voice output means for outputting voice based on the voice data received by the data receiving means.

With this configuration, when the operation control data and the voice data are received by the data receiving unit, the operation unit control unit controls the operation of the operating unit based on the received operation control data, and the voice output unit The voice is output based on the received voice data.
Here, a part or all of the data receiving means, the operating body control means, and the sound output means may be provided integrally with the operating body, or may be provided separately from the operating body. Hereinafter, the same applies to the terminal program of the fifteenth aspect.

  In addition, the communication terminal may be configured only by the operating body, or may be configured in combination by a combination of the operating body and other devices. In the former case, the data receiving means, the operating body control means and the sound output means are provided integrally with the operating body. In the latter case, for example, a communication terminal provided with a part or all of these means and an operating body can be communicably connected. Hereinafter, the same applies to the terminal program of the fifteenth aspect.

[Invention 12] Furthermore, the communication terminal of Invention 12 is
A communication terminal that is communicably connected to a communication terminal and performs voice communication,
An operating body display means for displaying a virtual operating body that is virtually operable; a data receiving means for receiving operation control data and audio data for controlling the operation of the physically operable operating body; and Virtual action body control means for controlling the action of the virtual action body based on action control data received by the data receiving means, and voice output means for outputting sound based on the sound data received by the data receiving means. It is characterized by that.

With such a configuration, when the operation control data and the voice data are received by the data receiving means, the action control means controls the operation of the virtual action body based on the received action control data, and the sound output means. Thus, sound is output based on the received sound data.
Here, a part or all of the data receiving means, the virtual action body control means, and the sound output means may be provided integrally with the action body display means, or may be provided separately from the action body display means. . Hereinafter, the same applies to the terminal program of the sixteenth aspect.

  In addition, the communication terminal may be configured by only the operating body display means, or may be combined by combining the operating body display means and other devices. In the former case, the data receiving means, virtual operating body control means and audio output means are provided integrally with the operating body display means. In the latter case, for example, a communication terminal provided with a part or all of these means and an operating body display means can be configured to be communicable. Hereinafter, the same applies to the terminal program of the sixteenth aspect.

[Invention 13] On the other hand, in order to achieve the above object, the operation control data storage terminal of Invention 13 includes:
An operation control data accumulating terminal for accumulating operation control data for controlling operation of a physically operable operating body that is communicably connected to a communication terminal,
Operation control data storage means for storing the operation control data; and operation control data providing means for providing the communication terminal with the operation control data of the operation control data storage means,
When the operation control data providing means receives the operation control data provision request, the operation control data providing means reads the operation control data related to the received provision request from the operation control data storage means, and reads the read operation control data in the provision request. It transmits to the communication terminal used as a transmission origin, It is characterized by the above-mentioned.

In such a configuration, when the operation control data providing request is received, the operation control data providing unit reads the operation control data related to the received providing request from the operation control data storage unit, and the read operation The control data is transmitted to the communication terminal that is the transmission source of the provision request.
This makes it possible to operate the operation body possessed by the other party of the communication by using the operation control data storage terminal without moving the operation body, thereby reducing the trouble of performing communication. Can also be obtained.

[Invention 14] On the other hand, in order to achieve the above object, a terminal program according to Invention 14 includes:
A program for a terminal to be executed by a computer operating as a communication terminal,
Operation detecting means for detecting the operation when a physically operable operating body is operated by an external action, and operation control data for controlling the operation of the operating body based on the detection result of the operation detecting means Control data generating means for generating voice, voice input means for inputting voice as data, operation control data generated by the action control data generating means, and voice data input by the voice input means are transmitted to the other communication terminals. It is a program for executing a process realized as a data transmission means.

  With such a configuration, when the program is read by the communication terminal and the communication terminal executes processing according to the read program, the same operation and effect as the communication terminal of the tenth aspect can be obtained.

[Invention 15] Further, the terminal program according to Invention 15 is:
A program for a terminal to be executed by a computer operating as a communication terminal,
Data receiving means for receiving operation control data and audio data for controlling the operation of the physically operable operating body, and operation for controlling the operation of the operating body based on the operation control data received by the data receiving means It is a program for executing processing realized as a body control means and a sound output means for outputting sound based on the sound data received by the data receiving means.

  With such a configuration, when the program is read by the communication terminal and the communication terminal executes processing according to the read program, the same operation and effect as the communication terminal of the eleventh aspect can be obtained.

[Invention 16] Further, the terminal program of the invention 16 includes:
A program for a terminal to be executed by a computer operating as a communication terminal,
Data receiving means for receiving operation control data and audio data for controlling the operation of a physically operable operating body, and a virtual operating body capable of virtually operating based on the operation control data received by the data receiving means A program for executing processing realized as a virtual action body control means for controlling the operation of the above and a sound output means for outputting sound based on the sound data received by the data receiving means.

  With such a configuration, when the program is read by the communication terminal and the communication terminal executes processing according to the read program, the same operation and effect as those of the communication terminal of the twelfth aspect are obtained.

[Invention 17] Furthermore, the terminal program according to Invention 17 is:
A terminal program for causing a computer operating as an operation control data storage terminal to execute the program,
A program for executing processing realized as operation control data providing means for providing operation control data for controlling operation of a physically operable operation body to a communication terminal,
When the operation control data providing unit receives the operation control data provision request, the operation control data providing unit reads the operation control data related to the received provision request from the operation control data storage unit, and transmits the read operation control data to the provision request. It is characterized in that it is transmitted to the original communication terminal.

  With such a configuration, when the program is read by the operation control data storage terminal and the operation control data storage terminal executes processing according to the read program, the operation and effect equivalent to those of the operation control data storage terminal of the thirteenth aspect are achieved. can get.

[Invention 18] On the other hand, in order to achieve the above object, the communication support method of Invention 18 includes:
A communication support method in which a plurality of communication terminals having physically operable operating bodies are communicably connected, and voice communication is performed between the communication terminals,
For one communication terminal that is the other party of communication,
An operation detecting step for detecting the operation when the operating body is operated by an external action, and an operation for generating operation control data for controlling the operation of the operating body based on a detection result of the operation detecting step. Control data generation step, voice input step for inputting voice as data, operation control data generated in the operation control data generation step and voice data input in the voice input step as the other communication terminal A data transmission step for transmitting to
For the other communication terminal,
The data receiving step for receiving the motion control data and the audio data, the motion body control step for controlling the motion of the motion body based on the motion control data received in the data receiving step, and the data receiving step A voice output step of outputting voice based on the voice data.
Thereby, an effect equivalent to that of the communication support system of aspect 1 is obtained.

Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 to FIG. 7 are diagrams showing a first embodiment of a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention.
In the present embodiment, a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention are illustrated in FIG. This is applied to the case where IP phone or e-mail is sent and received while moving.

First, the configuration of a network system to which the present invention is applied will be described with reference to FIG. FIG. 1 is a block diagram showing a configuration of a network system to which the present invention is applied.
As shown in FIG. 1, a home gateway 200 for performing IP telephone communication processing and e-mail transmission / reception processing is installed in each of the homes A and B. Connected to the home gateway 200 is a robot 100 simulating the form of a human or animal and having a plurality of joints configured as movable parts and operable by movement of the movable parts. Each home gateway 200 is connected to the Internet 199.

  The home gateway 200 can be configured as a general computer. For example, a calling process for another home gateway 200, a call process with another home gateway 200, an incoming call process from another home gateway 200, etc. In addition to performing communication processing, it is possible to send / receive emails to / from other home gateways 200 via a mail server (not shown) using an email sending / receiving application.

Next, the configuration of the robot 100 will be described in detail with reference to FIG. FIG. 2 is a functional block diagram showing the configuration of the robot 100.
As shown in FIG. 2, the robot 100 includes a movable unit 102 that constitutes a joint unit, a rotational drive unit 104 such as an actuator that rotationally drives the movable unit 102, and a rotary that detects a movable amount of the movable unit 102 as angle data. Each joint unit has a movable amount detection unit 106 such as an encoder, and further, a control unit 108 that controls each rotation drive unit 104 and each movable amount detection unit 106, a microphone 110, a speaker 112, and a home gateway. 200 has an I / F 114 that mediates data input / output.

  When the control unit 108 specifies the movable unit 102 and inputs the angle data of the rotation drive unit 104, the control unit 108 controls the rotation drive unit 104 to rotate the corresponding movable unit 102 by the angle from the reference angle. Also. When a request to detect the movable amount of the movable portion 102 is input by specifying the movable portion 102, the movable amount detection unit 106 is controlled so as to detect the movable amount of the corresponding movable portion 102 as angle data. The angle data obtained is output via the I / F 114.

The microphone 110 has an A / D conversion circuit, inputs sound as data, and outputs the input sound data via the I / F 114.
The speaker 112 has a D / A conversion circuit and outputs sound based on sound data input via the I / F 114.
Next, the configuration of the home gateway 200 will be described in detail with reference to FIG. FIG. 3 is a functional block diagram showing the configuration of the home gateway 200.

  As shown in FIG. 3, the home gateway 200 includes a CPU 30 that controls operations and the entire system based on a control program, a ROM 32 that stores a control program for the CPU 30 in a predetermined area, and data read from the ROM 32 and the like. And a RAM 34 for storing calculation results required in the calculation process of the CPU 30 and an I / F 38 for mediating input / output of data to / from an external device, which are signals for transferring data The buses 39 are connected to each other so as to be able to exchange data.

The I / F 38 includes an input device 40 such as a keyboard and a mouse that can input data as a human interface, a storage device 42 that stores data, tables, and the like as files, and a display that displays a screen based on an image signal. The device 44 and a signal line for connecting to the Internet 199 are connected.
The CPU 30 includes a microprocessing unit MPU and the like, and activates a predetermined program stored in a predetermined area of the ROM 32. According to the program, the calling process, the incoming call process, and the e-mail shown in the flowcharts of FIGS. Transmission processing and e-mail reception processing are each executed in a time-sharing manner.

First, the calling process will be described in detail with reference to FIG. FIG. 4 is a flowchart showing the calling process.
The calling process is a process of making a call to another home gateway 200 when making a call using an IP phone. When the call process is executed by the CPU 30, as shown in FIG. It is supposed to be.

In step S100, it is determined whether or not a call is requested. When it is determined that a call is requested (Yes), the process proceeds to step S102. When it is determined that this is not the case (No), a call is requested. Wait in step S100 until
In step S102, the home gateway 200 as a call destination is specified from a communication destination list such as a telephone directory, and the designation is input from the input device 40. The process proceeds to step S104, and the designated home gateway 200 is called. The signal is transmitted, and the process proceeds to step S106.

  In step S106, voice data is input from the robot 100, the process proceeds to step S108, angle data is input from the robot 100, the process proceeds to step S110, and the operation of the robot 100 is controlled based on the input angle data. Operation control data is generated, the process proceeds to step S112, the generated operation control data and the input voice data are transmitted to the home gateway 200 that is the call destination, and the process proceeds to step S114.

In step S114, it is determined whether or not the call has ended. When it is determined that the call has ended (Yes), the series of processes is ended and the original process is restored.
On the other hand, when it is determined in step S114 that the call has not ended (No), the process proceeds to step S106.
Next, the incoming call process will be described in detail with reference to FIG. FIG. 5 is a flowchart showing incoming call processing.

The incoming call process is a process for receiving an incoming call from another home gateway 200 and controlling the operation of the robot 100 when making a call using an IP phone. When the CPU 30 executes the incoming call process, as shown in FIG. First, the process proceeds to step S150.
In step S150, it is determined whether or not an incoming call signal has been received. When it is determined that an incoming call signal has been received (Yes), the process proceeds to step S152. When it is determined that this is not the case (No), The process waits in step S150 until an incoming call signal is received.

In step S152, a ringing tone is output using the speaker 112 of the robot 100, and the process proceeds to step S154 to determine whether or not it is on-hook. If it is determined that it is on-hook (Yes), the process proceeds to step S156. Transition.
In step S156, the motion control data and voice data are received, the process proceeds to step S158, the received voice data is output to the robot 100, the process proceeds to step S160, and the robot 100 is operated based on the received motion control data. Make it work. In the operation control of the robot 100, the operation timing and voice output timing of the robot 100 are synchronized with the operation detection timing and voice input timing of the communication destination robot 100.

Next, the process proceeds to step S162, where it is determined whether or not the call has ended. When it is determined that the call has ended (Yes), the series of processes is ended and the original process is restored.
On the other hand, when it is determined in step S162 that the call has not ended (No), the process proceeds to step S156.
Next, the e-mail transmission process will be described in detail with reference to FIG. FIG. 6 is a flowchart showing the e-mail transmission process.

The e-mail transmission process is a process of creating an e-mail and transmitting the created e-mail to another home gateway 200. When executed in the CPU 30, as shown in FIG. It is supposed to be.
In step S200, it is determined whether or not a start button (not shown) has been pressed. When it is determined that the start button has been pressed (Yes), the process proceeds to step S202, but when it is determined that it is not (No), The process waits in step S200 until the start button is pressed.

In step S202, angle data is input from the robot 100, the process proceeds to step S204, operation control data is generated based on the input angle data, the process proceeds to step S206, and the generated operation control data is stored in the storage device 42. And the process proceeds to step S208.
In step S208, it is determined whether or not the operation control data has been taken in. When it is determined that the operation control data has been taken in (Yes), the process proceeds to step S210, where Is input from the input device 40, and the process proceeds to step S212 to determine whether or not the input of character data is completed. When it is determined that the input of character data is completed (Yes), step S214 is performed. Migrate to

  In step S214, the home gateway 200 as the transmission destination is specified from the transmission destination list such as the address book, and the designation is input from the input device 40. The process proceeds to step S216, and the operation control data is transferred from the storage device 42. The electronic mail is created by attaching the read operation control data to the electronic mail, and the process proceeds to step S218, where the created electronic mail is transmitted to the home gateway 200 that is the transmission destination, and the series of processing ends. To return to the original process.

On the other hand, when it is determined in step S212 that the input of character data has been completed (No), the process proceeds to step S210.
On the other hand, when it is determined in step S208 that the operation control data has not been taken in (No), the process proceeds to step S202.
Next, the e-mail receiving process will be described in detail with reference to FIG. FIG. 7 is a flowchart showing the e-mail receiving process.

The e-mail receiving process is a process for receiving an e-mail from another home gateway 200 and controlling the operation of the robot 100 based on the received e-mail, and when executed in the CPU 30, as shown in FIG. First, the process proceeds to step S250.
In step S250, it is determined whether or not an e-mail has been received. When it is determined that an e-mail has been received (Yes), the process proceeds to step S252. Until it is received in step S250.

In step S252, a ring tone is output using the speaker 112 of the robot 100, and the process proceeds to step S254 to determine whether or not the operation control data is attached to the received e-mail, and the operation control data is attached. When it is determined that it is (Yes), the process proceeds to step S256.
In step S256, operation control data is acquired from the received e-mail, the process proceeds to step S258, the robot 100 is operated based on the acquired operation control data, a series of processes is terminated, and the original process is restored. .

On the other hand, when it is determined in step S254 that the operation control data is not attached to the received e-mail (No), the series of processes is terminated and the process returns to the original process.
Next, the operation of the present embodiment will be described.
First, a case where a telephone call using an IP phone is performed using the robot 100 will be described.
When making a call, the user requests a call at the home gateway 200 and designates the home gateway 200 as a call destination from a call destination list such as a telephone directory.

  In home gateway 200, when a call is requested and designation of a call destination is input, a call signal is transmitted to designated home gateway 200 through steps S102 and S104. Then, when it becomes possible to make a call with the home gateway 200 designated as the call destination, voice data and angle data are input from the robot 100 through steps S106 to S112, and operation control data is generated based on the input angle data. Then, the generated operation control data and the input voice data are transmitted to the home gateway 200 which is a call destination. Note that the processes in steps S106 to S112 are repeated until the call is finished at predetermined intervals (for example, several ms).

On the other hand, when receiving the incoming call signal, the call destination home gateway 200 repeats steps S152 and S154 and outputs a ringing tone using the speaker 112 of the robot 100.
When the called user answers the incoming call while the ringing tone is ringing, the called home gateway 200 receives the operation control data and the voice data through step S156, and the received voice data is received by the robot 100. The movement of the robot 100 is controlled based on the received movement control data. At this time, the operation timing and the voice output timing of the robot 100 are synchronized with the operation detection timing and the voice input timing of the destination robot 100. In other words, the robot 100 operates and the sound is output from the speaker 112 at the timing synchronized with the timing when the communication partner moves the robot 100 and the timing when the sound is emitted. Note that the processing in steps S156 to S160 is repeated until the call is finished every predetermined cycle (for example, several ms).

Next, a case where communication by electronic mail using the robot 100 is performed will be described.
When transmitting an e-mail, the user presses a start button in the home gateway 200 to start capturing operation control data.
In the home gateway 200, when the start button is pressed, the angle data is input from the robot 100 through steps S202 to S206, the operation control data is generated based on the input angle data, and the generated operation control data is generated. Is stored in the storage device 42.

  When the capture of the operation control data is completed, the user is requested to input character data as the body of the e-mail through step S210. When the user inputs character data in response to the request and designates the home gateway 200 as the destination from the destination list such as the address book, the operation control data is read from the storage device 42 through steps S216 and S218. The read operation control data is attached to the electronic mail, and the electronic mail thus created is transmitted to the home gateway 200 as the transmission destination.

  In the destination home gateway 200, when an e-mail is received, a ring tone is output using the speaker 112 of the robot 100 through step S252. If the operation control data is attached to the received e-mail, the operation control data is acquired from the received e-mail through steps S256 and S258, and the operation of the robot 100 is performed based on the acquired operation control data. Be controlled.

  In this way, in this embodiment, home gateway 200 inputs the operation when robot 100 is operated as angle data, generates operation control data based on the input angle data, and generates voice as data. The generated motion control data and the input voice data are transmitted to the other home gateway 200, while the motion control data and the voice data are received, and the motion of the robot 100 is controlled based on the received motion control data. The voice is output based on the received voice data.

As a result, since it is possible to talk with the other party of communication while being accompanied by the operation of the robot 100, it is possible to express emotions and atmospheres that are difficult to be communicated by text and telephone calls in a relatively detailed manner as compared with the conventional case.
Further, in the present embodiment, the home gateway 200 synchronizes the operation timing and voice output timing of the robot 100 with the operation detection timing and voice input timing of the communication destination robot 100.

Thereby, since the operation timing of the robot 100 is synchronized with the communication partner according to the talk, it is possible to express emotions and atmospheres that are difficult to convey in sentences and calls in more detail.
In the first embodiment, the robot 100 and the home gateway 200 correspond to the communication terminals of the invention 1, 2, 10, 11, 14, 15, or 18, and the robot 100 is the invention 1, 2, 10, 11 , 14, 15 or 18, step S 106 corresponds to the voice input means of the invention 1, 10 or 14 or the voice input step of the invention 18. Step S108 corresponds to the motion detection means of the invention 1, 10 or 14, or the motion detection step of the invention 18, and the step S110 corresponds to the motion control data generation means of the invention 1, 10, or 14 or the motion of the invention 18. This corresponds to the control data generation step.

  In the first embodiment, step S112 corresponds to the data transmission means of the invention 1, 10 or 14, or the data transmission step of the invention 18, and step S156 is the data reception of the invention 1, 11 or 15. This corresponds to the data receiving step of the means or the invention 18. Step S158 corresponds to the sound output means of the invention 1, 11 or 15, or the sound output step of the invention 18, and the step S160 is the action body control means of the invention 1, 11 or 15, or the action body of the invention 18. Corresponds to the control step.

  Next, a second embodiment of the present invention will be described with reference to the drawings. 8 to 10 are diagrams showing a second embodiment of a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention. Hereinafter, only the parts different from the first embodiment will be described, and the same parts as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be omitted.

  In the present embodiment, a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention are illustrated in FIG. This is applied to the case where IP phone or e-mail is transmitted / received while moving. Unlike the first embodiment, as shown in FIG. 8, when communicating between different types of robots 100, The operation control data is converted so that the operation does not become unnatural.

As shown in FIG. 9, the storage device 42 stores an operation control data conversion table 400 for converting operation control data. FIG. 9 is a diagram illustrating a data structure of the operation control data conversion table 400.
In the operation control data conversion table 400, as shown in FIG. 9, one record is registered for each operation control data to be converted. Each record includes a field 402 in which operation control data for the humanoid robot 100 is registered, and a field 404 in which operation control data for the dog robot 100 is registered.

  In the example of FIG. 9, in the first-stage record, the operation control data for moving the right hand of the humanoid robot 100 is in the field 402, and the operation control data for moving the right forefoot of the dog robot 100 is the field 404. Are registered respectively. If this is motion control data from the home gateway 200 of the humanoid robot 100 for moving the right hand, the motion control data is converted into corresponding motion control data for the dog robot 100. It means that.

The CPU 30 starts a predetermined program stored in a predetermined area of the ROM 32, and executes an operation control data conversion process shown in the flowchart of FIG. 10 according to the program. FIG. 10 is a flowchart showing the operation control data conversion process.
The operation control data conversion process is a process executed immediately before step S150 or step S258. When the operation control data conversion process is executed in the CPU 30, as shown in FIG. 10, first, the process proceeds to step S300.

  In step S300, it is determined whether or not the type of the robot 100 that is the communication destination is the same as the type of the robot 100 of the communication destination. If it is determined that the types of the robots 100 are different (No), the process proceeds to step S302. Then, the motion control data conversion table 400 is read from the storage device 42, the process proceeds to step S304, and the received motion control data is converted into motion control data for the robot 100 by referring to the read motion control data conversion table 400. Conversion is completed, and a series of processing ends and the original processing is restored.

On the other hand, when it is determined in step S300 that the type of the robot 100 as the communication destination is the same as the type of the own robot 100 (Yes), the series of processes is terminated and the original process is restored.
Next, the operation of the present embodiment will be described.
A case will be described in which a telephone call is made between the humanoid robot 100 and the dog robot 100 using an IP phone.

When making a call, a user having the humanoid robot 100 requests a call at the home gateway 200 and designates the home gateway 200 to be a call destination from a call destination list such as a telephone directory.
In home gateway 200, when a call is requested and designation of a call destination is input, a call signal is transmitted to designated home gateway 200 through steps S102 and S104. Then, when it becomes possible to make a call with the home gateway 200 designated as a call destination, voice data and angle data are input from the humanoid robot 100 through steps S106 to S112, and the humanoid robot is based on the input angle data. The operation control data for 100 is generated, and the generated operation control data and the input voice data are transmitted to the home gateway 200 which is a call destination.

On the other hand, when receiving the incoming call signal, the call destination home gateway 200 repeats steps S152 and S154 and outputs a ringing tone using the speaker 112 of the dog-type robot 100.
When the called user answers the incoming call while the ringing tone is sounding, the called home gateway 200 receives the operation control data and the voice data through steps S156, S158, and S300, and receives the received voice. While data is output to the robot 100, it is determined whether or not the type of the robot 100 as the communication destination is the same as the type of the own robot 100. At this time, since it is determined that the types of the robots 100 are different, the operation control data conversion table 400 is read from the storage device 42 through steps S302 and S304, and the read operation control data conversion table 400 is referred to. Thus, the received motion control data is converted into motion control data for the robot 100 of its own. Then, through step S160, the operation of the dog robot 100 is controlled based on the converted operation control data.

Thus, in this embodiment, when the home gateway 200 determines that the type of the robot 100 as the communication destination is different from the type of the robot 100 of its own, the home gateway 200 refers to the operation control data conversion table 400, The received motion control data is converted into motion control data for the robot 100 of its own.
As a result, even if the type of the robot 100 possessed by the communication partner is different from the type of the robot 100 possessed by itself, each robot 100 operates as if it is communicating using the same type of robot 100. Therefore, it is possible to reduce the possibility of damaging emotions and atmospheres that are difficult to convey in sentences and calls.

  In the second embodiment, the robot 100 and the home gateway 200 correspond to the communication terminals according to the first, second, sixth, tenth, eleventh, fourteenth, fifteenth, or eighteenth invention. Corresponding to 10, 11, 14, 15 or 18 operating bodies. Step S106 corresponds to the voice input means of the invention 1, 10 or 14 or the voice input step of the invention 18, and step S108 is the operation detection means of the invention 1, 10 or 14 or the action detection step of the invention 18. It corresponds to.

  In the second embodiment, step S110 corresponds to the operation control data generating means of the invention 1, 10 or 14, or the operation control data generating step of the invention 18, and step S112 is the invention 1, 10, or This corresponds to 14 data transmission means or the data transmission step of invention 18. Step S156 corresponds to the data receiving means of Invention 1, 6, 11 or 15, or the data receiving step of Invention 18, and Step S158 is the sound output means of Invention 1, 11 or 15, or the sound of Invention 18. Corresponds to the output step.

In the second embodiment, step S160 corresponds to the operating body control means of the invention 1, 11 or 15, or the operating body control step of the invention 18, and step S300 is the operating body type determination of the invention 6. Step S304 corresponds to the operation control data conversion means of the invention 6 or 8.
Next, a third embodiment of the present invention will be described with reference to the drawings. 11 and 12 are diagrams showing a third embodiment of a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention. Hereinafter, only the parts different from the first embodiment will be described, and the same parts as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be omitted.

  In the present embodiment, a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention are illustrated in FIG. The present invention is applied to a case where IP phone or e-mail is transmitted / received while moving, and is different from the first embodiment in that power is saved for the robot 100 while the robot 100 is not in use.

As shown in FIG. 11, the storage device 42 stores a power saving operation table 420 that defines a power saving operation. FIG. 11 is a diagram illustrating a data structure of the power saving operation table 420.
As shown in FIG. 11, one record is registered in the power saving operation table 420 for each type of the robot 100. Each record includes a field 422 in which the type of the robot 100 is registered, and a field 424 in which operation control data defining the power saving operation of the robot 100 is registered.

In the example of FIG. 11, motion control data that defines an operation in which the humanoid robot 100 falls asleep as the motion control data is registered in the first level record as the type of the robot 100. This means that while the humanoid robot 100 is not being used, the robot 100 performs an operation of sleeping on the chin.
The CPU 30 starts a predetermined program stored in a predetermined area of the ROM 32, and executes the power saving operation process shown in the flowchart of FIG. 12 according to the program. FIG. 12 is a flowchart showing power saving operation processing.

The power saving operation process is a process for saving power of the robot 100. When the power saving operation process is executed by the CPU 30, as shown in FIG. 12, first, the process proceeds to step S350.
In step S350, it is determined whether or not the surroundings of the robot 100 have a predetermined brightness. When it is determined that the surroundings of the robot 100 are less than the predetermined brightness (No), the process proceeds to step S352. If it is determined that this is not the case (Yes), the process waits in step S350 until the surroundings of the robot 100 become less than the predetermined brightness.

In step S352, the power saving operation table 420 is read from the storage device 42, the process proceeds to step S354, the robot 100 is saved with reference to the read power saving operation table 420, and a series of processing is terminated to return to the original processing. Return.
Next, the operation of the present embodiment will be described.
When the surroundings of the robot 100 become less than the predetermined brightness, the home gateway 200 reads the power saving operation table 420 from the storage device 42 through steps S352 and S354, and refers to the read power saving operation table 420. Power saving of the robot 100 is performed. For example, when the robot 100 is a humanoid, an operation of sleeping on the chin is performed as a power saving operation.

In this way, in this embodiment, the home gateway 200 reads the power saving operation table 420 from the storage device 42 when the surroundings of the robot 100 are less than the predetermined brightness, and the read power saving operation table 420 is read out. The robot 100 is configured to save power.
Thereby, since the power saving operation is performed while the robot 100 is not being used, power saving can be achieved.

  In the third embodiment, the robot 100 and the home gateway 200 correspond to the communication terminals of the invention 1, 2, 10, 11, 14, 15, or 18, and the robot 100 is the invention 1, 2, 10, 11 , 14, 15 or 18, step S 106 corresponds to the voice input means of the invention 1, 10 or 14 or the voice input step of the invention 18. Step S108 corresponds to the motion detection means of the invention 1, 10 or 14, or the motion detection step of the invention 18, and the step S110 corresponds to the motion control data generation means of the invention 1, 10, or 14 or the motion of the invention 18. This corresponds to the control data generation step.

  In the third embodiment, step S112 corresponds to the data transmission means of the invention 1, 10 or 14, or the data transmission step of the invention 18, and step S156 is the data reception of the invention 1, 11 or 15. This corresponds to the data receiving step of the means or the invention 18. Step S158 corresponds to the sound output means of the invention 1, 11 or 15, or the sound output step of the invention 18, and the step S160 is the action body control means of the invention 1, 11 or 15, or the action body of the invention 18. Corresponds to the control step.

  Next, a fourth embodiment of the present invention will be described with reference to the drawings. 13 to 16 are diagrams showing a fourth embodiment of the communication support system, the communication terminal, the operation control data storage terminal, the terminal program, and the communication support method according to the present invention. Hereinafter, only the parts different from the first embodiment will be described, and the same parts as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be omitted.

  In this embodiment, a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention are shown in FIG. The present invention is applied to the case where IP telephone or e-mail is transmitted / received while moving. The difference from the first embodiment is that a character that can be virtually operated together with or in place of the robot 100 is 2D. By displaying on the display 300, IP telephone or electronic mail is transmitted and received.

First, the configuration of a network system to which the present invention is applied will be described with reference to FIG. FIG. 13 is a block diagram showing a configuration of a network system to which the present invention is applied.
As shown in FIG. 13, a 2D display 300 for displaying a character in a two-dimensional manner is connected to the home gateway 200 so as to allow communication. Here, the robot 100 and the 2D display 300 may be connected, or only the 2D display 300 may be connected. In the latter case, the microphone 110 and the speaker 112 are provided in the 2D display 300.

As shown in FIG. 14, the storage device 42 stores an action control data conversion table 440 when a humanoid character is displayed on the 2D display 300. FIG. 14 is a diagram illustrating a data structure of the motion control data conversion table 440 when a humanoid character is displayed on the 2D display 300.
In the operation control data conversion table 440, as shown in FIG. 14, one record is registered for each operation control data to be converted. Each record includes a field 442 in which motion control data for the humanoid robot 100 is registered, and a field 444 in which motion control data for the humanoid character is registered when the 2D display 300 displays the humanoid character. It is configured.

  In the example of FIG. 14, in the first row record, the motion control data for moving the right hand of the humanoid robot 100 is in the field 442, and the motion control data for moving the right hand of the humanoid character is in the field 444, respectively. It is registered. If this is motion control data from the home gateway 200 of the humanoid robot 100 for moving the right hand, the motion control data is converted into corresponding motion control data for the humanoid character. Means.

Further, as shown in FIG. 15, the storage device 42 stores an action control data conversion table 460 when a dog-shaped character is displayed on the 2D display 300. FIG. 15 is a diagram illustrating a data structure of the motion control data conversion table 460 when a dog-shaped character is displayed on the 2D display 300.
In the operation control data conversion table 460, as shown in FIG. 15, one record is registered for each operation control data to be converted. Each record includes a field 462 in which motion control data for the humanoid robot 100 is registered, and a field 464 in which motion control data for the dog-type character is registered when the dog-type character is displayed on the 2D display 300. It is configured.

  In the example of FIG. 15, in the first record, the motion control data for moving the right hand of the humanoid robot 100 is in the field 462, and the motion control data for moving the right front foot of the dog-shaped character is in the field 464. Each is registered. If this is motion control data from the home gateway 200 of the humanoid robot 100 for moving the right hand, the motion control data is converted into corresponding motion control data for a dog-shaped character. Means.

The CPU 30 starts a predetermined program stored in a predetermined area of the ROM 32, and executes an operation control data conversion process shown in the flowchart of FIG. 16 according to the program. FIG. 16 is a flowchart showing the operation control data conversion process.
The operation control data conversion process is a process executed immediately before step S150 or step S258. When the operation control data conversion process is executed in the CPU 30, as shown in FIG. 16, first, the process proceeds to step S400.

In step S400, it is determined whether or not the output is the 2D display 300. When it is determined that the output is the 2D display 300 (Yes), the process proceeds to step S402 and the operation control data conversion tables 440 and 460 are stored. The data is read from the storage device 42, and the process proceeds to step S404.
In step S404, with reference to the read motion control data conversion tables 440 and 460, the received motion control data is converted into motion control data for a human character or a dog character, and the process proceeds to step S406, where the robot When 100 is connected, based on the converted motion control data, a humanoid character or a dog character is operated on the 2D display 300 so that the motion is the same or linked with the motion of the robot 100, When the robot 100 is not connected, a human character or a dog character is operated on the 2D display 300 based on the converted motion control data, and a series of processing is terminated and the original processing is restored.

On the other hand, when it is determined in step S400 that the output is not the 2D display 300 (No), the series of processing is terminated and the original processing is restored.
Next, the operation of the present embodiment will be described.
A case will be described in which an IP phone call is made between the humanoid robot 100 and the dog character.

When making a call, a user having the humanoid robot 100 requests a call at the home gateway 200 and designates the home gateway 200 to be a call destination from a call destination list such as a telephone directory.
In home gateway 200, when a call is requested and designation of a call destination is input, a call signal is transmitted to designated home gateway 200 through steps S102 and S104. Then, when it becomes possible to make a call with the home gateway 200 designated as a call destination, voice data and angle data are input from the humanoid robot 100 through steps S106 to S112, and the humanoid robot is based on the input angle data. The operation control data for 100 is generated, and the generated operation control data and the input voice data are transmitted to the home gateway 200 which is a call destination.

On the other hand, when receiving the incoming call signal, the call destination home gateway 200 repeats steps S152 and S154 to output a ringing tone using the robot 100 or the speaker 112 of the 2D display 300.
When the called user answers the incoming call while the ringing tone is ringing, the called home gateway 200 receives the operation control data and the voice data through steps S156, S158, and S400, and receives the received voice. Data is output to the robot 100 or the 2D display 300. Further, through steps S402 and S404, the motion control data conversion table 460 is read from the storage device 42, the read motion control data conversion table 460 is referred to, and the received motion control data is for a dog character. Converted to motion control data. If the robot 100 is connected through step S406, the motion of the dog-shaped character is controlled based on the converted motion control data so that the motion of the dog-type character is the same or linked with the motion of the robot 100. Is done. When the robot 100 is not connected, the motion of the dog character is controlled based on the converted motion control data.

Note that the same applies to a case where a call is made between the humanoid robot 100 and the humanoid character by IP telephone, except that the motion control data conversion table 440 is referred to.
Thus, in this embodiment, home gateway 200 includes 2D display 300 for displaying a virtual character in a planar manner, receives motion control data and audio data, and receives the received motion control data. The movement of the character is controlled based on the voice data and the voice is output based on the received voice data.

As a result, since it is possible to talk with the other party of the communication with the action by the character, it is possible to express emotions and atmospheres that are difficult to be transmitted through texts and telephone calls in a relatively detailed manner as compared with the related art.
In the fourth embodiment, the robot 100 and the home gateway 200 correspond to the communication terminals of inventions 1 to 3, 10 to 12, 14 to 16 or 18, and the 2D display 300 corresponds to the inventions 3, 5 or 12. Corresponding to the action body display means, the robot 100 corresponds to the action body of the inventions 1 to 3, 10 to 12, 14 to 16 or 18. The character corresponds to the virtual action body of the invention 3, 5, 12 or 16, the step S106 corresponds to the voice input means of the invention 1, 10 or 14, or the voice input step of the invention 18, and the step S108 is Corresponds to the motion detection means of the invention 1, 10 or 14, or the motion detection step of the invention 18.

  In the fourth embodiment, step S110 corresponds to the operation control data generation means of the invention 1, 10 or 14, or the operation control data generation step of the invention 18, and step S112 corresponds to the invention 1, 10, or This corresponds to 14 data transmission means or the data transmission step of invention 18. Step S156 corresponds to the data receiving means of the invention 1, 3, 11, 12, 15 or 16 or the data receiving step of the invention 18, and step S158 is the voice of the invention 1, 11, 12, 15 or 16. This corresponds to the output means or the voice output step of the eighteenth aspect.

Further, in the fourth embodiment, step S160 corresponds to the operating body control means of the invention 1, 3, 11 or 15, or the operating body control step of the invention 18, and step S406 corresponds to the invention 12 or 16 of the invention. It corresponds to the virtual motion control means.
Next, a fifth embodiment of the present invention will be described with reference to the drawings. 17 to 20 are diagrams showing a fifth embodiment of a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention. Hereinafter, only the parts different from the first embodiment will be described, and the same parts as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be omitted.

  In the present embodiment, a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention are arranged between a home A and a home B as shown in FIG. This is applied to the case where IP phone or e-mail is transmitted / received while moving. The difference from the first embodiment is that a character that can be virtually operated together with or in place of the robot 100 is 3D. By displaying on the display 320, IP telephone or electronic mail is transmitted and received.

First, the configuration of a network system to which the present invention is applied will be described with reference to FIG. FIG. 17 is a block diagram showing a configuration of a network system to which the present invention is applied.
As shown in FIG. 17, a 3D display 320 for displaying a character in a three-dimensional manner is connected to the home gateway 200 so as to be communicable. Here, the robot 100 and the 3D display 320 may be connected, or only the 3D display 320 may be connected. In the latter case, the microphone 110 and the speaker 112 are provided on the 3D display 320.

As shown in FIG. 18, the storage device 42 stores an action control data conversion table 480 for displaying a humanoid character on the 3D display 320. FIG. 18 is a diagram illustrating a data structure of the motion control data conversion table 480 when a humanoid character is displayed on the 3D display 320.
In the operation control data conversion table 480, as shown in FIG. 18, one record is registered for each operation control data to be converted. Each record includes a field 482 in which motion control data for the humanoid robot 100 is registered, and a field 484 in which motion control data for the humanoid character is registered when the 3D display 320 displays a humanoid character. It is configured.

Further, as shown in FIG. 19, the storage device 42 stores an action control data conversion table 500 when a dog-shaped character is displayed on the 3D display 320. FIG. 19 is a diagram illustrating a data structure of the motion control data conversion table 500 when a dog-type character is displayed on the 3D display 320.
In the operation control data conversion table 500, as shown in FIG. 19, one record is registered for each operation control data to be converted. Each record includes a field 502 in which motion control data for the humanoid robot 100 is registered, and a field 504 in which motion control data for the dog-shaped character is registered when the dog-shaped character is displayed on the 3D display 320. It is configured.

The CPU 30 starts a predetermined program stored in a predetermined area of the ROM 32, and executes the operation control data conversion process shown in the flowchart of FIG. 20 according to the program. FIG. 20 is a flowchart showing the operation control data conversion process.
The operation control data conversion process is a process executed immediately before step S150 or step S258. When the operation control data conversion process is executed by the CPU 30, as shown in FIG. 20, first, the process proceeds to step S450.

In step S450, it is determined whether or not the output is the 3D display 320. If it is determined that the output is the 3D display 320 (Yes), the process proceeds to step S452, and the operation control data conversion tables 480 and 500 are stored. The data is read from the storage device 42, and the process proceeds to step S454.
In step S454, the received motion control data conversion tables 480 and 500 are referred to, the received motion control data is converted into motion control data for a humanoid character or a dog character, and the process proceeds to step S456 to move the robot. When 100 is connected, based on the converted motion control data, the humanoid character or the dog character is moved on the 3D display 320 so that the same motion as the motion of the robot 100 or an interlocked motion is obtained. When the robot 100 is not connected, a human character or a dog character is operated on the 3D display 320 based on the converted motion control data, and a series of processing is terminated and the original processing is restored.

On the other hand, when it is determined in step S450 that the output is not the 3D display 320 (No), the series of processes is terminated and the original process is restored.
Note that the operation of the present embodiment is performed in the same manner, only replacing the case where the 2D display 300 is used in the fourth embodiment with the case where the 3D display 320 is used.

Thus, in the present embodiment, home gateway 200 includes 3D display 320 for displaying a virtual character in three dimensions, receives motion control data and audio data, and receives the received motion control data. The movement of the character is controlled based on the voice data and the voice is output based on the received voice data.
As a result, since it is possible to talk with the other party of the communication with the action by the character, it is possible to express emotions and atmospheres that are difficult to be transmitted through texts and telephone calls in a relatively detailed manner as compared with the related art.

  In the fifth embodiment, the robot 100 and the home gateway 200 correspond to the communication terminals of inventions 1 to 3, 10 to 12, 14 to 16 or 18, and the 3D display 320 corresponds to those of the inventions 3, 5 or 12. Corresponding to the action body display means, the robot 100 corresponds to the action body of the inventions 1 to 3, 10 to 12, 14 to 16 or 18. The character corresponds to the virtual action body of the invention 3, 5, 12 or 16, the step S106 corresponds to the voice input means of the invention 1, 10 or 14, or the voice input step of the invention 18, and the step S108 is Corresponds to the motion detection means of the invention 1, 10 or 14, or the motion detection step of the invention 18.

  In the fifth embodiment, step S110 corresponds to the operation control data generating means of the invention 1, 10 or 14, or the operation control data generating step of the invention 18, and step S112 is the invention 1, 10, or This corresponds to 14 data transmission means or the data transmission step of invention 18. Step S156 corresponds to the data receiving means of the invention 1, 3, 11, 12, 15 or 16 or the data receiving step of the invention 18, and step S158 is the voice of the invention 1, 11, 12, 15 or 16. This corresponds to the output means or the voice output step of the eighteenth aspect.

In the fifth embodiment, step S160 corresponds to the operating body control means of the invention 1, 3, 11 or 15, or the operating body control step of the invention 18, and step S456 corresponds to the invention 12 or 16 of the invention. It corresponds to the virtual motion control means.
Next, a sixth embodiment of the present invention will be described with reference to the drawings. 21 to 23 are diagrams showing a sixth embodiment of the communication support system, the communication terminal, the operation control data storage terminal, the terminal program, and the communication support method according to the present invention. Hereinafter, only the parts different from the first embodiment will be described, and the same parts as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be omitted.

  In the present embodiment, a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention are arranged between a home A and a home B as shown in FIG. The present invention is applied to the case where IP telephone or electronic mail is transmitted / received while moving, and is different from the first embodiment in that an operation control data storage server 360 that stores operation control data is used.

First, the configuration of a network system to which the present invention is applied will be described with reference to FIG. FIG. 21 is a block diagram showing a configuration of a network system to which the present invention is applied.
In FIG. 21, a 3D display 320 for stereoscopically displaying characters is connected to the home gateway 200 of the home A, and a mobile terminal 340 is communicably connected to the home gateway 200 of the home B instead of the robot 100. ing. In addition, an operation control data storage server 360 that stores operation control data is connected to the Internet 199.

Next, the configuration of the operation control data storage server 360 will be described.
The motion control data storage server 360 is configured to have the same function as a general computer in which a CPU, ROM, RAM, I / F, and the like are connected via a bus, and the motion of the robot 100 or the type of the character depends on the type of motion. Is stored in a database, and the operation control data of the database is provided in response to a request from the home gateway 200 or the portable terminal 340.

As shown in FIG. 22, the database of the motion control data storage server 360 stores a database reference table 520 in which a database to be referred to according to the type of the robot 100 or the character is registered. FIG. 22 is a diagram showing the data structure of the database reference table 520.
In the database reference table 520, as shown in FIG. 22, one record is registered for each output interface such as the robot 100, the 2D display 300, and the 3D display 320. Each record includes a field 522 in which an output interface is registered, and a field 524 in which a pointer to a database corresponding to the output interface and corresponding to the type of the robot 100 or character is registered.

  In the example of FIG. 22, the robot 100 is registered as the output interface and the pointer to the humanoid robot operation database is registered as an index to the database in the first row record. This means that when communicating with the home gateway 200 having the humanoid robot 100, the humanoid robot operation database is referred to, and the operation control data is selected therefrom.

The CPU of the operation control data storage server 360 includes a microprocessing unit MPU and the like, starts a predetermined program stored in a predetermined area of the ROM, and performs the operation control data providing process shown in the flowchart of FIG. 23 according to the program. It is supposed to run. FIG. 23 is a flowchart showing operation control data provision processing.
The operation control data provision process is a process for providing operation control data in response to a provision request from the mobile terminal 340. When the operation control data provision process is executed by the CPU, first, as shown in FIG. 23, the process proceeds to step S500. It has become.

In step S500, the mobile terminal 340 is inquired about the type of output interface of the communication destination and the type of the robot 100 or character, and when it is determined that the output interface of the communication destination is the robot 100 based on the response result, the process goes to step S502. Transition.
In step S502, with reference to the database reference table 520, the operation database corresponding to the type of the communication destination robot 100 is read, the operation control data related to the provision request is read from the read operation database, and the process proceeds to step S504. Then, the read operation control data is transmitted to the portable terminal 340, a series of processing is terminated, and the original processing is restored.

  On the other hand, when it is determined in step S500 that the output interface of the communication destination is the 2D display 300 based on the response result of the inquiry, the process proceeds to step S506 and the 2D of the communication destination is referred to by referring to the database reference table 520. The action database corresponding to the character type is read, the action control data related to the provision request is read from the read action database, and the process proceeds to step S504.

  On the other hand, when it is determined in step S500 that the output interface of the communication destination is the 3D display 320 based on the response result of the inquiry, the process proceeds to step S506 and the 3D of the communication destination is referred to by referring to the database reference table 520. The action database corresponding to the character type is read, the action control data related to the provision request is read from the read action database, and the process proceeds to step S504.

Next, the operation of the present embodiment will be described.
A case will be described in which a phone call is made between the portable terminal 340 and the humanoid robot 100 using an IP phone.
When a user of the mobile terminal 340 makes a call, the user first requests a call at the home gateway 200 and designates the home gateway 200 as a call destination from a call destination list such as a telephone directory. Further, the user accesses the operation control data storage server 360 in the portable terminal 340 and transmits a provision request for providing the operation control data.

When the operation control data storage server 360 receives the provision request, the mobile terminal 340 is inquired of the type of the output interface of the call destination and the type of the robot 100 or character through step S500.
In the portable terminal 340, since the output interface of the call destination is the robot 100 and the type of the robot 100 is human type, the user responds to the operation control data storage server 360 to that effect. Of course, this response may be automatically determined from the destination specified by the user.

  In the operation control data storage server 360, if there is a response from the mobile terminal 340, the response result is a response indicating that the response is the humanoid robot 100, so the database reference table 520 is referred to via the step S502, and the destination The operation database corresponding to the type of the robot 100 is read, and the operation control data related to the provision request is read from the read operation database. Then, the read operation control data is transmitted to the portable terminal 340 through step S504.

When the mobile terminal 340 receives the operation control data, the received operation control data is transmitted to the home gateway 200.
In home gateway 200, when a call is requested and designation of a call destination is input, a call signal is transmitted to designated home gateway 200 through steps S102 and S104. Then, when it becomes possible to make a call with the home gateway 200 designated as the call destination, the voice data is input from the portable terminal 340 through the steps S106 to S112, the operation control data is received from the portable terminal 340, and the received operation control is received. The data and the input voice data are transmitted to the home gateway 200 which is a call destination.

On the other hand, when receiving the incoming call signal, the call destination home gateway 200 repeats steps S152 and S154 and outputs a ringing tone using the speaker 112 of the humanoid robot 100.
When the called user answers the incoming call while the ringing tone is ringing, the called home gateway 200 receives the operation control data and the voice data through step S156, and the received voice data is received by the robot 100. The movement of the robot 100 is controlled based on the received movement control data.

In this way, in the present embodiment, when the operation control data storage server 360 receives the operation control data provision request, the operation control data storage server 360 reads the operation control data related to the received provision request from the operation database, and reads out the operation control data. Data is transmitted to the portable terminal 340 that is the transmission source of the provision request.
Thereby, the robot 100 possessed by the other party of communication can be operated by using the operation control data storage server 360 without moving the robot 100, so that it is possible to reduce time and effort at the time of communication.

  In the sixth embodiment, the robot 100 and the home gateway 200 correspond to the communication terminals of the inventions 1 to 3, 9 to 18, and the operation control data storage server 360 is the operation control data of the invention 9, 13 or 17. Corresponding to the storage terminal, the operation database corresponds to the operation control data storage means of the invention 9, 13 or 17. The 3D display 320 corresponds to the action body display means of the invention 3, 5 or 12, the robot 100 corresponds to the action body of the invention 1 to 3, 10 to 18, and the character is the invention 3, 5, 12 Alternatively, step S106 corresponds to the voice input unit of the first, ninth, tenth, or fourteenth aspect, or the voice input step of the eighteenth aspect.

  In the sixth embodiment, step S108 corresponds to the operation detecting means of the invention 1, 10 or 14, or the operation detecting step of the invention 18, and step S110 is the operation control of the invention 1, 10 or 14. This corresponds to the data generation means or the operation control data generation step of the eighteenth aspect. Step S112 corresponds to the data transmission means of the invention 1, 9, 10, or 14 or the data transmission step of the invention 18, and step S156 is the data reception means of the invention 1, 3, 11, 12, 15 or 16. Or the data reception step of the eighteenth aspect of the invention.

  In the sixth embodiment, step S158 corresponds to the sound output means of the invention 1, 11, 12, 15 or 16, or the sound output step of the invention 18, and the step S160 is the invention 1, 3, This corresponds to the operating body control means 11, 12, 15 or 16, or the operating body control step of the invention 18. Steps S500 to S508 correspond to the operation control data providing means of the invention 9, 13 or 17.

  Next, a seventh embodiment of the present invention will be described with reference to the drawings. FIG. 24 is a diagram showing a seventh embodiment of a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention. Hereinafter, only the parts different from the first embodiment will be described, and the same parts as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be omitted.

  In the present embodiment, a communication support system, a communication terminal, an operation control data storage terminal, a terminal program, and a communication support method according to the present invention are arranged between a home A and a home B as shown in FIG. The present invention is applied to the case where IP phone or e-mail is transmitted / received while moving. The difference from the first embodiment is that a virtually operable character is displayed on the 3D display 320 together with the robot 100. The point is that IP telephone or electronic mail is transmitted and received.

First, the configuration of a network system to which the present invention is applied will be described with reference to FIG. FIG. 24 is a block diagram showing a configuration of a network system to which the present invention is applied.
As shown in FIG. 24, the robot 100 and the 3D display 320 are connected to the home gateway 200 so as to communicate with each other. On the 3D display 320, a humanoid character A that performs the same or linked operation as that of its own robot 100, and a humanoid character that performs the same or linked operation as that of the communication destination robot 100 are displayed. B is displayed.

  As the calling process shown in the flowchart of FIG. 4, the CPU 30 performs a process of controlling the action of the humanoid character A on the 3D display 320 based on the action control data generated in step S110 after step S110. It has become. Further, as the incoming call processing shown in the flowchart of FIG. 5, after step S156, based on the operation control data received in step S156, the operation on the 3D display 320 is performed so as to be the same operation as or in conjunction with the operation of the robot 100. Thus, a process for controlling the movement of the human character B is executed.

  With such a configuration, when communication is performed between the home gateways 200, when the robot 100 is moved in its own home gateway 200, operation control data is generated along with the operation, and the generated operation control data is included in the generated operation control data. Based on this, the motion of the humanoid character A is controlled on the 3D display 320. As a result, the human character A moves with the movement of the robot 100.

On the other hand, when receiving the operation control data and voice data, the home gateway 200 of the communication destination controls the operation of the robot 100 based on the received operation control data, and the same operation as the operation of the robot 100 or an operation linked thereto. The motion of the humanoid character B is controlled on the 3D display 320 so that
Therefore, on the self side, the movement of the robot 100 of the self and the movement of the robot 100 of the communication destination can be grasped by the movements of the two humanoid characters A and B. The movement of the robot 100 and the movement of the robot 100 can be grasped by the movements of the two humanoid characters A and B.

  Thus, in the present embodiment, home gateway 200 controls the movement of humanoid character A on 3D display 320 based on the movement control data generated in step S110, and the movement control received in step S156. Based on the data, the motion of the humanoid character B is controlled on the 3D display 320 so that the motion is the same as or in conjunction with the motion of the robot 100.

As a result, in the 3D display 320, the humanoid character A represents the movement of the robot 100 of its own, and the humanoid character B represents the movement of the robot 100 of the communication destination, so that communication becomes real and is transmitted in sentences and calls. Can express difficult emotions and atmospheres in more detail.
In the seventh embodiment, the robot 100 and the home gateway 200 correspond to the communication terminals of inventions 1 to 3, 10 to 12, 14 to 16 or 18, and the 3D display 320 corresponds to those of the inventions 3, 5 or 12. Corresponding to the action body display means, the robot 100 corresponds to the action body of inventions 1 to 5, 10 to 12, 14 to 16 or 18. The humanoid character A corresponds to the first virtual action body of the invention 4, the humanoid character B corresponds to the second virtual action body of the invention 4, and step S106 is the voice of the invention 1, 10 or 14. This corresponds to the input means or the voice input step of the eighteenth aspect.

  In the seventh embodiment, step S108 corresponds to the operation detection means of the invention 1, 10 or 14, or the operation detection step of the invention 18, and step S110 is the operation of the invention 1, 4, 10 or 14. This corresponds to the operation control data generation means or the operation control data generation step of the eighteenth aspect. Step S112 corresponds to the data transmission means of the invention 1, 10 or 14, or the data transmission step of the invention 18, and step S156 is the data reception means of the invention 1, 3, 4, 11, 12, 15 or 16. Or the data reception step of the eighteenth aspect of the invention.

In the seventh embodiment, step S158 corresponds to the sound output means of the invention 1, 11, 12, 15 or 16, or the sound output step of the invention 18, and the step S160 is the invention 1, 3, This corresponds to the operating body control means of 4, 11, 12, 15 or 16, or the operating body control step of the invention 18.
In the second embodiment, the operation control data is converted by the communication destination home gateway 200. However, the present invention is not limited to this, and the operation control data is converted by the home gateway 200. It can also be configured. Specifically, when the home gateway 200 determines that the type of the robot 100 that is the communication destination is different from the type of the robot 100 that is the communication destination, the home gateway 200 refers to the operation control data conversion table 400 to generate the generated operation control data. The data is converted into operation control data for the communication destination robot 100.

As a result, even if the type of the robot 100 possessed by the communication partner is different from the type of the robot 100 possessed by the communication partner, each robot 100 operates as if it is communicating using the same type of robot 100. Therefore, it is possible to reduce the possibility of damaging emotions and atmospheres that are difficult to convey in sentences and calls.
In this case, the robot 100 and the home gateway 200 correspond to the communication terminal of the invention 7, the robot 100 corresponds to the operating body of the invention 7, and step S110 corresponds to the operation control data generating means of the invention 7, Step S300 corresponds to the operating object type determining means of the seventh aspect. Step S304 corresponds to the operation control data converting means of the seventh aspect.

Moreover, in the said embodiment, although the robot 100 and the home gateway 200 were comprised as a different body, you may comprise not only this but the robot 100 and the home gateway 200 as integral.
In the above embodiment, the 2D display 300 or 3D display 320 and the home gateway 200 are configured as separate bodies, but the present invention is not limited to this, and the 2D display 300 or 3D display 320 and the home gateway 200 are configured as an integral unit. May be.

  In the above embodiment, the ROM 32 is used for executing the processes shown in the flowcharts of FIGS. 4, 5, 6, 7, 10, 12, 16, 20, and 23. Although the case where a control program stored in advance is executed has been described, the present invention is not limited to this, and the program may be read from a storage medium storing the program showing these procedures into the RAM and executed. .

  Here, the storage medium is a semiconductor storage medium such as RAM or ROM, a magnetic storage type storage medium such as FD or HD, an optical reading type storage medium such as CD, CDV, LD, or DVD, or a magnetic storage type such as MO. / Optical reading type storage media, including any storage media that can be read by a computer regardless of electronic, magnetic, optical, or other reading methods.

  In the above embodiment, the communication support system, the communication terminal, the operation control data storage terminal and the terminal program, and the communication support method according to the present invention are connected between the homes A and B as shown in FIG. Although the present invention is applied to the case where IP phone or e-mail is transmitted / received while moving the robot 100, the present invention is not limited to this, and can be applied to other cases without departing from the gist of the present invention.

It is a block diagram which shows the structure of the network system to which this invention is applied. 2 is a functional block diagram showing a configuration of a robot 100. FIG. 2 is a functional block diagram showing a configuration of a home gateway 200. FIG. It is a flowchart which shows a calling process. It is a flowchart which shows an incoming call process. It is a flowchart which shows an email transmission process. It is a flowchart which shows an email reception process. It is a figure which shows a mode that operation | movement control data are converted when communicating between the robots of a different kind. 6 is a diagram illustrating a data structure of an operation control data conversion table 400. FIG. It is a flowchart which shows an operation control data conversion process. 6 is a diagram illustrating a data structure of a power saving operation table 420. FIG. It is a flowchart which shows a power saving operation process. It is a block diagram which shows the structure of the network system to which this invention is applied. It is a figure which shows the data structure of the motion control data conversion table 440 in the case of displaying a humanoid character on the 2D display 300. It is a figure which shows the data structure of the action control data conversion table 460 in the case of displaying a dog-type character on the 2D display 300. It is a flowchart which shows an operation control data conversion process. It is a block diagram which shows the structure of the network system to which this invention is applied. It is a figure which shows the data structure of the motion control data conversion table 480 in the case of displaying a humanoid character on the 3D display 320. FIG. It is a figure which shows the data structure of the action control data conversion table 500 in the case of displaying a dog-type character on the 3D display 320. FIG. It is a flowchart which shows an operation control data conversion process. It is a block diagram which shows the structure of the network system to which this invention is applied. It is a figure which shows the data structure of the database reference table 520. It is a flowchart which shows operation control data provision processing. It is a block diagram which shows the structure of the network system to which this invention is applied.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Robot, 102 ... Movable part, 104 ... Rotation drive part, 106 ... Movable amount detection part, 108 ... Control part, 110 ... Microphone, 112 ... Speaker, 114 ... I / F, 200 ... Home gateway, 30 ... CPU, 32 ... ROM, 34 ... RAM, 38 ... I / F, 40 ... input device, 42 ... storage device, 44 ... display device, 300 ... 2D display, 320 ... 3D display, 340 ... mobile terminal, 360 ... operation control data storage Server, 400, 440, 460 ... Operation control data conversion table, 480, 500 ... Operation control data conversion table, 420 ... Power saving operation table, 520 ... Database reference table, 199 ... Internet

Claims (18)

A communication support system in which a plurality of communication terminals are communicably connected and voice communication is performed between the communication terminals.
The communication terminal includes an operation body that is physically operable, an operation detection unit that detects the operation when the operation body is operated by an external action, and the operation based on a detection result of the operation detection unit. Motion control data generating means for generating motion control data for controlling body movement, voice input means for inputting voice as data, motion control data generated by the motion control data generating means, and voice input means Data transmitting means for transmitting the input voice data to the other communication terminal, data receiving means for receiving the operation control data and the voice data, and the operation body based on the operation control data received by the data receiving means And a voice output based on the voice data received by the data receiving means. Communication support system characterized by comprising an audio output means that. In claim 1,
The operation timing of the operating body and the output timing of the voice in the one communication terminal that is the communication counterpart, the operation detection timing of the operating body and the input timing of the voice in the other communication terminal that is the communication counterpart A communication support system characterized by synchronization. In any one of Claim 1 and 2,
The communication terminal has an operating body display means for displaying a virtual operating body that is virtually operable,
The action body control means controls the operation of the virtual action body based on the action control data received by the data receiving means so as to be the same action as the action of the action body or an operation linked thereto. Communication support system characterized by In claim 3,
The action body control means controls the action of the first virtual action body based on the action control data generated by the action control data generation means, and based on the action control data received by the data reception means, A communication support system configured to control the operation of the second virtual operation body so as to be the same operation as the operation of the body or an operation in conjunction with the operation of the body. In any one of Claims 3 and 4,
The communication support system, wherein the action object display means is one of a 2D display for displaying the virtual action object in a plane and a 3D display for displaying the virtual action object in a three-dimensional manner. . In any one of Claims 1 thru | or 5,
The communication terminal includes an operation object type determination unit that determines a type of an operation object of the communication terminal that is a communication partner, and an operation control data received by the data reception unit based on a determination result of the operation object type determination unit. Operation control data conversion means for converting
The motion control data conversion means determines that the type of the action body of the communication terminal that is the other party of communication is different from the type of action body of the communication terminal based on the determination result of the action body type determination means. The communication support system is characterized in that the operation control data received by the data receiving means is converted into operation control data for an operating body of the communication terminal. In any one of Claims 1 thru | or 5,
The communication terminal is an operation body type determination unit that determines a type of an operation body of the communication terminal that is a communication partner, and an operation generated by the operation control data generation unit based on a determination result of the operation body type determination unit Operation control data conversion means for converting control data;
The motion control data conversion means determines that the type of the action body of the communication terminal that is the other party of communication is different from the type of action body of the communication terminal based on the determination result of the action body type determination means. The communication support system is characterized in that the operation control data generated by the operation control data generating means is converted into operation control data for the operation body of the communication terminal which is a communication partner. In any one of Claim 6 and 7,
A conversion table storage means for storing an operation control data conversion table in which the operation control data for a specific type of operation object and the operation control data for an operation object of a type different from the specific type are associated;
The communication control system is characterized in that the operation control data conversion means converts the operation control data with reference to an operation control data conversion table of the conversion table storage means. In any one of Claims 1 thru | or 8,
The operation control data storage terminal for storing the operation control data is connected to be communicable,
The operation control data storage terminal has operation control data storage means for storing the operation control data, and operation control data providing means for providing operation control data of the operation control data storage means to the communication terminal,
When the operation control data providing means receives the operation control data provision request, the operation control data providing means reads the operation control data related to the received provision request from the operation control data storage means, and reads the read operation control data in the provision request. It is sent to the communication terminal that is the sender,
The communication terminal has operation control data acquisition means for acquiring the operation control data from the operation control data storage terminal,
The data transmission means transmits the operation control data acquired by the operation control data acquisition means and the voice data input by the voice input means to the other communication terminal. . A communication terminal that is communicably connected to a communication terminal and performs voice communication,
An operation body that is physically operable, an operation detection means for detecting the operation when the operation body is operated by an external action, and controlling the operation of the operation body based on a detection result of the operation detection means Operation control data generating means for generating operation control data for performing, voice input means for inputting voice as data, operation control data generated by the operation control data generating means, and voice data input by the voice input means A communication terminal comprising: data transmission means for transmitting to the other communication terminal. A communication terminal that is communicably connected to a communication terminal and performs voice communication,
An operating body that is physically operable, data receiving means for receiving operation control data and audio data for controlling the operation of the operating body, and the operating body based on the operation control data received by the data receiving means A communication terminal, comprising: an operating body control means for controlling the operation of the voice signal; and a voice output means for outputting a voice based on the voice data received by the data receiving means. A communication terminal that is communicably connected to a communication terminal and performs voice communication,
An operating body display means for displaying a virtual operating body that is virtually operable; a data receiving means for receiving operation control data and audio data for controlling the operation of the physically operable operating body; and Virtual action body control means for controlling the action of the virtual action body based on action control data received by the data receiving means, and voice output means for outputting sound based on the sound data received by the data receiving means. A communication terminal characterized by this. An operation control data accumulating terminal for accumulating operation control data for controlling operation of a physically operable operating body that is communicably connected to a communication terminal,
Operation control data storage means for storing the operation control data; and operation control data providing means for providing the communication terminal with the operation control data of the operation control data storage means,
When the operation control data providing means receives the operation control data provision request, the operation control data providing means reads the operation control data related to the received provision request from the operation control data storage means, and reads the read operation control data in the provision request. An operation control data storage terminal characterized by being transmitted to a communication terminal as a transmission source. A program for a terminal to be executed by a computer operating as a communication terminal,
Operation detecting means for detecting the operation when a physically operable operating body is operated by an external action, and operation control data for controlling the operation of the operating body based on the detection result of the operation detecting means Control data generating means for generating voice, voice input means for inputting voice as data, operation control data generated by the action control data generating means, and voice data input by the voice input means are transmitted to the other communication terminals. A terminal program characterized by being a program for executing processing realized as a data transmission means. A program for a terminal to be executed by a computer operating as a communication terminal,
Data receiving means for receiving operation control data and audio data for controlling the operation of the physically operable operating body, and operation for controlling the operation of the operating body based on the operation control data received by the data receiving means A terminal program characterized by being a program for executing a process realized as a body control means and a sound output means for outputting sound based on the sound data received by the data receiving means. A program for a terminal to be executed by a computer operating as a communication terminal,
Data receiving means for receiving operation control data and audio data for controlling the operation of a physically operable operating body, and a virtual operating body capable of virtually operating based on the operation control data received by the data receiving means A terminal that is a program for executing a process that is realized as a virtual operating body control unit that controls the operation of the voice and a voice output unit that outputs voice based on voice data received by the data receiving unit Program. A terminal program for causing a computer operating as an operation control data storage terminal to execute the program,
A program for executing processing realized as operation control data providing means for providing operation control data for controlling operation of a physically operable operation body to a communication terminal,
When the operation control data providing unit receives the operation control data provision request, the operation control data providing unit reads the operation control data related to the received provision request from the operation control data storage unit, and transmits the read operation control data to the provision request. A terminal program characterized by being transmitted to the original communication terminal. A communication support method in which a plurality of communication terminals having physically operable operating bodies are communicably connected, and voice communication is performed between the communication terminals,
For one communication terminal that is the other party of communication,
An operation detecting step for detecting the operation when the operating body is operated by an external action, and an operation for generating operation control data for controlling the operation of the operating body based on a detection result of the operation detecting step. Control data generation step, voice input step for inputting voice as data, operation control data generated in the operation control data generation step and voice data input in the voice input step as the other communication terminal A data transmission step for transmitting to
For the other communication terminal,
The data receiving step for receiving the motion control data and the audio data, the motion body control step for controlling the motion of the motion body based on the motion control data received in the data receiving step, and the data receiving step And a voice output step of outputting voice based on the voice data.

Images