JP6457706B1 - Translation system, translation method, and translation apparatus - Google Patents

Abstract

[PROBLEMS] To improve the quality of communication with a partner who uses a different language.
A translation device 3 specifies a first language used by a first user, a second language used by a second user, and a first user terminal U1 used by the first user uses a first language. Receiving a voice input, a step in which the first user terminal converts the voice in the first language into text data, transmitting the converted text data to the translation device 3, and a translation device 3 sending the text data to the second language. The translation data of the second language, the translation device 3 transmitting the translation data to the second user terminal used by the second user, and the second user terminal converting the translation data into the second language voice And providing a translation method.
[Selection] Figure 1

Description

The present invention relates to a translation system, a translation method, and a translation apparatus for translating input speech.

  Conventionally, a technique for translating input speech is known. Japanese Patent Application Laid-Open No. 2004-133830 discloses a technique for translating input speech to generate a character code string, transmitting the character code string to a communication partner apparatus, and displaying the character code string as a caption on the communication partner apparatus. It is disclosed.

JP 2013-201505 A

  In the prior art, since the character code string created after translation is displayed as subtitles, the communicating people have to visually recognize the subtitles displayed on the display. In this case, there is a problem that it is impossible to talk while looking at the other party's facial expression.

  Accordingly, the present invention has been made in view of these points, and provides a translation system, a translation method, a translation device, and a voice input / output device that can improve the quality of communication with a partner who uses a different language. For the purpose.

  The translation system of the 1st aspect of this invention is provided with the 1st user terminal which a 1st user uses, and the translation apparatus which can communicate with the said 1st user terminal. The first user terminal transmits, to the translation device, a voice input unit that receives voice input in a first language and first language text data obtained by converting the voice in the first language received by the voice input unit. A terminal transmission unit and a terminal reception unit that receives, from the translation device, first language translation data in which the language information of the second language input in the second user terminal used by the second user is translated into the first language And a voice output unit that outputs the voice of the first language into which the first language translation data received by the terminal reception unit is converted.

  The translation device receives the first language text data from the first user terminal and a specifying unit that specifies a first language used by the first user and a second language used by the second user. A device receiving unit; a language converting unit that converts the first language text data received by the device receiving unit into second language translation data; and a device that transmits the second language translation data to the second user terminal. And a transmission unit.

  The language conversion unit converts the second language translation data into the first language to generate retranslation data, the device transmission unit transmits the retranslation data to the first user terminal, and the voice The output unit may output the retranslation data while the voice input unit receives an input of the first language voice.

  The device transmission unit stops transmitting the retranslation data when the language conversion unit converts the language information of the second language input in the second user terminal into the first language translation data. The first language translation data may be transmitted.

  When the device receiving unit receives the first language text data including a predetermined word after transmitting the retranslated data to the first user terminal, the device transmitting unit sends the retranslated data to the second user terminal. The transmission of the second language translation data may be stopped.

  The device receiving unit receives second language text data obtained by converting second language speech from the second user terminal, and the language converting unit receives the second language text data received by the device receiving unit. Bilingual text data is converted into first language translation data, and the device transmission unit generates new first language translation data while the device transmission unit transmits the first language translation data. When is completed, transmission of the first language translation data being transmitted may be stopped and transmission of new first language translation data may be started.

  The voice output unit may include a bone conduction speaker, and the first language voice may be output from the bone conduction speaker while the voice input unit receives the voice of the first language.

  The voice input unit includes a plurality of main microphones for acquiring sound and a sub microphone for acquiring ambient sound, and the terminal transmission unit receives the sub microphone from sounds acquired by the plurality of main microphones. Text data corresponding to the sound after removing the acquired ambient sound may be transmitted as the first language text data corresponding to the voice of the first language.

  In a state where the user wears the first user terminal, a distance between the sub microphone and the mouth of the first user may be larger than a distance between the plurality of main microphones and the mouth of the first user.

  The first user terminal is configured to output a sound input to at least one of the plurality of main microphones based on a result of comparing a sound input to each of the plurality of main microphones with a sound input to the sub microphone. And a text conversion unit that converts the first language speech extracted by the extraction unit into the first language text data.

  The extraction unit identifies a sound that is estimated as the voice of the first language based on a result of comparing the sounds input to the plurality of main microphones, and the identified sound and the sound input to the sub microphone The voice of the first language may be extracted based on the result of the comparison.

  The terminal transmitting unit transmits user specifying information for specifying the second user in association with the first language text data to the translation device, and the specifying unit is associated with a plurality of users, The second language stored in the storage unit in association with the second user indicated by the user specifying information transmitted by the terminal transmission unit is referred to by referring to the storage unit storing the language used by each of the users. You may specify.

  The terminal transmission unit transmits language information for specifying the language of the second user to the translation device before starting transmission of the first language text data, and the specification unit includes the terminal transmission unit. The second language may be specified based on the language information transmitted by the user.

  The specifying unit may specify the second language based on a word included in the first language text data.

  In the translation method according to the second aspect of the present invention, the translation device specifies a first language used by the first user, a second language used by the second user, and a first used by the first user. A step in which a user terminal receives input of speech in a first language; a step in which the first user terminal converts speech in the first language into text data; and the step of transmitting the converted text data to the translation device; A translation device converting the text data into translation data of the second language; a translation device transmitting the translation data to a second user terminal used by the second user; and the second user. And a step of outputting the second language voice into which the translation data is converted.

  The translation device according to the third aspect of the present invention includes a specifying unit that specifies the first language used by the first user and the second language used by the second user, and the first user used by the first user. A device receiving unit that receives first language text data in which the speech of the first language is converted from a terminal, and a language conversion that converts the first language text data received by the device receiving unit into second language translation data And a device transmission unit that transmits the second language translation data to a second user terminal used by the second user.

  The first user terminal includes, for example, a voice input unit that receives voice input in a first language, text data obtained by converting the voice in the first language received by the voice input unit, and the first language. The language information of the second language input in the second user terminal used by the second user is translated into the first language from the terminal transmission unit that transmits to the translation device that translates into the second language, and the translation device. A terminal receiving unit that receives the first language translation data, and the first language translation data that is converted from the first language translation data received by the terminal receiving unit while speech is being input to the voice input unit. And an audio output unit that outputs audio.

  According to the present invention, it is possible to improve the quality of communication with a partner who uses a different language.

It is a figure which shows the structure of the translation system of this embodiment. It is a figure which shows the external appearance of a headset. It is a figure which shows the internal structure of a headset and an information terminal. It is a figure which shows the structure of a translation apparatus. It is a figure which shows the user selection screen displayed on a display part when a user starts utilization of an information terminal. It is a figure which shows the other party selection screen displayed on a display part when selecting the other party who has a conversation. It is a figure which shows the screen for conversation displayed on a display part when talking. It is a figure which shows the screen of the information terminal after a user speaks a finger | toe from a "speak" icon. It is a figure which shows the screen of the information terminal after a user utters the audio | voice of a 2nd language following the state of FIG. It is a figure which shows the process sequence in a translation system. It is a figure which shows the structure of the translation system which concerns on the modification of this embodiment. It is a figure which shows the structure of the translation apparatus in the case of implement | achieving the function of a language conversion part with a language conversion server.

[Outline of Translation System S1]
FIG. 1 is a diagram showing a configuration of the translation system S1 of the present embodiment. The translation system S1 includes a headset 1 (1a, 1b, 1c) and an information terminal 2 (2a, 2b, 2c), and a translation device 3 that functions as a translation device. The headset 1 and the information terminal 2 function as a user terminal that is a voice input / output device by operating in cooperation.

  FIG. 1 shows a user U1 who speaks a first language (eg, Japanese), a user U2 who speaks a second language (eg, English), and a user U3 who speaks a third language (eg, Chinese). The translation system S1 translates words spoken by each user into languages spoken by other users so that a plurality of users who speak different languages can understand the words spoken by other users. Is output as audio. In the following description, it is assumed that the user U1 is a guide for guiding tourists in a sightseeing spot, and the user U2 and the user U3 are tourists receiving explanation from the user U1.

  In the example shown in FIG. 1, users U1, U2, and U3 wear headsets 1a, 1b, and 1c, respectively. In addition, users U1, U2, and U3 hold information terminals 2a, 2b, and 2c, respectively. Information terminal 2a, 2b, 2c is a smart phone, for example. The headsets 1a, 1b, and 1c can transmit and receive data to and from the information terminals 2a, 2b, and 2c via wireless channels B1, B2, and B3, respectively. The wireless channel is, for example, Bluetooth (registered trademark).

  The headsets 1a, 1b, and 1c have the same configuration. In the following description, the headsets 1a, 1b, and 1c may be referred to as headsets 1 when there is no need to distinguish them. Similarly, the information terminals 2a, 2b, and 2c have the same configuration. In the following description, when there is no need to distinguish each, the information terminals 2a, 2b, and 2c may be referred to as information terminals 2.

  The headset 1 is configured so that the user can wear it on the head, and receives the voice spoken by the user and converts the inputted voice into a digital voice signal. The headset 1 transmits a digital audio signal to the information terminal 2 associated in advance via the wireless channel W1.

  The information terminal 2 recognizes the voice included in the digital voice signal received from the headset 1 and converts it into text data. When voice in the first language is input in the headset 1, the information terminal 2 creates text data in the first language. For example, when a Japanese voice is input in the headset 1, the information terminal 2 creates Japanese text data.

  The information terminal 2 transmits the created text data in the first language to the translation device 3. In the example shown in FIG. 1, the information terminal 2 transmits text data in the first language to the translation device 3 via the wireless communication line W, the access point 4 and the network N. The wireless communication line W is, for example, a Wi-Fi (registered trademark) line, but may be a line using another wireless communication method.

  When receiving the text data in the first language, the translation device 3 converts the received text data in the first language into text data in the second language specified in advance. For example, when the translation device 3 receives Japanese text data from the information terminal 2a used by the user U1 who speaks Japanese, the text data translated into English that can be understood by the user U2 selected as the partner with whom the user U1 speaks. Create In this specification, text data generated by translation by the translation device 3 is referred to as translation data. The translation apparatus 3 transmits the created translation data of the second language to the information terminal 2b.

  The information terminal 2b converts the received text data in the second language into a digital audio signal, and transmits the converted digital audio signal to the headset 1b via the wireless channel B2. The headset 1b converts the received digital audio signal into an analog audio signal and outputs the analog audio signal so that the user U2 can recognize it.

  After creating the second language text data, the translation device 3 converts the second language text data into the first language text data, and creates the first language retranslation data. The translation apparatus 3 transmits the created retranslation data to the information terminal 2a. The information terminal 2a converts the received retranslation data of the first language into a digital audio signal, and transmits the digital audio signal to the headset 1a via the radio channel B1. The headset 1a converts the received digital audio signal into an analog audio signal and outputs the analog audio signal so that the user U1 can recognize it.

  For example, the headset 1a transmits text data based on speech input by the user U1 during a predetermined period to the translation device 3, and then the time required for the translation device 3 to generate retranslation data has elapsed. The voice based on the retranslation data corresponding to a predetermined period is output. The predetermined period is, for example, a period during which the user U1 is inputting words to be translated, which are set by operating the information terminal 2a. Details of the operation for setting the predetermined period by the user U1 will be described later.

  The translation device 3 creates the retranslation data, and the headset 1 outputs the voice based on the retranslation data, so that the user U1 compares the words that the user U1 speaks with the words indicated by the voice based on the retranslation data. , You can check whether the words you have uttered are translated correctly. Therefore, when it is confirmed that the user U1 has not been translated correctly, the user U1 may make a correction gesture for the user U2 and the user U3 who are talking with each other, or may be paraphrased with another word. it can.

  As described above, the translation system S1 outputs the text data obtained by translating the speech input in the headset 1 as speech from the headset 1, so that the user wearing the headset 1 is a partner who uses a language different from his / her own. Talking while looking at your face, you can understand what the other person speaks. Therefore, translation system S1 can improve the quality of communication with the partner who uses a different language.

As will be described in detail later, the headset 1 has a bone conduction speaker. Therefore, while listening to the voice of the other party who is speaking with the ear, the user listens to the translated content of the speech uttered by the other party and the re-translated content of the speech uttered by the user through the bone conduction speaker. be able to. Since the headset 1 has such a configuration, the user can listen to the translated voice by bone conduction while listening to the other party's live voice with his / her ear. , It will be possible to understand what the other party speaks. As a result, the quality of communication with a partner who uses a different language can be further enhanced.
Hereinafter, details of the headset 1, the information terminal 2, and the translation device 3 will be described.

[Appearance of headset 1]
FIG. 2 is a diagram illustrating an appearance of the headset 1. As shown in FIG. 2, the headset 1 includes a first main microphone 11, a second main microphone 12, a sub microphone 13, a bone conduction speaker 14, a control unit 15, a cable 16, and a microphone housing portion 17. And a connecting member 18 and a main body 19.

  The first main microphone 11, the second main microphone 12, and the sub microphone 13 function as an audio input unit. The 1st main microphone 11 and the 2nd main microphone 12 are main microphones for acquiring the voice which user U utters, and submicrophone 13 is the submicrophone for acquiring ambient sound. In the state where the user U is wearing the headset 1, the distance between the sub microphone 13 and the mouth of the user U is based on the distance between the first main microphone 11 and the second main microphone 12, which are a plurality of main microphones, and the mouth of the user U. Is also big.

  The first main microphone 11 and the second main microphone 12 are provided side by side in a microphone housing portion 17 connected to the main body portion 19 via a flexible connecting member 18. On the other hand, the sub microphone 13 is provided in the vicinity of the bone conduction speaker 14 that is worn so as to be in contact with the vicinity of the lower part of the user's ear. Since the user uses the microphone accommodating portion 17 in a state in which the microphone is close to the mouth, the first main microphone 11 and the second main microphone 12 are emitted by the user U at a position closer to the user U's mouth than the sub microphone 13. Get audio.

  The sub microphone 13 is provided on the outer side of the bone conduction speaker 14L on the side opposite to the bone conduction speaker 14R to which the connection member 18 is connected (that is, the side not in contact with the user U). As described above, the sub microphone 13 is provided in the bone conduction speaker 14L on the side electrically separated from the first main microphone 11 and the second main microphone 12 as compared with the bone conduction speaker 14R. Since the sound signal input to the main microphone 11 and the second main microphone 12 and the sound signal input to the sub microphone 13 are difficult to interfere with each other, it is possible to improve the noise removal performance described later.

  The bone conduction speaker 14 is a speaker that can transmit sound to the user U by vibrating the bone with sound pressure. For example, the bone conduction speaker 14R is attached so as to contact the condylar process of the lower part of the user's right ear, and the bone conduction speaker 14L is attached so as to contact the condyle process of the lower part of the user's left ear. However, the position where the bone conduction speaker 14R and the bone conduction speaker 14L are mounted is arbitrary. The bone conduction speaker 14 outputs the sound in the first language while the first main microphone 11 and the second main microphone 12 receive the sound input in the language used by the user (for example, the first language). The sound of the first language output from the bone conduction speaker 14 is sound based on data obtained by translating the sound of another user who emits the second language, or sound based on re-translated data.

  Since the headset 1 has the bone conduction speaker 14, the user can hear the translated voice by bone conduction while listening to the other party's raw voice with his / her ear. , It will be possible to understand what the other party speaks.

  The control unit 15 accommodates various electric circuits electrically connected to the first main microphone 11, the second main microphone 12, the sub microphone 13, the bone conduction speaker 14R, and the bone conduction speaker 14L via the cable 16. . The electric circuit is, for example, a circuit that functions as an extraction unit that removes noise from the sound input from the first main microphone 11, the second main microphone 12, and the sub microphone 13 and extracts the sound input by the user, an analog audio signal A codec circuit for converting the digital audio signal into a digital audio signal, a communication circuit for transmitting / receiving the digital audio signal to / from the information terminal 2, and the like.

[Internal configuration of headset 1 and information terminal 2]
FIG. 3 is a diagram showing the internal configuration of the headset 1 and the information terminal 2. The control unit 15 includes an audio processing unit 151, a communication unit 152, and a control unit 153. In the following 4 explanations regarding the configuration of the headset 1, it is assumed that the headset 1 is the headset 1 a used by the user U 1 who speaks the first language.

  The sound processing unit 151 removes ambient sounds other than the sound emitted by the user U1 based on the sound signals input from the first main microphone 11, the second main microphone 12, and the sub microphone 13, thereby causing the user U1 to emit sound. It functions as an extraction unit that extracts the voice. The audio processing unit 151 generates a digital audio signal by, for example, PCM (Pulse Code Modulation) encoding the extracted audio. The audio processing unit 151 inputs the generated digital audio signal to the communication unit 152.

  The audio processing unit 151 generates an analog audio signal by decoding the digital audio signal input from the communication unit 152. The audio processing unit 151 outputs the generated analog audio signal via the bone conduction speaker 14.

  Furthermore, the audio processing unit 151 has a function of removing noise such as ambient sounds from the sound signals input from the first main microphone 11 and the second main microphone 12. In order to remove noise, the sound processing unit 151 first determines the sound estimated as the sound of the first language based on the result of comparing the sounds input to the first main microphone 11 and the second main microphone 12. Is identified.

  The audio processing unit 151 extracts, for example, a signal whose phase difference from the analog audio signal input to the second main microphone 12 is within a predetermined range from the analog audio signal input to the first main microphone 11, By removing a signal whose amplitude difference is outside a predetermined range, an estimated speech signal obtained by extracting speech that is estimated to be speech of the first language is generated. The predetermined range is assumed as, for example, a difference between a distance from the user U's mouth to the first main microphone 11 and a distance from the user U's mouth to the second main microphone 12 in a state where the user U wears the headset 1. It is a range that is less than or equal to the difference in amplitude that is assumed at the maximum value.

  Subsequently, the sound processing unit 151 inputs the sound specified based on the result of comparing the analog sound signal input to the first main microphone 11 and the analog sound signal input to the second main microphone 12 to the sub microphone 13. Based on the result of the comparison with the sound, the first language speech from which the ambient sound component is removed is extracted from the first speech signal. Specifically, the sound processing unit 151 removes at least a part of the ambient sound signal input to the sub microphone 13 from the generated estimated sound signal.

  Before removing the ambient sound signal from the estimated sound signal, the sound processing unit 151 is configured so that the attenuation amount of the signal equal to or higher than the level that is clearly the user U's sound is within the predetermined range in the estimated sound signal. The ambient sound signal input to the sub microphone 13 is attenuated. By doing in this way, the audio | voice processing part 151 can remove the component of ambient sound to the maximum, leaving the audio | voice component which the user uttered as much as possible.

  The communication unit 152 includes a wireless communication module for transmitting the digital audio signal generated by the audio processing unit 151 to the information terminal 2 and receiving the digital audio signal from the information terminal 2. The communication unit 152 functions as a terminal transmission unit that transmits the first language text data obtained by converting the speech of the first language received by the first main microphone 11 and the second main microphone 12 to the translation device 3. In addition, the communication unit 152 is a terminal receiving unit that receives from the translation device 3 the first language translation data in which the language information of the second language input in the headset 1b used by the user U2 is translated into the first language. Function. Further, the communication unit 152 receives retranslation data obtained by translating the second language translation data obtained by translating the first language text data transmitted from the communication unit 152 to the translation device 3 into the first language.

  The control unit 153 is, for example, a one-chip microcomputer incorporating a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The control unit 153 controls the audio processing unit 151 and the communication unit 152 by the CPU executing the program stored in the ROM and writing the data values described in the program to the registers of the audio processing unit 151 and the communication unit 152. To do.

  Next, the configuration of the information terminal 2 will be described. The information terminal 2 includes a first communication unit 21, a second communication unit 22, a display unit 23, an operation unit 24, a storage unit 25, and a control unit 26. The control unit 26 includes a text conversion unit 261 and a UI processing unit 262.

The first communication unit 21 includes a wireless communication module for receiving a digital audio signal from the headset 1 via the wireless channel B and transmitting the digital audio signal output from the audio processing unit 151 to the headset 1. .
The second communication unit 22 includes a wireless communication module for transmitting / receiving text data to / from the access point 4 via the wireless communication line W. For example, the second communication unit 22 generates text data corresponding to the sound after removing the ambient sound input to the sub microphone 13 from the sound input to the first main microphone 11 and the second main microphone 12 in the first language. It transmits as 1st language text data corresponding to an audio | voice.

  The display unit 23 is a display that displays various types of information. The display unit 23 is controlled by the UI processing unit 262, for example, the first language text data generated by the text conversion unit 261 based on the digital audio signal transmitted from the headset 1, and the second communication unit 22 uses the translation device 3. The first language translation data received from is displayed. An example of data displayed on the display unit 23 will be described later.

  The operation unit 24 is a device for receiving a user operation, and is, for example, a touch panel provided on the display unit 23. The operation unit 24 inputs an electrical signal generated according to a user operation to the UI processing unit 262.

  The storage unit 25 is a storage medium such as a ROM or a RAM. The storage unit 25 stores a program executed by the control unit 26. In addition, the storage unit 25 stores a language name that can be spoken by a user using the information terminal 2 input via the operation unit 24. Further, the text conversion unit 261 stores a speech recognition dictionary for converting a digital speech signal into text data, and a speech synthesis dictionary for converting text data into a digital speech signal. The storage unit 25 stores a plurality of speech recognition dictionaries and a plurality of speech synthesis dictionaries in association with a plurality of language names.

  The control unit 26 is a CPU, for example, and functions as a text conversion unit 261 and a UI processing unit 262 by executing a program stored in the storage unit 25.

  The text conversion unit 261 converts the first language speech extracted by the speech processing unit 151 functioning as an extraction unit into first language text data. Specifically, first, the text conversion unit 261 analyzes the digital audio signal input from the first communication unit 21 and identifies the phoneme. The text conversion unit 261 uses the speech recognition dictionary corresponding to the language name that can be spoken by the user using the information terminal 2 by referring to the storage unit 25, and the words included in the digital speech signal Is specified, and the digital voice signal is converted into the first language text data.

  The text conversion unit 261 associates the account name as the user specifying information for specifying the user and the account names of the user U2 and the user U3 who are conversation partners with the second language text data in association with the generated first language text data. It transmits to the translation apparatus 3 via the communication part 22. For example, the text conversion unit 261 transmits the account names of the users U2 and U3 together with the first language text data in response to receiving an instruction from the UI processing unit 262 to start translating the input speech. When the text conversion unit 261 acquires the second language name usable by the user U2 via the UI processing unit 262, the text conversion unit 261 can use the language usable by the user U2 before starting transmission of the first language text data. The language information for specifying can be transmitted to the translation device 3.

  In addition, the text conversion unit 261 converts the first language text data received from the translation device 3 via the second communication unit 22 into a digital speech signal by referring to the speech synthesis dictionary stored in the storage unit 25. . The text conversion unit 261 transmits the generated digital audio signal to the headset 1 via the first communication unit 21.

  The UI processing unit 262 causes the display unit 23 to display the text data acquired from the text conversion unit 261. In addition, the UI processing unit 262 specifies the operation content indicated by the electrical signal input from the operation unit 24 and notifies the text conversion unit 261 of the specified operation content. For example, the UI processing unit 262 notifies the text conversion unit 261 of the account name of the user U1 set by the user and the account names of the user U2 and the user U3 and causes the storage unit 25 to store them.

[Configuration of Translation Device 3]
FIG. 4 is a diagram illustrating a configuration of the translation apparatus 3. The translation device 3 includes a communication unit 31, a storage unit 32, and a control unit 33.

  The communication unit 31 includes a communication interface for transmitting / receiving text data to / from the information terminal 2 via the network N. The communication unit 31 includes, for example, a LAN (Local Area Network) controller.

  The storage unit 32 includes storage media such as a ROM, a RAM, and a hard disk. The storage unit 32 stores a program executed by the control unit 33. In addition, the storage unit 32 stores a dictionary for the language conversion unit 332 to convert the text data of the first language into text data of another language. Furthermore, the storage unit 32 stores a use language table in which account names of a plurality of users who can use the translation system S1 are associated with language names that can be used by each user.

  The control unit 33 is, for example, a CPU, and functions as a translation control unit 331 and a language conversion unit 332 by executing a program stored in the storage unit 32.

  The translation control unit 331 controls the language conversion unit 332 to convert the first language text data received from the communication unit 31 into second language translation data. Also, the translation control unit 331 controls the language conversion unit 332 to convert the second language text data received from the information terminal 2b via the communication unit 31 into the first language translation data. The translation control unit 331 transmits the second language translation data generated by conversion by the language conversion unit 332 to the information terminal 2b via the communication unit 31, and the first language translation generated by conversion by the language conversion unit 332 Data is transmitted to the information terminal 2a via the communication unit 31.

  In addition, when the translation control unit 331 acquires the second language translation data generated based on the first language text data from the language conversion unit 332, the translation control unit 331 translates the acquired second language translation data into text data of the first language. The language conversion unit 332 is controlled so as to generate retranslation data. The translation control unit 331 transmits the retranslation data generated by the language conversion unit 332 to the information terminal 2a via the communication unit 31.

  Furthermore, the translation control unit 331 functions as a specifying unit that specifies the first language used by the user U1 and the second language used by the user U2. The translation control unit 331 refers to the language table stored in the storage unit 32 and associates the first language text data via the first communication unit 21 with the account name of the user U1 transmitted from the second communication unit 22 And a second language name corresponding to the account name of the user U2 received in association with the first language text data. The translation control unit 331 notifies the language conversion unit 332 of the identified result.

  The translation control unit 331 may specify a second language that can be used by the user U2 based on the language information transmitted from the information terminal 2a. The translation control unit 331 specifies, for example, a first language that can be used by the user U1 and a second language that can be used by the user U2 based on information input when the user U1 using the information terminal 2a performs login processing. To do. In this case, the translation control unit 331 causes the language conversion unit 332 to translate based on the identified first language and second language until the user U1 logs off.

  The translation control unit 331 may specify that the language used by the user U1 is the first language by analyzing the received first language text data. Moreover, the translation control part 331 may specify a 2nd language based on the word contained in 1st language text data. For example, the translation control unit 331 specifies that the language used by the user U2 is the second language based on the account name included in the received first language text data. Specifically, when the content of the first language text data is “Tom, nice to meet you”, the translation control unit 331 detects that “Tom” is an account name included in the language table used. By specifying that the language that “Tom” can use is English, the second language is specified as English.

  The language conversion unit 332 converts the first language text data received by the first communication unit 21 from the information terminal 2a into the second language translation data based on the language type notified from the translation control unit 331. Upon receiving the input of the first language text data from the translation control unit 331, the language conversion unit 332 generates the second language translation data by translating the input first language text data, and the generated second language translation Data is notified to the translation control unit 331. Moreover, the language conversion part 332 converts the 2nd language text data which the 1st communication part 21 received from the information terminal 2b into 1st language translation data. Upon receiving the input of the second language text data from the translation control unit 331, the language conversion unit 332 generates the first language translation data by translating the input second language text data, and the generated first language translation Data is notified to the translation control unit 331.

  Further, the language conversion unit 332 translates the second language translation data generated based on the first language text data into the first language based on an instruction from the translation control unit 331, and generates retranslation data. The language conversion unit 332 notifies the translation control unit 331 of the retranslation data.

[Operation screen of information terminal 2]
Next, an operation when the user U1 starts a conversation with the user U2 and the user U3 will be described. FIG. 5 is a diagram illustrating a user selection screen displayed on the display unit 23 when the user U1 starts using the information terminal 2a. In the present embodiment, it is assumed that the information terminal 2a is not a terminal of the user U1 itself but a rented terminal. Therefore, first, the user U1 needs to set a language that can be used by the user U1.

  As shown in FIG. 5A, on the user selection screen, an account name and a language name of a user who can use the translation service by the translation device 3 are displayed in association with each other. As shown in FIG. 5B, the user U1 can use the translation service using the information terminal 2a by touching the check box on the left side of “Taro” which is his account name. . When the radio button on the left side of “Taro” is touched, the UI processing unit 262 stores in the storage unit 25 that the account name of the user U1 is “Taro” and the language to be used is Japanese.

  FIG. 6 is a diagram showing a partner selection screen displayed on the display unit 23 when selecting a partner to talk with. Also in FIG. 6A, the account name and language name of the user who can use the translation service by the translation apparatus 3 are displayed in association with each other as in FIG. As illustrated in FIG. 6B, when the user U1 touches the check box on the left side of “Tom” and the check box on the left side of “Turn”, the UI processing unit 262 indicates that the user U2 is “Tom”. The storage unit 25 stores that the user U3 is “around”.

  FIG. 7 is a diagram showing a conversation screen displayed on the display unit 23 when having a conversation. As shown in FIG. 7 (a), on the conversation screen, a first area R1 in which the first language text data in which the speech uttered by himself is converted is displayed, and a second area in which the retranslation data is displayed. R2 and a third region R3 in which the first language translation data in which the speech uttered by the other party is translated are displayed.

  In addition, the conversation screen includes a “speak” icon that is operated while the user inputs voice. The text conversion unit 261 converts the voice input in the headset 1 into the first language text data while the finger is touching the “speak” icon, and the first time when the finger is released from the “speak” icon. The conversion to language text data is terminated. Then, the text conversion unit 261 transmits the first language text data corresponding to the voice input from when the finger touches the “speak” icon to when the finger is released to the translation device 3. By doing so, only the period designated by the user is subject to translation, so that surrounding sounds input to the headset 1 while the user is not inputting voice are prevented from being erroneously translated. it can.

  As shown in FIG. 7B, when the user U1 utters a voice while touching the “speak” icon, the first language text data indicating the content of the voice uttered by the user U1 is displayed in the first region R1. Is displayed. The user U1 can visually confirm the displayed first language text data and confirm that the voice has been correctly recognized.

  When there is an error in the first language text data visually recognized by the user U1, the information terminal 2a may operate so as to cancel the input voice by the user U1 issuing a predetermined word. For example, when the word “redo” is detected in the voice input in the headset 1 a, the text conversion unit 261 is generated after the “speak” icon is touched until the word “redo” is detected. The first language text data is deleted. The text conversion unit 261 instructs the UI processing unit 262 to delete the first language text data displayed on the display unit 23. By doing in this way, the text conversion part 261 will transmit incorrect 1st language text data to the translation apparatus 3, when the audio | voice which the user U1 was unable to convert into correct 1st language text data. Can be prevented.

  FIG. 8 is a diagram illustrating the screen of the information terminal 2a and the screen of the information terminal 2b after the user U1 releases his / her finger from the “speak” icon. The retranslation data is displayed in the second area R2 of the screen of the information terminal 2a shown in FIG. FIG. 8B shows a screen of the information terminal 2b. In the third area R3 of the information terminal 2b, an English sentence translated from the Japanese sentence “Nice to meet you” issued by the user U1 is displayed. .

  The user U1 can confirm whether or not the translation has been correctly performed by visually checking the retranslation data displayed on the information terminal 2a. When the text conversion unit 261 detects the word “redo” issued by the user U1 while displaying the retranslation data, the text conversion unit 261 notifies the translation device 3 that there is an error in the second language translation data. Also good. When recognizing that there was an error in translation, translation apparatus 3 notifies information terminal 2b that there was an error in translation, and information terminal 2b erases the English sentence displayed in third region R3. Then, a word indicating cancellation (for example, canceled) may be displayed. By doing in this way, the translation apparatus 3 will continue to display incorrect 2nd language translation data on the information terminal 2b, when the speech which the user U1 uttered cannot be converted into correct 1st language text data. Can be prevented.

  The translation control unit 331 transmits the second language translation data to the information terminal 2b after waiting for a time necessary for the user U1 to confirm the contents of the retranslation data after transmitting the retranslation data to the information terminal 2a. You may send it. In this case, the translation control unit 331 transmits the retranslation data to the information terminal 2a, and then, when the communication unit 31 receives first language text data including a predetermined word (for example, “redo”), to the user U2. The transmission of the second language translation data may be stopped. By doing in this way, when the translation apparatus 3 has not been able to convert the voice uttered by the user U1 into correct first language text data, the translation device 3 is notified that erroneous second language translation data is transmitted to the information terminal 2b. Can be prevented.

  FIG. 9 is a diagram showing the screen of the information terminal 2a and the screen of the information terminal 2b after the user U2 utters the second language voice following the state of FIG. In the first area R1 of the information terminal 2b shown in FIG. 9B, the second language text data corresponding to the voice uttered by the user U2 is displayed, and the second language text data of the information terminal 2a shown in FIG. 9A is displayed. In one area R1, the first language translation data generated by translating the second language text data is displayed. In addition, re-translated data obtained by translating the first language translation data is displayed in the second region R2 of the information terminal 2b shown in FIG. 9B.

  From the headset 1a, the first language speech corresponding to the retranslation data shown in the second region R2 of FIG. 9A and the first language speech corresponding to the first language translation data shown in the third region R3. Is output. At this time, when the user U2 emits the second language voice and is transmitted to the translation device 3 while the first language voice is being output from the headset 1a, the translation control unit 331 performs the language conversion unit 332. When the language information of the second language input in the headset 1b is converted into the first language translation data, the transmission of the retranslation data is stopped and the first language translation data is transmitted to the information terminal 2a. By doing in this way, the user U1 becomes possible to grasp | ascertain the content of the audio | voice which the user U2 emitted preferentially rather than the content of retranslation data.

  Similarly, while the translation control unit 331 is transmitting the first language translation data based on the second language speech uttered by the user U2 to the information terminal 2a, the language conversion unit 332 newly generates the user U2. When the generation of new first language translation data is completed after translating the second language speech, transmission of the first language translation data being transmitted is stopped, and transmission of new first language translation data is started. May be. By doing in this way, when the user U2 utters the sound including the mistaken content, the user U1 promptly utters the sound of the correct content, so that the correct content is transmitted to the user U1.

  While the translation control unit 331 is transmitting the first language translation data based on the voice of the second language uttered by the user U2 to the information terminal 2a, the language conversion unit 332 newly generates the third language uttered by the user U3. When the speech of the language is translated and generation of new first language translation data is completed, the transmission of the first language translation data being transmitted is stopped, and the first language based on the third language speech uttered by the user U3 You may start transmission of translation data. In this case, the translation control unit 331 notifies the information terminal 2b that the transmission of the first language translation data based on the voice uttered by the user U2 is interrupted, and the information terminal 2b transmits the first language translation data. You may display that transmission was interrupted. In this way, the user U2 can recognize that what he / she has spoken is not transmitted to the user U1 and take an appropriate response such as speaking again.

[Processing Sequence in Translation System S1]
FIG. 10 is a diagram showing a processing sequence in the translation system S1. FIG. 10 starts from the point in time when the user U1 starts inputting the voice in the first language in the headset 1a (step S11). When the first language voice is input, the headset 1 a transmits digital voice data corresponding to the first language voice to the information terminal 2.

  The information terminal 2a converts the received digital voice data into first language text data (step S12). During this time, the UI processing unit 262 of the information terminal 2a monitors whether or not the voice input is completed (step S13), and the text conversion unit 261 generates the first language text data until the voice input is completed. continue. The text conversion unit 261 transmits the generated first language text data to the translation device 3 via the second communication unit 22 when the UI processing unit 262 determines that the voice input has been completed (YES in step S13). .

  Subsequently, the language conversion unit 332 converts the first language text data received via the communication unit 31 into second language text data, and generates second language translation data (step S14). The translation control unit 331 transmits the second language translation data generated by the language conversion unit 332 to the information terminal 2b via the communication unit 31.

  Upon receiving the second language translation data, the text conversion unit 261 of the information terminal 2b converts the received second language translation data into a second language digital audio signal (step S15). The text conversion unit 261 of the information terminal 2 b transmits a digital audio signal in the second language to the headset 1 b via the first communication unit 21. The voice processing unit 151 of the headset 1b converts the digital voice signal received from the information terminal 2b into an analog voice signal, and outputs the second language voice from the bone conduction speaker 14 (step S16).

  After the second language translation data is generated in step S14, the translation control unit 331 causes the language conversion unit 332 to translate the second language translation data into the first language and create retranslation data (step S17). The retranslation data is transmitted to the information terminal 2a. When receiving the retranslation data, the text conversion unit 261 of the information terminal 2a converts the received retranslation data into a digital speech signal in the first language (step S18). The text conversion unit 261 of the information terminal 2 a transmits a digital audio signal in the first language to the headset 1 a via the first communication unit 21. The voice processing unit 151 of the headset 1a converts the digital voice signal received from the information terminal 2a into an analog voice signal, and outputs the first language voice from the bone conduction speaker 14 (step S19).

  As described above, the text conversion unit 261 transmits the retranslation data to the information terminal 2a before transmitting the second language translation data to the information terminal 2b after step S14, and then the user U1 receives the retranslation data. The second language translation data may be transmitted to the information terminal 2b after the time necessary for confirming the elapses.

  FIG. 11 is a diagram showing a configuration of a translation system S2 according to a modification of the present embodiment. The translation system S2 is different from the translation system S1 in that the user U1 uses a headset 10 having a part of the functions of the information terminal 2a instead of the headset 1a. In addition, the translation system S1 in that the user U2 and the user U3 do not use the headset 1b and the headset 1c but use the information terminal 20b and the information terminal 20c instead of the information terminal 2b and the information terminal 2c. And different.

  The headset 10 has a function of the text conversion unit 261 in addition to the function of the headset 1 shown in FIG. Moreover, it has the function of the 2nd communication part 22 instead of the communication part 152 in the headset 1. FIG. By doing in this way, the user U1 can talk with the user U2 using the second language and the user U3 using the third language only by using the headset 10 without using the information terminal 2a. Can do.

  In addition, the headset 10 is configured to acquire the operation content in the information terminal 2 connected via the wireless channel, and the user U1 can set the timing to start translation using the information terminal 2. Also good. Further, the headset 10 displays the retranslation data and the first language translation data received from the translation device 3 via the access point 4a on the information terminal 2 connected via the radio channel so that the user U1 can visually recognize the retranslation data and the first language translation data. You may let them.

  In addition to the information terminal 2, the information terminal 20 includes a microphone that inputs sound and a speaker that outputs sound. By using the information terminal 20b and the information terminal 20c, the user U2 and the user U3 can talk with the user U1 without wearing the headset 1b and the headset 1c.

[Effects of translation system S1 and translation system S2]
As described above, in the translation system S1 and the translation system S2 according to the present embodiment, the translation device 3 translates the first language speech input in the headset 1a into the second language speech before the head. The data is transmitted to the set 1b, and the headset 1b outputs the sound translated into the second language. Further, the translation device 3 translates the second language voice input in the headset 1b into the first language voice, and then transmits the translated voice to the headset 1a, and the headset 1a translates the voice translated into the first language. Output. By doing in this way, the user wearing the headset 1a and the headset 1b can understand what the other person speaks while speaking while looking at the face of the other party who uses a different language. You can improve the quality of communication with the people you use.

  The headset 1 also has a bone conduction speaker 14. Therefore, the user can hear the translated voice by bone conduction while listening to the other party's live voice with his / her ear. become. As a result, the quality of communication with a partner who uses a different language can be further enhanced.

  In the above description, the case where the translation device 3 includes the language conversion unit 332 is illustrated. However, the translation device 3 may use an external server such as a cloud server having a translation function as the language conversion unit 332. Good. FIG. 12 is a diagram illustrating a configuration of the translation device 3 when the function of the language conversion unit 332 is realized by the language conversion server 5 different from the translation device 3. As described above, the translation control unit 331 may execute the translation process by interlocking with the external language conversion server 5 that operates in the same manner as the language conversion unit 332 via the communication unit 31.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment, A various deformation | transformation and change are possible within the range of the summary. is there. For example, the specific embodiments of device distribution / integration are not limited to the above-described embodiments, and all or a part of them may be configured to be functionally or physically distributed / integrated in arbitrary units. Can do. In addition, new embodiments generated by any combination of a plurality of embodiments are also included in the embodiments of the present invention. The effect of the new embodiment produced by the combination has the effect of the original embodiment.

  In the above description, it is assumed that the information terminal 2 is a terminal rented to the user U. However, the information terminal 2 may be a terminal with which the user U has contracted with a mobile phone operator. In this case, the information terminal 2 may store the language information used by the user U and not display the user selection screen shown in FIG.

DESCRIPTION OF SYMBOLS 1 Headset 2 Information terminal 3 Translation apparatus 4 Access point 5 Language conversion server 10 Headset 11 1st main microphone 12 2nd main microphone 13 Sub microphone 14 Bone conduction speaker 15 Control unit 16 Cable 17 Microphone accommodating part 18 Connection member 19 Main part 20 information terminal 21 first communication unit 22 second communication unit 23 display unit 24 operation unit 25 storage unit 26 control unit 31 communication unit 32 storage unit 33 control unit 151 voice processing unit 152 communication unit 153 control unit 261 text conversion unit 262 processing Unit 331 Translation control unit 332 Language conversion unit

Claims (16)

A first user terminal used by a first user, and a translation device capable of communicating with the first user terminal;
The first user terminal is
A voice input unit for receiving voice input in a first language;
A terminal transmitter for transmitting, to the translation device, first language text data obtained by converting the voice of the first language received by the voice input unit;
A terminal receiving unit for receiving, from the translation device, first language translation data in which the language information of the second language input in the second user terminal used by the second user is translated into the first language;
A voice output unit that outputs the first language voice converted from the first language translation data received by the terminal receiver;
Have
The translation device includes:
A specifying unit for specifying a first language used by the first user and a second language used by the second user;
A device receiver for receiving the first language text data from the first user terminal;
A language conversion unit that converts the first language text data received by the device reception unit into second language translation data, and converts the second language translation data into the first language to generate retranslation data ;
The second language translation data is transmitted to the second user terminal and the retranslation data is transmitted to the first user terminal, and the language conversion unit is input at the second user terminal. A device transmission unit that stops transmission of the retranslation data and transmits the first language translation data when language information of a language is converted into the first language translation data ;
I have a,
The speech output unit outputs the retranslation data transmitted by the device transmission unit while the speech input unit receives speech of the first language . A first user terminal used by a first user, and a translation device capable of communicating with the first user terminal;
The first user terminal is
A voice input unit for receiving voice input in a first language;
A terminal transmitter for transmitting, to the translation device, first language text data obtained by converting the voice of the first language received by the voice input unit;
A terminal receiving unit for receiving, from the translation device, first language translation data in which the language information of the second language input in the second user terminal used by the second user is translated into the first language;
A voice output unit that outputs the first language voice converted from the first language translation data received by the terminal receiver;
Have
The translation device includes:
A specifying unit for specifying a first language used by the first user and a second language used by the second user;
A device receiver for receiving the first language text data from the first user terminal;
A language conversion unit that converts the first language text data received by the device reception unit into second language translation data, and converts the second language translation data into the first language to generate retranslation data ;
The second language translation data is transmitted to the second user terminal, the retranslation data is transmitted to the first user terminal, and the retranslation data is transmitted to the first user terminal. A device transmitting unit for stopping transmission of the second language translation data to the second user terminal when the unit receives the first language text data including a predetermined word ;
I have a,
The speech output unit outputs the retranslation data transmitted by the device transmission unit while the speech input unit receives speech of the first language . A first user terminal used by a first user, and a translation device capable of communicating with the first user terminal;
The first user terminal is
A voice input unit for receiving voice input in a first language;
A terminal transmitter for transmitting, to the translation device, first language text data obtained by converting the voice of the first language received by the voice input unit;
A terminal receiving unit for receiving, from the translation device, first language translation data in which the language information of the second language input in the second user terminal used by the second user is translated into the first language;
A voice output unit that outputs the first language voice converted from the first language translation data received by the terminal receiver;
Have
The translation device includes:
A specifying unit for specifying a first language used by the first user and a second language used by the second user;
An apparatus receiving unit that receives the first language text data from the first user terminal and receives second language text data obtained by converting a second language voice from the second user terminal ;
The first language text data received by the device receiver is converted into second language translation data, and the second language text data of the second language received by the device receiver is converted into first language translation data. A language conversion unit,
While the second language translation data is transmitted to the second user terminal and the first language translation data is being transmitted, the language conversion unit finishes generating new first language translation data Then, an apparatus transmission unit that stops transmission of the first language translation data being transmitted and starts transmission of new first language translation data ;
Translation system having A first user terminal used by a first user, and a translation device capable of communicating with the first user terminal;
The first user terminal is
A voice input unit for receiving voice input in a first language;
User specification for specifying a second language different from the first user in association with the first language text data obtained by converting the first language voice received by the voice input unit and the first language text data A terminal transmission unit for transmitting information to the translation device;
From said translation device, and a terminal receiving section that receives a first language translation data language information of the second language is translated into the first language entered in the second user terminal that the second user uses,
A voice output unit that outputs the first language voice converted from the first language translation data received by the terminal receiver;
Have
The translation device includes:
The user identification transmitted by the terminal transmission unit by identifying a first language used by the first user and referring to a storage unit that stores a language used by each of the plurality of users in association with the plurality of users. A specifying unit for specifying a second language used by the second user, stored in the storage unit in association with the second user indicated by the information ;
A device receiver for receiving the first language text data from the first user terminal;
A language converter that converts the first language text data received by the device receiver into second language translation data;
A device transmission unit for transmitting the second language translation data to the second user terminal;
Translation system having A first user terminal used by a first user, and a translation device capable of communicating with the first user terminal;
The first user terminal is
A voice input unit for receiving a first language voice;
A terminal transmitter for transmitting, to the translation device, first language text data obtained by converting the voice of the first language received by the voice input unit;
A terminal receiving unit for receiving, from the translation device, first language translation data in which the language information of the second language input in the second user terminal used by the second user is translated into the first language;
A voice output unit that outputs the first language voice converted from the first language translation data received by the terminal receiver;
Have
The translation device includes:
A specifying unit for specifying a first language used by the first user and specifying a second language used by the second user based on a word included in the first language text data ;
A device receiver for receiving the first language text data from the first user terminal;
A language converter that converts the first language text data received by the device receiver into second language translation data;
A device transmission unit for transmitting the second language translation data to the second user terminal;
Translation system having The voice output unit has a bone conduction speaker, and the voice input unit outputs the voice of the first language from the bone conduction speaker while receiving the voice of the first language.
The translation system according to any one of claims 1 to 5. A step of the translation device identifying a first language used by the first user and a second language used by the second user;
A first user terminal used by a first user receiving an input of a voice in a first language;
The first user terminal converting the speech of the first language into first language text data, and transmitting the converted first language text data to the translation device;
The translation device converting the first language text data into second language translation data ;
The translation device converting the second language translation data into the first language to generate retranslation data;
The translation device transmitting the second language translation data to a second user terminal used by the second user and transmitting the retranslation data to the first user terminal;
The second user terminal outputting the second language speech in which the second language translation data is converted;
The first user terminal outputting the retranslation data while receiving input of the voice in the first language;
In the step of transmitting the retranslation data to the first user terminal, the translation device converts the language information of the second language input at the second user terminal into first language translation data. Discontinuing transmission of retranslation data and transmitting the first language translation data;
A translation method comprising: A step of the translation device identifying a first language used by the first user and a second language used by the second user;
A first user terminal used by a first user receiving an input of a voice in a first language;
The first user terminal converting the speech of the first language into first language text data, and transmitting the converted first language text data to the translation device;
The translation device converting the first language text data into second language translation data ;
The translation device converting the second language translation data into the first language to generate retranslation data;
The translation device transmitting the second language translation data to a second user terminal used by the second user and transmitting the retranslation data to the first user terminal ;
The second user terminal outputting the second language speech in which the second language translation data is converted;
The first user terminal outputting the retranslation data while receiving input of the voice in the first language;
In the step of transmitting the retranslation data to the first user terminal, the translation device receives the first language text data including a predetermined word after transmitting the retranslation data to the first user terminal. A step of stopping transmission of the second language translation data to the second user terminal,
A translation method comprising: A step of the translation device identifying a first language used by the first user and a second language used by the second user;
A first user terminal used by a first user receiving an input of a voice in a first language;
The first user terminal converting the speech of the first language into first language text data, and transmitting the converted first language text data to the translation device;
The translating device receiving the first language text data from the first user terminal;
Receiving the second language text data obtained by converting the second language speech from the second user terminal used by the second user;
Said translation device, and converting the first language text data to a second language translation data,
The translation device converting the received second language text data of the second language into first language translation data;
A step wherein the translation device, for transmitting the second language translation data to the second user terminal,
The second user terminal outputting the second language speech in which the second language translation data is converted;
When the translation device finishes generating the new first language translation data while transmitting the first language translation data, it stops transmitting the first language translation data being transmitted and Starting transmission of the first language translation data;
A translation method comprising: A step of the translation device identifying a first language used by the first user and a second language used by the second user;
A first user terminal used by a first user receiving an input of a voice in a first language;
The first user terminal converting the speech of the first language into first language text data, and transmitting the converted first language text data to the translation device;
The first user terminal transmitting user specifying information for specifying the second user in association with the first language text data;
The translation device converting the first language text data into second language translation data ;
The translation device transmitting the second language translation data to a second user terminal used by the second user;
The second user terminal outputting the second language speech in which the second language translation data is converted;
I have a,
In the step of specifying the second language, the translation device refers to the storage unit that stores the language used by each of the plurality of users in association with the plurality of users, whereby the user identification transmitted by the first user terminal A translation method for identifying a second language used by the second user, stored in the storage unit in association with the second user indicated by the information . A step of the translation device identifying a first language used by the first user and a second language used by the second user;
A first user terminal used by a first user receiving an input of a voice in a first language;
The first user terminal converting the speech of the first language into first language text data, and transmitting the converted first language text data to the translation device;
The translation device converting the first language text data into second language translation data ;
The translation device transmitting the second language translation data to a second user terminal used by the second user;
The second user terminal outputting the second language speech in which the second language translation data is converted;
I have a,
The translation method in which the translation device identifies a second language used by the second user based on a word included in the first language text data in the step of identifying a second language . A specifying unit that specifies the first language used by the first user and the second language used by the second user;
An apparatus receiving unit for receiving first language text data obtained by converting voice of the first language from a first user terminal used by the first user;
A language conversion unit that converts the first language text data received by the device reception unit into second language translation data, and converts the second language translation data into the first language to generate retranslation data ;
The second language translation data is transmitted to the second user terminal used by the second user and the retranslation data is transmitted to the first user terminal, and the language conversion unit inputs the second user terminal at the second user terminal. An apparatus transmitting unit for stopping transmission of the retranslation data and transmitting the first language translation data when the language information of the second language is converted into first language translation data ;
A translation apparatus. A specifying unit that specifies the first language used by the first user and the second language used by the second user;
An apparatus receiving unit for receiving first language text data obtained by converting voice of the first language from a first user terminal used by the first user;
A language conversion unit that converts the first language text data received by the device reception unit into second language translation data, and converts the second language translation data into the first language to generate retranslation data ;
The second language translation data is transmitted to a second user terminal used by the second user, the retranslation data is transmitted to the first user terminal, and the retranslation data is transmitted to the first user terminal. After that, when the device reception unit receives the first language text data including a predetermined word, a device transmission unit that stops transmission of the second language translation data to the second user terminal ,
A translation apparatus. A specifying unit that specifies the first language used by the first user and the second language used by the second user;
The first language text data converted from the first language voice is received from the first user terminal used by the first user , and the second language voice is received from the second user terminal used by the second user. A device receiving unit for receiving the second language text data converted from ;
The first language text data received by the device receiver is converted into second language translation data, and the second language text data of the second language received by the device receiver is converted into first language translation data. A language conversion unit,
While the second language translation data is transmitted to the second user terminal and the first language translation data is being transmitted, the language conversion unit finishes generating new first language translation data Then, an apparatus transmission unit that stops transmission of the first language translation data being transmitted and starts transmission of new first language translation data ;
A translation apparatus. A specifying unit that specifies the first language used by the first user and the second language used by the second user;
An apparatus receiving unit for receiving first language text data obtained by converting voice of the first language from a first user terminal used by the first user;
A language converter that converts the first language text data received by the device receiver into second language translation data;
An apparatus transmitting unit for transmitting the second language translation data to a second user terminal used by the second user;
I have a,
The specifying unit refers to a storage unit that stores a language used by each of the plurality of users in association with the plurality of users, thereby indicating the user specifying information received from the first user terminal used by the first user. A translation device that identifies a second language used by the second user and stored in the storage unit in association with the second user . A specifying unit that specifies the first language used by the first user and the second language used by the second user;
An apparatus receiving unit for receiving first language text data obtained by converting voice of the first language from a first user terminal used by the first user;
A language converter that converts the first language text data received by the device receiver into second language translation data;
An apparatus transmitting unit for transmitting the second language translation data to a second user terminal used by the second user;
I have a,
The translation unit is a translation device that identifies a second language used by the second user based on a word included in the first language text data .

Images