JP2020187777A - Translation display device, computer terminal, translation display method, and program - Google Patents

Abstract

To provide a translation display device capable of allowing a speaker to easily find a part of the sentence entered by the speaker where misrecognition or mistranslation occurs, a computer terminal, a translation display method, and a program.SOLUTION: The translation display device has a display form changing unit 107 that determines whether or not a source text contains the characters contained in a retranslated text concerning a source text of a first language and a retranslated text which is a translated source text translated into a second language, and the translated text is translated back into the first language, the characters included in the retranslated text are included in the source text. The display format of the characters constituting the retranslated text is different between the characters which are determined as included in the source text and characters which are determined as not included in the source text.SELECTED DRAWING: Figure 5

Description

The present disclosure relates to a translation display device, a computer terminal, a translation display method, and a program for automatically translating data input in a first language into a second language.

Voice translation technology has been developed that recognizes the speaker's voice, translates the recognition result into another language, and conveys it to the other party. In such a voice translation technology, a technology has been developed that can check the translation result before telling the other party so that the translation result is not transmitted to the other party when a misrecognition or mistranslation of the voice occurs. (For example, Patent Document 1).

International Publication No. 2013/14877

In Patent Document 1, the result of speech recognition is used as the original text, the translated version is reverse-translated, the reliability is calculated by comparing with the original text, and the translation result is not output when the reliability is low. Is disclosed.

In such a voice translation technique, when the reliability of the translation result is low, it is preferable that the speaker repeatedly re-inputs the voice until a translation result with sufficient reliability is obtained. In such a case, if there is a mechanism for the speaker to recognize the part where the mistranslation occurs in the sentence input by voice, the speaker pays attention to the part where the mistranslation occurs and re-enters. It can be performed. Patent Document 1 discloses that the reliability calculated for each word or word string is displayed together with the result of voice recognition and the result of reverse translation, and the speaker who sees the result is low when re-entering. You can input while paying attention to the reliability.

However, in the technique disclosed in Patent Document 1, the word or word string and the reliability are only written together, and the speaker can read at a glance which word or word string has low reliability. Have difficulty. For this reason, the speaker has to read the displayed reliability while waiting for the other party, which makes it difficult to perform smooth communication. Alternatively, the speaker will re-enter regardless of the reliability so as not to make the other party wait, and it will be difficult to preferably paraphrase the re-input so that erroneous translation does not occur again.

An object of the present disclosure is to provide a translation display device, a computer terminal, a translation display method, and a program that allow the speaker to easily recognize a part of a sentence input by the speaker where an erroneous translation has occurred.

The translation display device according to the present disclosure retranslates the original text data of the first language and the retranslated text data obtained by translating the original text data into the second language and then translating the translated text data into the first language. It is determined whether or not the characters included in the translated text data are included in the original text data, and the display form of the characters constituting the retranslated text data is the characters determined to be included in the original text data. A display form changing unit that is different from the characters determined not to be included in the original text data, a display unit that displays the retranslated text data based on the display form, and the retranslated text data are displayed on the display unit. In the displayed state, a translation output unit that receives a predetermined input and then outputs data based on the translated text data or outputs data based on the translated text data regardless of the presence or absence of the predetermined input. The display unit displays data based on the translated text data.

The computer terminal according to the present disclosure has the above translation display device.

The translation display method according to the present disclosure is a translation display method that supports translation from a first language to a second language using a computer, and the original text data of the first language and the original text data are converted into a second language. With respect to the retranslated text data obtained by translating the translated text data translated into the first language again into the first language, it is determined whether or not the characters included in the retranslated text data are included in the original text data, and the retranslation is performed. The display form of the characters constituting the text data is different between the characters determined to be included in the original text data and the characters determined not to be included in the original text data, and the retranslated text data is displayed. Displayed based on the form, and in the state where the retranslated text data is displayed, the translated text data is output after receiving a predetermined input or the data based on the translated text data is output regardless of the presence or absence of the predetermined input. Outputs data based on the above, and displays data based on the translated text data.

According to the present disclosure, the speaker can easily recognize the part where the misrecognition or mistranslation occurs in the sentence input by the speaker.

Schematic configuration of the translation display system according to an example of the present disclosure The figure which shows an example of the appearance of the user terminal which concerns on the example of this disclosure. Functional configuration diagram of the translation display device according to the first embodiment A flowchart showing an operation example of the translation process and the retranslation process executed by the translation display device according to the first embodiment. A flowchart showing an operation example of the display form change process executed by the translation display device according to the first embodiment. The figure which shows an example of the display form changed by the display form change process executed by the translation display device which concerns on Embodiment 1. A flowchart showing an operation example of similar character string processing executed by the translation display device according to the first embodiment. A flowchart showing an operation example of output processing executed by the translation display device according to the first embodiment.

Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations for substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate the understanding of those skilled in the art.

It should be noted that the inventors provide the accompanying drawings and the following description in order for those skilled in the art to fully understand the present disclosure, which are intended to limit the subject matter described in the claims. is not.

(Embodiment 1)
[1-1. Constitution]
FIG. 1 is a diagram schematically showing an overall configuration of a translation display system 1 according to an embodiment of the present disclosure. The translation display system 1 includes a user terminal 10 including a translation display device 100 (FIG. 3) described later, a voice recognition server 50 that can be connected to the user terminal 10 via a network, a translation server 60, and a voice synthesis server 70. Be prepared.

The voice recognition server 50, the translation server 60, and the voice synthesis server 70 are computer devices each including a processor such as a CPU, a ROM, a RAM, a storage device, and a communication I / F (interface) capable of communicating with the user terminal 10. The voice recognition server 50 receives voice data from the user terminal 10, generates a text of the voice recognition result, and transmits the text to the user terminal 10. The translation server 60 receives the text data of the first language from the user terminal 10, translates it into the text data of another language (second language) designated, and transmits it to the user terminal 10. The voice synthesis server 70 receives the translated text data from the user terminal 10, generates the voice data, and transmits the voice data to the user terminal 10.

[1-1-1. User terminal configuration]
As shown in FIG. 1, the user terminal 10 (an example of a computer terminal) includes a CPU 11, a ROM 12, a RAM 13, an input I / F (interface) 14, an output I / F (interface) 15, and a communication I / F (interface) 16. , An input operation unit 18, and a display 19. The user terminal 10 also includes a storage device 17, a microphone 30, and a speaker 40.

The CPU 11 is a processor or circuit that executes processing according to a predetermined program. The ROM 12 stores a control program or the like that describes the processing procedure of the CPU 11. The RAM 13 temporarily stores a control program and data as a work memory. The input I / F 14 is a connection unit connected to the microphone 30 and receives A / D-converted voice data from the microphone 30. The output I / F 15 is a connection unit connected to the speaker 40, and transmits D / A-converted voice to the speaker 40. The communication I / F 16 is a communication circuit for wirelessly or wiredly communicating with the voice recognition server 50, the translation server 60, and the voice synthesis server 70, respectively.

The input operation unit 18 accepts a user's input operation using a touch panel, keyboard, or pointing device (mouse or the like). The display 19 (an example of a display unit) is composed of a liquid crystal panel, an organic EL panel, or a panel similar thereto, and displays text data of a translation result and the like. In this specification, the "user" is a user of the translation display system 1.

The storage device 17 is a storage device such as a magnetic storage device such as an HDD (hard disk drive) or a semiconductor memory, and stores various programs such as an application and an OS and various data. The storage device 17 may be connected as a storage device separate from the user terminal 10.

FIG. 2 is a diagram showing an example of the appearance of the user terminal 10. In FIG. 2 and the following description, it is assumed that a user who speaks a first language attempts to communicate with a user who speaks a second language. In the following description, a user who speaks a first language may be described as a host, and a user who speaks a second language may be described as a guest.

As shown in FIG. 2, the touch keys K0 to K2 of the touch panel (corresponding to the input operation unit 18) are displayed on the display 19. The key K0 is a start button, and when operated, the voice recognition process in the user terminal 10 is started or ended. The key K1 is a first language start button and language selection button, and when operated, voice input to the first language microphone 30 spoken by the host is started or ended. The key K2 is a second language start button and language selection button, and when operated, voice input to the second language microphone 30 spoken by the guest is started or ended. Further, the languages of the key K1 and the key K2 can be switched by, for example, a long press operation. Further, the display 19 also displays the display area A1 of the first language and the display area A2 of the second language.

The microphone 30 inputs the voice (utterance) emitted by the user as voice data. The speaker 40 outputs the voice data received from the voice synthesis server 70. For example, as shown in FIG. 2, the result of picking up the sound with the microphone 30 and recognizing the voice is displayed in the display area A1 as the original text L1-1 (here, when the first language is Japanese, " I will tell you how to get to Tokyo Station. "). The retranslated text L1-2, which is a retranslated version of the translated text from which the original text has been translated, is displayed in the display area A1 (for example, "Tell me how to get to Tokyo Station."). The translated text L2-1 translated from the original text is displayed in the display area A2 (“I teach you a way to Tokyo Station.”), Is output as voice data from the speaker 40, and is output to the guest (listener) who interacts with the user. On the other hand, the voice of the second language is transmitted. Here, the case where the second language is English is illustrated.

[1-1-2. Translation display device configuration]
FIG. 3 shows the configuration of the translation display device 100 realized by executing a predetermined program mainly by the CPU 11 of the user terminal 10 using the memory area. The translation display device 100 includes the following elements or modules.

The voice acquisition unit 101 acquires the voice emitted by the user as voice data via the microphone 30. The voice acquisition unit 101 transmits the acquired voice data to the voice recognition server 50 via the communication I / F 16. The voice recognition server 50 recognizes voice data and converts it into text data (original text). In the following explanation, it is assumed that the first language is, for example, Japanese, and for example, "Tell me how to get to Tokyo Station" is acquired as the original text.

The original text acquisition unit 102 acquires the original text of the voice recognition result from the voice recognition server 50 via the communication I / F 16.

The original text transmission unit 103 transmits the original text to the translation server 60 via the communication I / F 16. The translation server 60 translates the original text into a second language and generates the translated text.

The translation acquisition unit 104 acquires the translation text from the translation server 60 via the communication I / F 16. In the following description, it is assumed that the second language is, for example, English, and for example, "I teach you a way to Tokyo Station." Is acquired as the translated text.

The translation transmission unit 105 transmits the translation text to the translation server 60 via the communication I / F 16. The translation server 60 retranslates the English translation text into Japanese and generates the retranslation text.

It should be noted that generating the retranslated text is effective for the speaker to confirm whether or not the content spoken by the speaker is properly translated.

The retranslation acquisition unit 106 acquires the retranslation text from the translation server 60 via the communication I / F 16 (for example, "Tell me how to get to Tokyo Station").

The display form changing unit 107 compares the original text acquired by the original text acquisition unit 102 with the retranslated text acquired by the retranslation acquisition unit 106 on a character-by-character basis, and changes the display form of different characters. Changing the display form means, for example, changing the character color, shading, and background color. As a result, the display form of the characters included in both the original text and the retranslated text and the display form of the characters different between the original text and the retranslated text can be made different from each other.

The similar character string detection unit 108 compares the original text acquired by the original text acquisition unit 102 with the retranslated text acquired by the retranslation acquisition unit 106, and detects and detects a similar character string including notational fluctuations. The result is output to the display form changing unit 107. The similar character string detection unit 108 detects a similar character string with reference to the similar character string DB (database) 170. The similar character string means a plurality of character strings having similar meanings but different notations. The display form changing unit 107 does not change the display form between the original text and the retranslated text with respect to the similar character string detected by the similar character string detecting unit 108.

The original text output unit 110 outputs the original text to be displayed on the display 19.

The retranslation output unit 111 outputs the retranslation text to be displayed on the display 19.

The translation output unit 112 outputs the translated text to be displayed on the display 19.

The voice output unit 113 outputs the voice data of the second language converted from the translated text by the voice synthesis server 70 to the speaker 40. As a result, the speaker 40 transmits the voice of the second language to the guest who interacts with the host.

[1-2. motion]
Hereinafter, the processing executed by the translation display device 100 (mainly the CPU 11) will be described with reference to FIG. 4 to 8 are flowcharts showing an operation example of the translation display process by the translation display device 100. In the example shown in FIGS. 4 to 8, the translation display device 100 translates the content spoken by the host using Japanese (first language) and conveys it to the guest using English (second language). To do.

FIG. 4 is a flowchart showing an operation example of the translation process and the retranslation process.

S401: Voice data is acquired from the microphone 30 by the voice acquisition unit 101. Here, it is assumed that the user utters "I will tell you how to get to Tokyo Station" and the microphone 30 acquires the voice data.

S402: Voice data is transmitted to the voice recognition server 50 by the voice acquisition unit 101.

S403: The original text acquisition unit 102 receives the original text converted by the voice recognition server 50.

S404: The original text is transmitted to the translation server 60 by the original text transmission unit 103.

S405: The translation acquisition unit 104 receives the translation text generated by the translation server 60. Here, it is assumed that the translated text "I teach you a way to Tokyo Station." Is received.

S406: The translation transmission unit 105 transmits the translation text to the translation server 60.

S407: The retranslation acquisition unit 106 receives the text retranslated from the second language translation text into the first language by the translation server 60. Here, it is assumed that the retranslated text "I will tell you how to get to Tokyo Station" is received.

Next, the display form change process is performed. FIG. 5 is a flowchart showing an operation example of the display form changing process.

S501: The display form changing unit 107 changes the display form of all characters of the original text and the retranslated text from the first display form to the second display form. In the following, as an example of changing the display form, an example of changing the character color will be described. For example, assuming that each character is displayed in black in the first display form and each character is displayed in red in the second display form, all the characters of the original text and the retranslated text are displayed in this step. The character color is changed to red by the form changing unit 107. Here, it is assumed that the first display form (character color: black) is a normal character display form, and the second display form (character color: red) is a character display form different from the usual one.

The following steps from step S502 to step S505 loop for all characters in the source text and the retranslated text. In the following description, the characters to be processed will be described.

S502: The display form changing unit 107 compares the characters to be processed with all the characters in the text to be compared. The text to be compared means a text of the original text and the retranslated text that does not include the character to be processed at present. That is, if the character to be processed at present is a character included in the original text, the text to be compared is the retranslated text. On the contrary, if the character to be processed at present is a character included in the retranslated text, the text to be compared is the source text.

S503: As a result of the comparison in step S502, the display form changing unit 107 determines whether or not the same character as the character to be processed is in the comparison target text. If it is determined that the same character exists (step S503: YES), the process proceeds to step S504, and if not (step S503: NO), the process proceeds to step S502 with the next character as the processing target.

A specific example will be described. As mentioned above, suppose the original text is "Tell me how to get to Tokyo Station" and the retranslated text is "Tell me how to get to Tokyo Station." Here, when the character to be processed is "East" of the original text, the determination result in step S503 is YES because the same character "East" is included in the retranslated text. On the other hand, when the character to be processed is "he" of the retranslated text, the same character is not included in the original text, so the determination result in step S503 is NO.

S504: Whether or not the character before the character to be processed and the character before the same character included in the comparison target text are the same by the display form changing unit 107, or with the character after the character to be processed. It is determined whether or not the characters after the same character included in the comparison target text are the same. If it is determined that either the preceding character or the following character is the same (step S504: YES), the process proceeds to step S505, and if not (step S504: NO), the process processes the next character. The target proceeds to step S502.

A specific example using the same original text and retranslated text as above will be described. When the character to be processed is "no" in the retranslated text, the previous character "he" is different from the character "de" before "no" in the original text to be compared. However, the character "line" after the character to be processed is the same as the character "line" after the "no" in the original text to be compared. That is, since the character after the character to be processed and the character after the same character included in the original text to be compared are the same, the determination in step S504 is YES. On the other hand, if the character to be processed is the first "ma" in the original text, the previous character "station" is the character before the "ma" in the retranslated text to be compared. Is different. The character "de" after the character to be processed is different from the character "su" after the character "ma" in the retranslated text to be compared. That is, the character before the character to be processed and the character before the same character contained in the source text to be compared, and the character after the character to be processed and after the same character contained in the source text to be compared. Since both characters are different, the determination in step S504 is NO.

S505: The display form changing unit 107 changes the display form of the character to be processed changed to the second display form in step S501 to the first display form which is the normal display form again. Specifically, the display form changing unit 107 performs a process of returning the character color changed to red in step S501 to black.

Then, when the processing of steps S502 to S505 is completed for all the characters of the original text and the retranslated text, the processing shifts to the similar character string processing described below. If the processing for all the characters of the original text and the retranslated text is not completed, the processing proceeds to step S502 with the next character as the processing target.

By the display form change process shown in FIG. 5 described above, the display form is changed as follows. FIG. 6 is a diagram showing an example of a display form changed by the display form change process. In FIG. 6, in FIG. 6, the character colors of “de” and “he”, which are different characters in the original text and the retranslated text, are red. In FIG. 6, "character color: red" is represented by outline characters. Further, the original text and the retranslated text contain the same character, but both the characters before and after are different. The character color of the first "ma" in the original text is red. As shown in FIG. 6, the character color of the second "ma" in the original text and the "ma" in the retranslated text is black.

As described above, in the display form changing process, the original text and the retranslated text are displayed in a second display form different from the first display form, which is a normal character display form, so that different parts can be seen at a glance. As a result, the user who is the speaker can further improve the quality of the translated text by rephrasing while paying attention to the portion displayed in the second display form.

Actually, when the display form change process of FIG. 5 is completed, the original text and the retranslated text are not displayed on the display 19, but FIG. 6 shows the case where the display is performed at this time. Is shown as a display example. In the present embodiment, the original text and the retranslated text are actually displayed on the display 19 in the output process described in FIG. 8 below after the similar character string processing described below is completed. is there.

Next, similar character string processing is performed. FIG. 7 is a flowchart showing an operation example of similar character string processing.

S701: The similar character string detection unit 108 refers to the similar character string DB 170.

Hereinafter, the similar character string DB 170 will be described. The similar character string DB 170 stores a similar character string as illustrated below.

(1) Hiragana / Kana / Kanji For example, for the character string "stiff shoulder", similar character strings including notational fluctuations such as "shoulder stiffness" and "stiff shoulder" are associated with each other and stored in the similar character string DB 170.

(2) Chinese numerals and Arabic numerals For example, for the character string "100", the Chinese character notation "hundred" is associated with each other as a similar character string and stored in the similar character string DB 170. Similarly, "10" and "ten", "1,000" and "thousand", "10,000" and "10,000" are similar character strings.

(3) Synonyms of Japanese and foreign words For example, for the character string "airport", foreign word katakana notation such as "airport" is associated with each other as similar character strings and stored in the similar character string DB 170.

(4) Similar expression For example, with respect to the character string "~ degree", character strings having similar meanings such as "~ degree" are associated with each other as similar character strings and are stored in the similar character string DB 170.

(5) Uppercase and lowercase letters of alphabetic characters For example, for the character string "Narita", character strings in which uppercase and lowercase letters of alphabetic characters are exchanged such as "Narita" and "narita" are associated with each other as similar character strings, and the similar character string DB170 It is remembered.

(6) End-of-sentence expression For example, for the end-of-sentence expression "-desu.", Paraphrasable sentence-end expressions such as "-da." Are associated with each other as similar character strings and are stored in the similar character string DB 170.

The following steps from step S702 to step S705 loop for all characters in the source text and the retranslated text. In the following description, the characters to be processed will be described.

S702: The similar character string detection unit 108 searches for a similar character string including the character to be processed. Specifically, for example, when the character to be processed is the character "shoulder", the similar character string detection unit 108 searches the similar character string DB 170 to detect a similar character string including "shoulder". The character strings including "shoulder" include, for example, "stiff shoulder" ("stiff shoulder", "stiff shoulder"), "tapping shoulder" ("tapping shoulder"), and "breaking shoulder" ("shoulder break-in"). ) Etc. are registered in the similar character string DB 170.

S703: The similar character string detection unit 108 determines whether or not a similar character string including the character to be processed is detected as a result of the search in step S702. If it is determined that a similar character string has been detected (step S703: YES), the process proceeds to step S704, and if not (step S703: NO), the process proceeds to step S702 with the next character as the processing target.

S704: The similar character string detection unit 108 determines whether or not the character after the character to be processed also completely matches the similar character string detected in step S703. If it is determined that the subsequent character also completely matches the similar character string (step S704: YES), the process proceeds to step S705, and if not (step S704: NO), the process steps with the next character as the processing target. Proceed to S702.

A specific example will be described. For example, if the character to be processed is the character "shoulder" and the characters after it are "ko" and "ri", these character strings exactly match the similar character string "stiff shoulder". The determination result in step S704 is YES. On the other hand, for example, even if the character to be processed is the character "shoulder", the character string composed of "shoulder" and the character after it completely matches the similar character string stored in the similar character string DB170. If not (“shoulder”, “shoulder”, etc.), the determination result in step S704 is NO.

S705: The display form changing unit 107 changes the display form of all the characters included in the similar character string to the first display form. Specifically, when the character color of the character included in the detected similar character string is red, the display form changing unit 107 changes the character color of the character to black. In the above-mentioned display form change process, if the character color of the character has already been changed to black, it remains black.

Then, when the processing of steps S702 to S705 is completed for all the characters of the original text and the retranslated text, the processing shifts to the output processing described below. If the processing for all the characters of the original text and the retranslated text is not completed, the processing proceeds to step S702 with the next character as the processing target.

As described above, in the similar character string processing, the characters included in the similar character string are displayed in the first display form, which is the normal character display form. As a result, character strings with the same content or similar expressions, such as notation fluctuations and Chinese numerals, are displayed in the first display form even if the characters do not match, so that the user who is the speaker can use it. , The same content or similar expressions can be rephrased without paying attention when rephrasing.

Next, output processing is performed. FIG. 8 is a flowchart showing an operation example of the output process.

S801: The ratio of the number of characters changed to the second display form after the above-mentioned display form change processing and similar character string processing is completed is determined by the display form change unit 107 to the number of characters of the original text and the retranslated text. Whether or not it is equal to or more than the ratio is determined. If the number of characters changed to the second display form is equal to or greater than a predetermined ratio in either the original text or the retranslated text (step S801: YES), the process proceeds to step S802. On the other hand, if not (step S8011: NO), the process proceeds to step S803.

S802: The original text and the retranslated text are discarded by the display form changing unit 107. Then, the process returns to step S401 shown in FIG. That is, the translation display device 100 returns to the state of waiting for the voice input again by the user who is the speaker.

The case where the number of characters changed to the second display form is equal to or more than a predetermined ratio is a case where the difference between the original text and the retranslated text is large, that is, when it is determined that there is a high possibility that the translation has failed. In such a case, the translation display device 100 discards the retranslated text that has a high possibility of mistranslation, and automatically returns to the state of waiting for the voice input by the user who is the speaker, thereby retranslating the text by the user. It is preferable because it is not necessary to confirm the above and to operate the translation display device 100 for performing voice input again.

S803: The original text output unit 110 displays the original text whose display form has been changed by the display form changing unit 107 on the display 19 (when the original text and the retranslated text completely match, the original text is displayed. The display format is not changed).

S804: The retranslation output unit 111 displays the retranslation text whose display form is partially changed by the display form change unit 107 on the display 19 (note that the original text and the retranslation text completely match). In that case, the display form is not changed).

S805: Whether or not the user who confirmed the retranslated text displayed on the display 19 by the input operation unit 18 performed an operation (hereinafter referred to as a translation approval operation) indicating that the translation result of the content was accepted. It is judged. If it is determined that the translation approval operation has been performed (step S805: YES), the process proceeds to step S806, and if not (step S805: NO), the process proceeds to step S802. The translation approval operation is an example of a predetermined input of the present invention. When it is not determined that the translation approval operation has been performed in step S805 (step S805: NO), for example, when an operation indicating that the translation result is not approved is performed by the user, and the translation approval operation is performed for a predetermined time. Including the case where it is not done.

Specifically, for the translation approval operation, for example, an operation in which the OK button displayed on the display 19 which is a touch panel is pressed by the user, or an OK button displayed on the display 19 by a keyboard or a pointing device is selected. Operation etc. Further, the operation indicating that the translation result is not accepted is, for example, an operation in which the NO button displayed on the display 19 is selected by the user. The OK button and the NO button are not shown in FIG.

S806: The translation output unit 112 displays the translated text on the display 19.

S807: The voice output unit 113 outputs the translated text as voice data from the speaker 40. The translation text display process in step S806 and the voice output process of the translation text in step S807 may be performed first or at the same time.

As described above, in the output process, when the number of characters different between the original text and the retranslated text is less than a predetermined ratio, the original text and the retranslated text are displayed in the display area A1 of the display 19. By confirming the display on the display 19, the user who is the speaker can paraphrase and re-input the voice so that a more correct translation result can be obtained. On the other hand, if the number of characters different between the original text and the retranslated text is more than a predetermined ratio, that is, if there is a high possibility that the translation has failed, the state of automatically waiting for voice input by the user who is the speaker. By returning to, it is not necessary for the user to confirm the retranslated text and to operate the translation display device 100 for performing voice input again, which is preferable.

Then, when the user confirms the retranslated text displayed on the display 19 and performs a translation approval operation indicating that the translation result of the content is accepted, the translated text is displayed on the display 19 and translated from the speaker 40. Text audio data is output. As a result, the original text of the first language input by the user who is the speaker is translated into the second language and transmitted to the guest, enabling smooth communication.

As described above, the translation display device 100 according to the first embodiment of the present disclosure retranslates the original text in the first language and the translated text obtained by translating the original text into the second language. With respect to the text, it is determined whether or not the characters included in the retranslated text are included in the original text, and the display form of the characters constituting the retranslated text is the characters determined to be included in the original text and the original text. It has a display form changing unit 107 that is different from the characters determined not to be included in the text.

With such a configuration, the original text input by the user is compared with the retranslated text obtained by retranslating the translation result, and the retranslated text contains the display form of the characters not included in the original text. On the other hand, it can be different. Therefore, the user who sees the display of the retranslated text can recognize at a glance a character different from the original text in the retranslated text. Therefore, it is more preferable for the user to pay particular attention to the part where the display form is different, that is, the part where the translation is likely not performed correctly, for example, to paraphrase and re-enter the original text. You will be able to obtain various translation results.

Further, in the translation display device 100 according to the first embodiment of the present disclosure, when the display form changing unit 107 targets the characters included in the retranslated text, the same characters as the characters to be processed are used as the original text. Even if it exists, if the character before the character to be processed in the retranslated text and the character before the character to be processed in the original text are not the same, or the character to be processed in the retranslated text If the character after the character and the character after the same character as the character to be processed in the original text are not the same, it is determined that the character to be processed is not included in the original text.

With such a configuration, when the same character appears in different places in the original text and the retranslated text (for example, the first "ma" in the original text illustrated in FIG. 6 and the "ma" in the retranslated text). Is not determined that the character is different between the original text and the retranslated text, and the display form is not changed. As a result, in the retranslated text, the display form of the part where the translation is likely not performed correctly is displayed in a display form different from other parts, so that the user pays special attention to that part, for example, paraphrasing. If you re-enter the original text by doing the above, you will be able to obtain more suitable translation results.

Further, the translation display device 100 according to the first embodiment of the present disclosure detects similar character strings associated with character strings having similar meanings but different displays in the original text and the retranslated text. The character string detecting unit 108 is further provided, and the display form changing unit 107 changes the display form of the characters included in the detected similar character strings to the first display form (normal display form).

With such a configuration, for example, a similar character string in which a plurality of character strings having similar meanings but different notations are associated with each other exists in the original text and the retranslated text, thereby making the original text and the retranslated text. Even if different characters exist, if it is determined that the characters are included in the similar character string, the display form of the characters is not changed. Therefore, for convenience of translation, when different expressions with the same meaning appear in the original text and the retranslated text, the user can re-enter the paraphrase without paying attention to the part, which is preferable. Is.

[Modification example]
As described above, the first embodiment has been described as an example of the technology disclosed in the present application. However, the technique in the present disclosure is not limited to this, and can be applied to embodiments in which changes, replacements, additions, omissions, etc. are made as appropriate. It is also possible to combine the components and functions described in the first and second embodiments to form a new embodiment. Hereinafter, the above-mentioned modified examples of the present invention will be illustrated.

[1]
In the first embodiment, the display form of both the original text and the retranslated text has been changed, but the present invention is not limited to this. Only one of the display forms may be changed. In the first embodiment, the correctness of the translated text is evaluated via the retranslated text. Therefore, the purpose of evaluating the correctness of the translated text is achieved even if the display form is changed only for the retranslated text. it can. In addition, it is useful because the host can recognize the part to be rephrased by changing the display form only for the original text. Similarly, only one of the original text and the retranslated text may be displayed.

[2]
In the first embodiment, the display form of all characters of the original text and the retranslated text is once changed from the first display form to the second display form, and then the first display form is determined according to the result of the determination. It was changed to, but it is not limited to this. The determination may be made with the first display form as it is, and may be changed to the second display form according to the result of the determination. That is, the procedure described in the first embodiment is only an example, and the display form of the characters determined to be included in the original text in the retranslated text and / or the characters included in the retranslated text in the original text is displayed. , The specific procedure does not matter as long as it is implemented in the second display form.

[3]
In the first embodiment, the character to be processed and the character included in the comparison target text, the character before the character to be processed and the character before the same character included in the comparison target text, or the processing target. Based on the result of comparison between the character after the character and the character after the same character included in the comparison target text, it was determined whether or not the processing target character is included in the comparison target text. , Not limited to this. It may be determined whether or not the character to be processed is included in the text to be compared based on the comparison result of only one character to be processed, or it is processed based on the comparison result of more characters before or after. It may be determined whether or not the target character is included in the comparison target text. Generally, if the number of characters to be compared is increased, the judgment becomes stricter, and if it is decreased, the judgment becomes lenient. Therefore, the strictness of the judgment may be adjusted by specifying the number of characters.

[4]
In the first embodiment, in the processing of steps S702 to S705 of the similar character string processing shown in FIG. 7, in the above description of the first embodiment, all the characters of the original text and the retranslated text are looped. However, the present invention is not limited to this. For example, the processing of steps S702 to S705 shown in FIG. 7 for a character remaining in the second display form (not returned to the first display form in step S505) in the display form changing process shown in FIG. You may only loop.

A specific example will be described. For example, if the original text contains the character string "about 50 minutes" and the retranslated text contains the character string "about 50 minutes", the display form change process includes "ho" and "do" of the original text. The characters "" and "degree" and "degree" of the retranslated text are changed to the second display form (for example, character color: red). After the display form change processing, in the similar character string processing, in the variant example 1, not for all the characters of the original text and the retranslated text, but for each character of "ho", "do", "degree", and "degree" ( The processing of steps S702 to S705 is performed only for the character changed to the second display form). By such processing, the amount of processing in the similar character string processing can be reduced, so that the similar character string processing can be performed at high speed.

[5]
In the first embodiment, the similar character string processing may be omitted. Since it is necessary to access the similar character string DB 170 in order to process the similar character string, the translation display device 100 has a means for incorporating the similar character string DB 170 or accessing the similar character string DB 170 provided externally. It is necessary (in the first embodiment, the case where the similar character string DB 170 is provided externally is described). Therefore, it is desirable to omit the similar character string processing when there are restrictions on the function or capacity of the translation display device 100.

[6]
In the first embodiment, it has been described that the translated text is displayed on the display 19 and the voice data of the translated text is output by the speaker 40 after the translation approval operation of the user is performed. Not limited. For example, the translated text may be displayed on the display 19 almost at the same time as the original text or the retranslated text regardless of whether or not the user has performed the translation approval operation.

[7]
In the first embodiment, when a user who speaks the first language attempts to communicate with a user who speaks the second language, a translated text obtained by translating the original text input by voice in the first language into the second language is displayed. Although an example of outputting audio has been described, the present invention is not limited to this. The translated text may be regarded as either display or audio output. In addition, when a user who speaks a second language attempts to communicate with a user who speaks the first language, the translated text obtained by translating the original text input by voice in the second language into the first language is displayed and output by voice. You may. Furthermore, after the user who speaks the first language attempts to communicate with the user who speaks the second language, the response from the user who speaks the second language is used as the original text as voice input, and the translated text translated into the first language is displayed. And audio may be output.

[8]
Each processing function of the translation display device 100 according to the first embodiment is, for example, on a control circuit of a CPU (Central Processing Unit) (or a microcomputer such as an MPU (Micro Processing Unit) or an MCU (Micro Controller Unit)). , All or any part of it may be performed. In addition, each processing function may execute all or any part thereof on a program that is analyzed and executed by a CPU (or a microcomputer such as an MPU or MCU) or on hardware by wired logic. Further, the translation display device 100 may be composed of one or a plurality of processors or circuits. The translation display device 100 may be composed of one or a plurality of semiconductor chips.

[9]
In the first embodiment, the translation display device 100 inputs the voice of the first language, but the text data of the first language may be directly input as the original text.

[10]
In the first embodiment, the voice recognition server 50, the translation server 60, and the voice synthesis server 70 are not limited to separate servers. All or part of these may be provided in one computer device.

[11]
The execution order of each process (FIGS. 4 to 8 and the like) in the first embodiment is not necessarily limited to the order described in the first embodiment, and is executed within a range that does not deviate from the gist of the invention. The order can be changed. For example, the processing of similar character strings may be performed first.

[12]
The translation display device 100 according to the present disclosure is not limited to the above embodiment. The translation display method executed by the translation display device 100, a computer program, and a computer-readable recording medium on which such a program is recorded are included in the scope of the present invention. Here, as the computer-readable recording medium, for example, a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), and a semiconductor memory are used. Can be mentioned. Further, the computer program is not limited to the one recorded on the recording medium, and may be transmitted via a telecommunication line, a wireless or wired communication line, a network typified by the Internet, or the like.

The present disclosure can be used as a translation display device or a translation display method using a computer terminal.

1 Translation display system 10 User terminal 11 CPU
12 ROM
13 RAM
14 Input I / F
15 Output I / F
16 Communication I / F
17 Storage device 18 Input operation unit 19 Display 30 Microphone 40 Speaker 50 Voice recognition server 60 Translation server 70 Voice synthesis server 100 Translation display device 101 Voice acquisition unit 102 Original text acquisition unit 103 Original text transmission unit 104 Translation acquisition unit 105 Translation transmission unit 106 Translation acquisition unit 107 Display form change unit 108 Similar character string detection unit 110 Original text output unit 111 Retranslation output unit 112 Translation output unit 113 Audio output unit 170 Similar character string DB (database)

Claims (12)

Regarding the original text data of the first language and the retranslated text data obtained by translating the original text data into the second language and retranslating the translated text data into the first language, the characters included in the retranslated text data are described above. It is determined whether or not it is included in the original text data, and the display form of the characters constituting the retranslated text data is not included in the characters determined to be included in the original text data and the original text data. The display form change part that makes it different from the judged character,
A display unit that displays the retranslated text data based on the display form, and
In a state where the retranslated text data is displayed on the display unit, data based on the translated text data is output after receiving a predetermined input, or data based on the translated text data regardless of the presence or absence of the predetermined input. Translation output section that outputs
Have,
The display unit displays data based on the translated text data.
Translation display device. The translation output unit outputs the voice data converted from the translated text data to the speaker.
The translation display device according to claim 1. The translation output unit outputs the translation text data to the display unit.
The translation display device according to claim 1. The translation output unit does not output data based on the translated text data until the predetermined input is received.
The translation display device according to claim 1. When the characters included in the retranslated text data are processed, the display form changing unit is in the retranslated text data even if the same characters as the characters to be processed are present in the original text data. When the character before the character to be processed and the character before the character same as the character to be processed in the original text data are not the same, or after the character to be processed in the retranslated text data. If the character in the original text data and the character after the same character as the character to be processed in the original text data are not the same, it is determined that the character to be processed is not included in the original text data.
The translation display device according to claim 1. Further, it has a similar character string detecting unit for detecting similar character strings having similar meanings but different notations in the original text data and the retranslated text data.
The display form changing unit determines that the characters included in the detected similar character string are included in the original text data.
The translation display device according to claim 1. The display form changing unit further determines whether or not the characters included in the original text data are included in the retranslated text data, and changes the display form of the characters constituting the original text data to the retranslated text. Differentiate between the characters determined to be included in the data and the characters determined not to be included in the retranslated text data.
The display unit displays the original text data based on the display form.
The translation display device according to claim 1. A microphone that generates voice data based on the voice spoken in the first language,
An original text acquisition unit that acquires voice-recognized original text data based on the voice data,
A translation acquisition unit that acquires the translated text data translated into the second language based on the original text data, and
A retranslation acquisition unit that acquires the retranslated text data retranslated into the first language based on the translated text data,
The translation display device according to claim 1. When the number of characters determined not to be included in the original text data in the retranslated text data is equal to or more than a predetermined ratio, the display form changing unit converts the translated text data and the retranslated text data. Discard,
The translation display device according to claim 1. The translation display device according to claim 1 is provided.
Computer terminal. A translation display method that supports translation from a first language to a second language using a computer.
Regarding the original text data of the first language and the retranslated text data obtained by translating the original text data into the second language and translating the translated text data into the first language again, the characters included in the retranslated text data are described above. Judge whether it is included in the original text data and
The display form of the characters constituting the retranslated text data is different between the characters determined to be included in the original text data and the characters determined not to be included in the original text data.
The retranslated text data is displayed based on the display form,
In the state where the retranslated text data is displayed, the data based on the translated text data is output after receiving the predetermined input, or the data based on the translated text data is output regardless of the presence or absence of the predetermined input. ,
Display data based on the translated text data,
Translation display method. A program for causing a processor to execute the translation display method according to claim 11.

Images