JP2019082981A - Inter-different language communication assisting device and system - Google Patents

Abstract

To provide an inter-different language communication assisting device that makes it possible to smoothly promote conversation between different languages.SOLUTION: An inter-different language communication assisting device 10 comprises: a storage unit 15 for storing a dictionary in which expressions of a first language and the translations of the expressions are registered in association; a registration unit 161 for accepting selection of an expression, among the expressions of the first language registered in the dictionary, that is the object of translation and registering translation object information that indicates being the object of translation or translation non-object information that indicates being not the object of translation in the dictionary in association to the expression of the first language; a first language character string acceptance unit 162 for accepting a character string of the first language; an extraction unit 164 for extracting an expression for which translation object information is registered in the dictionary from the character string of the first language; and a translation output unit 165 for acquiring a translation of the extracted expression and outputting the translation.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an interlingual communication support apparatus and system.

  Conventionally, in a conversation between different languages, the speaker translates the speech of an utterance sentence uttered by a first language into a sentence of a second language desired, converts the translated sentence into a synthetic speech, and reproduces it for a listener A translation device is used.

  For example, Patent Document 1 discloses a speech translation apparatus including speech recognition means, machine translation means, speech synthesis means, speech detection means, and speech output means. The machine translation means generates a translated sentence by translating the whole of the uttered sentence, and the voice output means outputs the translated sentence corresponding to the whole of the uttered sentence by speech synthesis.

Patent No. 5750380 gazette

  However, translation processing for the entire utterance sentence requires a large amount of processing time, and furthermore, since the translated sentence output in this manner has a length corresponding to the entire utterance sentence, the listener It takes a lot of time to recognize and interfere with smooth conversation. In particular, when the listener can understand the speaker's language to a certain extent, these problems caused by translating the entire utterance sentence become significant. Therefore, translating only the words that the listener does not know can shorten the processing time. It is preferable as a conversation using functions.

  The present invention has been made in view of such circumstances, and it is an object of the present invention to provide an inter-language communication support apparatus and system which can facilitate communication between different languages.

  In the inter-language communication support apparatus according to the present invention, a storage unit for storing a phrase in which a phrase in a first language and a translation of the phrase are mutually linked and registered, and a phrase in the phrase in the first language registered in the dictionary A registration unit that receives selection of a word to be translated and that translates target information indicating that it is a target of translation or non-translational target information that indicates that it is not a target of translation in a dictionary by linking to words in the first language A first language character string reception unit for receiving a first language character string, an extraction unit for extracting a word or phrase for which translation target information is registered in a dictionary from a character string of a first language, a translated word of the extracted word or phrase And a translated word output unit for obtaining the translated word from the dictionary.

  According to the present invention, it is possible to provide an inter-language communication support apparatus capable of facilitating communication between different languages in accordance with the level of a listener.

FIG. 1 is a block diagram showing a functional configuration of an inter-language communication support device 10 according to a first embodiment of the present invention. It is a figure which shows an example of a dictionary table. FIG. 8 is a diagram showing an example of an operation flow of output setting registration processing by the inter-language communication support device 10. FIG. 6 is a diagram showing an example of an output setting selection screen 700. It is a figure which shows an example of the operation | movement flow of the translation process by the inter-language communication assistance apparatus 10. FIG. FIG. 2 is a diagram showing an example of translation by the inter-language communication support device 10. FIG. 2 is a diagram showing an example of translation by the inter-language communication support device 10. FIG. 2 is a diagram showing an example of translation by the inter-language communication support device 10. FIG. 2 is a diagram showing an example of translation by the inter-language communication support device 10. It is a block diagram which shows the functional structure of the inter-language communication assistance apparatus 20 which concerns on 2nd Embodiment of this invention. It is a figure which shows another example of a dictionary table. It is a figure which shows an example of the operation | movement flow of the translation process by the inter-language communication assistance apparatus 20, and a warning process. It is a figure which shows an example of the output of the translated word and warning by the inter-language communication assistance apparatus 20. FIG. It is a figure which shows an example of the output of the translated word and warning by the inter-language communication assistance apparatus 20. FIG. It is a figure which shows an example of the output of the translated word and warning by the inter-language communication assistance apparatus 20. FIG.

  Hereinafter, various embodiments of the present invention will be described with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to those embodiments, but extends to the invention described in the claims and the equivalents thereof.

First Embodiment
(1) Configuration of Interlingual Communication Support Device 10 FIG. 1 is a block diagram showing a functional configuration of the interlingual communication support device 10 according to the first embodiment of the present invention.

  The inter-language communication support device 10 receives an utterance in the first language, and a predetermined language (different from the first language or the first language) of the terms set in advance as the target of translation among the terms included in the utterance The translated word represented by the second language can be output. To that end, the inter-language communication support device 10 includes an operation unit 11, a voice input unit 12, a voice output unit 13, a display unit 14, a storage unit 15, and a processing unit 16.

  The operation unit 11 includes, for example, a touch panel, key buttons, and the like, receives an operation of inputting characters, numbers, symbols, and the like by the user, and supplies a signal corresponding to the operation to the processing unit 16. The voice input unit 12 includes, for example, a general microphone, acquires voice of speech and converts it into a voice signal. The audio output unit 13 includes, for example, a general speaker or the like, and generates audio based on the audio signal supplied from the processing unit 16. The display unit 14 is configured of, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, or the like, and displays an image or the like based on display data supplied from the processing unit 16. The display unit 14 and the sound output unit 16 may be configured by at least one wearable terminal such as an HMD (Head Mount Display) used by each user.

  The storage unit 15 includes, for example, at least one of a magnetic tape device, a magnetic disk device, and an optical disk device, and stores a computer program, data, and the like used for processing in the processing unit 16. In addition, the storage unit 15 stores a dictionary table described later. In addition, the storage unit 15 stores output settings of translated words by the inter-language communication support device 10 described later.

  The processing unit 16 includes one or more processors and their peripheral circuits. The processing unit 16 is, for example, a CPU, and controls the overall operation of the inter-language communication support device 10 in an integrated manner. The processing unit 16 controls the operation of the operation unit 11 and the like so that various processes of the inter-language communication support device 10 are performed in an appropriate procedure based on a program or the like stored in the storage unit 15. The processing unit 16 executes processing based on the computer program stored in the storage unit 15.

  The processing unit 16 performs output setting registration processing and translation processing, which will be described later. For that purpose, the processing unit 16 includes, for example, a registration processing unit 161, a voice reception processing unit 162 and a voice recognition processing unit 163 which are first language character string receiving units, a word extraction processing unit 164, and a translated word output processing unit 165. And The registration processing unit 161 receives selection of various settings of the dictionary table, and registers the settings in the dictionary table. The voice reception processing unit 162 receives the voice related to the utterance of the speaker to be translated. The voice recognition processing unit 163 recognizes the received voice and generates a character string corresponding to the voice. The word extraction processing unit 164 extracts a word to be translated in the dictionary table from the generated character string. The translated word output processing unit 165 outputs the translated word of the word to be translated by a predetermined method.

  FIG. 2 is a diagram showing an example of the dictionary table stored in the storage unit 15. As shown in FIG. 2, in the dictionary table, information such as “translational word”, “tag”, and “translation information” is registered in association with each “word”.

  The “phrase” is character string (text) information indicating an element in a sentence, which is expressed in a language (first language) to be translated by the inter-language communication support apparatus 10. The term includes, for example, any element in the language such as a morpheme, a syntax, an idiomatic phrase, and the like, in addition to a term consisting of one or more words. Further, in the dictionary table, a plurality of different phrases derived from the same reference phrase may be registered as separate phrases. In the dictionary table shown in FIG. 2, the first language is English. However, the first language is not limited to English, but may be Japanese, Chinese, Korean, French, German, Spanish, Portuguese or any other language (including dialect, slang, etc.) Good.

  "Translation" is character string information indicating a translation corresponding to a word. The "translational word" may include not only the translation word represented by a language (second language) different from the first language described above, but also the translation word represented by the first language itself. In the example shown in FIG. 2, the "translation" is a translation represented by "translation (Japanese)" which is a translation represented by Japanese as a second language, and "translation" which is a translation represented by English as a first language (English) ”. For example, “translation (Japanese)” corresponding to the phrase “absolutely” includes “at all”, “absolutely”, “actually”, etc., and “translation (English)” corresponding to the phrase “absolutely”. Includes “very” and the like. In addition, the translation represented by the same language as the first language may include, for example, synonyms of a phrase, particularly synonyms with a low degree of difficulty, and the like.

  The “tag” is information indicating a category to which the word / phrase belongs when the word / phrase is classified according to a predetermined classification standard. In the example shown in FIG. 2, a plurality of "tags" of "level", "grammatical function", and "field" are shown. “Level” is information indicating the degree of difficulty of a word. In the example shown in FIG. 2, the words are classified into the stages of “1” to “8” based on JACET 8000, which is a known classification standard. For example, the words classified in the “1” stage are words corresponding to any one of the first to 1000th words when the words are arranged in the order of predetermined difficulty, and the words classified in the “2” stage Is a word corresponding to any of the 1001st to 2000th. The same applies to the words classified into the stages from "3" to "8". The predetermined classification standard indicating the degree of difficulty of the word is not limited to JACET 8000, and may be any standard classification standard such as the well-known standard vocabulary level 12000 (SVL12000) or a WLC-based dictionary. The "grammatical function" is information indicating the grammatical function indicated by the word, and any grammatical function such as part of speech of words such as nouns, verbs and adjectives, and tenses such as present tense and past tense etc. Including features. The “field” is information indicating the theme in which the items represented by the word are included. An "area" may include, for example, specialties such as academic themes used exclusively by a particular expert. Also, "field" may include general themes relating to various topics in daily conversation and the like. The “tag” is not limited to the above-described example, and an arbitrary tag can be set.

  The “translation information” is information indicating whether the word / phrase is a target of translation by the interlanguage communication support device 10. Here, translation means outputting the translation of the word / phrase according to a predetermined method. For example, displaying the translation on the display unit 14 and outputting the translation from the voice output unit 13 as voice. As shown in FIG. 2, in the "translation information" column of the dictionary table, information (translation target information) indicating that the word / phrase is a target of translation is "target" that the word / phrase is not a target of translation The indicated information (translation non-target information) is represented as "non-target". Note that the translation target information further indicates “target (display)” indicating that the translation word is a target to be translated by displaying the translation word on the display unit 14, and a target to translate the translation word by speech output from the voice output unit 13. And “object (voice)” may be included. In addition, the translation target information may further include a “target (display / voice)” indicating a translation term by displaying the translated word on the display unit 14 and outputting voice from the voice output unit 13.

(2) Operation of Inter-Language Communication Support Device 10 (2-1) Output Setting Registration Process FIG. 3 is a diagram showing an example of an operation flow of an output setting registration process by the inter-language communication support device 10. The output setting registration process is a process for registering the setting relating to translation by the inter-language communication support device 10.

(Step S11)
First, the registration processing unit 161 of the inter-language communication support device 10 receives the output setting designated by the user. Specifically, the registration processing unit 161 displays an output setting selection screen on the display unit 14 based on the display data stored in the storage unit 15. Then, when the user designates each item on the output setting selection screen by operating the operation unit 11, the registration processing unit 161 receives the designated output setting.

  FIG. 4 is a diagram showing an example of the output setting selection screen 700. As shown in FIG. The output setting selection screen 700 includes an original text output setting area 701, a translation output setting area 702, and a test score setting area 703.

  The original text output setting area 701 is an area for setting the display on the display unit 14 of the voice (input voice) input to the inter-language communication support device 10, and, for example, the item of "display output of original text" 701a and an item 701b of "highlighting of translation part". In the item 701 a of “display output of original text”, it is possible to select whether or not to display the character string corresponding to the input voice on the display unit 14. In the item 701b of "emphasis display of translation part", among the character strings corresponding to the input voice displayed on the display unit 14, it is selected whether the character string corresponding to the phrase to be translated is to be highlighted or not. it can.

  The translation output setting area 702 is, for example, an area 702 a of “(1) voice output” for setting regarding the voice output from the voice output unit 13 of the translated word, and setting for displaying the translated word on the display unit 14. An area 702 b of “(2) display output” of FIG. In the "(1) voice output" area 702a, it is possible to select whether or not the Japanese or English translated word is voice output from the voice output unit 13, and the word or phrase to be the target of the voice output is a dictionary table. Can be selected by tags (levels, grammatical functions, fields, etc.). In an area 702 b of “(2) display output”, it is possible to select whether or not to display translated Japanese or English words on the display unit 14, and to display the tag to be displayed in the dictionary table It can be selected by level, grammatical function, and field etc.). In the translation output setting area 702, it may be possible to individually select words and phrases to be translated.

  The test score setting area 703 includes, for example, an icon 703a for selecting reading of an external test score, and an icon 703b for selecting to receive a test. When the user selects the icon 703a, the registration processing unit 161 reads in advance the score of the external English test received by the user. Specifically, when the icon 703a is selected, the registration processing unit 161 accesses an information processing apparatus owned by an external test organization or the like, and acquires a test score stored in the information processing apparatus. Then, the registration processing unit 161 determines the English level of the user based on the acquired test score. In addition, when the user selects the icon 703b, the registration processing unit 161 performs an English test such as CAT (Computer Adaptive Test). Specifically, when the icon 703 b is selected, the registration processing unit 161 sequentially displays on the display unit 14 questions of an English test such as CAT. Then, the registration processing unit 161 receives an answer input by the user operating the operation unit 11. Then, when the English test is completed, the registration processing unit 161 calculates a test score and then determines the English level of the user.

(Step S12)
Next, the registration processing unit 161 stores the output setting received in step S11 in the storage unit 15. Specifically, various items relating to the output setting are stored in the storage unit 15, and the translation information registered in the dictionary table for the word having the tag selected in the translation output setting area 702 is the target of translation. Update to translation target information that indicates that there is. In addition, when the English level of the user is determined by reading the score of the above-mentioned external English test, the registration processing unit 161 translates the translation information registered in the dictionary table for the words of the English level or higher. Update to translation target information indicating that it is the target of translation. In addition, when the English level of the user is determined by performing the above-described English test, the registration processing unit 161 is the target of translation information for the translation information registered in the dictionary table for the words of the English level or higher. Update to translation target information indicating that This is the end of the output setting registration process.

(2-2) Translation Processing FIG. 5 is a diagram showing an example of the operation flow of translation processing by the inter-language communication support device 10.

(Step S21)
First, when an English speaker speaks in English, the voice reception processing unit 162 receives the voice related to the speech through the voice input unit 12. Specifically, for example, as shown in FIG. 6, an English speaker makes an utterance 101 with "I absolutely feel that urban lifestyle is preferable." In English. Then, when the speech input unit 12 converts the speech of the utterance 101 into a speech signal, the speech reception processing unit 162 receives the speech signal from the speech input unit 12.

(Step S22)
Next, the voice recognition processing unit 163 recognizes the voice received by the voice reception processing unit 162 by voice recognition processing, and generates a character string corresponding to the voice. In the example illustrated in FIG. 6, the speech recognition processing unit 163 generates a character string “I absolutely feel that urban lifestyle is preferable.” Corresponding to the utterance 101.

  At this time, for example, the speech recognition processing unit 163 uses a hidden Markov model (HMM) to perform matching between the waveform of the speech signal received from the speech input unit 12 and the predetermined acoustic model. The speech recognition process may be performed by Alternatively, the speech recognition processing unit 163 may execute the speech recognition process by a method of matching with a language model reflecting the probability of word / phrase connection based on a grammatical viewpoint in addition to matching with an acoustic model. However, the speech recognition process is not limited to these methods, and may be performed by any method.

(Step S23)
Next, the word extraction processing unit 164 refers to the dictionary table stored in the storage unit 15, and extracts, from the generated character string, the words for which translation target information is registered in the dictionary table.

  Here, as a result of the output setting registration process described above, as shown in FIG. 2, it is assumed that the translation target information is registered in the word / phrase whose “level” tag is “5” or more as shown in FIG. That is, it is assumed that the phrase whose “level” tag is “5” or more is the target of translation by the inter-language communication support device 10. Then, referring to FIG. 2, the level of “I” included in the utterance 101 is “1”, the level of “absolutely” is “2”, the level of “feel” is “2”, and the level of “that” is The levels of “1” and “urban” are “5”, the level of “lifestyle” is “3”, the level of “is” is “1”, and the level of “preferable” is “6”. From the above, among the character strings corresponding to the above-described utterance 101, the words “urban” and “preferable” whose level is “5” or more are targets for translation.

(Step S24)
Next, the translated word output processing unit 165 refers to the dictionary table stored in the storage unit 15 and outputs the translated word of the extracted phrase according to the contents set in the output setting registration process described above. Translation process ends. The output timing of the translated word may be, for example, in the middle of the utterance 101 or after the end of the utterance 101. Hereinafter, various aspects of translation by the inter-language communication support device 10 will be described with reference to FIGS. 6 to 9. The modes shown in FIGS. 6 to 9 are merely examples, and the modes of translation by the inter-language communication support apparatus 10 are not limited to these.

  In the example shown in FIG. 6, the inter-language communication support device 10 outputs the translated word from the voice output unit 13 by synthesizing the voice corresponding to the translated word. Specifically, when the inter-language communication support device 10 receives the utterance 101 by the English speaker, the speech output unit 13 outputs the voice 201 of the translated word “city” corresponding to the word “urban” which is the target of translation. Voice output from Furthermore, the inter-language communication support device 10 outputs the speech 202 of the translation word “preferred” corresponding to the word “preferable” which is the target of translation from the speech output unit 13. In addition, the timing which outputs an audio | voice may be any in the middle of the speech 101, and after completion | finish of the speech 101, for example.

  In the example shown in FIG. 7, the inter-language communication support device 10 displays the character string corresponding to the translated word in the translation display area 300 of the display unit 14, and further sets the character string corresponding to the input voice in the original text display area 400. indicate. Specifically, when the inter-language communication support device 10 receives the utterance 101 by the English speaker, the display unit 14 displays the character string 301 of the translated word "in the city" corresponding to the word "urban" which is the target of translation. The translation display area 300 of FIG. Furthermore, the inter-language communication support device 10 displays the character string 302 of the translation word “preferred” corresponding to the phrase “preferable”, which is the target of translation, in the translation display area 300 of the display unit 14. In addition, the inter-language communication support device 10 displays the character string “I absolutely feel that urban lifestyle is preferable.” Corresponding to the input speech in the original text display area 400 of the display unit 14. Furthermore, the inter-language communication support device 10 is a frame 401 for highlighting that encloses the character string of “urban” which is a target of translation, and a target of translation. A frame 402 for highlighting surrounding the text string "preferable" is displayed. In addition, the aspect of highlighting is not limited to a frame, but an aspect in which the character is underlined (solid line, double line, wavy line, dotted line, etc.), the aspect in which the color of the character is different from other characters, the character The aspect of changing (larger or smaller) the size of or the aspect of moving the character may be any aspect.

  In the example shown in FIG. 8, the inter-language communication support device 10 displays the translated word in the same language as the language of the input speech. Specifically, the inter-language communication support apparatus 10 includes the character string 302 of the translated word "town" represented in English corresponding to the word "urban" which is the target of translation, and "preferable" which is the target of translation The character string 304 of the translated word "better", which is expressed in English, corresponding to the word "" is displayed in the translation display area 300 of the display unit 14.

  In the example shown in FIG. 9, the inter-language communication support device 10 divides the speech output into the display output according to the type of the translation target information registered in the dictionary table, and outputs the translated word. Specifically, in the dictionary table, the translation information registered in the words "urban" and "preferable" is "target (voice)" and the translation information registered in the words "absolutely" and "feel" is Assume that it is "target (display)". At this time, as shown in FIG. 8, when the inter-language communication support device 10 receives the speech 101 by the English speaker, the speech 201 of the translated word “city” corresponding to the word “urban” and “preferable” The voice output unit 13 voice-outputs the voice 202 of the translated word “preferred” corresponding to the phrase. Furthermore, the inter-language communication support apparatus 10 includes the string "Absolutely" corresponding to the word "absolutely" 305, and the string "I feel" corresponding to the word "feel" 306 , And display on the translation display area 300 of the display unit 14.

  As described above, in the inter-language communication support apparatus 10 according to the embodiment of the present invention described above, the storage unit 15 stores the dictionary table in which the words of the first language and the translated terms of the words are linked to each other. A registration for accepting selection of a term to be translated out of terms in the first language registered in the dictionary table and associating translation information indicating whether or not it is a target of translation with the term in the first language in the dictionary table And a processing unit 161. Therefore, the user can select a word to be translated based on the set tag. Therefore, since the inter-language communication support device 10 outputs only the translated word of the phrase that the user wishes to translate, the inter-language communication support device 10 can smoothly advance the conversation between the different languages. Become.

Second Embodiment
Next, the inter-language communication support device 20 according to the second embodiment of the present invention will be described. The inter-language communication support device 20 has a function of outputting a predetermined warning according to the content of the utterance in the first language, in addition to the function of the inter-language communication support device 10 described above. That is, the inter-language communication support device 20 can receive an utterance in the first language, and can output a predetermined alert for a phrase set in advance as a target of the alert among the phrases included in the utterance. In the following, the different parts of the inter-language communication support apparatus 20 from the inter-language communication support apparatus 10 according to the first embodiment described above will be described, and the same parts as the inter-language communication support apparatus 10 will be described as appropriate. Omit.

  FIG. 10 is a block diagram showing a functional configuration of the inter-language communication support apparatus 20 according to the second embodiment of the present invention. As shown in FIG. 10, the processing unit 16 included in the inter-language communication support device 20 further includes a warning output processing unit 166.

  In the inter-language communication support device 20, "warning information" is further registered in the dictionary table stored in the storage unit 15, as shown in FIG. Here, the “warning information” is information indicating whether or not the word or phrase is a target of a warning by the inter-language communication support device 20. As shown in FIG. 11, in the “Warning information” column of the dictionary table, information indicating that the word / phrase is a target of warning (warning target information) is “target” that the word / phrase is not a target of warning. Information to be shown (not alert information) is represented as "non-object".

  The warning target information further indicates “target (display)” indicating that the warning is to be displayed on the display unit 14, and “target (showing) the warning to be output from the voice output unit 13 by voice”. Audio) may be included. Further, the warning target information may further include a “target (display / voice)” indicating a warning on the display unit 14 and indicating that the voice output unit 13 is a voice output target.

  The registration processing unit 161 included in the inter-language communication support apparatus 20 processes the warning information (warning target information or warning) according to the registration process of the translation information (translation target information or non-translation non-target information) described above for the dictionary table. Register non-target information).

  The word extraction processing unit 164 included in the inter-language communication support device 20 extracts not only the words to be translated but also the words to be warned in the dictionary table.

Here, with reference to FIG. 12, an operation flow of translation and warning processing by the inter-language communication support device 20 will be described.
(Step S31)
First, when an English speaker speaks in English, the voice reception processing unit 162 receives the voice related to the speech through the voice input unit 12. Specifically, for example, as shown in FIG. 13, the English speaker speaks “101 absolutely feel that urban lifestyle is preferable.” In English. Then, when the speech input unit 12 converts the speech of the utterance 101 into a speech signal, the speech reception processing unit 162 receives the speech signal from the speech input unit 12.

(Step S32)
Next, the voice recognition processing unit 163 recognizes the voice received by the voice reception processing unit 162 by voice recognition processing, and generates a character string corresponding to the voice. In the example illustrated in FIG. 13, the speech recognition processing unit 163 generates a character string “I absolutely feel that urban lifestyle is preferable.” Corresponding to the utterance 101.

(Step S33)
Next, the word extraction processing unit 164 refers to the dictionary table stored in the storage unit 15, and from the generated character string, the word for which translation target information is registered in the dictionary table and the word for which warning target information is registered. Extract each one.

  Here, as a result of the above-described output setting registration process, as shown in FIG. 11, it is assumed that translation target information is registered in the word and phrase whose “level” tag is “5” or more as shown in FIG. Further, in the dictionary table, as shown in FIG. 11, it is assumed that the alarm target information is registered in the words and phrases whose tag of “level” is “6” or more.

(Step S34)
Next, the warning output processing unit 166 outputs a predetermined warning when the word extraction processing unit 164 extracts a word whose warning target information is registered in the dictionary table. For example, the warning output processing unit 166 outputs the warning from the voice output unit 13 by synthesizing the voice corresponding to the predetermined warning message. The content of the predetermined warning message is not particularly limited, but may be content that explicitly or suggests to the speaker that the level of the phrase used by the speaker is high. The predetermined warning message may include a word in which warning target information is registered, according to the contents set in the above-described output setting registration process. In the example of FIG. 13, since the utterance 101 includes the word “preferable” in which the alert target information is registered, the alert output processing unit 166 outputs a warning message 500 of “Please don't use“ preferable ”.” Voice output.

(Step S35)
Next, the translated word output processing unit 165 refers to the dictionary table stored in the storage unit 15, and outputs the translated word of the extracted word / phrase according to the contents set in the above-described output setting registration process. The output timing of the translated word may be, for example, in the middle of the utterance 101 or after the end of the utterance 101. As described above, by processing the warning output of step S34 prior to the output of the translated word of step S35, the speed of response to the user is improved. However, the warning and the translation may be output simultaneously, or the translation process may be performed prior to the warning process. This is the end of the operation flow of translation and warning processing by the inter-language communication support device 20.

  FIG. 14 is a diagram for explaining another aspect of the warning by the inter-language communication support device 20. As shown in FIG. The inter-language communication support device 20 may display a warning message on the display unit 14. As shown in FIG. 14, the inter-language communication support device 20 may display a warning message 601 “Please don't use“ preferable ”.” In the warning display area 600. As shown in FIG. 14, the warning message 601 may include the phrase “preferable” in which the warning target information is registered.

  FIG. 15 is a diagram for explaining still another aspect of the warning by the inter-language communication support device 20. As shown in FIG. For example, as shown in FIG. 15, the inter-language communication support device 20 superimposes a predetermined warning on the character string “I absolutely feel that urban lifestyle is preferable.” Corresponding to the input speech displayed in the original text display area 400. You may display it. For example, as shown in FIG. 15, the inter-language communication support device 20 uses, as a predetermined warning message 602, an arrow extending from the character string "preferable", which is a phrase in which warning target information is registered, and "Difficult Term !!" You may display the character string with.

  The present invention is not limited to the embodiments described above, and can be implemented in other various forms without departing from the scope of the present invention. For this reason, the said embodiment is only a mere illustration in all the points, and is not interpreted restrictively. For example, the processing steps described above can be arbitrarily changed in order or performed in parallel as long as no contradiction occurs in the processing content. In addition, other steps may be added between each processing step. Further, the steps described as one step may be divided into a plurality of steps and executed, or those described separately into a plurality of steps may be grasped as one step.

[Modification]
The interlanguage communication support device 10 or 20 determines that the phrase that the listener has rehearsed during the conversation is a phrase that the listener does not know, and the translation information related to the phrase registered in the dictionary table is translated target information It may be updated to To that end, the inter-language communication support apparatus 10 or 20 may use, for example, a question determination unit (a question determination processing unit) that determines whether the speech accepted by the speech acceptance unit (speech acceptance processing unit) is a question. If the translation information related to the word / phrase registered in the dictionary table is not a target of translation for the word / phrase included in the voice determined to be present, the translation information is updated to the translation target information An update unit (update processing unit) may be included. The question determination unit may determine that the voice is a question, for example, when the rate of change of the height of the sound related to the voice received by the voice reception unit exceeds a predetermined threshold. Alternatively, the question determination unit may set a character string corresponding to the speech generated by the speech recognition unit (speech recognition processing unit) to a predetermined keyword ("what", "what", "meaning", "meaning", "excus me" If the voice includes “perdun” or the like, it may be determined that the voice is a question.

  The inter-language communication support device 10 or 20 may change the translation information (translation target information or non-translation non-target information) in the dictionary table through voice. To that end, the registration unit (registration processing unit) included in the inter-language communication support apparatus 10 or 20 stores the words and phrases stored in the dictionary table in the character string corresponding to the voice generated by the voice recognition unit (voice recognition processing unit). If it contains, the translation information of the word / phrase may be changed.

  The inter-language communication support apparatus 10 or 20 may analyze the topic in the conversation, change the translation information of the phrase during the conversation, etc., and update the dictionary table. To that end, the inter-language communication support device 10 or 20 determines a determination unit whether or not the character string generated by the speech recognition unit (speech recognition processing unit) includes a predetermined phrase during conversation, and the determination. The information processing apparatus may further include an updating unit that changes translation information of the word / phrase in the dictionary table to translation target information when the unit determines that the word / phrase is included a predetermined number of times.

  When the interlingual communication support device 10 or 20 listens to a phrase or the like that the user does not know during a conversation or a lecture, the designated phrase is designated, and the designated phrase is subsequently translated (displayed Alternatively, voice output may be performed. To that end, the inter-language communication support device 10 or 20 receives the designation of at least one of the character strings of the first language displayed on the display unit by the translated word output unit (translation word output processing unit), and And an update unit configured to update translation information of the dictionary table for at least one word / phrase related to the received specification.

  The inter-language communication support device 10 or 20 may be implemented in any device such as a smartphone or a translation dedicated device. In addition, the inter-language communication support device 10 or 20 may be implemented in a wearable device of any shape, such as a glasses type, an earphone type, or a hearing aid type. Also, the inter-language communication support device 10 or 20 may be implemented in a television, a radio or the like.

  Each configuration provided in the interlanguage communication system according to the present embodiment is not a single device, but a plurality of devices such as a device used by a speaker, a device used by a listener, and a device shared by a speaker and a listener It may be distributed and implemented in the device. Then, for example, a warning may be displayed on a smartphone or an HMD or other device used by the speaker, and a translation or an original may be displayed on a smartphone or an HMD or other device used by the listener.

  The inter-language communication support apparatus according to the present embodiment can be grasped as a translation apparatus when the inter-language communication is viewed from the viewpoint of translation.

10, 20 ... interlingual communication support device, 11 ... operation unit, 12 ... voice input unit, 13 ... voice output unit, 14 ... display unit, 15 ... storage unit, 16 ... processing unit, 161 ... registration processing unit, 162 ... Speech reception processing unit, 163 ... Speech recognition processing unit, 164 ... Phrase extraction processing unit, 165 ... Translation output processing unit, 166 ... Warning output processing unit

Claims (16)

A storage unit storing a dictionary in which a phrase of the first language and a translated word of the phrase are associated with each other and registered;
It accepts the selection of a term to be translated from among the terms of the first language registered in the dictionary, and indicates translated target information indicating that it is a target of translation or non-translational non-target information that indicates that it is not a target of translation. A registration unit which is linked to a word / phrase of a first language and registered in the dictionary;
A first language character string reception unit that receives a character string of a first language;
An extraction unit which extracts, from the character string of the first language, a word or phrase in which the translation target information is registered in the dictionary;
And a translated word output unit that obtains a translated word of the extracted word from the dictionary and outputs the translated word. The first language character string reception unit
A voice reception unit that receives voice of a first language;
The inter-language communication support system according to claim 1, further comprising: a speech recognition unit that recognizes the accepted speech of the first language and generates a character string of the first language corresponding to the speech.   The inter-language communication support system according to claim 1, wherein the translated word output unit outputs the obtained translated word by synthesizing a voice corresponding to the obtained translated word.   The inter-language communication support system according to any one of claims 1 to 3, wherein the translated word output unit outputs the acquired translated word by displaying the acquired character string of the translated word.   The inter-language communication support system according to claim 4, wherein the translated word output unit further displays the character string of the first language received by the first language character string reception unit.   The translated word output unit emphasizes a character string corresponding to the phrase extracted by the extraction unit, and further displays the character string of the first language accepted by the first language character string accepting unit. Interlingual communication support system described.   The inter-language communication support system according to any one of claims 1 to 6, wherein a category according to a predetermined classification standard is further registered in the dictionary for each word / phrase of the first language.   8. The interlanguage according to claim 7, wherein the registration unit receives selection of one category, associates the translation target information with a word or phrase in which the one category is registered in the dictionary, and registers the translation target information in the dictionary. Communication support system. The translated word output unit may include, among the acquired translated words,
For the translated word for which the first category is registered in the dictionary, the voice corresponding to the translated word is synthesized,
By displaying the character string of the translated word for the translated word for which the second category is registered in the dictionary,
The inter-language communication support system according to claim 7, wherein the acquired translated word is output.   The inter-language communication support system according to any one of claims 7 to 9, wherein the predetermined classification standard is a difficulty level, a grammatical function, or a field.   The inter-language communication support system according to any one of claims 1 to 10, which is a glasses-type terminal.   The inter-language communication support system according to any one of claims 1 to 11, wherein a language of the translated word registered in the dictionary is a first language or a second language different from the first language. The registration unit further accepts selection of a word to be a target of warning among the words of the first language registered in the dictionary, and that the target of warning indicating that it is a target of warning or not a target of warning The warning non-target information to be shown is linked to the word of the first language and registered in the dictionary,
The extraction unit further extracts, from the character string of the first language, a word or phrase in which the warning target information is registered in the dictionary,
The inter-language communication support further includes a warning output unit that outputs a predetermined warning when the extraction unit extracts the word or phrase in which the warning target information is registered in the dictionary. The interlingual communication support device according to any one of the above.   The inter-language communication support system according to claim 13, wherein the warning output unit outputs the predetermined warning by synthesizing a voice corresponding to a predetermined warning message.   The inter-language communication support system according to claim 13, wherein the warning output unit outputs the predetermined warning by displaying a predetermined warning message. A storage unit storing a dictionary in which a phrase of the first language and a translated word of the phrase are associated with each other and registered;
It accepts the selection of a term to be translated from among the terms of the first language registered in the dictionary, and indicates translated target information indicating that it is a target of translation or non-translational non-target information that indicates that it is not a target of translation. A registration unit which is linked to a word / phrase of a first language and registered in the dictionary;
A first language character string reception unit that receives a character string of a first language;
An extraction unit which extracts, from the character string of the first language, a word or phrase in which the translation target information is registered in the dictionary;
And a translated word output unit that acquires the translated word of the extracted word from the dictionary and outputs the translated word.

Images