US20210271827A1 - Multilingual communication system and multilingual communication provision method - Google Patents

Multilingual communication system and multilingual communication provision method Download PDF

Info

Publication number
US20210271827A1
US20210271827A1 US17/308,560 US202117308560A US2021271827A1 US 20210271827 A1 US20210271827 A1 US 20210271827A1 US 202117308560 A US202117308560 A US 202117308560A US 2021271827 A1 US2021271827 A1 US 2021271827A1
Authority
US
United States
Prior art keywords
terminal
message
language
box
translation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US17/308,560
Inventor
Hatsumi TANAKA
Masumi MIYASAKA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Loveland Co Ltd
Original Assignee
Loveland Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Loveland Co Ltd filed Critical Loveland Co Ltd
Priority to US17/308,560 priority Critical patent/US20210271827A1/en
Publication of US20210271827A1 publication Critical patent/US20210271827A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/42Data-driven translation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/42Data-driven translation
    • G06F40/47Machine-assisted translation, e.g. using translation memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/58Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/046Interoperability with other network applications or services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/06Message adaptation to terminal or network requirements
    • H04L51/066Format adaptation, e.g. format conversion or compression
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/104Peer-to-peer [P2P] networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2203/00Aspects of automatic or semi-automatic exchanges
    • H04M2203/20Aspects of automatic or semi-automatic exchanges related to features of supplementary services
    • H04M2203/2061Language aspects

Definitions

  • the present invention relates to a technique of realizing communication between users who use different languages.
  • PTL 1 to 4 disclose a system in which text input by users is machine-translated in languages that other users use to enable communication of a plurality of users who use different languages.
  • PTL 1 disclose a message exchange system for smoothly exchanging messages between users who use different languages.
  • the message exchange system disclosed in PTL 1 recognizes an original language from key information associated with a message text transmitted by a relay server computer or the like, recognizes a target language by referring to locale information of an OS (operating system), stores setting information that defines a machine translation program selected in correspondence with the original language of the message text, outputs a translated text obtained by translating the message text from the original language to a target language desired by a receiving user.
  • the locale information is information that defines a language environment and the like of the OS.
  • the message exchange system of PTL 1 may also output the original text before translation of the received message text in the original language as necessary.
  • the technique disclosed in PTL 1 acquires the language information set to the OS to identify a language and translates chatting texts on the basis of the language information.
  • PTL 2 discloses a message posting system having a function of displaying an original text of chatting or the like.
  • the message posting system disclosed in PTL 2 performs chatting via a browser and is configured such that a server acquires and stores client information, use language information, and option information such as a designated language, as necessary, of each client and outputs a translation translated in a use language to the browser of the client for all participants.
  • the message posting system disclosed in PTL 2 may also output an original text of the received message as necessary.
  • the technique disclosed in PTL 2 performs chatting via a browser and designates a language from the browser.
  • PTL 3 discloses a multilingual translation system that translates text information in a language used in a terminal device.
  • the multilingual translation system disclosed in PTL 3 acquires locale data of a browser, extracts and stores a language set in the locale data as a use language used in the terminal device, and outputs a translation translated in the use language.
  • the technique disclosed in PTL 3 translates a text in a language identified on the basis of the locale data of the browser.
  • PTL 4 discloses a system for multi-user multilingual communication.
  • the system disclosed in PTL 4 identifies a first language and a second language, receives a message of the first language from a first person communicating in the first language, searches a data store for a first corresponding message in the second language, and transmits the first corresponding message to the second person who communicates in the second language.
  • the language is identified by analyzing a content in a received chatting dialog or acquiring language preference or setting information from each chatting client system.
  • a real-time property of a service is important in achieving smooth bidirectional communication between users.
  • the real-time property deteriorates because the time elapsed until a translation of a text input by a certain user is displayed to the other user after the user inputs the text increases with the process associated with translation.
  • the language information set to a browser or an OS of each terminal is acquired in advance to recognize the language used in each terminal, and when a text is input from a terminal, an original language and a destination language of the text are determined, and then, translation is executed.
  • the conventional system determines the original language of a text and a translation destination language of an input text whenever the text is input. Therefore, it takes a considerable time until the translation of a text is displayed to other users after a certain user inputs the text, and the real-time property of a service deteriorates.
  • One of the objects of the present invention is to provide a technique for enabling smooth communication on computers between users who use different languages.
  • a system is a multilingual communication system that provides translation-enabled terminal-to-terminal communication, the multilingual communication system including: a participating terminal connection unit that connects a plurality of terminals participating in the communication, acquires language information set for each of the terminals to recognize a use language used in the terminal from the language information, defines for each terminal a terminal message box for the communication, in which transmission messages from a terminal and reception messages to the terminal are described so as to be displayable in a time-series manner, and correlates the use language of the terminal with the terminal message box; a box coupling setting unit that sets coupling between a first terminal message box and a second terminal message box so that a transmission message written in the first terminal message box defined for a first terminal is translated using a use language of the first terminal message box as a translation source language and using a use language of the second terminal message box defined for a second terminal as a translation destination language and is written in the second terminal message box as a reception message; and a box coupling execution unit
  • the language information set to the terminal is acquired, the terminal message boxes of the respective terminals are defined, and the terminal message boxes are coupled in advance so that a message written from a first terminal is translated and is displayed on a second terminal. Due to this, when a message is written from the first terminal, the message can be translated immediately, and the translated message can be displayed on the second terminal. Therefore, users who use different languages can communicate smoothly on computers.
  • FIG. 1 is a block diagram illustrating a hardware configuration of a multilingual communication system according to Embodiment 1.
  • FIG. 2 is a diagram illustrating an example of a screen display of the multilingual communication system according to Embodiment 1.
  • FIG. 3 is a diagram illustrating an example of a screen display of the multilingual communication system according to Embodiment 1.
  • FIG. 4 is a diagram illustrating an example of a screen display of the multilingual communication system according to Embodiment 1.
  • FIG. 5 is a sequence diagram illustrating exchange between devices of the multilingual communication system according to Embodiment 1.
  • FIG. 6 is a block diagram illustrating a functional configuration of the multilingual communication system according to Embodiment 1.
  • FIG. 7 is a flowchart of a translation preparation process performed by the multilingual communication system according to Embodiment 1.
  • FIG. 8 is a flowchart illustrating a details process of a box coupling setting process according to Embodiment 1.
  • FIG. 9 is a diagram illustrating a state in which two bidirectional couplings are set according to Embodiment 1.
  • FIG. 10 is a block diagram illustrating a configuration of a terminal according to Embodiment 1.
  • FIG. 11 is a block diagram illustrating a configuration of another terminal according to Embodiment 1.
  • FIG. 12 is a flowchart illustrating a data writing process according to Embodiment 1.
  • FIG. 13 is a diagram illustrating how a translation is corrected according to Embodiment 1.
  • FIG. 14 is a flowchart illustrating a translation learning process according to Embodiment 1.
  • FIG. 15 is a flowchart illustrating a data writing process according to Embodiment 2.
  • FIG. 16 is a sequence diagram illustrating exchange between devices according to Embodiment 3.
  • FIG. 1 is a block diagram illustrating a hardware configuration of a multilingual communication system according to Embodiment 1.
  • a multilingual communication system 10 according to the present embodiment includes a server 16 and a plurality of terminals 17 as examples of hardware components.
  • the multilingual communication system 10 is a system that provides a text-based real-time chatting service on the terminal 17 . Users may have one-to-one conversations and a plurality of users may converse with each other. In the example of FIG. 1 , three users (AA, BB, and CC) converse with each other. Moreover, the multilingual communication system 10 has a function of translating and displaying texts and can realize communication in which users who use different languages exchange information with each other.
  • FIGS. 2, 3, and 4 are diagrams illustrating an example of a screen display of the multilingual communication system according to Embodiment 1.
  • FIG. 2 illustrates a screen displayed on the terminal 17 of the user AA.
  • FIG. 3 illustrates a screen displayed on the terminal 17 of the user BB.
  • FIG. 4 illustrates a screen displayed on the terminal 17 of the user CC.
  • Transmission messages and reception messages included in communication are displayed on a chatting screen from top to down in a time-series order of the writing date and time.
  • the communication is chatting and the messages transmitted and received are texts.
  • the present invention is not limited thereto.
  • a document file may be included in the message.
  • the file may be transmitted as it is and the content of the document file may be translated.
  • a transmission message written by the user is displayed on the right side, and reception messages written by the other users are displayed on the left side.
  • an English text T 1 a written by the user AA as well as a user name D 1 a and a date and time D 2 a are displayed on a chatting screen of the user AA who uses English.
  • the date and time D 2 a indicates 12:00, February 3.
  • a Japanese text T 1 b written by the user BB and an English translation text T 2 be thereof as well as a user name D 1 b and a date and time D 2 b are displayed.
  • the date and time D 2 b indicates 12:05, February 3.
  • a French text T 1 c written by the user CC and an English translation text T 2 ce thereof as well as a user name D 1 c and a date and time D 2 c are displayed.
  • the date and time D 2 c indicates 12:12, February 3.
  • an English text T 1 a written by the user AA and a Japanese translation text T 2 aj thereof as well as a user name D 1 a and a date and time D 2 a are displayed on the chatting screen of the user BB who uses Japanese.
  • the date and time D 2 a indicates 12:00, February 3.
  • a Japanese text T 1 b written by the user BB as well as a user name D 1 b and a date and time D 2 b are displayed.
  • the date and time D 2 b indicates 12:05, February 3.
  • a French text T 1 c written by the user CC and a Japanese translation text T 2 cj thereof as well as a user name D 1 c and a date and time D 2 c are displayed.
  • the date and time D 2 c indicates 12:12, February 3.
  • an English text T 1 a written by the user AA and a French translation text T 2 af thereof as well as a user name D 1 a and a date and time D 2 a are displayed on the chatting screen of the user CC who uses French.
  • the date and time D 2 a indicates 12:00, February 3.
  • a Japanese text T 1 b written by the user BB and a French translation text T 2 bf thereof as well as a user name D 1 b and a date and time D 2 b are displayed.
  • the date and time D 2 b indicates 12:05, February 3.
  • a French text T 1 c written by the user CC as well as a user name D 1 c and a date and time D 2 c are displayed.
  • the date and time D 2 c indicates 12:12, February 3.
  • the user AA who uses English, the user BB who uses Japanese, and the user CC who uses French can write texts in their own languages and converse with each other while seeing texts displayed on the screen in their own languages.
  • FIGS. 2, 3, and 4 illustrate an example in which both texts before and after translation are displayed as the reception message, there is not limitation thereto. As another example, only the text after translation may be displayed, and a user may select any one of both texts so that the texts are switchably displayed.
  • FIG. 5 is a sequence diagram illustrating exchange between devices of the multilingual communication system according to Embodiment 1. This example illustrates a state in which a terminal 17 a of the user AA and a terminal 17 b of the user BB connect to the server 16 and start chatting as a two-party chatting.
  • the terminal 17 a acquires the language information set in the browser (step 302 ) and connects to the server 16 while notifying the server 16 of the language information (step 303 ).
  • the server 16 recognizes the language used in the terminal 17 a (step 304 ).
  • the terminal 17 b acquires the language information set in the browser (step 306 ) and connects to the server 16 while notifying the server 16 of the language information (step 307 ).
  • the server 16 recognizes the language used in the terminal 17 b (step 308 ).
  • the terminal 17 a sends a chatting request to the server 16 (step 310 ).
  • the server 16 defines a terminal message box Box_A for the chatting of the terminal 17 a in which transmission messages from the terminal 17 a and reception messages to the terminal 17 a are described so as to be displayable in a time-series manner and correlates the use language (in this example, English) of the terminal 17 a with the terminal message box Box_A (step 311 ).
  • Displaying in a time-series manner means that the messages are displayed in a time-series order and does not mean that messages are recorded in a time-series order. For example, if information on a writing time point is appended to each message, the messages can be displayed in a time-series manner.
  • the terminal 17 b When the user BB requests the start of chatting with the user AA using the terminal 17 b (step 312 ), the terminal 17 b sends a chatting request to the server 16 (step 313 ).
  • the server 16 defines a terminal message box Box_B for the chatting of the terminal 17 b in which transmission messages from the terminal 17 b and reception messages to the terminal 17 b are described so as to be displayable in a time-series manner and correlates the use language (in this example, Japanese) of the terminal 17 b with the terminal message box Box_B (step 314 ).
  • the server 16 couples the terminal message box Box_A and the terminal message box Box_B (step 315 ).
  • This coupling involves fixing the translation source language and the translation destination language of the translation of text between terminal message boxes to create a state in which the text written in one terminal message box is translated immediately and is applied to the other terminal message box.
  • the coupling is one-directional from one terminal message box to the other terminal message box, two couplings of both directions are generally set simultaneously.
  • the server 16 When coupling from the terminal message box Box_A to the terminal message box Box_B is set, the server 16 translates the text of the transmission message written to the terminal message box Box_A defined in the terminal 17 a using the use language (English) of the terminal message box Box_A as the translation source language and the use language (Japanese) of the terminal message box Box_B defined in the terminal 17 b as the translation destination language and writes the translated text as the text of the reception message of the terminal message box Box_B.
  • the server 16 when coupling from the terminal message box Box_B to the terminal message box Box_A is set, the server 16 translates the text of the transmission message written to the terminal message box Box_B defined in the terminal 17 b using the use language (Japanese) of the terminal message box Box_B as the translation source language and the use language (English) of the terminal message box Box_A defined in the terminal 17 a as the translation destination language and writes the translated text as the text of the reception message of the terminal message box Box_A.
  • Japanese Japanese
  • English English
  • step 316 when the user AA writes text (step 316 ), the text is transmitted from the terminal 17 a to the server 16 as a transmission message (step 317 ), and the server 16 translates the text from English to Japanese immediately (step 318 ).
  • step 319 when the user BB writes text (step 319 ), the text is transmitted from the terminal 17 b to the server 16 as a transmission message (step 320 ), and the server 16 translates the text from Japanese to English immediately (step 321 ).
  • FIG. 6 is a block diagram illustrating a functional configuration of the multilingual communication system according to Embodiment 1.
  • FIG. 6 illustrates a functional block diagram illustrating a functional configuration of the multilingual communication system 10 .
  • main functions of the multilingual communication system 10 are arranged in the server 16 , some functions may be arranged in the terminal 17 via a browser, for example.
  • the multilingual communication system 10 includes a participating terminal connection unit 11 , a box coupling setting unit 12 , a box coupling execution unit 13 , a message storage unit 14 , and a translation learning unit 15 .
  • the participating terminal connection unit 11 connects to a plurality of terminals 17 participating in communication and acquires the language information set for each of the terminals 17 to recognize the use language used in the terminal 17 . Moreover, the participating terminal connection unit 11 defines for each terminal 17 a terminal message box for the communication, in which transmission messages from the terminal 17 and reception messages to the terminal 17 are described so as to be displayable in a time-series manner, and correlates the use language of the terminal 17 with the terminal message box.
  • the box coupling setting unit 12 sets coupling between a terminal message box Box_A and a terminal message box Box_B so that the transmission message written in the terminal message box Box_A (a first terminal message box) defined in the terminal 17 a (first terminal) is translated using the use language of the terminal message box Box_A as a translation source language and using the use language of the terminal message box Box_B (a second terminal message box) defined in the terminal 17 b (second terminal) as a translation destination language and is written in the terminal message box Box_B as a reception message.
  • the box coupling execution unit 13 When a transmission message is written in the terminal message box Box_A from the terminal 17 a , the box coupling execution unit 13 translates the transmission message from the translation source language (English) to the translation destination language (Japanese) according to the coupling and writes the translated transmission message in the terminal message box Box_B as a reception message so that the reception message is displayed on the terminal 17 b.
  • the terminal 17 when the terminal 17 connects to the multilingual communication system 10 and sets communication with a certain counterpart, the language information set in the terminal 17 is acquired, the terminal message box of each terminal 17 is defined, and the terminal message boxes are coupled in advance so that the message written from the terminal 17 a , for example, is translated and is displayed on the terminal 17 b . Therefore, when a message is written from the terminal 17 a , the message can be translated immediately and the translated message can be displayed on the terminal 17 b.
  • the participating terminal connection unit 11 may acquire the language information when the terminal 17 connects to the multilingual communication system 10 , and may define the terminal message box for the terminal 17 when the terminal 17 having connected to the multilingual communication system 10 sets communication with a specific counterpart. Since the language information set to the terminal 17 is acquired in advance when the terminal 17 connects to the multilingual communication system 10 , it is possible to define the terminal message box quickly when the terminal 17 sets communication with a specific counterpart and to set coupling of translation between the terminal message boxes.
  • the participating terminal connection unit 11 acquires the language information set to the terminal 17 whenever connecting the terminal 17 to the multilingual communication system 10 . Since the new language information is acquired whenever connecting the terminal 17 to the multilingual communication system 10 , it is possible to automatically select the language used by the user in a latest state.
  • FIG. 7 is a flowchart of a translation preparation process performed by the multilingual communication system according to Embodiment 1.
  • the multilingual communication system 10 waits for a connection request that the user issues to the multilingual communication system 10 using the terminal 17 with the aid of the participating terminal connection unit 11 (step 101 ).
  • the multilingual communication system 10 acquires the language information from the browser of the terminal 17 with the aid of the participating terminal connection unit 11 (step 102 ) and connects to the terminal 17 (step 103 ).
  • the multilingual communication system 10 waits for a request for participating in chatting which is a communication from the terminal 17 with the aid of the participating terminal connection unit 11 (step 104 ).
  • the multilingual communication system 10 defines a terminal message box for the terminal 17 with the aid of the participating terminal connection unit 11 (step 105 ).
  • the multilingual communication system 10 sets coupling between the terminal message box of the terminal 17 and the terminal message box of another terminal 17 that performs communication with the terminal 17 with the aid of the box coupling setting unit 12 (step 106 ).
  • FIG. 8 is a flowchart illustrating a detailed process of a box coupling setting process according to Embodiment 1.
  • the box coupling setting unit 12 determines a translation source language by referring to the language information of a transmitting terminal 17 (step 201 ). Subsequently, the box coupling setting unit 12 determines a translation destination language by referring to the language information of a receiving terminal 17 (step 202 ). Moreover, the box coupling setting unit 12 selects a dictionary used for translation on the basis of the translation source language and the translation destination language (step 203 ) and performs setting such that translation is executed to display the text written from the transmitting terminal 17 on the receiving terminal (step 204 ).
  • FIG. 9 is a diagram illustrating a state in which two bidirectional couplings are set according to Embodiment 1.
  • Two couplings C 1 and C 2 are set between the terminal message box Box_A of the terminal 17 a and the terminal message box Box_B of the terminal 17 b .
  • Translation from. English (E) to Japanese (J) is set in the coupling from the terminal message box Box_A to the terminal message box Box_B.
  • Translation from Japanese (J) to English (E) is set in the coupling from the terminal message box Box_B to the terminal message box Box_A.
  • communication is a group chatting in which three or more users can participate, and when a new third terminal 17 c participates in the chatting which is already set between the terminals 17 a and 17 b , the participating terminal connection unit 11 defines a terminal message box of the terminal 17 c for the chatting group.
  • the box coupling setting unit 12 sets a coupling in which the terminal message box of the terminal 17 c is a transmitting side and the terminal message boxes of the terminals 17 a and 17 b are a receiving side and a coupling in which the terminal message boxes of the terminals 17 a and 17 b are a transmitting side and the terminal message box of the terminal 17 c is a receiving side. Since a terminal message box and a coupling is added when a new user (the terminal 17 c ) participates in the group chatting, translation can be performed quickly when presenting the transmission message text written from the terminal 17 c to the other terminals 17 a and 17 b and presenting the translation from the other terminals 17 a and 17 b to the terminal 17 c.
  • FIG. 10 is a block diagram illustrating a configuration of a terminal according to Embodiment 1.
  • FIG. 10 illustrates a schematic block diagram of the terminal 17 configured as a personal computer (PC).
  • Software 23 that operates on the browser 21 is present in the terminal 17 .
  • the software 23 may not be software installed on the PC but may be deployed temporarily from the server 16 via the browser 21 .
  • Language information 22 is set in the browser 21 .
  • the software 23 acquires the language information 22 and notifies the server 16 of the language information 22 .
  • the participating terminal connection unit 11 acquires the language information 22 set in the browser 21 of the terminal 17 and connects the terminal 17 to the multilingual communication system 10 . Since the software 23 acquires the language information 22 from the browser 21 of the terminal 17 , the language used by the user can be automatically recognized even when the user does not perform a language designating operation. For example, chatting can be performed in different languages by operating browser-based software on the PC.
  • FIG. 11 is a block diagram illustrating a configuration of another terminal according to Embodiment 1.
  • FIG. 11 illustrates a schematic block diagram of the terminal 17 configured as a smartphone.
  • Application software 33 that operates on an operating system (OS) is installed in the terminal 17 .
  • OS operating system
  • Examples of the OS of the smartphone include Android (registered trademark) and iOS (registered trademark).
  • the application 33 that operates on the OS 31 is installed in the terminal 17 .
  • the participating terminal connection unit 11 When the application 33 is activated in the terminal 17 , the participating terminal connection unit 11 , at least a portion of which is implemented by the application 33 , acquires language information 32 set to the operating system 31 of the terminal 17 and connects the terminal 17 to the multilingual communication system 10 . Since the application software acquires the language information 32 from the OS 31 of the terminal 17 , the use language of the user can be automatically recognized before the user starts writing a text even when the user does not perform a language designating operation. For example, by installing a native application on the OS in the smartphone, chatting can be performed in different languages.
  • FIG. 12 is a flowchart illustrating a data writing process according to Embodiment 1.
  • the message storage unit 14 waits until a predetermined writing timing comes (step 501 ).
  • the writing timing is a timing which is not synchronous with writing of a text in a terminal message box and a method of determining the timing is not particularly limited.
  • the writing timing may come at predetermined intervals, and it may be determined that the writing timing has come when the amount of accumulated message data reaches a predetermined value.
  • the message storage unit 14 writes data including the text written to the terminal message box or the text from other terminals 17 and a translated text thereof, and various pieces of information added to these texts in a database (step 502 ).
  • the message storage unit 14 records the data of messages described in the terminal message box so as to be displayable in a time-series manner collectively in a database (not illustrated) at predetermined timings that are not synchronous with the writing timing. Since the messages written from the terminal 17 are recorded collectively in the database asynchronously with the writing, it is possible to suppress decrease in responsiveness resulting from a delay in a translation process when users write messages.
  • FIG. 13 is a diagram illustrating how a translation is corrected according to Embodiment 1.
  • an English translation text T 2 be of the Japanese text T 1 b written by the user BB, which is a reception message, is being corrected.
  • the message storage unit 14 stores translation correction data which correlates a message that is the reception message before translation, a reception message before correction, and a reception message after correction in a database (not illustrated).
  • Dictionary data mentioned herein may include data that defines a translation method as well as data that correlates words of both languages.
  • the translation learning unit 15 analyzes data that the box coupling execution unit 13 has stored in a database to update dictionary data that the box coupling execution unit 13 uses for translation.
  • the correction of the translation by users may be fed back to dictionary data by a learning function to improve translation accuracy.
  • FIG. 14 is a flowchart illustrating a translation learning process according to Embodiment 1.
  • the translation learning unit 15 extracts (step 601 ) and analyzes (step 602 ) translation correction data stored in the database.
  • the translation learning unit 15 updates the dictionary data on the basis of the analysis result (step 603 ).
  • the terminal message box may be a virtual box defined such that a message written by a user is appended with at least one of user information indicating a user who has written the message and terminal information indicating a terminal in which the message is written, date and time information indicating a date and time on which the message was written, a translation flag indicating whether the message is translated or not, and information on a translation source language and a translation destination language if the message was translated, so that a terminal message box associated with each message and a time-series order of the messages can be understood.
  • a virtual box which is a data storage area, it is possible to execute different processes for respective terminal message boxes and store message data efficiently without storing the same in a distributed manner.
  • the box coupling setting unit 12 may generate screen data for displaying the transmission messages and the reception messages in a time-series manner on the basis of the terminal information, the date and time information, and the translation flag appended to the transmission message and the reception message and display a screen based on the screen data on the terminal 17 .
  • Embodiment 1 illustrates an example in which data is written from a terminal message box to a database asynchronously with the user writing texts in the terminal message box.
  • the present invention is not limited thereto.
  • data may be written from a terminal message box to a database when a user does not write data in the terminal message box.
  • Embodiments 1 and 2 will be mainly described.
  • FIG. 15 is a flowchart illustrating a data writing process according to Embodiment 2.
  • the message storage unit 14 waits until a predetermined writing timing comes (step 501 ).
  • a method of determining the writing timing is not particularly limited.
  • the writing timing may come at predetermined intervals, and it may be determined that the writing timing has come when the amount of accumulated message data reaches a predetermined value.
  • the message storage unit 14 determines whether a text has been written from the terminal 17 to the terminal message box (that is, the terminal message box has been updated) (step 701 ).
  • the message storage unit 14 waits until the updating ends.
  • the message storage unit 14 writes data including a text written to the terminal message box, translated texts of the texts written from the other terminals 17 , and various pieces of information appended to these pieces of texts in a database (step 502 ).
  • the message storage unit 14 records the data of messages described in the terminal message box so as to be displayable in a time-series manner collectively in a database at predetermined timings different from the writing timing. Since the messages written from the terminal 17 are recorded collectively in the database at timings different from the writing timing, it is possible to suppress decrease in responsiveness resulting from a delay in a translation process when users write messages.
  • Embodiment 1 illustrates an example in which, when the terminal 17 connects to the server 16 , the language information set to the terminal 17 is acquired and is sent to the server 16 .
  • Embodiment 3 illustrates an example in which, when a request to start communication with another terminal 17 is received from a connected terminal 17 , the language information set to the terminal 17 is acquired and is sent to the server 16 .
  • Embodiments 1 and 3 will be mainly described.
  • FIG. 16 is a sequence diagram illustrating exchange between devices according to Embodiment 3.
  • a state in which a user AA and a user BB connect to the server 16 to start chatting is illustrated.
  • the terminal 17 a connects to the server 16 (step 402 ).
  • the terminal 17 b connects to the server 16 (step 404 ).
  • the terminal 17 a acquires the language information set in the browser (step 406 ) and requests the start of chatting while notifying the server 16 of the language information (step 407 ).
  • the server 16 recognizes the language used in the terminal 17 a (step 408 ). Moreover, the server 16 defines a terminal message box Box_A for the chatting of the terminal 17 a in which transmission messages from the terminal 17 a and reception messages to the terminal 17 a are described so as to be displayable in a time-series manner and correlates the use language (in this example, English) of the terminal 17 a with the terminal message box Box_A (step 409 ).
  • the terminal 17 b acquires the language information set in the browser (step 411 ). Moreover, the terminal 17 b requests the start of chatting while notifying the server 16 of the language information (step 412 ).
  • the server 16 recognizes the use language of the terminal 17 b (step 413 ).
  • the server 16 defines a terminal message box Box_B for the chatting of the terminal 17 b in which transmission messages from the terminal 17 b and reception messages to the terminal 17 b are described so as to be displayable in a time-series manner and correlates the use language (in this example, Japanese) of the terminal 17 b with the terminal message box Box_B (step 414 ).
  • the server 16 couples the terminal message box Box_A and the terminal message box Box_B (step 415 ).
  • the server 16 When the terminal message box Box_A and the terminal message box Box_B are coupled, the server 16 translates the text of the transmission message written to the terminal message box Box_A defined in the terminal 17 a using the use language (English) of the terminal message box Box_A as the translation source language and the use language (Japanese) of the terminal message box Box_B defined in the terminal 17 b as the translation destination language and writes the translated text as the text of the reception message of the terminal message box Box_B.
  • the use language English
  • Japanese Japanese
  • the server 16 translates the text of the transmission message written to the terminal message box Box_B defined in the terminal 17 b using the use language (Japanese) of the terminal message box Box_B as the translation source language and the use language (English) of the terminal message box Box_A defined in the terminal 17 a as the translation destination language and writes the translated text as the text of the reception message of the terminal message box Box_A.
  • Japanese Japanese
  • English English
  • step 416 when the user AA writes text (step 416 ), the text is transmitted from the terminal 17 a to the server 16 as a transmission message (step 417 ), and the server 16 translates the text from English to Japanese immediately (step 418 ).
  • step 419 when the user BB writes text (step 419 ), the text is transmitted from the terminal 17 b to the server 16 as a transmission message (step 420 ), and the server 16 translates the text from Japanese to English immediately (step 421 ).
  • the server 16 can start translation of the written text immediately.
  • the participating terminal connection unit 11 of the multilingual communication system 10 acquires the language information and defines a terminal message box for the terminal 17 . Since the language information set to the terminals 17 is acquired and the terminal message boxes are defined, and the translations between the terminal message boxes are coupled when the terminals 17 start communication, translation can be performed immediately when texts are written.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Information Transfer Between Computers (AREA)
  • Machine Translation (AREA)

Abstract

A participating terminal connection unit connects a plurality of terminals participating in communication, acquires language information set for each terminal to recognize the language used in the terminal, defines for each terminal a terminal message box for the communication, in which messages are described so as to be displayable in a time-series manner, and correlates the use language of the terminal with the terminal message box. A box coupling setting unit sets coupling between first and second terminal message boxes so that a transmission message written in the first terminal message box is translated and written in the second terminal message box as a reception message. When a transmission message is written in the first terminal message box from the first terminal, a box coupling execution unit translates the transmission message according to the coupling and writes the translated message in the second terminal message box as a reception message.

Description

  • This is a Continuation of application Ser. No. 16/314,964 filed Jan. 3, 2019, which in turn is a U.S. National Stage of International Application No. PCT/JP2017/001373 filed Jan. 17, 2017. The disclosure of the prior applications is hereby incorporated by reference herein in its entirety.
  • TECHNICAL FIELD
  • The present invention relates to a technique of realizing communication between users who use different languages.
  • BACKGROUND ART
  • If users who use different languages can communicate using their own languages, it would be convenient because users can communicate with each other by overcoming the language barrier or without using unfamiliar languages. Chatting is an example of communication in which data such as text is transmitted between users on a real-time basis via a network using computers. PTL 1 to 4 disclose a system in which text input by users is machine-translated in languages that other users use to enable communication of a plurality of users who use different languages.
  • PTL 1 disclose a message exchange system for smoothly exchanging messages between users who use different languages. The message exchange system disclosed in PTL 1 recognizes an original language from key information associated with a message text transmitted by a relay server computer or the like, recognizes a target language by referring to locale information of an OS (operating system), stores setting information that defines a machine translation program selected in correspondence with the original language of the message text, outputs a translated text obtained by translating the message text from the original language to a target language desired by a receiving user. The locale information is information that defines a language environment and the like of the OS. Moreover, the message exchange system of PTL 1 may also output the original text before translation of the received message text in the original language as necessary. The technique disclosed in PTL 1 acquires the language information set to the OS to identify a language and translates chatting texts on the basis of the language information.
  • PTL 2 discloses a message posting system having a function of displaying an original text of chatting or the like. The message posting system disclosed in PTL 2 performs chatting via a browser and is configured such that a server acquires and stores client information, use language information, and option information such as a designated language, as necessary, of each client and outputs a translation translated in a use language to the browser of the client for all participants. The message posting system disclosed in PTL 2 may also output an original text of the received message as necessary. The technique disclosed in PTL 2 performs chatting via a browser and designates a language from the browser.
  • PTL 3 discloses a multilingual translation system that translates text information in a language used in a terminal device. The multilingual translation system disclosed in PTL 3 acquires locale data of a browser, extracts and stores a language set in the locale data as a use language used in the terminal device, and outputs a translation translated in the use language. The technique disclosed in PTL 3 translates a text in a language identified on the basis of the locale data of the browser.
  • PTL 4 discloses a system for multi-user multilingual communication. The system disclosed in PTL 4 identifies a first language and a second language, receives a message of the first language from a first person communicating in the first language, searches a data store for a first corresponding message in the second language, and transmits the first corresponding message to the second person who communicates in the second language. The language is identified by analyzing a content in a received chatting dialog or acquiring language preference or setting information from each chatting client system.
  • CITATION LIST Patent Literature
  • [PTL 1] Japanese Patent Application Publication No. 2006-146724
  • [PTL 2] Japanese Patent Application Publication No. 2003-16023
  • [PTL 3] Japanese Patent Application Publication No. 2006-4296
  • [PTL 4] Japanese Translation of PCT Application No. 2016-509312
  • SUMMARY OF INVENTION Technical Problem
  • A real-time property of a service is important in achieving smooth bidirectional communication between users. Particularly, in a system that provides translation-enabled communication, there is a problem that the real-time property deteriorates because the time elapsed until a translation of a text input by a certain user is displayed to the other user after the user inputs the text increases with the process associated with translation.
  • In such a conventional system as disclosed in PTL 1 to 4, the language information set to a browser or an OS of each terminal is acquired in advance to recognize the language used in each terminal, and when a text is input from a terminal, an original language and a destination language of the text are determined, and then, translation is executed. In this manner, the conventional system determines the original language of a text and a translation destination language of an input text whenever the text is input. Therefore, it takes a considerable time until the translation of a text is displayed to other users after a certain user inputs the text, and the real-time property of a service deteriorates.
  • One of the objects of the present invention is to provide a technique for enabling smooth communication on computers between users who use different languages.
  • Solution to Problem
  • A system according to one embodiment of the present invention is a multilingual communication system that provides translation-enabled terminal-to-terminal communication, the multilingual communication system including: a participating terminal connection unit that connects a plurality of terminals participating in the communication, acquires language information set for each of the terminals to recognize a use language used in the terminal from the language information, defines for each terminal a terminal message box for the communication, in which transmission messages from a terminal and reception messages to the terminal are described so as to be displayable in a time-series manner, and correlates the use language of the terminal with the terminal message box; a box coupling setting unit that sets coupling between a first terminal message box and a second terminal message box so that a transmission message written in the first terminal message box defined for a first terminal is translated using a use language of the first terminal message box as a translation source language and using a use language of the second terminal message box defined for a second terminal as a translation destination language and is written in the second terminal message box as a reception message; and a box coupling execution unit that, when a transmission message is written in the first terminal message box from the first terminal, translates the transmission message from the translation source language to the translation destination language according to the coupling, writes the translated transmission message in the second terminal message box as a reception message, and displays the reception message on the second terminal.
  • Advantageous Effects of Invention
  • According to the embodiment, when a terminal connects to the multilingual communication system and sets communication with a certain counterpart, the language information set to the terminal is acquired, the terminal message boxes of the respective terminals are defined, and the terminal message boxes are coupled in advance so that a message written from a first terminal is translated and is displayed on a second terminal. Due to this, when a message is written from the first terminal, the message can be translated immediately, and the translated message can be displayed on the second terminal. Therefore, users who use different languages can communicate smoothly on computers.
  • BRIEF DESCRIPTION OF DRAWINGS
  • FIG. 1 is a block diagram illustrating a hardware configuration of a multilingual communication system according to Embodiment 1.
  • FIG. 2 is a diagram illustrating an example of a screen display of the multilingual communication system according to Embodiment 1.
  • FIG. 3 is a diagram illustrating an example of a screen display of the multilingual communication system according to Embodiment 1.
  • FIG. 4 is a diagram illustrating an example of a screen display of the multilingual communication system according to Embodiment 1.
  • FIG. 5 is a sequence diagram illustrating exchange between devices of the multilingual communication system according to Embodiment 1.
  • FIG. 6 is a block diagram illustrating a functional configuration of the multilingual communication system according to Embodiment 1.
  • FIG. 7 is a flowchart of a translation preparation process performed by the multilingual communication system according to Embodiment 1.
  • FIG. 8 is a flowchart illustrating a details process of a box coupling setting process according to Embodiment 1.
  • FIG. 9 is a diagram illustrating a state in which two bidirectional couplings are set according to Embodiment 1.
  • FIG. 10 is a block diagram illustrating a configuration of a terminal according to Embodiment 1.
  • FIG. 11 is a block diagram illustrating a configuration of another terminal according to Embodiment 1.
  • FIG. 12 is a flowchart illustrating a data writing process according to Embodiment 1.
  • FIG. 13 is a diagram illustrating how a translation is corrected according to Embodiment 1.
  • FIG. 14 is a flowchart illustrating a translation learning process according to Embodiment 1.
  • FIG. 15 is a flowchart illustrating a data writing process according to Embodiment 2.
  • FIG. 16 is a sequence diagram illustrating exchange between devices according to Embodiment 3.
  • DESCRIPTION OF EMBODIMENTS
  • Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
  • Embodiment 1
  • FIG. 1 is a block diagram illustrating a hardware configuration of a multilingual communication system according to Embodiment 1. A multilingual communication system 10 according to the present embodiment includes a server 16 and a plurality of terminals 17 as examples of hardware components.
  • The multilingual communication system 10 is a system that provides a text-based real-time chatting service on the terminal 17. Users may have one-to-one conversations and a plurality of users may converse with each other. In the example of FIG. 1, three users (AA, BB, and CC) converse with each other. Moreover, the multilingual communication system 10 has a function of translating and displaying texts and can realize communication in which users who use different languages exchange information with each other.
  • FIGS. 2, 3, and 4 are diagrams illustrating an example of a screen display of the multilingual communication system according to Embodiment 1. FIG. 2 illustrates a screen displayed on the terminal 17 of the user AA. FIG. 3 illustrates a screen displayed on the terminal 17 of the user BB. FIG. 4 illustrates a screen displayed on the terminal 17 of the user CC. In this example, it is assumed that the user AA uses English, the user BB uses Japanese, and the user CC uses French.
  • Transmission messages and reception messages included in communication are displayed on a chatting screen from top to down in a time-series order of the writing date and time. In this example, it is assumed that the communication is chatting and the messages transmitted and received are texts. However, the present invention is not limited thereto. As another example, a document file may be included in the message. In this case, the file may be transmitted as it is and the content of the document file may be translated. Moreover, in this example, a transmission message written by the user is displayed on the right side, and reception messages written by the other users are displayed on the left side.
  • As illustrated in FIG. 2, an English text T1 a written by the user AA as well as a user name D1 a and a date and time D2 a are displayed on a chatting screen of the user AA who uses English. The date and time D2 a indicates 12:00, February 3. Moreover, a Japanese text T1 b written by the user BB and an English translation text T2 be thereof as well as a user name D1 b and a date and time D2 b are displayed. The date and time D2 b indicates 12:05, February 3. Furthermore, a French text T1 c written by the user CC and an English translation text T2 ce thereof as well as a user name D1 c and a date and time D2 c are displayed. The date and time D2 c indicates 12:12, February 3.
  • As illustrated in FIG. 3, an English text T1 a written by the user AA and a Japanese translation text T2 aj thereof as well as a user name D1 a and a date and time D2 a are displayed on the chatting screen of the user BB who uses Japanese. The date and time D2 a indicates 12:00, February 3. Moreover, a Japanese text T1 b written by the user BB as well as a user name D1 b and a date and time D2 b are displayed. The date and time D2 b indicates 12:05, February 3. Furthermore, a French text T1 c written by the user CC and a Japanese translation text T2 cj thereof as well as a user name D1 c and a date and time D2 c are displayed. The date and time D2 c indicates 12:12, February 3.
  • As illustrated in FIG. 4, an English text T1 a written by the user AA and a French translation text T2 af thereof as well as a user name D1 a and a date and time D2 a are displayed on the chatting screen of the user CC who uses French. The date and time D2 a indicates 12:00, February 3. Moreover, a Japanese text T1 b written by the user BB and a French translation text T2 bf thereof as well as a user name D1 b and a date and time D2 b are displayed. The date and time D2 b indicates 12:05, February 3. Furthermore, a French text T1 c written by the user CC as well as a user name D1 c and a date and time D2 c are displayed. The date and time D2 c indicates 12:12, February 3.
  • In this way, the user AA who uses English, the user BB who uses Japanese, and the user CC who uses French can write texts in their own languages and converse with each other while seeing texts displayed on the screen in their own languages.
  • Although FIGS. 2, 3, and 4 illustrate an example in which both texts before and after translation are displayed as the reception message, there is not limitation thereto. As another example, only the text after translation may be displayed, and a user may select any one of both texts so that the texts are switchably displayed.
  • FIG. 5 is a sequence diagram illustrating exchange between devices of the multilingual communication system according to Embodiment 1. This example illustrates a state in which a terminal 17 a of the user AA and a terminal 17 b of the user BB connect to the server 16 and start chatting as a two-party chatting.
  • When the user AA sends a connection request to the server 16 using a browser on the terminal 17 a (step 301), the terminal 17 a acquires the language information set in the browser (step 302) and connects to the server 16 while notifying the server 16 of the language information (step 303). In this case, the server 16 recognizes the language used in the terminal 17 a (step 304).
  • Similarly, when the user BB sends a connection request to the server 16 using a browser on the terminal 17 b (step 305), the terminal 17 b acquires the language information set in the browser (step 306) and connects to the server 16 while notifying the server 16 of the language information (step 307). In this case, the server 16 recognizes the language used in the terminal 17 b (step 308).
  • In this state, when the user AA requests the start of chatting with the user BB using the terminal 17 a (step 309), the terminal 17 a sends a chatting request to the server 16 (step 310). The server 16 defines a terminal message box Box_A for the chatting of the terminal 17 a in which transmission messages from the terminal 17 a and reception messages to the terminal 17 a are described so as to be displayable in a time-series manner and correlates the use language (in this example, English) of the terminal 17 a with the terminal message box Box_A (step 311). Displaying in a time-series manner means that the messages are displayed in a time-series order and does not mean that messages are recorded in a time-series order. For example, if information on a writing time point is appended to each message, the messages can be displayed in a time-series manner.
  • When the user BB requests the start of chatting with the user AA using the terminal 17 b (step 312), the terminal 17 b sends a chatting request to the server 16 (step 313). The server 16 defines a terminal message box Box_B for the chatting of the terminal 17 b in which transmission messages from the terminal 17 b and reception messages to the terminal 17 b are described so as to be displayable in a time-series manner and correlates the use language (in this example, Japanese) of the terminal 17 b with the terminal message box Box_B (step 314).
  • When the terminal message boxes Box_A and Box_B of the terminals 17 a and 17 b are provided, the server 16 couples the terminal message box Box_A and the terminal message box Box_B (step 315). This coupling involves fixing the translation source language and the translation destination language of the translation of text between terminal message boxes to create a state in which the text written in one terminal message box is translated immediately and is applied to the other terminal message box. Although the coupling is one-directional from one terminal message box to the other terminal message box, two couplings of both directions are generally set simultaneously.
  • When coupling from the terminal message box Box_A to the terminal message box Box_B is set, the server 16 translates the text of the transmission message written to the terminal message box Box_A defined in the terminal 17 a using the use language (English) of the terminal message box Box_A as the translation source language and the use language (Japanese) of the terminal message box Box_B defined in the terminal 17 b as the translation destination language and writes the translated text as the text of the reception message of the terminal message box Box_B. Moreover, when coupling from the terminal message box Box_B to the terminal message box Box_A is set, the server 16 translates the text of the transmission message written to the terminal message box Box_B defined in the terminal 17 b using the use language (Japanese) of the terminal message box Box_B as the translation source language and the use language (English) of the terminal message box Box_A defined in the terminal 17 a as the translation destination language and writes the translated text as the text of the reception message of the terminal message box Box_A.
  • After that, when the user AA writes text (step 316), the text is transmitted from the terminal 17 a to the server 16 as a transmission message (step 317), and the server 16 translates the text from English to Japanese immediately (step 318). Similarly, when the user BB writes text (step 319), the text is transmitted from the terminal 17 b to the server 16 as a transmission message (step 320), and the server 16 translates the text from Japanese to English immediately (step 321). Once the coupling is set, since the translation source language and the translation destination language are not changed until the coupling is canceled, the server 16 can start translation of the written text immediately.
  • FIG. 6 is a block diagram illustrating a functional configuration of the multilingual communication system according to Embodiment 1. FIG. 6 illustrates a functional block diagram illustrating a functional configuration of the multilingual communication system 10. Although main functions of the multilingual communication system 10 are arranged in the server 16, some functions may be arranged in the terminal 17 via a browser, for example.
  • Referring to FIG. 6, the multilingual communication system 10 includes a participating terminal connection unit 11, a box coupling setting unit 12, a box coupling execution unit 13, a message storage unit 14, and a translation learning unit 15.
  • The participating terminal connection unit 11 connects to a plurality of terminals 17 participating in communication and acquires the language information set for each of the terminals 17 to recognize the use language used in the terminal 17. Moreover, the participating terminal connection unit 11 defines for each terminal 17 a terminal message box for the communication, in which transmission messages from the terminal 17 and reception messages to the terminal 17 are described so as to be displayable in a time-series manner, and correlates the use language of the terminal 17 with the terminal message box.
  • The box coupling setting unit 12 sets coupling between a terminal message box Box_A and a terminal message box Box_B so that the transmission message written in the terminal message box Box_A (a first terminal message box) defined in the terminal 17 a (first terminal) is translated using the use language of the terminal message box Box_A as a translation source language and using the use language of the terminal message box Box_B (a second terminal message box) defined in the terminal 17 b (second terminal) as a translation destination language and is written in the terminal message box Box_B as a reception message.
  • When a transmission message is written in the terminal message box Box_A from the terminal 17 a, the box coupling execution unit 13 translates the transmission message from the translation source language (English) to the translation destination language (Japanese) according to the coupling and writes the translated transmission message in the terminal message box Box_B as a reception message so that the reception message is displayed on the terminal 17 b.
  • In this manner, according to the present embodiment, when the terminal 17 connects to the multilingual communication system 10 and sets communication with a certain counterpart, the language information set in the terminal 17 is acquired, the terminal message box of each terminal 17 is defined, and the terminal message boxes are coupled in advance so that the message written from the terminal 17 a, for example, is translated and is displayed on the terminal 17 b. Therefore, when a message is written from the terminal 17 a, the message can be translated immediately and the translated message can be displayed on the terminal 17 b.
  • In this case, the participating terminal connection unit 11 may acquire the language information when the terminal 17 connects to the multilingual communication system 10, and may define the terminal message box for the terminal 17 when the terminal 17 having connected to the multilingual communication system 10 sets communication with a specific counterpart. Since the language information set to the terminal 17 is acquired in advance when the terminal 17 connects to the multilingual communication system 10, it is possible to define the terminal message box quickly when the terminal 17 sets communication with a specific counterpart and to set coupling of translation between the terminal message boxes.
  • The participating terminal connection unit 11 acquires the language information set to the terminal 17 whenever connecting the terminal 17 to the multilingual communication system 10. Since the new language information is acquired whenever connecting the terminal 17 to the multilingual communication system 10, it is possible to automatically select the language used by the user in a latest state.
  • FIG. 7 is a flowchart of a translation preparation process performed by the multilingual communication system according to Embodiment 1. First, the multilingual communication system 10 waits for a connection request that the user issues to the multilingual communication system 10 using the terminal 17 with the aid of the participating terminal connection unit 11 (step 101). When a connection request is received, the multilingual communication system 10 acquires the language information from the browser of the terminal 17 with the aid of the participating terminal connection unit 11 (step 102) and connects to the terminal 17 (step 103).
  • Subsequently, the multilingual communication system 10 waits for a request for participating in chatting which is a communication from the terminal 17 with the aid of the participating terminal connection unit 11 (step 104). When a participation request is received, the multilingual communication system 10 defines a terminal message box for the terminal 17 with the aid of the participating terminal connection unit 11 (step 105).
  • The multilingual communication system 10 sets coupling between the terminal message box of the terminal 17 and the terminal message box of another terminal 17 that performs communication with the terminal 17 with the aid of the box coupling setting unit 12 (step 106).
  • Next, the details of the process of coupling the terminal message boxes in step 106 will be described. FIG. 8 is a flowchart illustrating a detailed process of a box coupling setting process according to Embodiment 1.
  • The box coupling setting unit 12 determines a translation source language by referring to the language information of a transmitting terminal 17 (step 201). Subsequently, the box coupling setting unit 12 determines a translation destination language by referring to the language information of a receiving terminal 17 (step 202). Moreover, the box coupling setting unit 12 selects a dictionary used for translation on the basis of the translation source language and the translation destination language (step 203) and performs setting such that translation is executed to display the text written from the transmitting terminal 17 on the receiving terminal (step 204).
  • The box coupling setting unit 12 sets two couplings to perform bidirectional communication between the two terminals 17. FIG. 9 is a diagram illustrating a state in which two bidirectional couplings are set according to Embodiment 1.
  • Two couplings C1 and C2 are set between the terminal message box Box_A of the terminal 17 a and the terminal message box Box_B of the terminal 17 b. Translation from. English (E) to Japanese (J) is set in the coupling from the terminal message box Box_A to the terminal message box Box_B. Translation from Japanese (J) to English (E) is set in the coupling from the terminal message box Box_B to the terminal message box Box_A.
  • While communication in which two terminals 17 a and 17 b have one-to-one conversations has been described, three or more terminals 17 a, 17 b, and 17 c may converse with each other as illustrated in FIG. 1. For example, communication is a group chatting in which three or more users can participate, and when a new third terminal 17 c participates in the chatting which is already set between the terminals 17 a and 17 b, the participating terminal connection unit 11 defines a terminal message box of the terminal 17 c for the chatting group. The box coupling setting unit 12 sets a coupling in which the terminal message box of the terminal 17 c is a transmitting side and the terminal message boxes of the terminals 17 a and 17 b are a receiving side and a coupling in which the terminal message boxes of the terminals 17 a and 17 b are a transmitting side and the terminal message box of the terminal 17 c is a receiving side. Since a terminal message box and a coupling is added when a new user (the terminal 17 c) participates in the group chatting, translation can be performed quickly when presenting the transmission message text written from the terminal 17 c to the other terminals 17 a and 17 b and presenting the translation from the other terminals 17 a and 17 b to the terminal 17 c.
  • FIG. 10 is a block diagram illustrating a configuration of a terminal according to Embodiment 1. FIG. 10 illustrates a schematic block diagram of the terminal 17 configured as a personal computer (PC). Software 23 that operates on the browser 21 is present in the terminal 17. The software 23 may not be software installed on the PC but may be deployed temporarily from the server 16 via the browser 21. Language information 22 is set in the browser 21. The software 23 acquires the language information 22 and notifies the server 16 of the language information 22.
  • In the terminal 17, when the software 23 operates on the browser 21 and the software 23 is executed, the participating terminal connection unit 11, at least a portion of which is implemented by the software 23, acquires the language information 22 set in the browser 21 of the terminal 17 and connects the terminal 17 to the multilingual communication system 10. Since the software 23 acquires the language information 22 from the browser 21 of the terminal 17, the language used by the user can be automatically recognized even when the user does not perform a language designating operation. For example, chatting can be performed in different languages by operating browser-based software on the PC.
  • FIG. 11 is a block diagram illustrating a configuration of another terminal according to Embodiment 1. FIG. 11 illustrates a schematic block diagram of the terminal 17 configured as a smartphone. Application software 33 that operates on an operating system (OS) is installed in the terminal 17. Examples of the OS of the smartphone include Android (registered trademark) and iOS (registered trademark).
  • The application 33 that operates on the OS 31 is installed in the terminal 17. When the application 33 is activated in the terminal 17, the participating terminal connection unit 11, at least a portion of which is implemented by the application 33, acquires language information 32 set to the operating system 31 of the terminal 17 and connects the terminal 17 to the multilingual communication system 10. Since the application software acquires the language information 32 from the OS 31 of the terminal 17, the use language of the user can be automatically recognized before the user starts writing a text even when the user does not perform a language designating operation. For example, by installing a native application on the OS in the smartphone, chatting can be performed in different languages.
  • FIG. 12 is a flowchart illustrating a data writing process according to Embodiment 1.
  • First, the message storage unit 14 waits until a predetermined writing timing comes (step 501). The writing timing is a timing which is not synchronous with writing of a text in a terminal message box and a method of determining the timing is not particularly limited. For example, the writing timing may come at predetermined intervals, and it may be determined that the writing timing has come when the amount of accumulated message data reaches a predetermined value. When it is determined that the writing timing has come, the message storage unit 14 writes data including the text written to the terminal message box or the text from other terminals 17 and a translated text thereof, and various pieces of information added to these texts in a database (step 502).
  • In this manner, the message storage unit 14 records the data of messages described in the terminal message box so as to be displayable in a time-series manner collectively in a database (not illustrated) at predetermined timings that are not synchronous with the writing timing. Since the messages written from the terminal 17 are recorded collectively in the database asynchronously with the writing, it is possible to suppress decrease in responsiveness resulting from a delay in a translation process when users write messages.
  • For example, the reception message on the terminal message box Box_B displayed on the terminal 17 b can be corrected from the terminal 17 b. FIG. 13 is a diagram illustrating how a translation is corrected according to Embodiment 1. In the example of FIG. 13, an English translation text T2 be of the Japanese text T1 b written by the user BB, which is a reception message, is being corrected. When the reception message is corrected, the message storage unit 14 stores translation correction data which correlates a message that is the reception message before translation, a reception message before correction, and a reception message after correction in a database (not illustrated). Dictionary data mentioned herein may include data that defines a translation method as well as data that correlates words of both languages. When a translation is corrected by a user, since the correction is stored in a database, it is possible to analyze the correction and apply the analysis result to a dictionary or the like to improve translation accuracy.
  • The translation learning unit 15 analyzes data that the box coupling execution unit 13 has stored in a database to update dictionary data that the box coupling execution unit 13 uses for translation. The correction of the translation by users may be fed back to dictionary data by a learning function to improve translation accuracy.
  • FIG. 14 is a flowchart illustrating a translation learning process according to Embodiment 1. The translation learning unit 15 extracts (step 601) and analyzes (step 602) translation correction data stored in the database. The translation learning unit 15 updates the dictionary data on the basis of the analysis result (step 603).
  • It is not necessary to store the terminal message boxes in separate storage areas. For example, information for identifying terminal message boxes may be appended to pieces of message data so that the pieces of message data can be stored in a separable manner. For example, the terminal message box may be a virtual box defined such that a message written by a user is appended with at least one of user information indicating a user who has written the message and terminal information indicating a terminal in which the message is written, date and time information indicating a date and time on which the message was written, a translation flag indicating whether the message is translated or not, and information on a translation source language and a translation destination language if the message was translated, so that a terminal message box associated with each message and a time-series order of the messages can be understood. By defining a virtual box which is a data storage area, it is possible to execute different processes for respective terminal message boxes and store message data efficiently without storing the same in a distributed manner.
  • In this case, the box coupling setting unit 12 may generate screen data for displaying the transmission messages and the reception messages in a time-series manner on the basis of the terminal information, the date and time information, and the translation flag appended to the transmission message and the reception message and display a screen based on the screen data on the terminal 17.
  • While a basic configuration and operation of the embodiment of the present invention has been described, the present embodiment can be modified in various ways.
  • Embodiment 2
  • Embodiment 1 illustrates an example in which data is written from a terminal message box to a database asynchronously with the user writing texts in the terminal message box. However, the present invention is not limited thereto. As another example, data may be written from a terminal message box to a database when a user does not write data in the terminal message box.
  • Hereinafter, different portions between Embodiments 1 and 2 will be mainly described.
  • FIG. 15 is a flowchart illustrating a data writing process according to Embodiment 2. First, the message storage unit 14 waits until a predetermined writing timing comes (step 501). A method of determining the writing timing is not particularly limited. For example, the writing timing may come at predetermined intervals, and it may be determined that the writing timing has come when the amount of accumulated message data reaches a predetermined value.
  • When it is determined that the writing timing has come, the message storage unit 14 determines whether a text has been written from the terminal 17 to the terminal message box (that is, the terminal message box has been updated) (step 701).
  • When the terminal message box is being updated, the message storage unit 14 waits until the updating ends. When the terminal message box is not being updated, the message storage unit 14 writes data including a text written to the terminal message box, translated texts of the texts written from the other terminals 17, and various pieces of information appended to these pieces of texts in a database (step 502).
  • In this manner, the message storage unit 14 records the data of messages described in the terminal message box so as to be displayable in a time-series manner collectively in a database at predetermined timings different from the writing timing. Since the messages written from the terminal 17 are recorded collectively in the database at timings different from the writing timing, it is possible to suppress decrease in responsiveness resulting from a delay in a translation process when users write messages.
  • Embodiment 3
  • Embodiment 1 illustrates an example in which, when the terminal 17 connects to the server 16, the language information set to the terminal 17 is acquired and is sent to the server 16. However, the present invention is not limited thereto. Embodiment 3 illustrates an example in which, when a request to start communication with another terminal 17 is received from a connected terminal 17, the language information set to the terminal 17 is acquired and is sent to the server 16.
  • Hereinafter, different portions between Embodiments 1 and 3 will be mainly described.
  • FIG. 16 is a sequence diagram illustrating exchange between devices according to Embodiment 3. In this example, a state in which a user AA and a user BB connect to the server 16 to start chatting is illustrated.
  • When the user AA sends a request for connection to the server 16 via a browser using the terminal 17 a (step 401), the terminal 17 a connects to the server 16 (step 402). Similarly, when the user BB sends a request for connection to the server 16 via a browser using the terminal 17 b (step 403), the terminal 17 b connects to the server 16 (step 404).
  • In this state, when the user AA requests the start of chatting with the user BB using the terminal 17 a (step 405), the terminal 17 a acquires the language information set in the browser (step 406) and requests the start of chatting while notifying the server 16 of the language information (step 407).
  • In this case, the server 16 recognizes the language used in the terminal 17 a (step 408). Moreover, the server 16 defines a terminal message box Box_A for the chatting of the terminal 17 a in which transmission messages from the terminal 17 a and reception messages to the terminal 17 a are described so as to be displayable in a time-series manner and correlates the use language (in this example, English) of the terminal 17 a with the terminal message box Box_A (step 409).
  • When the user BB requests the start of chatting with the user AA using the terminal 17 b (step 410), the terminal 17 b acquires the language information set in the browser (step 411). Moreover, the terminal 17 b requests the start of chatting while notifying the server 16 of the language information (step 412).
  • In this case, the server 16 recognizes the use language of the terminal 17 b (step 413). The server 16 defines a terminal message box Box_B for the chatting of the terminal 17 b in which transmission messages from the terminal 17 b and reception messages to the terminal 17 b are described so as to be displayable in a time-series manner and correlates the use language (in this example, Japanese) of the terminal 17 b with the terminal message box Box_B (step 414).
  • When the terminal message boxes Box_A and Box_B of the terminals 17 a and 17 b are provided, the server 16 couples the terminal message box Box_A and the terminal message box Box_B (step 415).
  • When the terminal message box Box_A and the terminal message box Box_B are coupled, the server 16 translates the text of the transmission message written to the terminal message box Box_A defined in the terminal 17 a using the use language (English) of the terminal message box Box_A as the translation source language and the use language (Japanese) of the terminal message box Box_B defined in the terminal 17 b as the translation destination language and writes the translated text as the text of the reception message of the terminal message box Box_B. Moreover, the server 16 translates the text of the transmission message written to the terminal message box Box_B defined in the terminal 17 b using the use language (Japanese) of the terminal message box Box_B as the translation source language and the use language (English) of the terminal message box Box_A defined in the terminal 17 a as the translation destination language and writes the translated text as the text of the reception message of the terminal message box Box_A.
  • After that, when the user AA writes text (step 416), the text is transmitted from the terminal 17 a to the server 16 as a transmission message (step 417), and the server 16 translates the text from English to Japanese immediately (step 418). Similarly, when the user BB writes text (step 419), the text is transmitted from the terminal 17 b to the server 16 as a transmission message (step 420), and the server 16 translates the text from Japanese to English immediately (step 421). Once the coupling is set, since the translation source language and the translation destination language are not changed until the coupling is canceled, the server 16 can start translation of the written text immediately.
  • In this case, when the terminal 17 connects to the multilingual communication system 10 to set communication with a specific counterpart, the participating terminal connection unit 11 of the multilingual communication system 10 acquires the language information and defines a terminal message box for the terminal 17. Since the language information set to the terminals 17 is acquired and the terminal message boxes are defined, and the translations between the terminal message boxes are coupled when the terminals 17 start communication, translation can be performed immediately when texts are written.
  • The embodiments of the present invention are examples for describing the present invention and the scope of the present invention is not limited to these embodiments. Those skilled in the art can implement the present invention in various other forms without departing from the spirit of the present invention.
  • REFERENCE SIGNS LIST
    • 10 Multilingual communication system
    • 11 Participating terminal connection unit
    • 12 Box coupling setting unit
    • 13 Box coupling execution unit
    • 14 Message storage unit
    • 15 Translation learning unit
    • 16 Server
    • 17 Terminal
    • 17 a Terminal
    • 17 b Terminal
    • 17 c Terminal
    • 21 Browser
    • 22 Language information
    • 23 Software
    • 31 Operating system
    • 32 Language information
    • 33 Application software

Claims (16)

1. A server that provides translation-enabled terminal-to-terminal communication, the server comprising:
a first message box in which a message to be displayed on a first terminal participating in the communication is written;
and a second message box in which a message to be displayed on a second terminal participating in the communication is written, wherein the server is configured to execute:
acquiring use languages used in the first terminal and the second terminal;
upon receiving a first transmission message from the first terminal, translating the first transmission message using the use language of the first terminal as a translation source language and using the use language of the second terminal as a translation destination language, and writing the translated message in the second message box; and
upon receiving a second transmission message from the second terminal, translating the second transmission message using the use language of the second terminal as a translation source language and using the use language of the first terminal as a translation destination language, and writing the translated message in the first message box.
2. The server according to claim 1, wherein
the use language used in the first terminal or the second terminal is acquired when each of the terminals is connected to the server.
3. The server according to claim 1, wherein
the use language used in the first terminal or the second terminal is acquired whenever each of the terminals is connected to the server.
4. The server according to claim 1, wherein
the use language used in the first terminal or the second terminal is acquired by acquiring a use language set in a browser of each of the terminals.
5. The server according to claim 1, wherein
the use language used in the first terminal or the second terminal is acquired by acquiring a use language set in an operating system of each of the terminals.
6. The server according to claim 1, which records data of the message written in the first message box or the second message box, in a database at a predetermined timing that is not synchronous with the writing timing.
7. The server according to claim 1, which records data of the message written in the first message box or the second message box, in a database at a predetermined timing different from the writing timing.
8. The server according to claim 1, wherein
the communication is a group chatting in which three or more users can participate, and
when a new third terminal participates in a chatting group which is already set,
the server defines a third message box in which a message to be displayed on the third terminal is written.
9. The server according to claim 1, wherein
the translated message written in the first message box can be corrected from the first terminal, and
when the correction is implemented, the server stores data that correlates the second transmission message, the translated message before the correction, and the translated message after the correction.
10. The server according to claim 9, which analyzes the data and updates dictionary data used for the translation.
11. The server according to claim 1, which acquires the use language of the first terminal and defines the first message box when the first terminal connects to the server and sets communication with the second terminal.
12. A multilingual communication provision method for providing computer-based translation-enabled terminal-to-terminal communication, the multilingual communication provision method comprising:
defining a first message box in which a message to be displayed on a first terminal participating in the communication is written, and a second message box in which a message to be displayed on a second terminal participating in the communication is written;
acquiring use languages used in the first terminal and the second terminal;
upon receiving a first transmission message from the first terminal, translating the first transmission message using the use language of the first terminal as a translation source language and using the use language of the second terminal as a translation destination language, and writing the translated message in the second message box; and
upon receiving a second transmission message from the second terminal, translating the second transmission message using the use language of the second terminal as a translation source language and using the use language of the first terminal as a translation destination language, and writing the translated message in the first message box.
13. A non-transitory computer-readable medium containing a computer-executable program for causing a server that provides translation-enabled terminal-to-terminal communication to function as:
a message box unit including a first message box in which a message to be displayed on a first terminal participating in the communication is written, and a second message box in which a message to be displayed on a second terminal participating in the communication is written;
an acquisition unit configured to acquire use languages used in the first terminal and the second terminal;
a first writing unit configured to, upon receiving a first transmission message from the first terminal, translate the first transmission message using the use language of the first terminal as a translation source language and using the use language of the second terminal as a translation destination language, and writing the translated message in the second message box; and
a second writing unit configured to, upon receiving a second transmission message from the second terminal, translate the second transmission message using the use language of the second terminal as a translation source language and using the use language of the first terminal as a translation destination language, and writing the translated message in the first message box.
14. A server that provides translation-enabled terminal-to-terminal communication, the server comprising:
a participating terminal connection unit configured to connect a plurality of terminals participating in the communication, acquire language information set for each of the terminals to recognize a use language used in the terminal from the language information, define for each terminal a terminal message box for the communication, in which transmission messages from a terminal and reception messages to the terminal are described so as to be displayable in a time-series manner, and correlate the use language of the terminal with the terminal message box;
a box coupling setting unit configured to set coupling between a first terminal message box and a second terminal message box so that a transmission message written in the first terminal message box defined for a first terminal is translated using a use language of the first terminal message box as a translation source language and using a use language of the second terminal message box defined for a second terminal as a translation destination language and is written in the second terminal message box as a reception message; and
a box coupling execution unit configured to, when a transmission message is written in the first terminal message box from the first terminal, translate the transmission message from the translation source language to the translation destination language according to the coupling, write the translated transmission message in the second terminal message box as a reception message, and display the reception message on the second terminal.
15. A multilingual communication provision method for providing computer-based translation-enabled terminal-to-terminal communication, the multilingual communication provision method comprising:
causing participating terminal connection means to connect a plurality of terminals participating in the communication, acquire language information set for each of the terminals to recognize a use language used in the terminal from the language information, define for each terminal a terminal message box for the communication, in which transmission messages from a terminal and reception messages to the terminal are described so as to be displayable in a time-series manner, and correlate the use language of the terminal with the terminal message box;
causing box coupling setting means to set coupling between a first terminal message box and a second terminal message box so that a transmission message written in the first terminal message box defined for a first terminal is translated using a use language of the first terminal message box as a translation source language and using a use language of the second terminal message box defined for a second terminal as a translation destination language and is written in the second terminal message box as a reception message; and
causing box coupling execution means to, when a transmission message is written in the first terminal message box from the first terminal, translate the transmission message from the translation source language to the translation destination language according to the coupling, write the translated transmission message in the second terminal message box as a reception message, and display the reception message on the second terminal.
16. A non-transitory computer-readable medium containing a computer-executable program for causing a server that provides translation-enabled terminal-to-terminal communication to function as:
a participating terminal connection unit configured to connect a plurality of terminals participating in the communication, acquire language information set for each of the terminals to recognize a use language used in the terminal from the language information, define for each terminal a terminal message box for the communication, in which transmission messages from a terminal and reception messages to the terminal are described so as to be displayable in a time-series manner, and correlate the use language of the terminal with the terminal message box;
a box coupling setting unit configured to set coupling between a first terminal message box and a second terminal message box so that a transmission message written in the first terminal message box defined for a first terminal is translated using a use language of the first terminal message box as a translation source language and using a use language of the second terminal message box defined for a second terminal as a translation destination language and is written in the second terminal message box as a reception message; and
a box coupling execution unit configured to, when a transmission message is written in the first terminal message box from the first terminal, translate the transmission message from the translation source language to the translation destination language according to the coupling, write the translated transmission message in the second terminal message box as a reception message, and display the reception message on the second terminal.
US17/308,560 2017-01-17 2021-05-05 Multilingual communication system and multilingual communication provision method Abandoned US20210271827A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/308,560 US20210271827A1 (en) 2017-01-17 2021-05-05 Multilingual communication system and multilingual communication provision method

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
PCT/JP2017/001373 WO2018134878A1 (en) 2017-01-17 2017-01-17 Multilingual communication system and multilingual communication provision method
US201916314964A 2019-01-03 2019-01-03
US17/308,560 US20210271827A1 (en) 2017-01-17 2021-05-05 Multilingual communication system and multilingual communication provision method

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
US16/314,964 Continuation US11030421B2 (en) 2017-01-17 2017-01-17 Multilingual communication system and multilingual communication provision method
PCT/JP2017/001373 Continuation WO2018134878A1 (en) 2017-01-17 2017-01-17 Multilingual communication system and multilingual communication provision method

Publications (1)

Publication Number Publication Date
US20210271827A1 true US20210271827A1 (en) 2021-09-02

Family

ID=62907821

Family Applications (2)

Application Number Title Priority Date Filing Date
US16/314,964 Active US11030421B2 (en) 2017-01-17 2017-01-17 Multilingual communication system and multilingual communication provision method
US17/308,560 Abandoned US20210271827A1 (en) 2017-01-17 2021-05-05 Multilingual communication system and multilingual communication provision method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US16/314,964 Active US11030421B2 (en) 2017-01-17 2017-01-17 Multilingual communication system and multilingual communication provision method

Country Status (9)

Country Link
US (2) US11030421B2 (en)
EP (1) EP3572953B1 (en)
JP (1) JP6382475B1 (en)
KR (1) KR102024502B1 (en)
CN (2) CN109478206B (en)
AU (2) AU2017393668A1 (en)
SG (1) SG11201907351WA (en)
TW (2) TWI710907B (en)
WO (1) WO2018134878A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109598001A (en) * 2017-09-30 2019-04-09 阿里巴巴集团控股有限公司 A kind of information display method, device and equipment
JP6689421B1 (en) * 2019-01-25 2020-04-28 株式会社インタラクティブソリューションズ Speech analysis system
KR102138663B1 (en) * 2019-03-29 2020-07-28 이승진 A chat system and translation service that can support multilingual translation
KR20230151184A (en) 2022-04-25 2023-11-01 주식회사 블루시스 Artificial intelligence natural language processing-based psychological emotion expression and communication improvement system using online work collaboration communication big data

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110044438A1 (en) * 2009-08-20 2011-02-24 T-Mobile Usa, Inc. Shareable Applications On Telecommunications Devices
US20140222414A1 (en) * 2013-02-07 2014-08-07 Alfredo Reviati Messaging translator

Family Cites Families (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5715466A (en) * 1995-02-14 1998-02-03 Compuserve Incorporated System for parallel foreign language communication over a computer network
US5987401A (en) * 1995-12-08 1999-11-16 Apple Computer, Inc. Language translation for real-time text-based conversations
US6581066B1 (en) * 1999-11-29 2003-06-17 Xerox Corporation Technique enabling end users to create secure command-language-based services dynamically
US6816468B1 (en) * 1999-12-16 2004-11-09 Nortel Networks Limited Captioning for tele-conferences
WO2001075662A2 (en) * 2000-03-31 2001-10-11 Amikai, Inc. Method and apparatus for providing multilingual translation over a network
KR20020002527A (en) * 2000-06-30 2002-01-10 조용환 Real-time multilingual multi translations chatting system and method thereof
JP2002041432A (en) * 2000-07-25 2002-02-08 Oki Electric Ind Co Ltd Chat system, terminal equipment, server device, and medium
JP2002063201A (en) * 2000-08-17 2002-02-28 Nova Asia:Kk Method for retrieving information corresponding to multi-language by using computer network and retrieval /translation tool bar
JP2002073514A (en) * 2000-08-31 2002-03-12 Hiroichi Yoshida Method of exchanging information while utilizing communication network
JP2002183065A (en) * 2000-12-18 2002-06-28 Casio Comput Co Ltd Translation support device, translation support method and recording medium stored with translation support program
WO2002086737A1 (en) * 2001-04-20 2002-10-31 Wordsniffer, Inc. Method and apparatus for integrated, user-directed web site text translation
JP2003016023A (en) 2001-07-04 2003-01-17 Nec Commun Syst Ltd Bulletin system for message with original text display
JP4495886B2 (en) * 2001-08-09 2010-07-07 株式会社日立製作所 Managing voice input recognition sentence collection
JP2003058481A (en) * 2001-08-10 2003-02-28 Logo Vista Corp Multilanguage chat system
US8392173B2 (en) 2003-02-10 2013-03-05 At&T Intellectual Property I, L.P. Message translations
JP2004280574A (en) * 2003-03-17 2004-10-07 Internatl Business Mach Corp <Ibm> Translation system, dictionary updating server, translation method, programs therefor, and storage medium
JP2006004296A (en) 2004-06-18 2006-01-05 Cypress Soft Kk Multi-lingual translation system, central processing unit, computer program, and multi-lingual translation method
KR100766463B1 (en) * 2004-11-22 2007-10-15 주식회사 에이아이코퍼스 Language conversion system and service method moving in combination with messenger
JP2006146724A (en) 2004-11-22 2006-06-08 I'llb Solutions Co Ltd Message transfer system and program
US7958446B2 (en) * 2005-05-17 2011-06-07 Yahoo! Inc. Systems and methods for language translation in network browsing applications
JP3963394B2 (en) * 2005-12-28 2007-08-22 インターナショナル・ビジネス・マシーンズ・コーポレーション Device for reporting software fault information
US7849144B2 (en) * 2006-01-13 2010-12-07 Cisco Technology, Inc. Server-initiated language translation of an instant message based on identifying language attributes of sending and receiving users
US8660244B2 (en) * 2006-02-17 2014-02-25 Microsoft Corporation Machine translation instant messaging applications
US20080126386A1 (en) * 2006-09-20 2008-05-29 Microsoft Corporation Translation of electronic data interchange messages to extensible markup language representation(s)
JP4271224B2 (en) * 2006-09-27 2009-06-03 株式会社東芝 Speech translation apparatus, speech translation method, speech translation program and system
JP5002271B2 (en) * 2007-01-18 2012-08-15 株式会社東芝 Apparatus, method, and program for machine translation of input source language sentence into target language
US20080262827A1 (en) * 2007-03-26 2008-10-23 Telestic Llc Real-Time Translation Of Text, Voice And Ideograms
CN101072168B (en) * 2007-06-22 2011-11-02 腾讯科技(深圳)有限公司 Multi-language instant communication terminal and its system and method
CN101471893A (en) * 2007-12-28 2009-07-01 英业达股份有限公司 System and method for translation of instant message
US8326601B2 (en) 2009-02-11 2012-12-04 Microsoft Corporation Queue based mechanism to support multi-language chat rooms
US8639762B2 (en) 2009-03-23 2014-01-28 Google Inc. Providing access to a conversation in a hosted conversation system
US8473555B2 (en) * 2009-05-12 2013-06-25 International Business Machines Corporation Multilingual support for an improved messaging system
US20100313255A1 (en) * 2009-06-03 2010-12-09 Exling, Llc Web Browser and Web Page Plug-In Language Translation Method and System
US8265671B2 (en) * 2009-06-17 2012-09-11 Mobile Captions Company Llc Methods and systems for providing near real time messaging to hearing impaired user during telephone calls
US9277021B2 (en) * 2009-08-21 2016-03-01 Avaya Inc. Sending a user associated telecommunication address
US20110252316A1 (en) * 2010-04-12 2011-10-13 Microsoft Corporation Translating text on a surface computing device
KR101271285B1 (en) 2011-12-28 2013-06-04 (주)카카오 A method of providing a multi language translation for messages included in chatting window
US9672209B2 (en) * 2012-06-21 2017-06-06 International Business Machines Corporation Dynamic translation substitution
US9600473B2 (en) * 2013-02-08 2017-03-21 Machine Zone, Inc. Systems and methods for multi-user multi-lingual communications
US9031829B2 (en) * 2013-02-08 2015-05-12 Machine Zone, Inc. Systems and methods for multi-user multi-lingual communications
KR20140120192A (en) 2013-04-02 2014-10-13 삼성전자주식회사 Method for processing data and an electronic device thereof
CA2913984C (en) 2013-06-03 2019-05-07 Machine Zone, Inc. Systems and methods for multi-user multi-lingual communications
US9372672B1 (en) * 2013-09-04 2016-06-21 Tg, Llc Translation in visual context
KR101406981B1 (en) 2013-09-17 2014-06-13 김길원 System and Method for Translating Messages of Multiple Languages
CN103530285A (en) * 2013-10-09 2014-01-22 百度在线网络技术(北京)有限公司 Method and device for translating messages
US10466882B2 (en) * 2014-03-31 2019-11-05 Microsoft Technology Licensing, Llc Collaborative co-authoring via an electronic user interface
WO2016018004A1 (en) * 2014-07-31 2016-02-04 Samsung Electronics Co., Ltd. Method, apparatus, and system for providing translated content
CN105335355B (en) 2014-08-08 2018-11-09 掌赢信息科技(上海)有限公司 Text message automatic translating method, apparatus and system in instant communication software
WO2016129008A1 (en) * 2015-02-09 2016-08-18 株式会社フュートレック Communication terminal, message translation system, message translation method, and message translation program
KR20170014589A (en) * 2015-07-30 2017-02-08 삼성전자주식회사 User terminal apparatus for providing translation service and control method thereof
US10409623B2 (en) * 2016-05-27 2019-09-10 Microsoft Technology Licensing, Llc Graphical user interface for localizing a computer program using context data captured from the computer program
CN108066078A (en) * 2016-11-10 2018-05-25 睿传数据股份有限公司 Intelligent bedsie card and its Control management system
MY185876A (en) * 2018-02-26 2021-06-14 Loveland Co Ltd Webpage translation system, webpage translation apparatus, webpage providing apparatus, and webpage translation method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110044438A1 (en) * 2009-08-20 2011-02-24 T-Mobile Usa, Inc. Shareable Applications On Telecommunications Devices
US20140222414A1 (en) * 2013-02-07 2014-08-07 Alfredo Reviati Messaging translator

Also Published As

Publication number Publication date
US20190205397A1 (en) 2019-07-04
EP3572953B1 (en) 2023-09-13
TW202129504A (en) 2021-08-01
AU2017393668A1 (en) 2019-08-29
CN112215016A (en) 2021-01-12
TWI710907B (en) 2020-11-21
WO2018134878A1 (en) 2018-07-26
EP3572953A4 (en) 2020-09-23
KR20180133936A (en) 2018-12-17
TW201828106A (en) 2018-08-01
KR102024502B1 (en) 2019-09-23
CN109478206B (en) 2020-10-20
SG11201907351WA (en) 2019-09-27
EP3572953A1 (en) 2019-11-27
TWI771778B (en) 2022-07-21
US11030421B2 (en) 2021-06-08
EP3572953C0 (en) 2023-09-13
CN109478206A (en) 2019-03-15
AU2020256425A1 (en) 2020-11-12
JPWO2018134878A1 (en) 2019-01-31
JP6382475B1 (en) 2018-08-29

Similar Documents

Publication Publication Date Title
US20210271827A1 (en) Multilingual communication system and multilingual communication provision method
US11615651B2 (en) Remote automobile diagnostic method and apparatus, mobile terminal, electronic device and server
US10516633B2 (en) Method, system, and storage medium for message processing
AU2019226143B2 (en) Modifying native document comments in a preview
CN104317787A (en) Instant communication terminal and information translation method and device thereof
CN109558323B (en) System, method and apparatus for debugging pages
CN108027725B (en) Method, device and equipment for guiding terminal equipment operation
CN110149265B (en) Message display method and device and computer equipment
CN108039173B (en) Voice information input method, mobile terminal, system and readable storage medium
US20190266248A1 (en) Webpage translation system, webpage translation apparatus, webpage providing apparatus, and webpage translation method
KR101639301B1 (en) Online coding learning method, server and system thereof
US20120221947A1 (en) Information processing apparatus and method
JP2019003666A (en) Multi-language communication system and multi-language communication provision method
JP2017182763A (en) Method for providing translation using image, user terminal, server, system and computer program
CN112131092A (en) Page debugging method and device
CN113641439A (en) Text recognition and display method, device, electronic equipment and medium
CN112966480A (en) Teleconference annotation method and related equipment thereof
US10114904B2 (en) Method, system, electronic device and server for synchronous display of operating information
CN108459890B (en) Interface display method and device for application
KR20150105855A (en) Method for synchronizing server-side language and client-side language, and server-client system using the same
CN106649283B (en) Translation device and method based on natural conversation mode for mobile equipment
CN113791787A (en) Method and device for developing page
TW201608394A (en) Automatic translation method of instant messaging system
JP2011164671A (en) Information processing system, server, terminal device, information processing method and program
JP2017027125A (en) Information processing system and information processing device

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION