WO2015133790A1

WO2015133790A1 - Translation chatting service providing device and method

Info

Publication number: WO2015133790A1
Application number: PCT/KR2015/002037
Authority: WO
Inventors: 이의복
Original assignee: 헬로챗 주식회사
Priority date: 2014-03-04
Filing date: 2015-03-03
Publication date: 2015-09-11
Also published as: KR20150104051A

Abstract

A translation chatting service providing method is disclosed. The translation chatting service providing method comprises the steps of: receiving a first voice input in a first language; transmitting the first voice input to a translation chatting service providing server; receiving, from the translation chatting service providing server, the first text in the first language corresponding to the first voice input and a second text in a second language into which the first text is translated; and displaying the first text and the second text.

Description

Apparatus and method for providing a translation chat service

The present invention relates to an apparatus and method for providing a real-time translation chat service.

With the development of internet technology and mobile technology, a chat service between a plurality of smart terminals is activated. However, the existing chat system is developed for users who use the same language and can chat with each other only by using the same language. That is, users who speak different languages are difficult to chat in real time. Therefore, it is troublesome to chat in either language of the parties or to chat in English, which can be recognized as a common language. Or, users may write messages in their native language in the chat window, and use a separate translation program to translate the message into the language of the other user and then chat. Therefore, according to the conventional chat system, it is difficult to provide a smooth chat service between users who use different languages.

On the other hand, in order to improve this problem, a multi-party chat service using different languages is provided. In the multi-party chat, the translation is performed in real time by the relay of the translation server. The multi-party chat service provides real-time translation between different kinds of languages, for example, when a person who speaks Korean, Japanese and English speaks in a three way chat.

By the way, the existing multi-party chat service is going through a duplicate process when using the service, there was an inefficient and inconvenient. For example, when a chat message is input in Korean to a Korean user terminal, the terminal requests a Japanese translation from the translation server, and then transmits it to the Japanese user. In addition, since the Korean user inputs the Korean language to the terminal, the terminal has to request the English translation from the translation server, and then transmits the same to the English user.

Conventional multi-party chat service providing method is disclosed in Korea Patent Publication No. 2010-0089673.

The present invention is to solve the above-mentioned problems of the prior art, apparatus for providing a translation chat service for providing the original text and the translation to the chat counterpart user terminal by translating chat texts of different languages input to each of the plurality of user terminals in real time. And to provide a method.

In addition, the present application provides a translation chat service providing apparatus and method for recognizing a chat text from a voice input of a different language input from each of a plurality of user terminals, and translates in real time to provide the original text and the translation to the chat counterpart user terminal. It aims to do it.

In addition, the present application provides a translation chat service providing apparatus and method for translating a chat message of a different language input from each of the plurality of user terminals in real time to provide the original text and the translation to the user terminal, and together provide the TTS voice of the translation It aims to provide.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, a translation chat service providing method according to an embodiment of the present application, receiving a first voice input of the first language; Transmitting the first voice input to a translation chat service providing server; Receiving a first text of the first language corresponding to the first voice input and a second text of the second language in which the first text is translated from the translation chat service providing server; And displaying the first text and the second text.

As a technical means for achieving the above technical problem, a method of providing a translation chat service according to another embodiment of the present application, receiving a first text of the first language; Transmitting the first text to a translation chat service providing server; Receiving a second text of a second language in which the first text is translated from the translation chat service providing server; And displaying the first text and the second text.

As a technical means for achieving the above technical problem, a method of providing a translation chat service according to another embodiment of the present application, receiving the first text of the first language and the identifier of the second user terminal from the first user terminal ; Preparing a second text of a second language in which the first text is translated; Transmitting the second text to the first user terminal; The method may include transmitting the first text and the second text to the second user terminal based on the identifier of the second user terminal.

As a technical means for achieving the above technical problem, a method of providing a translation chat service according to another embodiment of the present application, receiving the first voice input of the first language and the identifier of the second user terminal from the first user terminal step; Preparing a first text corresponding to the first voice input and a second text of a second language in which the first text is translated; Transmitting the first text and the second text to the first user terminal; The method may include transmitting the first text and the second text to the second user terminal based on the identifier of the second user terminal.

As a technical means for achieving the above technical problem, an apparatus for providing a translation chat service according to another embodiment of the present application, the text receiving unit for receiving a first text of the first language from the first user terminal; A translation preparation unit for preparing a second text of a second language in which the first text is translated; And a transmission unit transmitting the second text to the first user terminal and transmitting the first text and the second text to a second user terminal.

As a technical means for achieving the above technical problem, the English word learning service providing system according to an embodiment of the present application, the English dictionary DB, the memorization vocabulary DB for storing and managing memorized words, and the chat to store and manage memorized words A database module including a wordbook DB; A wordbook generation module for extracting an English word from an English sentence displayed in a chat window through a multilingual translation chat service and storing it in the chat wordbook DB; A wordbook management module for moving selected English words from among English words stored in the chat wordbook DB to another DB; A user interface module for providing a user interface to a user terminal so that a user can execute a service according to a preset input action; And a display module for displaying the data stored in the user interface and the database module on the user terminal in a preset layout.

According to the above-described problem solving means of the present application, it is possible to provide a text and a translation to each user terminal by translating chat text of different languages input in each of the plurality of user terminals in real time.

In addition, according to the above-described problem solution means of the present invention, it is possible to recognize the chat text from the voice input of the different languages input from each of the plurality of user terminals, to translate in real time to provide the original text and the translation to the chat counterpart user terminal have.

In addition, according to the above-described problem solution means of the present invention, by recognizing the chat message from the voice input of the different languages input from each of the plurality of user terminals and translates in real time to provide the original text and the translated text to the user terminal, the TTS of the translated text By providing voice together, foreign language learning effect can be provided to the user at the same time as chatting.

1 is a view showing a translation chat service providing system according to an embodiment of the present application.

2 is a flowchart illustrating a translation chat service providing method according to an exemplary embodiment of the present application.

3 is a flowchart illustrating a translation chat service providing method according to another exemplary embodiment of the present application.

4 is a flowchart of a translation chat service providing method according to another exemplary embodiment of the present application.

5 is a flowchart illustrating a translation chat service providing method according to another exemplary embodiment of the present application.

6 is a block diagram of an apparatus for providing a translation chat service, according to an exemplary embodiment.

7 is a block diagram of an English word learning service providing system according to an exemplary embodiment of the present application.

FIG. 8 is a diagram schematically illustrating a process of generating definite English words in a wordbook generating module of an English word learning service providing system according to an exemplary embodiment of the present disclosure.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present disclosure. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted for simplicity of explanation, and like reference numerals designate like parts throughout the specification.

Throughout this specification, when a portion is "connected" to another portion, this includes not only "directly connected" but also "electrically connected" with another element in between. do.

Throughout this specification, when a member is located “on” another member, this includes not only when one member is in contact with another member but also when another member exists between the two members.

Throughout this specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding the other components unless specifically stated otherwise.

As used throughout this specification, the terms "about", "substantially" and the like are used at, or in the sense of, numerical values when a manufacturing and material tolerance inherent in the stated meanings is indicated, Accurate or absolute figures are used to assist in the prevention of unfair use by unscrupulous infringers. As used throughout this specification, the term "step to" or "step of" does not mean "step for."

Some of the operations or functions described as being performed by the terminal, the apparatus, or the device may be performed instead in the server connected to the terminal, the apparatus, or the device. Similarly, some of the operations or functions described as being performed by the server may be performed by the terminal, apparatus or device connected to the server. Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing a translation chat service providing system according to an embodiment of the present application. As illustrated in FIG. 1, a translation chat service providing system 100 according to an exemplary embodiment of the present disclosure includes a translation chat service providing server 110, a first user terminal 120, and a second user terminal 130. can do.

The translation chat service providing server 110, the first user terminal 120, and the second user terminal 130 may be interconnected through the network 140. The network 140 refers to a connection structure capable of exchanging information between each node such as a terminal and a server. Examples of such a network include a 3rd generation partnership project (3GPP) network, a long term evolution (LTE) network, and 5G. Network, World Interoperability for Microwave Access (WIMAX) Network, Internet, Local Area Network (LAN), Wireless Local Area Network (WLAN), Wide Area Network (WAN), Personal Area Network (PAN), Bluetooth (Bluetooth) ) Networks, satellite broadcasting networks, analog broadcasting networks, DMB (Digital Multimedia Broadcasting) networks, and the like.

The first user terminal 120 and the second user terminal 130 may chat with each other via the translation chat service providing server 110. In FIG. 1, the translation chat service providing server 110 provides a translation chat service to the first user terminal 120 and the second user terminal 130, but is connected to the translation chat service providing server 110. The number of user terminals provided with a translation chat service is not limited to two.

According to various embodiments of the present disclosure, each of the first user terminal 120 and the second user terminal 130 may be various types of devices. For example, each of the first user terminal 120 and the second user terminal 130 may be a TV device, a computer, or a portable terminal capable of connecting to a remote server or device through the network 140. Here, an example of a TV device includes a smart TV, an IPTV set-top box, etc. An example of a computer includes a laptop, a desktop, a laptop, and the like, and an example of a portable terminal includes portability and mobility. As a guaranteed wireless communication device, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (WBRO) terminal, smartphone, tablet PC, etc. Based wireless communication device) may be included.

An application for providing a translation chat service to a user may be installed and driven in the first user terminal 120 and the second user terminal 130. For example, the application may provide a user interface for a user to select a chat counterpart, to select a language to be used for a chat, to input text of a selected language, or to output text translated in a selected language.

According to an embodiment of the present invention, the first user terminal 120 may receive an input of a first text of a first language. For example, the first language is a language used by a user of the first user terminal 120 to input text, and may be a native language of the user of the first user terminal 120. For example, the first language may include English, Japanese, Chinese, Korean, German, and the like. In addition, the first text is a message that the user of the first user terminal 120 wants to send to the chat counterpart, and the text is input by the user through the first user terminal 120.

The first user terminal 120 may receive an input for selecting a first language prior to receiving the input of the first text. For example, the user may select a first language to be used for inputting the first text through a touch interface and an application provided by the first user terminal 120.

The first user terminal 120 may transmit the first text of the input first language to the translation chat service providing server 110 through the network 140. In addition, the first user terminal 120 may transmit the identifier of the second user terminal 130 to receive the chat message together with the first text to the chat service providing server 110. For example, a user of the first user terminal 120 may be a second user in a user list or a contact list stored in the first user terminal 120 through a touch interface and an application provided by the first user terminal 120. The terminal 130 may be selected. For example, the identifier of the second user terminal 130 may include a phone number, a serial number, an identification character, etc., assigned to the second user terminal 130.

In addition, according to an embodiment of the present invention, the first user terminal 120 may receive an input for selecting a second language prior to receiving the input of the first text. For example, the user may select a second language in which the first text is to be translated through a touch interface and an application provided by the first user terminal 120. In addition, according to another embodiment of the present invention, the first user terminal 120 may automatically select and recognize the second language according to the nationality of the user of the second user terminal 130 to receive the chat message. . In addition, the first user terminal 120 may transmit an identifier of a second language in which the first text is to be translated to the chat service providing server 110 together with the first text.

The translation chat service providing server 110 may prepare a second text of the second language in which the first text of the first language received from the first user terminal 120 is translated. For example, the second language may be a language of text provided to the second user terminal 130 and may be a native language of the user of the second user terminal 130, and may include English, Japanese, Chinese, Korean, German, and the like. It may include. According to an embodiment of the present invention, the translation chat service providing server 110 may be connected to a multilingual translation engine through the network 140. In addition, the translation chat service providing server 110 provides the translation engine with information about the first text received from the first user terminal 120 and a second language that is the language in which the first text is to be translated, The second text of the second language in which one text is translated may be received. In addition, according to another embodiment of the present invention, the translation chat service providing server 110 may include a multilingual translation engine. In addition, the translation chat service providing server 110 may translate the first text of the first language into the second text of the second language by using the translation engine.

The translation chat service providing server 110 may transmit the second text of the second language in which the first text is translated to the first user terminal 120 through the network 140. The first user terminal 120 may receive the second text from the translation chat service providing server 110 and display the first text and the second text in one speech bubble. Accordingly, the user of the first user terminal 120 can simultaneously see the first text of the first language and the translated text in which the first text is translated, thereby obtaining a foreign language learning effect when chatting.

In addition, although the first text and the second text are simultaneously displayed in the speech bubble, according to an embodiment of the present invention, the user of the first user terminal 120 may be configured to display the first text and the second language of the first language. The text to be displayed in the speech bubble may be selected from the second text. For example, the user may select text to be displayed in a speech bubble among the first text and the second text through a user interface displayed on the first user terminal 120. For another example, the user may select at least one of the first text and the second text by touching the speech bubble displayed on the first user terminal 120. For example, each time the user touches the speech bubble, the speech bubble may be displayed in the order of the first text, the second text, and the first text plus the second text. As such, the first user terminal 120 may select a type of language of the text displayed on the speech bubble according to the user's input.

In addition, the translation chat service providing server 110 based on the identifier of the second user terminal 130 that is the chat counterpart received from the first user terminal 120, the first text of the first language and the second language of the second language. 2 text may be transmitted to the second user terminal 130. Accordingly, the second user terminal 130 may display the first text that is the original text received by the first user terminal 120 that is the chat counterpart and the second text that is the translated text within one speech bubble.

Next, the first user terminal 120 is input by the user of the second user terminal 130, the third text of the second language received by the second user terminal 130 and the third text is translated The fourth text of the first language may be received from the translation chat service providing server 110. For example, the third text is a chat message input by the user of the second user terminal 130 as a reply to the second text. In addition, the first user terminal 120 may display the third text and the fourth text received from the translation chat service providing server 110 in one speech bubble.

According to an embodiment of the present invention, the translation chat service providing server 110 may perform at least one of the first text received from the first user terminal 120 and the third text received from the second user terminal 130. Morphological analysis may be performed to recognize a messenger dialogue, a proper noun (for example, a name, a title, and the like), a new word, and the like, which are stored in advance, and prepare a corresponding translation text. In addition, according to an embodiment of the present invention, the translation chat service providing server 110 may store a relative relationship between each user in advance, and may store the Zonto language usage information according to the chat counterpart. For example, the user may input / set the zone word usage information in association with each chat counterpart. For example, when the user of the second user terminal 130 is a senior of the user of the first user terminal 120, the database of the translation chat service providing server 110 may include the first user terminal 120 and the second user. When chatting between the terminals 130 may be stored in advance that the information about using the zoning language. The translation chat service providing server 110 may determine whether to use an antagonist based on the identifier of the second user terminal 120 and with reference to the database. The translation chat service providing server 110 may include the zoning language in the second text of the second language provided to the second user terminal 130.

According to another embodiment of the present invention, the first user terminal 120 may receive a first voice input of the first language. For example, a user of the first user terminal 120 may drive a voice input application installed in the first user terminal 120 to input a first voice input. The first voice input is a voice input including a message for the user of the first user terminal 120 to transmit to the chat counterpart.

In addition, the first user terminal 120 may transmit the received first voice input to the translation chat service providing server 110 through the network 140. In addition, the first user terminal 120 may transmit the identifier of the second user terminal 130 to receive the chat message together with the first voice input to the chat service providing server 110. In addition, the first user terminal 120 may transmit an identifier of a second language to which the first text corresponding to the first voice input is translated to the chat service providing server 110 together with the first voice input.

The translation chat service providing server 110 may prepare a first text corresponding to the first voice input of the first language received from the first user terminal 120. For example, the translation chat service providing server 110 may recognize the first text from the first voice input using a voice recognition algorithm.

In addition, the translation chat service providing server 110 may prepare a second text of the second language in which the first text is translated. For example, the translation chat service providing server 110 provides the multilingual translation engine connected via the network 140 with information about the first text and the second language, which is the language into which the first text is to be translated, The second text of the second language in which one text is translated may be received. In addition, according to another embodiment of the present invention, the translation chat service providing server 110 may translate the first text into the second text of the second language using a multilingual translation engine.

The translation chat service providing server 110 may transmit the first text recognized from the first voice input and the second text of the second language in which the first text is translated to the first user terminal 120 through the network 140. have. The first user terminal 120 may receive the first text and the second text from the translation chat service providing server 110 and display the first text and the second text in one speech bubble.

In addition, the translation chat service providing server 110 may provide text to speech (TTS) voice data of the second text to the first user terminal 120. In addition, the first user terminal 120 may reproduce the TTS voice of the second text based on the received TTS voice data. Accordingly, the user of the first user terminal 120 can hear the TTS voice of the translated text in which the first voice input of the first language input by the voice is translated, thereby obtaining a foreign language learning effect when chatting. .

In addition, the translation chat service providing server 110 based on the identifier of the second user terminal 130 that is the chat counterpart received from the first user terminal 120, the first text and the second text to the second user terminal 130. ) Can be sent. Therefore, the second user terminal 130 may display the first text recognized from the first voice input received by the first user terminal 120, which is the chat counterpart, and the second text, which is a translation thereof, in one speech bubble. In addition, the translation chat service providing server 110 receives the first voice input data (ie, the first voice input received from the first user terminal 120) of the first language corresponding to the first text. 130). In addition, the second user terminal 130 may reproduce a voice corresponding to the first text based on the received first voice input of the first language. Accordingly, the user of the second user terminal 130 may have a voice of the user of the first user terminal 120 corresponding to the first text of the first language in which the second text displayed on the second user terminal 130 is translated. You can listen together, so you can learn foreign languages when you chat. In addition, since the user of the second user terminal 130 can chat while directly listening to the voice of the chat counterpart, the user of the second user terminal 130 may feel more intimacy and interest.

On the other hand, according to another embodiment of the present invention, the translation chat service providing server 110 is a TTS (Text of the first text) with or instead of the first voice input received from the first user terminal 120 to Speech) voice data may be provided to the second user terminal 130. In addition, the second user terminal 130 may reproduce the TTS voice based on the received TTS voice data. Accordingly, the user of the second user terminal 130 may hear a TTS voice of the first text of the first language in which the second text displayed on the second user terminal 130 is translated.

Next, the first user terminal 120 is input by the user of the second user terminal 130, the third text corresponding to the second voice input of the second language received by the second user terminal 130 and the The fourth text of the first language in which the third text is translated may be received from the translation chat service providing server 110. For example, the third text is a chat message input by a user of the second user terminal 130 by voice as a reply to the second text. In addition, the first user terminal 120 may display the third text and the fourth text received from the translation chat service providing server 110 in one speech bubble.

In addition, the translation chat service providing server 110 may provide the first user terminal 120 with second voice input data of a second language corresponding to the third text. In addition, the first user terminal 120 may reproduce the user voice of the second user terminal 130 corresponding to the third text based on the received second voice input data of the second language. Therefore, the user of the first user terminal 120 can hear the second user voice for the text recognized from the second voice input of the second language input by the user of the second user terminal 130 by voice, chat The foreign language learning effect can be obtained when doing this.

According to an embodiment of the present invention, the first user voice of the first text, the TTS voice of the second text and the second user voice of the third text are respectively displayed with the first text, the second text and the third text. Can be played automatically at the same time. Therefore, the foreign language learning effect can be further improved.

Meanwhile, according to another exemplary embodiment of the present invention, the translation chat service providing server 110 may include a TTS (Text) of the third text together with or instead of the second voice input received from the second user terminal 130. to Speech) voice data may be provided to the first user terminal 120. In addition, the first user terminal 120 may reproduce the TTS voice based on the received TTS voice data.

2 is a flowchart illustrating a translation chat service providing method according to an exemplary embodiment of the present application. The translation chat service providing method illustrated in FIG. 2 may be performed by the translation chat service providing system described above with reference to the drawings. Therefore, even if omitted below, the content described with reference to the translation chat service providing system through FIG. 1 also applies to FIG. 2.

In operation S210, the first user terminal 120 may receive a user input for selecting at least one of the first language and the second language. For example, the first user terminal 120 receives a touch input for selecting the first language and the second language, or the second user terminal 130 that is the nationality or chat counterpart of the user of the first user terminal 120. The first language and the second language can be recognized by automatically recognizing the nationality of the user. The first language is a language used by a user of the first user terminal 120 to input text, and the second language is a language in which the text is to be translated.

In operation S220, the first user terminal 120 may receive a first text input of a first language. In operation S230, the first user terminal 120 may transmit the first text received in operation S220 to the translation chat service providing server 110. In operation S240, the first user terminal 120 may receive the second text of the second language in which the first text is translated from the translation chat service providing server 110. In operation S250, the first user terminal 120 may display the first text of the first language received in step S220 and the second text of the second language received in step S240. For example, the first user terminal 120 may display a first speech bubble including the first text and the second text on the display panel.

In operation S260, the first user terminal 120 translates the third text of the second language received by the second user terminal 130 and the fourth text of the first language into which the third text is translated. Can be received from 110. For example, the third text may be a reply message to the first text input by the user of the second user terminal 130. In operation S270, the first user terminal 120 may display the third text and the fourth text received in operation S260. For example, the first user terminal 120 may display a second speech bubble including the third text and the fourth text on the display panel at the lower left end of the first speech bubble.

3 is a flowchart illustrating a translation chat service providing method according to another exemplary embodiment of the present application. The translation chat service providing method illustrated in FIG. 3 may be performed by the translation chat service providing system described above with reference to the drawings. Therefore, even if omitted below, the content described with reference to the translation chat service providing system through FIG. 1 also applies to FIG. 3.

In operation S310, the first user terminal 120 may receive a user input of selecting at least one of the first language and the second language. In operation S320, the first user terminal 120 may receive a first voice input of a first language. In operation S330, the first user terminal 120 may transmit the first voice input received in operation S320 to the translation chat service providing server 110. In operation S340, the first user terminal 110 receives a first text of a first language corresponding to the first voice input from the translation chat service providing server 110 and a second of a second language in which the first text is translated. You can receive text. In operation S350, the first user terminal 120 may display the first text and the second text received in operation S340. For example, the first user terminal 120 may display a first speech bubble including the first text and the second text on the display panel.

In operation S360, the first user terminal 120 may receive the TTS voice data of the second text from the translation chat service providing server 110 and reproduce the TTS voice of the second text based on the TTS voice data. According to an embodiment of the present invention, the step S350 and the step S360 are integrated into one step, so that the first user terminal 120 displays the second text and simultaneously reproduces the TTS voice of the second text.

In operation S370, the first user terminal 120 may include a third text corresponding to a second voice input of the second language received by the second user terminal 130 and a first language of the first language in which the third text is translated. 4 text may be received from the translation chat service providing server 110. For example, the second voice input is a voice input input by a user of the second user terminal 130 as a reply to the second text.

In operation S380, the first user terminal 120 may display the third text and the fourth text received in operation S370. For example, the first user terminal 120 may display a second speech bubble including the third text and the fourth text on the display panel at the lower left end of the first speech bubble.

In operation S390, the first user terminal 120 receives the second voice input data (eg, the second user terminal 130) of the second language corresponding to the third text from the translation chat service providing server 110. And a second voice corresponding to the third text based on the second voice input data. According to an embodiment of the present invention, the step S380 and the step S390 are integrated into one step, so that the first user terminal 120 can display the third text and reproduce the second voice of the third text. .

4 is a flowchart of a translation chat service providing method according to another exemplary embodiment of the present application. The translation chat service providing method illustrated in FIG. 4 may be performed by the translation chat service providing system described above with reference to the drawings. Therefore, even if omitted below, the content described with reference to the translation chat service providing system through FIG. 1 also applies to FIG. 4.

In operation S410, the translation chat service providing server 110 may receive a first text of the first language and an identifier of the second user terminal 130, which is a chat counterpart, from the first user terminal 120. In operation S420, the translation chat service providing server 110 may receive a user input of selecting a second language, which is a language in which the first text is to be translated, from the first user terminal 120.

In operation S430, the translation chat service providing server 110 may prepare a second text of a second language in which the first text received in operation S410 is translated. According to an embodiment of the present invention, the translation chat service providing server 110 may be connected to a multilingual translation engine through the network 140. In addition, the translation chat service providing server 110 provides the translation engine with information about the first text received from the first user terminal 120 and a second language that is the language in which the first text is to be translated, The second text of the second language in which one text is translated may be received. In addition, according to another embodiment of the present invention, the translation chat service providing server 110 may translate the first text of the first language into the second text of the second language using a translation engine.

In operation S440, the translation chat service providing server 110 may transmit the second text prepared in operation S430 to the first user terminal 120. In addition, in step S450, the translation chat service providing server 110 may display the first text and the second text on the basis of the identifier of the second user terminal 130 received in step S410. Can be sent to.

5 is a flowchart illustrating a translation chat service providing method according to another exemplary embodiment of the present application. The translation chat service providing method illustrated in FIG. 5 may be performed by the translation chat service providing system described above with reference to the drawings. Therefore, even if omitted below, the content described with reference to the translation chat service providing system through FIG. 1 also applies to FIG. 5.

In operation S510, the translation chat service providing server 110 may receive a first voice input of a first language and an identifier of a second user terminal from the first user terminal 120. In operation S520, the translation chat service providing server 110 may prepare a first text corresponding to the first voice input. For example, the translation chat service providing server 110 may recognize the first text from the first voice input using a voice recognition algorithm. In operation S520, the translation chat service providing server 110 may prepare a second text of the second language in which the first text is translated. For example, the translation chat service providing server 110 may receive the second text of the second language in which the first text is translated from a multilingual translation engine connected through the network 140. In addition, according to another embodiment of the present invention, the translation chat service providing server 110 may translate the first text of the first language into the second text of the second language using a translation engine.

In operation S530, the translation chat service providing server 110 may transmit the first text and the second text prepared in operation S520 to the first user terminal 120. In operation S540, the translation chat service providing server 110 may transmit the TTS voice data and / or the first voice input data of the second text to the first user terminal 120.

In operation S550, the translation chat service providing server 110 may transmit the first text and the second text prepared in operation S520 to the second user terminal 130. In operation S560, the translation chat service providing server 110 may transmit first voice input data of the first language corresponding to the first text to the second user terminal 130. According to an embodiment of the present invention, the steps S530 to S560 may be integrated into one step. Accordingly, the translation chat service providing server 110 transmits the first text and the second text to the first user terminal 120 and the second user terminal 130, and simultaneously transmits the TTS voice data of the second text. The first user terminal 120 may transmit the first audio input data of the first text to the second user terminal 130.

6 is a block diagram of an apparatus for providing a translation chat service, according to an exemplary embodiment. As illustrated in FIG. 6, the apparatus for providing a translation chat service 110 according to an exemplary embodiment of the present disclosure may include a text receiver 610, a translation preparation unit 620, a speech recognition unit 630, a transmitter 640, The TTS provider 650 and the database 660 may be included. However, in some embodiments of the present invention, the translation chat service providing apparatus 110 may be configured differently from FIG. 6. For example, some of the components shown in FIG. 6 may be omitted or merged, and additional components may be further included.

The text receiver 610 may receive a text including a chat message from a user terminal (eg, the first user terminal 120 or the second user terminal 130). For example, the text receiver 610 may receive the first text of the first language from the first user terminal 120.

According to an embodiment of the present invention, the translation preparation unit 620 may prepare the second text of the second language in which the first text received by the text receiving unit 610 is translated. For example, the translation preparation unit 620 provides the multilingual translation engine via the network with information about the first text and the second language, which is the language in which the first text is to be translated, and the first text translated from the translation engine. A second text of two languages can be received. For another example, the translation preparation unit 620 may include a translation engine, and may translate the first text of the first language into the second text of the second language using the translation engine.

According to another embodiment of the present invention, the translation preparation unit 620 may translate the first text recognized by the speech recognition unit 630 into the second text of the second language.

The voice recognition unit 630 may receive a first voice input of the first language from the first user terminal 120. In addition, the voice recognition unit 630 may extract and recognize the first text from the first voice input by using a voice recognition algorithm.

According to an embodiment of the present invention, the transmitter 640 may transmit the second text of the second language prepared by the translation preparation unit 620 to the first user terminal 120. In addition, the transmission unit 630 transmits the first text of the first language received by the text receiving unit 610 and the second text of the second language prepared by the translation preparation unit 620 to the second user terminal 130. Can be.

In addition, according to another embodiment of the present invention, the transmission unit 640 is the first text recognized by the speech recognition unit 630 and the second text of the second language prepared by the translation preparation unit 620 to the first It may be transmitted to the user terminal 120.

The TTS provider 650 may provide the TTS voice of the second text to the first user terminal 120. In addition, the TTS providing unit 650 transmits a first voice input corresponding to the first text (eg, the first voice input received by the voice recognition unit 630) to the second user terminal 130, which is a chat counterpart. Can provide. In addition, the TTS providing unit 650 may provide the TTS voice of the first text to the second user terminal 130 that is the chat counterpart.

The database 660 may store an identifier (eg, a phone number or a unique ID) of the user terminal including the first user terminal 120 and the second user terminal 130. In addition, the database 660 may store information about a relative relationship between each user terminal (for example, information on whether or not to use a zoning word). In addition, the database 660 may store information about a language mainly used by a user of each user terminal. In addition, the database 660 may further store information about the messenger dialog and its translation, information about new words and its translation, proper nouns (names / names), information about the translation, and the like.

7 is a block diagram of an English word learning service providing system according to an exemplary embodiment of the present application. The English word learning service providing system may be a device or server included in the translation chat service providing apparatus 110 or a device or server including the translation chat service providing apparatus 110. For example, the English word learning service providing system may provide an English word learning service based on the second text received by the first user terminal 120 or the third text received by the second user terminal 120. .

Referring to FIG. 8, the English word learning service providing system 700 may include a database module 710, a wordbook generation module 720, a wordbook management module 730, a user interface module 740, and a display module 750. Can be.

The database module 710 may include an English dictionary DB 711, a memorization wordbook DB 712, a chat wordbook DB 713, and may further include a review wordbook DB 714. The English dictionary DB 711 may store and manage English words in a known English-Korean dictionary, Korean-English dictionary, English-English dictionary, and the like. The memorization vocabulary DB 712 may store and manage English words designated by the user as memorized words (hereinafter, memorized words). The chat vocabulary DB 713 may include English words extracted from English sentences (eg, second text) displayed in a chat window of a user terminal, and English words designated as words not yet memorized by the user (hereinafter, memorized words). Can be stored and managed The review wordbook DB 714 may store and manage English words stored in the memorization wordbook DB 712 according to a preset time period.

The vocabulary generation module 720 may extract the English word from the English sentence displayed in the chat window through the multilingual translation chat service provided by the user terminal and store it in the chat vocabulary DB 713.

The wordbook generation module 720 may include an English word extraction module 721, an English word generation module 722, and an English word storage module 723, and may further include a review English word generation module 724.

The English word extracting module 721 may receive an English sentence displayed on the chat window and extract a candidate English word from the English sentence. The English word generating module 722 may compare candidate English words extracted from the English word extracting module 721 with English words stored in the memorization wordbook DB 712, and remove duplicate English words. This is because the English words identical to the English words stored in the memorization word book DB 712 need not be memorized. Also, the English word generation module 722 may further remove English words not stored in the English dictionary DB 711 after comparing the candidate English words extracted from the English word extraction module 721 with English words stored in the English dictionary DB 711. have. Some of the proper nouns such as person names are not stored in the English dictionary DB 711, and do not need to memorize separately.

The English word storage module 723 may automatically store definite English words in the chat vocabulary DB 713 except the English word removed by the English word generation module 722. In this case, the English word storage module 723 may tag generation date information to the determined English words and store it in the chat vocabulary 713. The reason for tagging the generation date information is to classify the confirmed English words by date so that the user can learn more efficiently.

The reviewed English word generation module 724 may review the English word stored in the memorized word list DB 712 according to a preset time period based on the generation date information tagged with the English word stored in the memorized word list DB 712. ) Can be stored in duplicate. According to the German psychologist Hermann Ebbinhaus's forgetting curves, a person begins to forget what he has studied in ten minutes, 50% in one hour, 30% in a day, and 20 in a month. Remember to remember only%. In other words, human memory is inversely proportional to the passage of time, and repetitive learning is required at appropriate times according to cycles in order to remember decreasing memory in the long run. In accordance with the theory of the oblivion curve of the Ebbing House, the review English word generation module 724 stores the words stored in the memorization wordbook DB 712, that is, the words designated by the user as a memorization word, for a predetermined time period (eg, one day, one week, Full storage, such as full, month, etc. in the review vocabulary DB 714, so that the user can repeatedly learn the memorized words at an appropriate time period.

FIG. 8 is a diagram schematically illustrating a process of generating definite English words in a wordbook generating module of an English word learning service providing system according to an exemplary embodiment of the present disclosure. Referring to FIG. 8, for example, a wordbook is created when the English sentence (eg, the first text) displayed in the chat window of the first user terminal 120 is “Janifer, are you okay? Yuna moved out today.” Module 720 describes the process of generating definitive English words.

The English word extracting module 721 may receive the English sentence and extract a candidate English word from the English sentence. In this case, the method of extracting the candidate English word may use a method of extracting English words placed before and after the sentence code based on sentence codes such as spaces, commas, exclamation marks, question marks, and periods included in the English sentence. have. Candidate English words extracted from the English sentence by the English word extraction module 721 may be “Janifer”, “are”, “you”, “okay”, “Yuna”, “moved”, “out”, and “today”.

The English word generation module 722 may duplicately remove the same English word as the English word stored in the memorized wordbook DB 712 among the candidate English words. For example, when the words “are”, “you”, and “okay” are already stored in the memorization vocabulary DB 712, the English word generation module 722 excludes duplicate words from the candidate English words and “Janifer”, “ Only Yuna ”,“ moved ”,“ out ”and“ today ”can be left.

In addition, the English word generation module 722 may further remove English words that are not stored in the English dictionary DB (711). Words such as “Janifer” and “Yuna” in the candidate English words are likely to be not stored in the English dictionary DB 711 because they are names of human beings. has exist). If the words "Janifer" and "Yuna" are not stored in the English dictionary DB 711, the English word generation module 722 excludes the words from the candidate English words, and moves the words "moved", "out", and "today". Only you can leave

The English word storing module 723 may automatically store the confirmed English words (moved, out, today) finally determined by the English word generating module 722 in the chat vocabulary DB 713. At this time, if the generation date of the confirmed English word is, for example, February 20, 2014, it may be stored in the chat vocabulary DB 713 after tagging the generation date information such as '20140220'.

As described above, in the present specification, "candidate English word" means all words extracted from an English sentence corresponding to a chat message, and "determined English word" is an English word removed by the English word generation module 722 from the candidate English words. Means words except

Referring back to FIG. 7, the wordbook management module 730 may move selected English words from among English words stored in the chat wordbook DB 713 according to a user input signal to another DB. For example, the wordbook management module 730 may move the English words inputted with a check signal through the user interface from the English words stored in the chat wordbook DB 713 to the memorized wordbook DB 712.

The user interface module 740 may provide a user interface on the screen of the terminal so that the user can execute a service according to a preset input action. The display module 750 may display data stored in the user interface and the database module 710 on the terminal screen according to a preset layout.

The method of providing a translation chat service described above may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

The above description of the present application is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present application is indicated by the following claims rather than the above description, and it should be construed that all changes or modifications derived from the meaning and scope of the claims and their equivalents are included in the scope of the present application.

Claims

In the method for providing a translation chat service in a first user terminal,

Receiving a first voice input of a first language;

Transmitting the first voice input to a translation chat service providing server;

Receiving a first text of the first language corresponding to the first voice input and a second text of the second language in which the first text is translated from the translation chat service providing server; And

Displaying the first text and the second text;

Translation chat service providing method comprising a.
The method of claim 1,

Receiving from the translation chat service providing server a third text corresponding to a second voice input of the second language received by a second user terminal and a fourth text of the first language in which the third text is translated; And

Displaying the third text and the fourth text;

More,

And the first user terminal and the second user terminal are chatting with each other via the translation chat service providing server.
The method of claim 2,

Receiving at least one of TTS (Text to Speech) data of the second text and data of the second voice input of a second language corresponding to the third text from the translation chat service providing server; And

Reproducing the TTS voice of the second text based on the TTS data or reproducing the second voice input of a second language corresponding to the third text based on the data of the second voice input;

Translation chat service providing method further comprises.
The method of claim 3, wherein

The TTS voice of the second text is reproduced at the same time as the second text is displayed, and the second voice input of the second language corresponding to the third test is reproduced at the same time as the third text is displayed. How to provide translation chat service.
The method of claim 1,

Receiving a user input of selecting at least one of the first language and the second language,

Translation chat service providing method further comprises.
In the method for providing a translation chat service in a first user terminal,

Receiving a first text of a first language;

Transmitting the first text to a translation chat service providing server;

Receiving a second text of a second language in which the first text is translated from the translation chat service providing server; And

Displaying the first text and the second text;

Translation chat service providing method comprising a.
The method of claim 6,

Receiving, by the second user terminal, the third text of the second language and the fourth text of the first language in which the third text is translated from the translation chat service providing server; And

Displaying the third text and the fourth text;

More,

And the first user terminal and the second user terminal are chatting with each other via the translation chat service providing server.
The method of claim 6,

Receiving a user input of selecting at least one of the first language and the second language,

Translation chat service providing method comprising the more.
The method of claim 6,

And the translation chat service providing server receives a second text of the second language from a translation engine connected through a network.
In the translation chat service providing server provides a translation chat service,

Receiving the first text of the first language and the identifier of the second user terminal from the first user terminal;

Preparing a second text of a second language in which the first text is translated;

Transmitting the second text to the first user terminal;

Transmitting the first text and the second text to the second user terminal based on the identifier of the second user terminal;

Including,

And the first user terminal and the second user terminal are chatting with each other.
The method of claim 10,

Receiving a user input of selecting the second language from the first user terminal,

Translation chat service providing method further comprises.
The method of claim 10,

Preparing the second text,

Translating the first text of the first language into the second text or receiving the second text from a translation engine connected via a network.
In the translation chat service providing server provides a translation chat service,

Receiving a first voice input of a first language and an identifier of a second user terminal from the first user terminal;

Preparing a first text corresponding to the first voice input and a second text of a second language in which the first text is translated;

Transmitting the first text and the second text to the first user terminal;

Transmitting the first text and the second text to the second user terminal based on the identifier of the second user terminal;

Including,

And the first user terminal and the second user terminal are chatting with each other.
The method of claim 13,

Providing a TTS voice of the second text to the first user terminal, and providing the first voice input corresponding to the first text to the second user terminal;

Translation chat service providing method further comprises.
The method of claim 14,

The TTS voice of the second text is provided when the second text is transmitted to the first user terminal, and the first voice input corresponding to the first text is transmitted to the second user terminal. Translation chat service providing method, characterized in that provided when.
A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 1 to 15.
In the translation chat service providing apparatus,

A text receiver configured to receive a first text of a first language from a first user terminal;

A translation preparation unit for preparing a second text of a second language in which the first text is translated; And

A transmission unit for transmitting the second text to the first user terminal and transmitting the first text and the second text to a second user terminal;

Including,

And the first user terminal and the second user terminal are chatting with each other.
The method of claim 17,

A voice recognition unit receiving a first voice input of the first language from the first user terminal and recognizing the first text from the first voice input; And

A TTS providing unit providing the TTS voice of the second text to the first user terminal and providing the first voice input corresponding to the first text to the second user terminal;

Translation chat service providing apparatus further comprising a.
In the English-language learning service providing system associated with a user terminal that provides a multi-language translation for the chat message at the same time, and provides a multi-language translation chat service that can select the language displayed on the chat window,

The English word learning service providing system,

A database module including an English dictionary DB, a memorization wordbook DB for storing and managing memorized words, and a chat wordbook DB for storing and managing memorized words;

A wordbook generation module for extracting an English word from an English sentence displayed on the chat window through the multilingual translation chat service and storing the English word in the chat wordbook DB;

A wordbook management module for moving selected English words from among English words stored in the chat wordbook DB to another DB;

A user interface module for providing a user interface to the user terminal so that a user can execute a service according to a preset input action; And

And a display module for displaying the data stored in the user interface and the database module on the user terminal according to a preset layout.