KR102206486B1 - Method for proving translation service by using input application and terminal device using the same - Google Patents

Abstract

The present application relates to a method of providing a translation service using an input application and a terminal device using the same. The method of providing a translation service using an input application according to an embodiment of the present invention is provided in accordance with a request of a first application running in the terminal device. An input interface output step of outputting an input interface for inputting content to the first application; A translation pair setting step of switching the input interface to a translation input mode according to a user's input, and setting translation pair information of the input language and the translation language according to the input language and the translation language selected by the user; A target string extraction step of extracting a target string corresponding to the input language from the content when a user inputs content using the input interface; A translation step of translating the target string into the translation language to generate a translation string; And an input step of inputting the translation text into an input window of the first application.

Description

{Method for proving translation service by using input application and terminal device using the same}

The present application relates to a method of providing a translation service using an input application for inputting content such as text into an input window of a first application, and a terminal device using the same.

In recent years, due to the development of digital technology, the use of mobile terminals has become common, and various services using the mobile terminals have been provided.

Mobile terminals include smart phones, tablets, wearable devices, etc., and various functions that can be provided by a personal computer (PC) such as communication, games, and multimedia services. It is developing in the trend of mounting.

Typically, a mobile terminal must have an information input means capable of receiving information from a user. Recently, a virtual keyboard input method is used as an information input means of a mobile terminal. The virtual keyboard input method may refer to a method of displaying a virtual keyboard on a touch screen and receiving a key value corresponding to the key when a user touches a desired key on the virtual keyboard.

Virtual keyboard related technologies are described in Arthur, C. Lamb, Jr. US Patent No. 5,276,794 to et al. In this technology, when a data field is selected with a pointer, a virtual keyboard is popped up and displayed. The virtual keyboard has a key area and a display area, and when a predetermined key configured in the key area is selected by a user, a character of the corresponding key is displayed on the display area.

The present application is to provide a method for providing a translation service using an input application that can translate and input a character string input by a user in real time, and a terminal device using the same.

The present application is intended to provide a method for providing a translation service using an input application and a terminal device using the same, which can automatically translate and provide a user's language when a character string written in a foreign language is selected.

According to an embodiment of the present invention, a method for providing a translation service using an input application includes: an input interface output step of outputting an input interface for inputting content to the first application in response to a request of a first application running in a terminal device; A translation pair setting step of switching the input interface to a translation input mode according to a user's input, and setting translation pair information of the input language and the translation language according to the input language and the translation language selected by the user; A target string extraction step of extracting a target string corresponding to the input language from the content when a user inputs content using the input interface; A translation step of translating the target string into the translation language to generate a translation string; And an input step of inputting the translation text into an input window of the first application.

According to an embodiment of the present invention, a terminal device includes: an interface output unit for outputting an input interface for inputting content to the first application according to a request of a first application being executed; A translation pair setting unit that switches the input interface to a translation input mode according to a user's input, and sets translation pair information of the input language and translation language according to the input language and translation language selected by the user; A target string extraction unit extracting a target string corresponding to the input language from the content when a user inputs content using the input interface; A translation unit for translating the target text string into the translation language to generate a translation text string; And an input unit for inputting the translation text into an input window of the first application.

A terminal device according to another embodiment of the present invention includes a processor; And a memory coupled to the processor, wherein the memory includes one or more modules configured to be executed by the processor, and the one or more modules include, according to a request of a first application running in the terminal device, Outputs an input interface for inputting content to the first application, switches the input interface to a translation input mode according to a user's input, and translates the input language and the translation language according to the input language and translation language selected by the user Set twin information, and when a user inputs the content using the input interface, a target string corresponding to the input language is extracted from the content, and the target string is translated into the translation language to generate a translation string, , It may include a command for inputting the translation string into the input window of the first application.

In addition, the solution to the above-described problem does not enumerate all the features of the present invention. Various features of the present invention and advantages and effects thereof may be understood in more detail with reference to the following specific embodiments.

According to a method of providing a translation service using an input application and a terminal device using the same according to an embodiment of the present invention, a character string input by a user can be translated and provided in real time. In addition, when a character string written in a foreign language is selected, it can be automatically translated into the language used by the user and provided. Therefore, the user can conveniently communicate using an input application without the need to use a separate translation program or the like.

According to a method for providing a translation service using an input application and a terminal device using the same according to an embodiment of the present invention, it is possible to translate in consideration of the style of a character string input by a user. Therefore, even when the user communicates using the translation function, he or she can include his or her own style or nuance.

However, the method of providing a translation service using an input application according to embodiments of the present invention and the effects that can be achieved by a terminal device using the same are not limited to those mentioned above, and other effects not mentioned are described below. From this, it will be clearly understood by those of ordinary skill in the art to which the present invention belongs.

1 is a schematic diagram showing a system for providing a translation service according to an embodiment of the present invention.
2 and 3 are block diagrams showing a terminal device according to an embodiment of the present invention.
4 is a schematic diagram showing a translation input mode of an input application according to an embodiment of the present invention.
5 is a schematic diagram showing selection of an input language and a translation language of an input application according to an embodiment of the present invention.
6 and 7 are schematic diagrams showing a translation input of an input application according to an embodiment of the present invention.
8 to 10 are schematic diagrams showing reverse translation of an input application according to an embodiment of the present invention.
11 and 12 are flowcharts illustrating a method of providing a translation service by an input application according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but identical or similar elements are denoted by the same reference numerals regardless of reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves. That is, the term'unit' used in the present invention means a hardware component such as software, FPGA or ASIC, and the'unit' performs certain roles. However,'part' is not limited to software or hardware. The'unit' may be configured to be in an addressable storage medium, or may be configured to reproduce one or more processors. Thus, as an example,'unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, Includes subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and variables. The functions provided in the components and'units' may be combined into a smaller number of components and'units', or may be further divided into additional components and'units'.

In addition, in describing the embodiments disclosed in the present specification, when it is determined that a detailed description of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed in the present specification is not limited by the accompanying drawings, and all modifications included in the spirit and scope of the present invention It should be understood to include equivalents or substitutes.

1 is a schematic diagram showing a system for providing a translation service using an input application according to an embodiment of the present invention.

Referring to FIG. 1, a system for providing a translation service using an input application according to an embodiment of the present invention may include a terminal device 100 and a service server 200.

Hereinafter, a system for providing a translation service using an input application according to an embodiment of the present invention will be described with reference to FIG. 1.

The terminal device 100 may execute various types of applications, and may display the running application in visual or audio format and provide it to a user. The terminal device 100 may include a display unit for visually displaying an application, and may include an input device unit receiving an input from a user, a memory storing at least one program, and a processor.

Applications executed in the terminal device 100 may include input windows for receiving contents such as text, voice, image, and video from a user. For example, an input window may be included in a messenger application for exchanging messages with a counterpart, a memo application for writing and storing a simple memo, a word processor application for writing a document, and the like. Hereinafter, applications including an input window are referred to as a first application.

When the user desires to input text or the like in the input window of the first application, the input application may be executed. The input application is provided separately from the first application and may be executed in addition to the first application. That is, the input application is executed when content such as text is input to the input window of the first application, and may perform a function of inputting content input by the user to the first application. For example, when a user wants to input a character, the input application can display and provide a virtual keyboard on the display of the terminal device, and the user can input a character string or the like in the input window by applying the input to the virtual keyboard. I can. In addition, when the user desires to input a voice or an image, after obtaining a voice or an image by activating a microphone or a camera provided in the terminal device 100, the user may input it into the first application.

Meanwhile, the input application may provide various additional services, and depending on embodiments, it is also possible to provide a translation service using the input application. For example, a user can chat with a foreigner using a messenger application. At this time, the user may have difficulty in communication using a foreign language, but the user's convenience may be improved by using a translation service provided by the input application. That is, when the user inputs Korean, the input application may automatically translate and provide English, and a reverse translation function for translating the English input by the counterpart into Korean may also be provided. Therefore, a user can conveniently receive a translation service without having to run a separate application.

The terminal device 100 may access an App store or a Play store to download and install various applications including an input application. According to an embodiment, the service server 200 or other devices ( It is also possible to download through wired or wireless communication with (not shown).

The terminal device 100 may be a mobile terminal such as a smart phone or a tablet PC, and according to embodiments, a fixed device such as a desktop may also be included. Here, the terminal device 100 includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistants (PDA), a portable multimedia player (PMP), a slate PC, and a tablet. PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, a watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD (head mounted display)) and the like may be included.

Meanwhile, the terminal device 100 may be connected to the service server 200 through a communication network. Here, the communication network may include a wired network and a wireless network, and specifically, various types of networks such as a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN). May include a network. Further, the communication network may include a well-known World Wide Web (WWW). However, the communication network according to the present invention is not limited to the networks listed above, and may include a known wireless data network, a known telephone network, a known wired or wireless television network, and the like.

The service server 200 may be connected to the terminal device 100 through an input application, and may provide various services such as a translation service to the terminal device 100 through an input application. Depending on the embodiment, the service server 20 may perform translation on the character string received from the input application and provide the translated character string to the terminal device 100.

2 is a block diagram showing a terminal device according to an embodiment of the present invention.

Referring to FIG. 2, a terminal device 100 according to an embodiment of the present invention includes an interface output unit 110, a translation pair setting unit 120, a target character string extraction unit 130, a translation unit 140, It may include an input unit 150 and a reverse translation unit 160.

Below. A terminal device according to an embodiment of the present invention will be described with reference to FIG. 2.

The interface output unit 110 may output an input interface for inputting content to the first application according to a request of the first application being executed. The user may wish to input content such as a character string or voice into the first application in order to receive a service or the like by the first application. In this case, the interface output unit 110 may execute an input application and output an input interface for content input to the display unit of the terminal device.

Specifically, referring to Fig. 4(a), the first application (a) may be a messenger application, and a user may exchange messages with a counterpart through the messenger application. The user may input content such as a character string, voice, or image through the input window a2, and the first application a may display the contents input by the user on the content display window a1.

Here, the input application may be executed to input content into the input window a1 of the first application a, and the interface output unit 110 outputs the input interface b, so that the user can input the input interface b Content can be entered using. In this case, the display unit of the terminal device 100 may display the first application (a) in one area and the input interface (b) in the other area. Here, the area in which the input interface b is displayed in the display unit may be preset as a setting area.

Meanwhile, when the cursor is positioned on the input window a2 of the first application, the interface output unit 110 may determine that the first application a calls the input application. That is, if the cursor is positioned in the input window a2, it can be seen that the user has an intention to input content in the corresponding input window a2. Therefore, the cursor is positioned in the input window a2 of the first application. In this case, the input interface b can be output. Depending on the embodiment, the user may directly position the cursor in the input window a2 of the first application (a), and the first application (a) may automatically position the cursor in the input window a2. Do.

The translation pair setting unit 120 may switch the input interface to a translation input mode according to a user's input. Here, the user may input an input language and a translation language for translation, and the translation pair setting unit 120 may set the translation pair information according to the input language and translation language selected by the user. Referring to FIG. 4A, the input interface b may include a toolbar b2 including a plurality of operation icons. Here, each of the operation icons is for executing various services provided by the input application, and the input application may provide a service corresponding to each operation icon. For example, when the user selects a search icon, a separate execution window may be displayed so that the user may perform an Internet search, or a search site or a search application may be executed. In addition, when an emoticon icon is selected, an emoticon including an action or shape such as a character is displayed, and the input window a2 may input an emoticon selected by the user. Meanwhile, a translation icon t may be included in the toolbar b2, and when a user applies an input to the translation icon t, the translation input mode may be switched as shown in FIG. 4(b).

In this case, the user may input a character string in the original text input window b3, and a translated string corresponding to the character string input in the original text input window b3 will be displayed in the input window a1 of the first application (a). I can. Here, in order for the input application to perform translation, it is necessary to receive information on an input language input by a user and a translation language to be translated. To this end, the translation pair setting unit 120 may receive an input language and a translation language from a user, and may generate translation pair information using the input language and the translation language.

Specifically, when a user applies an input to the translation setting icon s of FIG. 4B, a setting window b4 for the input language and the translation language may be displayed as shown in FIG. 5. Here, a plurality of language icons i corresponding to the input language and the translation language provided by the input application may be displayed on the setting window b4, and languages corresponding to the language icon selected by the user among the language icons are respectively input languages and It can be set as a translation language. For example, when Korean is selected as the input language and English is selected as the translation language, translation pair information may be generated by combining Korean and English.

When the user inputs content using the input interface (b), the target character string extractor 130 may extract a target character string corresponding to the input language from the content. Here, the content input by the user may include a character string, a voice, an image, and a video.

Specifically, as shown in FIG. 6, when the content input by the user is a character string, a virtual keyboard b1 including a keyboard corresponding to the input language may be displayed on the display of the terminal device 100. . That is, when the user selects Korean as the input language, the Korean keyboard may be displayed, and when the user selects English, the English keyboard may be displayed. Here, since the input language is Korean and the translation language is English, a virtual keyboard b1 corresponding to Korean may be output.

Thereafter, the user may input a character string in the input language using the virtual keyboard b1, and the character string input by the user may be displayed on the original text display window b3. Accordingly, the user can check the character string he has created through the original text display window b3, and if necessary, modify the character string. Here, the target character string extraction unit 130 may receive a character string input to the original text display window b3, and may extract the received character string as a target character string. That is, since the user directly inputs a character string using the virtual keyboard b1, the received character string can be extracted as a target character string.

Meanwhile, depending on the embodiment, it is also possible for the user to input voice as content. Although not shown, a voice recognition icon may be further included in the original text display window b3, and when a user applies an input to the voice recognition icon, a microphone of the terminal device may be activated. Thereafter, a voice spoken by the user may be received as a voice signal using a microphone, and a voice recognition algorithm may be applied to the received voice signal. In this case, the target character string extraction unit 130 may generate a character string corresponding to the speech signal by using a speech recognition algorithm, and may extract the generated character string as a target character string. For example, the terminal device 100 or the service server 200 may include a voice model database and the like, and a standard voice pattern corresponding to each character may be stored in the voice model database. In this case, the input voice signal can be compared with a standard voice pattern stored in the voice model database, and a standard voice pattern corresponding to each voice signal can be extracted. Thereafter, the extracted standard speech pattern may be converted into a corresponding character, and the converted characters may be combined to generate a target character string. However, the method of converting the voice to text by the target text extractor 130 is not limited thereto, and may convert voice to text in various ways.

According to another embodiment, it is possible for a user to input an image as content. For example, there may be a case in which a foreign language written on a printed matter or a sign is translated and inputted. In this case, it may be advantageous for user convenience to translate an image created by photographing it rather than directly inputting the foreign language. Although not shown, a camera icon may be further included in the original text display window b3, and when a user applies an input to the camera icon, the camera of the terminal device may be activated. Thereafter, an image may be generated by photographing an object including a character string written in an input language using a camera, and a character recognition algorithm may be applied to the generated image. In this case, the target string extraction unit 130 may recognize a character string included in the image using a character recognition algorithm, and may extract the recognized character string as a target character string. For example, a distribution of pixel values for an image may be expressed as a shape pattern, which is an electrical signal, and a standard shape pattern corresponding to each character may be stored in a character model database or the like. In this case, the input shape pattern can be compared with the standard shape pattern stored in the character model database, and a standard shape pattern corresponding to each shape pattern can be extracted. Thereafter, each character corresponding to the extracted standard shape pattern can be converted to generate a target character string. However, the method of recognizing the character included in the image by the target character string extraction unit 130 is not limited thereto, and may recognize characters included in the image in various ways.

In addition, the target character string extraction unit 130 may extract the target character string by recognizing the voice included in the video.

The translation unit 140 may generate a translation string by translating the target string into a translation language. Here, the translation unit 140 may include a translation engine, and may use the translation engine to translate the target string into a translation language. The translation engine may provide statistical machine translation or artificial neural network machine translation, and may be formed by learning through machine learning methods such as deep learning. The translation string generated by the translation engine may be displayed in the input window a2 of the first application a.

Depending on the embodiment, according to the style information set by the user, the translation unit 140 may generate a translation string by changing the style of the translation string. For example, the stylistic information may include written, colloquial, honorific, and the like, and the translation unit 140 may generate a translated text in written, colloquial, honorific, or the like according to the user's selection. A user may input a character string in an input language including various styles or nuances according to his or her use or purpose, but the style or nuances may be omitted during the translation process. Accordingly, the user can select the style he wants from the style information and set the style of the translation string, thereby including the nuances he wants to convey in the translation string. Depending on the embodiment, it is also possible to set the stylistic information as a speech method for business, a speech method for promoting friendship, and a speech method for SNS. The translation engines can each be learned through machine learning or the like so as to provide a result corresponding to the style selectable from each style information.

Additionally, depending on the embodiment, the translation unit 140 may translate the same target character string into different languages and provide it to the user. For example, there may be a case where a user communicates with a plurality of foreigners, and each foreigner may have a different language. In this case, when the user applies a reset input for changing the translation language while the target string is maintained, the target string can be retranslated and displayed in a translation language corresponding to the reset input.

Specifically, as shown in Fig. 7(a), the user may first want to translate Korean into English. Thereafter, while the target string is kept the same, the translation language can be reset by applying an input to the translation setting icon s. That is, as shown in FIG. 7B, by selecting "Japanese" as a translation language from among a plurality of language icons, a reset input may be applied to the translation unit 140. In this case, as shown in Fig. 7(c), the same target character string can be retranslated into Japanese corresponding to the reset input and displayed in the input window a2. Through this, the user can conveniently translate and input one target string into a plurality of different languages.

On the other hand, depending on the embodiment, it is also possible to perform the translation in the service server 200. In this case, the translation unit 140 may request a translation by transmitting the target text string and the translation pair information to the service server 200. The service server 200 may include a translation engine, and after performing the translation using the translation engine, may provide a translation string to the translation unit 140.

The input unit 150 may input the translated text into the input window a2 of the first application. That is, as shown in Fig. 6(a), the translation string generated by the translation unit 140 may be displayed on the input window a1 of the first application (a) by the input unit 150. Thereafter, when the user inputs the input button of the input window a1, the translated text is inputted to the first application and displayed on the content display window a1.

Meanwhile, a target character string input by a user in an input language may be displayed in the original text display window b3, and a translation character string may be displayed in the input window a1. Accordingly, the user can check the target string input by the user and the translated translation string, and if there is no abnormality, the translation string can be input through the input window of the first application. Here, the case where the user inputs a character string is exemplified, but even when the user inputs a voice or image, the target character string and the translation character corresponding to the voice or image input by the user are input display window (b3) and an input window, respectively. It can be confirmed through (a2). In the case of translation, since there is a risk of being translated into completely different content when a typo or the like is included, it may be provided so that the user can check before inputting through the input display window b3 and the input window a2.

The reverse translation unit 160 may reverse translate a character string displayed in a translation language included in the first application into an input language according to a user's request. That is, a reverse-translated string can be generated by back-translating the selected string selected by the user into an input language, and the generated reverse-translated string can be displayed to the user.

Specifically, as shown in FIG. 8(a), a plurality of character strings displayed in a translated language may be included in the content display window a1 of the first application a. Here, the user may select a character string to be reverse-translated from among a plurality of character strings and copy it to the clipboard. The control window a3 displayed when a character string is selected is executed by the first application a, and it is difficult to control the operation of the input application using the control window a3. Therefore, when the first application (a) copies the text string to the clipboard, the input application may access the clipboard and extract information on the copied text string, and this may be extracted as a selection text string. That is, the first application and the input application may share the selection string through the clipboard.

Thereafter, the reverse translation unit 160 may extract an input language corresponding to the translation language from the translation pair information set in the translation pair setting unit 120, and reverse-translate the selected string according to the extracted input language to obtain a reverse translation string. Can be generated. Here, the reverse translation unit 160 may directly perform the reverse translation, but depending on the embodiment, it is possible to request a reverse translation from the translation unit 140.

When the reverse translation is completed, as shown in Fig. 8(b), the reverse translation character string b5 can be displayed on the input interface b. Here, since the reverse translation unit 160 can control the input application, the reverse translation character string b5 can be displayed only on the input interface b of the input application. The reverse translation string b5 may be displayed only for a set display time (eg, 3 seconds), or disappear when the user taps or swipes the reverse translation string b5. . Therefore, in the case of chatting with a foreigner, the user can easily check the message transmitted by the other party through reverse translation. Here, since the user's translation pair information is used, reverse translation can be automatically performed without the need to separately set a translation language or the like.

Additionally, the reverse translation unit 160 may adjust the size of the displayed reverse translation character string b5 according to the length of the reverse translation character string. As shown in Fig. 9(a), if the selected string is 3 lines, it can be displayed in the set font size, but if it is more than 7 lines as shown in Fig. 9(b), the set font size is reduced and reversed. Translated text can be displayed simultaneously in one screen. Here, the font size or the length of the reverse translation character string to which the font size reduction is applied may be variously set according to embodiments, and depending on the embodiment, the reverse translation character string (b5) may be displayed through a scroll or the like. Do.

Meanwhile, the reverse translation character string is displayed on the input interface b, and when the input interface b is not displayed in the display unit, the reverse translation character string may not be displayed. Here, copying to the clipboard is performed by the user on the first application, and there may be a case where the user does not intend to generate the reverse translation character string. Accordingly, the reverse translation unit 160 may not display the translated character string when the input interface b is not displayed in the display unit.

However, according to an embodiment, when a user taps or long-taps a character string to copy a character string to the clipboard, as shown in Fig. 10(a), the first application (a) opens the input interface (b). There is also a case of setting not to be displayed. In this case, when the user causes the input interface to be output again within the set time, it can be seen that the user wants to check the reverse translation character string. Therefore, as shown in Fig. 10(b), the reverse translation character string b5 is displayed together while outputting the input interface b, and the reverse translation character string b5 can be provided to the user.

Meanwhile, as shown in FIG. 3, the terminal device 100 according to the embodiment of the present invention may include a physical configuration such as a processor 10 and a memory 40, and May include one or more modules configured to be executed by the processor 10. Specifically, one or more modules may include an interface output module, a translation pair setting module, a target string extraction module, a translation module, an input module, and a reverse translation module.

The processor 10 may execute various software programs and an instruction set stored in the memory 40 to perform various functions and perform a function of processing data. The peripheral interface unit 30 may connect input/output peripheral devices of the computer device to the processor 10 and the memory 40, and the memory controller 20 includes the processor 10 or a component of the computer device as the memory 40 In the case of accessing to, the function of controlling memory access can be performed. Depending on the embodiment, the processor 10, the memory controller 20, and the peripheral interface unit 30 may be implemented on a single chip, or may be implemented as separate chips.

The memory 40 may include a high-speed random access memory, one or more magnetic disk storage devices, a nonvolatile memory such as a flash memory device, and the like. In addition, the memory 40 may further include a storage device located away from the processor 10 or a network attached storage device that is accessed through a communication network such as the Internet.

The display unit 50 may be configured to display the content of the first application or the input application through the view of the user. For example, the display unit 50 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, and a flexible display. , It can be visually displayed using a 3D display, an electrophoretic display, or the like. However, the content of the present invention is not limited thereto, and the display unit may be implemented in various ways. Additionally, the display unit 50 may further include a speaker or the like, so that the user may audibly recognize voice or sound. Furthermore, it is also possible to further include a haptic unit or the like in the display unit 50 to recognize content through tactile sensation. That is, the display unit 50 may allow the user to perceive by using visual, auditory and tactile senses.

The input device unit 60 receives input from a user, and includes a keyboard, a keypad, a mouse, a touch pen, a touch pad, and a touch panel. , A jog wheel, a jog switch, and the like may correspond to the input device unit 60.

Meanwhile, as shown in FIG. 3, the terminal device 100 according to an embodiment of the present invention includes an operating system in the memory 40, an interface output module corresponding to an application program, a translation pair setting module, and a target string. It may include an extraction module, a translation module, an input module, and a reverse translation module. Here, each of the modules is a set of instructions for performing the above-described functions, and may be stored in the memory 40.

Accordingly, in the terminal device 100 according to an embodiment of the present invention, the processor 10 may access the memory 40 and execute a command corresponding to each module. However, the interface output module, translation pair setting module, target string extraction module, translation module, input module and reverse translation module are the interface output unit, translation pair setting unit, target string extraction unit, translation unit, input unit and reverse translation unit. Each corresponds to, so a detailed description is omitted here.

11 and 12 are flowcharts illustrating a method of providing a translation service using an input application according to an embodiment of the present invention.

11 and 12, a method for providing a translation service according to an embodiment of the present invention includes an input interface output step (S10), a translation pair setting step (S20), a target string extraction step (S30), and a translation step (S40). ), an input step (S50) and a reverse translation step (S60). Here, each step may be performed by the terminal device.

Hereinafter, a method of providing a translation service according to an embodiment of the present invention will be described with reference to FIGS. 11 and 12.

In the input interface output step S10, an input interface for inputting content to the first application may be output according to a request of the first application running in the terminal device. The user may wish to input content such as a character string or voice into the first application in order to receive a service or the like by the first application. In this case, by executing the input application, an input interface for inputting content may be output to the display unit of the terminal device. Depending on the embodiment, the input interface may be output when the cursor is positioned in the input window of the first application, and the input interface may be displayed in the setting area of the display unit included in the terminal device.

In the translation pair setting step S20, the input interface is switched to the translation input mode according to the user's input, and translation pair information of the input language and the translation language may be set according to the input language and translation language selected by the user. Specifically, in the input application, there may be a translation icon for switching to the translation input mode, and when a user applies an input to the translation icon, the translation input mode can be switched. In this case, an interface for receiving an input language required for translation and a translation language from a user may be output. That is, language icons corresponding to a plurality of languages may be displayed, and a user may select a language icon corresponding to an input language and a translation language from among the plurality of language icons. Thereafter, a language corresponding to the language icon selected by the user may be set as the input language and the translation language, respectively, and they may be grouped and set as translation pair information.

In the target string extraction step S30, when a user inputs content using an input interface, a target string corresponding to the input language may be extracted from the content. Here, the content may include at least one of a character string, a voice, an image, and a video.

Depending on the embodiment, a character string may be input as content. In this case, in the target string extraction step S30, a virtual keyboard including a keyboard corresponding to the input language may be displayed on the display unit of the terminal device. Thereafter, a character string input by a user in an input language may be received through a virtual keyboard, and after receiving the character string, the character string may be extracted as a target character string. In other words, a character string input by a user using a virtual keyboard can be extracted as a target character string.

In addition, depending on the embodiment, it is also possible to input audio as content. In this case, in the target string extraction step (S30), the voice spoken in the input language can be received as a voice signal using the microphone of the terminal device, and a voice recognition algorithm is applied to the received voice signal to respond to the voice signal. You can extract the target string. Here, since the extraction of the target character string using the speech recognition algorithm has been described above, detailed description is omitted here.

Additionally, when the user inputs an image as content, in the target string extraction step (S30), an image including a character string written in the input language may be photographed using a camera of the terminal device. Thereafter, by applying a character recognition algorithm to the image, a character string included in the image may be extracted as a target character string. Here, since the extraction of the target character string using the character recognition algorithm has been described above, detailed descriptions are omitted here.

In the translation step (S40), the target text string is translated into a translation language to generate a translation text string. Here, translation can be performed using a translation engine that provides statistical machine translation or artificial neural network machine translation. Depending on the embodiment, in the translation step (S40), it is also possible to generate a translation string by transmitting the target string and the translation pair information to the translation server to request translation, and to receive the translation string translated into the translation language from the translation server. It is possible.

On the other hand, when the user applies a reset input for changing the translation language, it is possible to generate a retranslated character string retranslating the target character string into a translation language corresponding to the reset input. That is, since the same target string can be translated into different translation languages only by the reset input, user convenience can be improved.

Additionally, in the translation step (S40), according to the style information set by the user, the style of the translation text may be set as colloquial, written, honorific, or the like to generate the translated text. In addition, it is possible to set the stylistic information as a speech method for business, a speech method for promoting friendship, and a speech method for SNS upload. That is, by setting the style of the translation string, the user can generate the translation string including various nuances according to his or her use or purpose.

In the input step S50, the translated text may be input into the input window of the first application. That is, the translation text may be displayed on the input window of the first application, and then, when the user inputs the input button of the input window, the translation text may be input to the first application. Here, the input interface may include an original text display window, and a target character string input by the user in the input language may be displayed on the original text display window. Accordingly, the user can simultaneously check the input target string and the translated translation string, and when there is no abnormality, the user can input the translation string through the input window of the first application.

In the reverse translation step S60, a reverse translation character string may be generated by performing a reverse translation of a character string displayed in a translation language included in the first application into an input language. That is, a reverse-translated string can be generated by back-translating the selected string selected by the user into an input language, and the generated reverse-translated string can be displayed to the user. Here, the reverse translation step S60 is indicated to be performed after the input step S50, but is not limited thereto, and the reverse translation step S60 may be performed at various times.

In the reverse translation step (S60), as shown in FIG. 12, from among a plurality of character strings displayed in a translation language in the first application, the selected character string copied by the user to the clipboard may be extracted (S61). . That is, the character string copied by the first application may be stored in the clipboard, and the input application may access the clipboard and extract the selection character string selected by the user.

Thereafter, an input language corresponding to the translation language is extracted from the translation pair information, and a reverse translation character string may be generated by inverse translation of the selected character string into the input language (S62). When the input application performs a translation function, translation pair information is set, and the translation pair information includes an input language and a translation language selected by the user. Therefore, in the reverse translation step (S60), the translation language can be reverse translated into the input language using the translation pair information. In other words, it is possible to generate a reverse translation string by back-translating the selected string into the input language.

When the reverse translation character string is generated, the reverse translation character string may be displayed on the input interface (S63). That is, the reverse translation character string can be displayed in the display unit and provided to the user. The reverse translation character string may be displayed for a set display time (for example, 3 seconds), and according to an embodiment, a user inputs a separate gesture such as a tab or swipe on the reverse translation character string. It is also possible to make it disappear in case.

However, the reverse translation character string is displayed on the input interface, and when the input interface is not displayed on the display unit included in the terminal device, the reverse translation character string may not be displayed. Users can copy strings for a variety of reasons, and copying a string does not necessarily correspond to requiring the display of a reverse-translated string. Therefore, when the input interface is not displayed, the reverse translation character string may not be displayed.

On the other hand, if the input interface is output again according to the user's input within a set time after generating the reverse translation character string, the reverse translation character string may be displayed on the input interface. It can be seen that the user intends to check the reverse translation character string to output the input interface again within the set time after creating the reverse translation character string. Therefore, it is possible to display the reverse translation string at the same time while displaying the input interface.

The present invention described above can be implemented as a computer-readable code in a medium on which a program is recorded. The computer-readable medium may be one that continuously stores a program executable by a computer, or temporarily stores a program for execution or download. In addition, the medium may be a variety of recording means or storage means in a form in which a single piece of hardware or several pieces of hardware are combined. The medium is not limited to a medium directly connected to a computer system, but may be distributed on a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magnetic-optical media such as floptical disks, and And a ROM, RAM, flash memory, and the like, and may be configured to store program instructions. In addition, examples of other media include an app store that distributes applications, a site that supplies or distributes various software, and a recording medium or storage medium managed by a server. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

The present invention is not limited by the above-described embodiments and the accompanying drawings. It will be apparent to those of ordinary skill in the art to which the present invention pertains, that components according to the present invention can be substituted, modified, and changed within the scope of the technical spirit of the present invention.

10: processor 20: memory control unit
30: peripheral interface unit 40: memory
100: terminal device 110: interface output unit
120: translation pair setting unit 130: target string extraction unit
140: translation unit 150: input unit
160: reverse translation unit 200: service server
S10: Interface output step S20: Translation pair setup step
S30: target string extraction step S40: translation step
S50: input step S60: reverse translation step

Claims (17)

In the method of providing a translation service using an input application,
An input interface output step of outputting an input interface for inputting content to the first application in response to a request of a first application running on the terminal device;
A translation pair setting step of switching the input interface to a translation input mode according to a user's input, and setting translation pair information of the input language and the translation language according to the input language and the translation language selected by the user;
A target string extraction step of extracting a target string corresponding to the input language from the content when a user inputs content using the input interface;
A translation step of translating the target string into the translation language to generate a translation string;
An input step of inputting the translation string into an input window of the first application; And
A reverse translation step of generating a reverse translation character string by reverse translating the character string copied by the user to the input language from among the character strings displayed in the translation language included in the first application,
The reverse translation step
The translation service providing method, characterized in that the reverse translation character string is displayed on the input interface.
The method of claim 1, wherein the input interface output step
And displaying the input interface within a setting area of a display unit included in the terminal device.
The method of claim 1, wherein the step of setting the translation pair
A method for providing a translation service, comprising: displaying respective language icons corresponding to a plurality of languages, and setting languages corresponding to a language icon selected by a user among the language icons as the input language and the translation language, respectively.
The method of claim 1, wherein the step of extracting the target string
Displaying a virtual keyboard including a keyboard corresponding to the input language on a display of the terminal device; And
Receiving a character string input by a user in the input language through the virtual keyboard; And
And extracting the character string as the target character string.
The method of claim 1, wherein the step of extracting the target string
Receiving a voice spoken in the input language as a voice signal using a microphone of the terminal device; And
And extracting the target character string corresponding to the speech signal by applying a speech recognition algorithm to the speech signal.
The method of claim 1, wherein the step of extracting the target string
Capturing an image including a character string written in the input language using a camera of the terminal device; And
And extracting the character string included in the image as the target character string by applying a character recognition algorithm to the image.
The method of claim 1, wherein the translation step
A method for providing a translation service, comprising transmitting the target string and translation pair information to a translation server to request a translation, and receiving a translation string translated into the translation language from the translation server.
The method of claim 1, wherein the translation step
When a reset input for changing the translation language is received, a retranslated character string obtained by retranslating the target character string into a translation language corresponding to the reset input is generated.
The method of claim 1, wherein the input interface
And an original text display window in which the extracted target string is displayed.
The method of claim 1, wherein the translation step
According to the style information set by the user, the translation text is generated by setting the style of the translation text to at least one of a colloquial, written, and honorific text.
delete The method of claim 1, wherein the reverse translation step
Extracting a selection string copied by a user to a clipboard from among a plurality of character strings displayed in the translation language in the first application;
Extracting the input language corresponding to the translation language from the translation pair information, and reverse-translating the selected character string into the input language to generate a reverse translation character string; And
A translation service providing method comprising the step of displaying the reverse translation character string on the input interface.
The method of claim 12, wherein the displaying on the input interface comprises:
And displaying the reverse translation character string only when the input interface is displayed in a display unit included in the terminal device.
The method of claim 13, wherein the displaying on the input interface comprises:
When the input interface is output again within a set time after generating the reverse translation character string, the reverse translation character string is displayed on the input interface.
A computer program stored in a medium to execute the translation service providing method according to any one of claims 1 to 10 and 12 to 14 in combination with hardware.
An interface output unit for outputting an input interface for inputting content to the first application in response to a request from the running first application;
A translation pair setting unit that switches the input interface to a translation input mode according to a user's input, and sets translation pair information of the input language and translation language according to the input language and translation language selected by the user;
A target string extraction unit extracting a target string corresponding to the input language from the content when a user inputs content using the input interface;
A translation unit for translating the target text string into the translation language to generate a translation text string;
An input unit for inputting the translation string into an input window of the first application; And
Among the character strings displayed in the translation language included in the first application, including a reverse translation unit for generating a reverse translation character string by reverse translating the character string copied to the input language by the user,
The reverse translation unit
The terminal device, characterized in that the reverse translation character string is displayed on the input interface.
Processor; And
Comprising a memory coupled to the processor,
The memory includes one or more modules configured to be executed by the processor,
The one or more modules,
In response to the request of the first application running in the terminal device, output an input interface for inputting content to the first application,
Switching the input interface to a translation input mode according to a user's input, and setting translation pair information of the input language and translation language according to the input language and translation language selected by the user,
When a user inputs the content using the input interface, a target string corresponding to the input language is extracted from the content,
Translating the target string into the translation language to generate a translation string,
Input the translation string into the input window of the first application,
Among the character strings displayed in the translation language included in the first application, the character string copied by the user to the clipboard is reverse-translated into the input language to generate a reverse translation character string,
The reverse translation character string is displayed on the input interface,
Terminal device containing a command.

Images