KR101753649B1 - The real-time auto translation and interpretation service system based on position information and method thereof - Google Patents

Abstract

The present invention relates to a system and method for real-time automatic translation and interpretation service based on location information, which comprises first and second user terminals for performing a translation / interpreting application service, and translation and interpretation services for the first and second user terminals, Related application service, and is provided with voice data of the first language and current location information from the first user terminal in a state where the first and second languages are set in different first and second languages, And translating the converted character data of the first language into character data of the second language and displaying the converted character data on the screen of the first user terminal, Converting the translated character data of the second language into voice data of the second language, Based on the current location information provided from the first user terminal, the translation / interpretation service providing server for providing a translation / interpretation service providing server for providing a service for real- Providing local service information to the first or second user terminal in real time so as to automatically translate and interpret the service in real time based on the current location information of each user terminal .

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a location-based automatic translation and interpretation service system and a method thereof,

The present invention relates to a system and a method for providing an automatic translation and interpretation service in real time based on current location information of each user terminal.

In general, a person who is not fluent in a foreign language often has difficulty communicating with a foreigner or a foreigner during a conversation or conversation. However, without help from someone who knows a foreign language well, I have to communicate with a foreigner by going to a dictionary or a conversation booklet myself, but it is difficult to communicate in real time and it is difficult to communicate properly.

In recent years, the development of smartphone technology has developed an automatic translator, which has been put to practical use because of its high reliability in the case of Korean and Japanese with similar language systems. In English, the reliability of translation is lower than that of Japanese, And simple sentences are widely known to be practically usable and their translation programs.

On the other hand, there is a lot of research effort on speech recognition for machine recognition of human voice. With the development of sampling technology and self-learning function using neural network, automatic recognition rate of voice is increased and practical use in some fields .

In addition, a technique of outputting characters by voice is widely used as a voice output device that converts a pronunciation combination of each character, a pronunciation of other words, a pronunciation of a sentence, etc. into a database (DB) and outputs it as a voice.

In addition, it provides an interpretation service that converts users' languages into native languages and provides them to users using Smart Phones that are always possessed by modern people. However, even in one country, there are some languages that are somewhat new or have different meanings depending on the region. These languages are called "tongues", and because they are so different from standard words, it is sometimes difficult for people from the same country to understand them.

However, since the interpretation service provided by the conventional mobile communication terminal is interpreted by the user on the basis of the standard language of each country, there is a problem that the original purpose of the interpretation service can not be provided properly when the other party speaks in dialect.

Therefore, there is a demand for a service in which a language (dialect) of another country (standard language) or a language (dialect) which differs depending on the region of the country is appropriately interpreted according to the user's request and the introduction of the area is performed together.

Korean Patent Publication No. 10-2001-0089860

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-described problems, and it is an object of the present invention to provide a speech recognition apparatus and a speech recognition method in which speech of first and second different languages is input and converted into characters by speech recognition, Displays it on the user terminal, translates it into the other language, displays the translated character on the corresponding user terminal, converts it into a voice signal, and outputs it to the other party, Based on the current location information of the user terminal, a real-time automatic translation and interpretation service based on location information is provided to provide the user with a dialect considering not only a foreign language interpretation but also regional characteristics, System and method therefor.

In order to achieve the above object, a first aspect of the present invention provides a service providing system comprising: first and second user terminals for performing translation / interpretation related application services; And translating / interpreting application services of the first and second user terminals, respectively, in a state where the first and second languages are synchronized with each other and set in different first and second languages, Translating the converted character data of the first language into character data of the second language through a character translation service to convert the character data of the first language into character data of the first language by using the voice recognition service, Providing a service to be displayed on the screen of the user terminal, translating the translated character data of the second language into voice data of the second language, and providing the translation service to the second user terminal in real time Wherein the translation / interpretation service providing server comprises: a translating / interpreting service providing server, Based on at least one of the location-based area introduction information corresponding to the current location and the regional franchise information, to the first or second user terminal in real time, Based automatic translation and interpretation service system.

Here, the translation / interpretation service providing server may convert the text data into character data of the first language through the speech recognition service, and provide a service to be displayed on the screen of the first user terminal, It is preferable that the converted character data of the first language is modified using the interpretation-related application service and transmitted to the translation / interpretation service providing server.

Preferably, the translation / interpretation service providing server searches for a local dialect corresponding to the current location information provided from the first user terminal among the converted character data of the first language, and when the local dialect exists, It is possible to convert the local dialect into a standard language of the first language and provide a service to be displayed on the screen of the first user terminal.

Preferably, the translation / interpretation service providing server receives the voice data and the current location information of the second language from the second user terminal, converts the voice data into character data of the second language through the voice recognition service, Translating the converted character data of the second language into character data of the first language through the service and displaying the translated character data of the first language on the screen of the second user terminal, 1 language, and provides the service to be transmitted to the first user terminal in real time. The location-based area introduction information corresponding to the current location based on the current location information provided from the second user terminal, Information on at least one of the local characteristic information data to the first or second user terminal in real time Service can be provided.

Preferably, the translation / interpretation service providing server provides a service to be displayed on the screen of the second user terminal by converting it into character data of the second language through the voice recognition service, / Translator application service, the character data of the converted second language can be modified and transmitted to the translation / interpretation service providing server.

Preferably, the translation / interpretation service providing server searches for a local dialect corresponding to the current location information provided from the second user terminal among the converted character data of the second language, and when the local dialect exists, It is possible to convert the local dialect into a standard language of the second language and provide the service to be displayed on the screen of the second user terminal.

Preferably, the translation / interpreter service providing server includes first and second language data storage means for storing character data of the first and second languages respectively corresponding to the voice data of the first and second languages into a database (DB) Language speech - character storage module; First and second language translation storage modules for storing dictionary and translation information of each language for translation of the first and second languages in a database; Converting the voice data of the first and second languages into character data of the first and second languages, respectively, and converting the character data of the first and second languages into the first and second language data, respectively, First and second language voice-to-character conversion modules for converting voice data into voice data of a language; First and second language translation modules for translating character data of the first and second languages converted from the first and second language voice-to-character conversion modules into corresponding counterpart languages; First and second local information storage modules for storing characteristic information for each country and region of the first and second languages in a database; And a controller for receiving the voice data of the first language from the first user terminal and converting the voice data of the first language into character data of the first language by using the first language voice-to-character conversion module and the first language voice- And a translation module for receiving the character data of the first language converted from the first language voice-to-character conversion module and translating the character data into character data of the second language using the first language translation module and the first language translation storage module And providing a service for displaying character data of a second language translated from the first language translation module on the screen of the first user terminal, and for providing the second language voice-to-character conversion module and the second language voice- Converts the voice data into voice data of the second language using a character storage module and provides the voice data to the second user terminal in real time, The method of claim 1, further comprising: receiving current location information from the first user terminal and using the first local information storage module to transmit at least one local characteristic information data of the location- Or a control module that provides a service to be transmitted in real time to a second user terminal.

Preferably, the control module further includes a first language information storage module for storing the standard language of the first language and the dialect information of each region in a database, wherein the control module controls the first language information storage module, Searches for a local dialect corresponding to the current location information provided from the first user terminal among the character data of the language and converts the local dialect into a standard language of the first language when the local dialect exists, So that the service can be displayed.

Preferably, the control module is configured to receive voice data of the second language from the second user terminal and receive voice data of the second language by using the second language voice-to-character conversion module and the second language voice- The second language translation module and the second language translation storage module to receive character data of the second language converted from the second language voice-to-character conversion module, Language translation module to provide a service for displaying character data of a first language translated from the second language translation module on the screen of the second user terminal, And converting the voice data into voice data of the first language using the first language voice-and-character storage module and transmitting the voice data to the first user terminal in real time Wherein the second local information storage module is provided with current location information from the second user terminal and stores at least any one local feature of at least one of the location- And to transmit the information data to the first or second user terminal in real time.

Preferably, the control module further includes a second language information storage module for storing the standard language of the second language and the dialect information of the region in a database, wherein the control module controls the second language information storage module, Searches for a local dialect corresponding to the current location information provided from the second user terminal among the character data of the language, and if the local dialect exists, converts the local dialect into a standard language of the second language, So that the service can be displayed.

Preferably, the first and second user terminals may include a GPS receiving module for receiving latitude, longitude and altitude information using a plurality of Global Positioning System (GPS) satellites to obtain current position information .

A second aspect of the present invention, at least one user terminal for performing translation / interpretation related application services; And a voice recognition module for receiving the voice data of the first language and the current location information from the user terminal in a state where the first and second languages are set to different languages using the translation / interpretation related application service of the user terminal, Converting the converted character data of the first language into character data of the second language through a character translation service and displaying the translated character data on the screen of the user terminal, And a translation / interpretation service providing server for converting the translated character data of the second language into voice data of the second language and providing the translated service to the user terminal in real time, wherein the translation / The current location information corresponding to the current location based on the current location information provided from the user terminal To provide a value based Area information and local merchants information of at least either one of the local characteristic information, the location information based on a real-time automatic translation and interpretation service system, comprising a step of providing the service to real-time transmission of data to the user terminal.

Here, the translation / interpreter service providing server may convert the text data into character data of the first language through the voice recognition service and provide a service to be displayed on the screen of the user terminal, And transmits the converted character data to the translation / interpretation service providing server.

Preferably, the translation / interpretation service providing server searches for a local dialect corresponding to the current location information provided from the user terminal among the converted character data of the first language, and when the local dialect exists, It is possible to convert a dialect into a standard language of the first language and provide a service to be displayed on the screen of the user terminal.

Preferably, the user terminal may include a GPS receiving module for receiving latitude, longitude, and altitude information using a plurality of Global Positioning System (GPS) satellites to obtain current position information.

A third aspect of the present invention is a method for providing a location-based real-time automatic translation and interpretation service using a system including a translation / interpretation service providing server connected to a first and a second user terminal through a communication network, a) synchronizing with each other using the translation / interpretation related application services of the first and second user terminals, and then setting the first and second languages as different first and second languages; (b) converting the voice data of the first language transmitted from the first user terminal through the voice recognition service of the translation / interpretation service providing server into character data of the first language; (c) translating the character data of the first language converted in the step (b) into character data of the second language through the character translation service of the translation / interpretation service providing server, Providing a service to be displayed on a screen; (d) translating the character data of the second language translated in the step (c) into voice data of the second language through the translation / interpretation service providing server, and transmitting the translated voice data to the second user terminal ; Based on the current location information transmitted from the first user terminal through the translation / interpretation service providing server, and (e) the location-based area introduction information and the regional franchise point information corresponding to the current location, And providing the service to the first or second user terminal to transmit the data to the first or second user terminal in real time.

Here, after the step (b), after the service is converted into the character data of the first language through the voice recognition service of the translation / interpreter service providing server, a service is provided so that it is displayed on the screen of the first user terminal And modifying the character data of the first language converted in the step (b) by using the translation / interpretation related application service of the first user terminal, and transmitting the modified character data to the translation / interpretation service providing server .

Preferably, if the local dialect corresponding to the current location information transmitted from the first user terminal exists in the converted character data of the first language through the translation / interpretation service provision server, The local dialect may be converted into a standard language of the first language, and then the service may be displayed on the screen of the first user terminal.

Preferably, after the step (a), converting the voice data of the second language transmitted from the second user terminal through the voice recognition service of the translation / interpreter service providing server into the character data of the second language Translating the converted character data of the second language into character data of the first language through the character translation service of the translation / interpretation service providing server, and displaying the translated character data on the screen of the second user terminal Translating character data of the translated first language into voice data of the first language through the translation / interpretation service providing server, and providing the translated service to the first user terminal in real time Based on the current location information transmitted from the second user terminal through the translation / interpretation service providing server, That the step of providing location-based information description area and the merchant area information of the at least one local characteristic information services such that the first and second real-time transmission to the user terminal the data may further include.

Preferably, the method further comprises: providing a service to be displayed on the screen of the second user terminal after converting it into character data of the second language through the voice recognition service of the translation / interpreter service providing server; And converting the converted character data of the second language to the translation / interpretation service providing server by using the translation / interpretation application service of the terminal.

Preferably, if the local dialect corresponding to the current location information transmitted from the second user terminal exists in the converted character data of the second language through the translation / interpretation service provision server, if the local dialect exists, The local dialect may be converted into a standard language of the second language, and the service may be displayed on the screen of the second user terminal.

Preferably, after step (a), the first and second language voice-and-character storing modules of the translation / interpretation service providing server respectively transmit the first and second language voice data corresponding to the first and second language voice data, respectively, (DB) of the character data of the second language and storing the character data of the second language in a database (DB), and transmitting the translation data of the first language and the second language And converting the translation and interpretation information of the translation and interpretation service providing server into a database and storing the translation and translation information in a database; Translating voice data of a first language into character data of the first language; and translating the first language through the first language translation module and the first language translation storage module of the translation / Translating the character data of the first language converted from the voice-to-character conversion module into character data of the second language; and transmitting the character data of the first language through the first and second local information storage modules of the translation / And translating the character data of the second language translated from the first language translation module through the translation / interpretation service providing server into the database of the first user terminal Translating service from the first language translation module through the second language voice-to-character conversion module and the second language voice-and-character storage module of the translation / interpreter service providing server; Converting character data of a language into voice data of the second language and providing the service to the second user terminal in real time; Based on the current location information transmitted from the first user terminal through the first translation / interpretation service providing server, at least one of the location-based area introduction information and the regional merchant information corresponding to the current location stored in the first area information storage module And providing a service to transmit one local characteristic information data to the first or second user terminal in real time.

Preferably, the method further comprises the steps of: storing the standard language and dialect information of the first language in a database through a first language information storage module of the translation / interpretation service providing server, Searching for a local dialect corresponding to the current location information transmitted from the first user terminal among the converted character data of the first language using the language information storage module and, if the local dialect exists, Converting the language into a standard language and providing the service to be displayed on the screen of the first user terminal.

Preferably, the second language voice-to-character conversion module of the translation / interpretation service providing server and the second language voice data transmitted from the second user terminal through the second language voice- Converting the second language voice-to-character conversion module to character data of a second language converted from the second language voice-to-character conversion module through the second language translation module and the second language translation storage module of the translation / interpretation service providing server; Translating the character data of the first language translated from the second language translation module through the translation / interpretation service providing server into the character data of the first language; And a second language voice-to-character conversion module of the translation / interpretation service providing server, Translating character data of the first language translated from the second language translation module into voice data of the first language and providing the translated service to the first user terminal in real time; Based on the current location information transmitted from the second user terminal through the server, location-based area introduction information corresponding to the current location stored in the second area information storage module, and local franchise information To the first or second user terminal in real time.

Preferably, the method further comprises the steps of: storing the standard language and dialect information of the second language in a database through a second language information storage module of the translation / interpretation service providing server; Searching for a local dialect corresponding to the current location information transmitted from the second user terminal among the converted character data of the second language using the language information storage module and, if the local dialect exists, Converting the language into a standard language of two languages, and providing the service to be displayed on the screen of the second user terminal.

A fourth aspect of the present invention is a method for providing a voice recognition based real time automatic translation and interpretation service using a system including a translation / interpretation service providing server connected to at least one user terminal through a communication network, ) Setting different first and second languages using the translation / interpretation application service of the user terminal; (b ') converting the voice data of the first language transmitted from the user terminal through the voice recognition service of the translation / interpretation service providing server into character data of the first language; (c ') translating the character data of the first language converted in the step (b') into character data of the second language through the character translation service of the translation / interpretation service providing server, Providing a service to be displayed on a screen; (d ') translating the character data of the second language translated in the step (c') into voice data of the second language through the translation / interpreter service providing server, and transmitting the translated voice data to the user terminal ; Based on the current location information transmitted from the user terminal through the translation / interpretation service providing server, and (e ') at least one local characteristic information data And providing the service to the user terminal in real-time so as to transmit the real-time automatic translation and interpretation service method to the user terminal.

After the step (b '), a step of providing a service to be displayed on the screen of the user terminal after converting into character data of the first language through the speech recognition service of the translation / interpretation service providing server And modifying the converted character data of the first language by using the translation / interpretation application service of the user terminal, and transmitting the corrected character data to the translation / interpretation service providing server.

Preferably, if the local dialect corresponding to the current location information transmitted from the user terminal exists in the converted character data of the first language through the translation / interpretation service provision server, if the local dialect exists, It is possible to convert a dialect into a standard language of the first language and provide the service to be displayed on the screen of the user terminal.

A fifth aspect of the present invention provides a computer-readable recording medium on which a program capable of executing the above-described real-time automatic translation and interpretation service method based on location information is recorded.

The location-based real-time automatic translation and interpretation service method according to the present invention can be implemented as a computer-readable code on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

For example, the computer-readable recording medium includes a ROM, a RAM, a CD-ROM, a magnetic tape, a hard disk, a floppy disk, a removable storage device, a nonvolatile memory, , And optical data storage devices.

According to the system and method for real-time automatic translation and interpretation service based on location information of the present invention as described above, speech of first and second different languages is received and converted into characters by speech recognition, The input terminal is displayed on the corresponding user terminal and is translated into the other language. The translated character is displayed on the corresponding user terminal, and converted into a voice signal and outputted to the other side. Automatic translation and interpretation, and it is possible to provide not only a foreign language interpretation but also a dialect considering a local characteristic based on the current location information of the user terminal, and also provide material and service information for the area together with the user.

FIG. 1 is a block diagram of an entire system for explaining a real-time automatic translation and interpretation service system based on location information according to an embodiment of the present invention.
2 is a block diagram illustrating a translation / interpretation service providing server according to an embodiment of the present invention.
3 is a flowchart illustrating a method for real-time automatic translation and interpretation service based on location information according to an embodiment of the present invention.

The above and other objects, features, and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings, which are not intended to limit the scope of the present invention. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the following embodiments of the present invention may be modified into various other forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to enable those skilled in the art to more fully understand the present invention.

Each block of the accompanying block diagrams and combinations of steps of the flowcharts may be performed by computer program instructions (execution engines), which may be stored in a general-purpose computer, special purpose computer, or other processor of a programmable data processing apparatus The instructions that are executed through the processor of the computer or other programmable data processing equipment will generate means for performing the functions described in each block or flowchart of the block diagram. These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory It is also possible for the instructions stored in the block diagram to produce an article of manufacture containing instruction means for performing the functions described in each block or flowchart of the flowchart.

Computer program instructions may also be loaded onto a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible that the instructions that perform the data processing equipment are capable of providing the steps for executing the functions described in each block of the block diagram and at each step of the flowchart.

Also, each block or step may represent a portion of a module, segment, or code that includes one or more executable instructions for executing the specified logical functions, and in some alternative embodiments, It should be noted that functions may occur out of order. For example, two successive blocks or steps may actually be performed substantially concurrently, and it is also possible that the blocks or steps are performed in the reverse order of the function as needed.

FIG. 1 is a block diagram of an entire system for explaining a location-based real-time automatic translation and interpretation service system according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a translation / interpretation service providing server applied to an embodiment of the present invention. And is a block diagram for specifically explaining this.

1 and 2, a location-based real-time automatic translation and interpretation service system according to an embodiment of the present invention includes at least one user terminal 100-1 to 100-N and a translation / A providing server 200, and the like.

Each of the user terminals 100-1 to 100-N is connected to the translation / interpretation service providing server 200 through the communication network 10. At this time, the communication network 10 has a large capacity, long distance voice and data service (Wi-Fi), WiGig, Wireless Broadband Internet, Wibro, and World Interoperability (WiBro) to provide Internet or high-speed multimedia service. for Microwave Access, Wimax).

The Internet includes a plurality of services such as HTTP (Hyper Text Transfer Protocol), Telnet, File Transfer Protocol (FTP), Domain Name System (DNS), Simple Mail Transfer Protocol (SMTP) Refers to a worldwide open computer network structure providing Simple Network Management Protocol (SNMP), Network File Service (NFS), Network Information Service (NIS), and the like. Each user terminal 100-1 to 100- And provides an environment for allowing the interpreter service providing server 200 to be connected. Meanwhile, the Internet may be a wired or wireless Internet, or may be a core network integrated with a wired public network, a wireless mobile communication network, or a portable Internet.

If the communication network 10 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an example of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the mobile communication network may include, for example, a radio network controller (RNC). Meanwhile, although the WCDMA network is described as an example, it may be a next generation communication network such as a 3G LTE network, a 4G network, and a 5G network, or an IP network based on other IPs. The communication network 10 transmits signals and / or data of the user terminals 100-1 to 100-N and the translation / interpretation service providing server 200 to each other.

Each of the user terminals 100-1 to 100-N includes at least one of a smart phone, a smart pad, and a smart note communicating through a wireless Internet or a portable Internet. (Digital Multimedia Broadcasting) phone, a tablet PC, an iPad, a desktop personal computer (PC), a personal computer, a mobile phone, , A laptop PC, and the like, as well as a wired / wireless home appliance / communication device having a user interface for connecting to a translation / interpretation service providing server 200.

In particular, when each of the user terminals 100-1 to 100-N is implemented as a normal smart phone, the smart phone may be various applications that the user desires, unlike a general mobile phone (a feature phone) This phone is based on an open operating system that can be freely used and deleted by downloading the program. It can be used for all mobile phones equipped with mobile office functions as well as functions such as voice / It is desirable to understand that the present invention is a communication device that does not have a voice communication function but includes all Internet phones or Tablet PCs capable of accessing the Internet.

Such an open-type operating system may include, for example, Symbian of NOKIA, BlackBerry of RIMS, iPhone of Apple, Microsoft's Windows Mobile, Google's Google Android, and Samsung's ocean.

As described above, since the smartphone uses an open operating system, a user can arbitrarily install and manage various application programs, unlike a mobile phone having a closed operating system.

That is, the smartphone basically includes a control unit, a memory unit, a screen output unit, a key input unit, a sound output unit, a sound input unit, a camera unit, a wireless network communication module, a near field wireless communication module, and a battery for power supply.

The controller is a generic term for controlling the operation of the smartphone, and includes at least one processor and an execution memory, and is connected to each functional unit provided in the smart phone through a bus.

The controller controls the operation of the smartphone by loading at least one program code included in the smartphone into the execution memory through the processor and calculating the result by transferring the result to at least one functional unit through the bus .

The memory unit is a general term of a non-volatile memory included in a smart phone, and stores and maintains at least one program code executed through the control unit and at least one data set in which the program code is used. The memory unit basically stores a system program code and a system data set corresponding to an operating system of a smartphone, a communication program code and a communication data set for processing a wireless communication connection of the smartphone, at least one application program code and an application data set , And the program code and data set for implementing the present invention are also stored in the memory unit.

The screen output unit is composed of a screen output device (e.g., an LCD, an LED device) and an output module for driving the screen output device. The screen output unit is connected to the control unit through a bus, And outputs it to the device.

The key input unit is composed of a key input device having at least one key button (or a touch screen device interlocked with the screen output unit) and an input module for driving the key input unit. The control unit is connected to the control unit via a bus, Or inputs data necessary for the operation of the control unit.

The sound output unit includes a speaker for outputting a sound signal and a sound module for driving the speaker. The sound output unit is connected to the control unit through a bus, and outputs a result of operation corresponding to the sound output from the various operation results of the control unit through the speaker . The sound module decodes sound data to be output through the speaker and converts the sound data into a sound signal.

The sound input unit includes a microphone for receiving a sound signal and a sound module for driving the microphone, and transmits the sound data input through the microphone to the control unit. The sound module encodes and encodes a sound signal input through the microphone.

The camera unit includes an optical unit, a CCD (Charge Coupled Device) and a camera module for driving the CCD unit, and obtains bitmap data input to the CCD through the optical unit. The bitmap data may include both still image data and moving image data.

The wireless network communication module is a collective term for communicating wireless communication and includes at least one antenna, an RF module, a baseband module, and a signal processing module for transmitting and receiving a radio frequency signal of a specific frequency band. And transmits the calculation result corresponding to the wireless communication among the various calculation results of the control unit through the wireless communication or receives the data through the wireless communication and transmits the data to the control unit, , Communication, and handoff procedures.

Also, the wireless network communication module includes a mobile communication structure for performing at least one of connection, location registration, call processing, call connection, data communication, and handoff to a mobile communication network according to the CDMA / WCDMA standard. Meanwhile, according to the intention of those skilled in the art, the wireless network communication module may further include a portable Internet communication structure for performing at least one of connection to the portable Internet, location registration, data communication, and handoff according to the IEEE 802.16 standard, It is evident that the present invention is not limited by the wireless communication configuration provided by the communication module.

The short-range wireless communication module is composed of a short-range wireless communication module that connects a communication session using a radio frequency signal as a communication medium within a predetermined distance. Preferably, the short-range wireless communication module includes RFID communication, Bluetooth communication, Wi- And wireless communication. The short-range wireless communication module may be integrated with the wireless network communication module.

In particular, when each of the user terminals 100-1 to 100-N applied to the embodiment of the present invention is implemented as a smart phone, for example, via an App Store or a translation / interpretation service providing server 200 Translation / Interpretation-Related Application (Application) Download the program and perform translation / interpretation-related application services.

As described above, the translation / interpretation service providing server 200 can access the translation / interpretation service providing application service through the translation / interpretation related application service installed in the smart phone and use the real time translation and interpretation service.

For example, when each of the user terminals 100-1 to 100-N is composed of two first and second user terminals 100-1 and 100-2, the first and second user terminals 100-1 And 100-2, respectively, to synchronize with each other using a translating / interpreting-related application service installed in each of the first and second languages (for example, Korean-Japanese , Korean-English, Korean-Chinese, Korean-German, Korean-French, etc.) to the translation / interpreter service providing server 200.

Further, by using the translation / interpretation related application service installed in the first and second user terminals 100-1 and 100-2, the voice signals of the respective users are received via the microphone and converted into digital voice data, To the translation / interpretation service providing server 200 through the translation / interpretation service providing server 200.

Also, the translation / interpretation service providing server 200 transmits the translation / interpretation service using the translation / interpretation related application service installed in the first and second user terminals 100-1 and 100-2, The character data corresponding to the voice data can be received and displayed on the screen.

The first and second user terminals 100-1 and 100-2 may include a multilingual keyboard module (not shown) that can input characters by connecting a country-specific keyboard to the first and second user terminals 100-1 and 100-2. A selection button for selecting and modifying the voice recognition character data or the translated character data to be translated, a correction button, a translation request button for requesting translation of the voice input character, a voice output request for requesting voice output of the translated character data Button or the like may be separately provided.

When accurate speech recognition or accurate translation is not obtained in the character display by the voice input or the translation character display, that is, in the error part which can not be automatically processed by the speech recognition service and translation service of the translation / interpretation service providing server 200 The user can arbitrarily display the current recognition character and display it as a block shade so as to support the service so that the user can select and re-input and / or modify it. The first and second user terminals 100-1 and 100-2 ), It is possible to provide a simplified keyboard so as to support a character input by a combination key or a character input by a menu display method.

In addition, each of the user terminals 100-1 to 100-N includes a GPS receiving module for receiving latitude, longitude, and altitude information using a plurality of GPS (Global Positioning System) satellites 20, (110).

When the user's voice data is transmitted to the translation / interpreter service providing server 200 through the communication network 10 using the translation / interpretation related application service installed in each of the user terminals 100-1 to 100-N, It is preferable that current position information obtained through the receiving module 110 is transmitted together.

The local characteristic information data transmitted from the translation / interpretation service providing server 200 through the communication network 10 (for example, the local characteristic information data, Location-based area introduction information, local merchant information, etc.) can be displayed and displayed on the screen.

It is also possible to use the translation / interpretation related application service installed in each of the user terminals 100-1 to 100-N and the standard language and / or language of the language transmitted from the translation / interpretation service providing server 200 via the communication network 10 Local dialects can be provided and displayed on the screen.

The translation / interpretation service providing server 200 is connected to each of the user terminals 100-1 to 100-N via the communication network 10 and receives the voice data of the first language from the first user terminal 100-1 And converts the converted character data of the first language into character data of the second language through the character translation service to convert the converted character data into character data of the first language through the speech recognition service, And provides a service to display on the screen of the display unit.

Also, the translation / interpretation service providing server 200 searches whether the local dialect corresponding to the current location information provided from the first user terminal 100-1 exists in the converted character data of the first language, Converts the local dialect into a standard language of the first language and provides a service to be displayed on the screen of the first user terminal 100-1.

Also, the translation / interpretation service providing server 200 has a function of converting the translated character data of the second language into voice data of the second language and providing a service to be transmitted to the second user terminal 100-2 in real time .

In addition, the translation / interpretation service providing server 200 receives the current location information transmitted from the first user terminal 100-1, and based on the received current location information, the translation / interpretation service providing server 200 searches for a local feature corresponding to the current location, such as a normal beacon service, (E.g., location-based area introduction information, local merchant information, etc.) to the first or second user terminal 100-1 or 100-2 in real time.

In addition, the translation / interpretation service providing server 200 may convert the text data into character data of a first language through the speech recognition service and provide a service to be displayed on the screen of the first user terminal 100-1 . At this time, it is preferable that the converted character data of the first language is transmitted to the translation / interpretation service providing server 200 by using the translation / interpretation related application service of the first user terminal 100-1.

In addition, the translation / interpretation service providing server 200 receives the voice data of the second language from the second user terminal 100-2, converts the voice data into character data of the second language through the voice recognition service, Translate the converted character data of the second language into character data of the first language and provide a service to be displayed on the screen of the second user terminal 100-2, Language character data into voice data of the first language and provide the service to the first user terminal 100-1 so as to be transmitted in real time.

Also, the translation / interpretation service providing server 200 receives the current location information transmitted from the second user terminal 100-2 and, based on the received current location information, the translation / interpretation service providing server 200 transmits the local character corresponding to the current location such as a normal beacon service (E.g., location-based area introduction information, local merchant information, etc.) to the first or second user terminal 100-1 or 100-2 in real time.

In addition, the translation / interpretation service providing server 200 may convert the text data into character data of a second language through the speech recognition service and provide a service to be displayed on the screen of the second user terminal 100-2 . At this time, it is preferable that the converted character data of the second language is transmitted to the translation / interpretation service providing server 200 by using the translation / interpretation related application service of the second user terminal 100-2.

In addition, the translation / interpretation service providing server 200 searches whether the local dialect corresponding to the current location information provided from the second user terminal 100-2 exists in the converted character data of the second language, The local dialect may be converted into a standard language of the second language and displayed on the screen of the second user terminal 100-2.

2, the translation / interpretation service providing server 200 may include a communication module 210, first and second language voice-and-character storage modules 220a and 220b, first and second language translation storage Modules 230a and 230b, first and second language voice-to-character conversion modules 240a and 240b, first and second language translation modules 250a and 250b, first and second local information storage modules 260a and 260b, 260b, first and second language information storage modules 270a and 270b, a control module 280, and the like.

The communication module 210 transmits and receives data and / or signals to / from the user terminals 100-1 through 100-N connected through the communication network 10.

The first and second language voice-and-character storing modules 220a and 220b have a function of storing character data of the first and second languages corresponding to the voice data of the first and second languages into a database (DB) .

The first and second language translation storage modules 230a and 230b function to store dictionary and translation information of each language for translation of the first and second languages into a database (DB).

The first and second language voice-to-character conversion modules 240a and 240b convert voice data of the first and second languages into character data of the first and second languages, respectively, through a voice recognition service (for example, a voice recognition program) And converting the character data of the first and second languages into voice data of the first and second languages, respectively.

The first and second language translation modules 250a and 250b are configured to translate the first and second language voice-to-character conversion modules 240a and 240b from the first and second language voice-to-character conversion modules 240a and 240b through a character translation service And translates the character data of the language into the corresponding counterpart language.

The first and second local information storage modules 260a and 260b store the feature information of each country and region of the first and second languages into a database (DB).

The first and second language information storage modules 270a and 270b store the standard language and the dialect information of the first and second languages into a database (DB).

At this time, the standard language refers to an ideal language that imposes certain restrictions on a common language of a country. For example, the above standard words include "Seoul Horse" in Korea, "Londoner" in Britain, "Parisian" in France, and "Tokyoer" in Japan.

In addition, the dialect refers to a language created by a specific word or a method of applying a language, unlike the standard word. For example, the dialects include "English", "German", "Jeolla-do" and "Gyeongsang-do", which are branched from Germanic language.

The control module 280 is a module for controlling the overall operation of the translation / interpretation service providing server 200. Specifically, the control module 280 receives the voice data of the first language from the first user terminal 100-1, Conversion module 240a and the first language voice-and-character storage module 220a so as to be converted into character data of the first language.

The control module 280 receives the converted first language character data from the first language voice-to-character conversion module 240a and receives the first language translation module 250a and the first language translation storage module 230a To be translated into character data of the second language.

In addition, the control module 280 provides a service for displaying the translated character data of the second language from the first language translation module 250a on the screen of the first user terminal 100-1, Language voice-to-character conversion module 240b and the second language voice-and-character storage module 220b into voice data of a second language and transmit the voice data to the second user terminal 100-2 in real time .

The control module 280 receives the voice data of the second language from the second user terminal 100-2 and transmits the voice data to the second language voice-to-character conversion module 240b and the second language voice-and-character storage module 220b. So as to be converted into character data of the second language.

The control module 280 receives the converted second language character data from the second language voice-to-character conversion module 240b and receives the second language translation module 250b and the second language translation storage module 230b To be translated into character data of the first language.

In addition, the control module 280 provides a service to display the translated character data of the first language from the second language translation module 250b on the screen of the second user terminal 100-2, Language voice-to-character conversion module 240a and the first language voice-and-character storage module 220a to convert the voice data into voice data of a first language and transmit the voice data to the first user terminal 100-1 in real- .

The reason why the first and second language voice-to-character conversion modules 240a and 240b are respectively provided is that the signal processing amount for speech recognition is complicated, and a voice having a different language is recognized and converted into a corresponding character And a voice-character database (DB) is constructed for each language, respectively, for recognition processing of voice.

As described above, in the embodiment of the present invention, when the first user speaks in Korean, when the first language is implemented in Korean and the second language is implemented in Japanese, the voice of the translation / interpretation service providing server 200 The Korean is recognized by the recognition service, the Hangul is displayed on the screen of the first user terminal 100-1 owned by the first user, the displayed Hangul is automatically translated into the Japanese, 100-1), and the translated Japanese is converted into a voice signal and output to the second user terminal 100-2 owned by the second user.

Then, when the second user speaks in Japanese, the Japanese is recognized by the speech recognition service of the translation / interpretation service providing server 200 and is displayed on the screen of the second user terminal 100-2 owned by the second user And the Hangul is automatically displayed on the screen of the second user terminal 100-2 and the translated Hangul is converted into a voice signal to be displayed on the screen of the second user terminal 100-2, 1 user terminal 100-1.

As described above, the present invention is not limited to achieving perfect speech recognition, translation, and interpretation, but may be implemented using various speech recognition databases (DBs), speech recognition systems, A practical application can be applied more realistically by constructing and using a basic translation database (DB), and by registering and learning functions of information such as voice, words and translation.

On the other hand, the translation / interpretation service providing server 200 recognizes the input voice transmitted from each of the user terminals 100-1 to 100-N and converts the character information into characters, The translator / interpreter-related application of the translator / interpreter 100-1 to 100-N.

At this time, if the user views the voice recognition character displayed on the screen of each of the user terminals 100-1 to 100-N, the block is selected with respect to a character not recognized correctly or with a selection key for an erroneously recognized character, Only the voice is inputted repeatedly.

When the voice input is completed, the translation / interpretation service providing server 200 automatically translates the text-converted content into the corresponding language. That is, the first and second language voice-to-character conversion modules 240a and 240b and the first and second language translation modules 250a and 250b of the translation / interpretation service providing server 200 store the character-converted information And translates and controls each language into a corresponding language through the first and second language translation modules 250a and 250b.

The first and second language translation modules 250a and 250b translate the languages corresponding to each other into the corresponding language using the dictionary stored in the first and second language translation storage modules 230a and 230b and the translation database DB , And the translated contents are transmitted to the control module 280 and outputted to the translation / interpretation related applications of the user terminals 100-1 to 100-N.

The translated contents are again converted into voice information in the first and second language voice-to-character conversion modules 240a and 240b, respectively, and the voice information is transmitted to the control module 280, (210). Therefore, since the communication module 210 outputs the voice of the other language, the automatic interpretation function is performed.

As described in detail above, the present invention automatically translates the speech into the other language by voice recognition and outputs the translated language as speech, so that it can function as an automatic translator. It provides automatic translation and interpretation of simple words, short sentences or simple conversations, so it can be very useful for travelers or foreign language learners.

The control module 280 receives the current location information transmitted from the first user terminal 100-1 through the communication module 210 and transmits the current location information corresponding to the current location using the first local information storage module 260a (E.g., location-based area introduction information, local merchant information, etc.) to be transmitted to the first or second user terminal 100-1 or 100-2 in real time.

The control module 280 receives the current location information transmitted from the second user terminal 100-2 through the communication module 210 and transmits the current location information corresponding to the current location using the second local information storage module 260b (E.g., location-based area introduction information, local merchant information, etc.) to be transmitted to the first or second user terminal 100-1 or 100-2 in real time.

In addition, the control module 280 may use the first language information storage module 270a to convert the first language voice-to-character conversion module 240a to the first user terminal 100-1, If the local dialect exists, converts the local dialect into a standard language of the first language and displays it on the screen of the first user terminal 100-1 ).

In addition, the control module 280 selects the second language voice-to-character conversion module 240b from the second language voice data conversion module 240b using the second language information storage module 270b, If there is a corresponding local dialect, converts the local dialect into a standard language of the second language and displays it on the screen of the second user terminal 100-2 ).

Meanwhile, the voice recognition based real-time automatic translation and interpretation service of the present invention can also be performed through one user terminal (e.g., 100-1).

Namely, in the translation / interpretation service providing server 200, in a state where the first and second languages are set to different languages using the translation / interpretation related application service of the user terminal 100-1, And converting the converted character data of the first language into character data of the second language through the character translation service to convert the character data of the first language into character data of the second language, And may provide a service to be displayed on the screen of the terminal 100-1.

In addition, the translation / interpretation service providing server 200 may convert the translated character data of the second language into voice data of the second language and provide the service to the user terminal 100-1 in real time.

Also, the translation / interpretation service providing server 200 may convert the text data into character data of the first language through the voice recognition service and provide a service to be displayed on the screen of the user terminal 100-1. At this time, it is preferable that the converted character data of the first language is transmitted to the translation / interpretation service providing server 200 by using the translation / interpretation related application service of the user terminal 100-1.

Also, the translation / interpretation service providing server 200 receives the current location information from the user terminal 100-1, and based on the location information, the local / regional feature information data corresponding to the current location, such as a normal beacon service , Location-based area introduction information, local merchant information, etc.) to the user terminal 100-1 in real time.

Also, the translation / interpretation service providing server 200 searches whether the local dialect corresponding to the current location information provided from the user terminal 100-1 exists in the converted character data of the first language, and the local dialect exists , It is possible to convert the local dialect into a standard language of the first language and provide a service to be displayed on the screen of the user terminal 100-1.

Hereinafter, a location-based real-time automatic translation and interpretation service method according to an embodiment of the present invention will be described in detail.

FIG. 3 is a general flowchart for explaining a location-based real-time automatic translation and interpretation service method according to an embodiment of the present invention. The first and second user terminals (for example, 100-1 and 100-2) Time automatic translation and interpretation service based on the location information.

Referring to FIGS. 1 to 3, a location-based real-time automatic translation and interpretation service method according to an embodiment of the present invention includes firstly translating and translating first and second user terminals 100-1 and 100-2, / An interpreter-related application service, and sets them to different first and second languages (S100).

Thereafter, the voice data of the first language transmitted from the first user terminal 100-1 through the voice recognition service of the translation / interpretation service providing server 200 is converted into the character data of the first language (S200).

After translating the character data of the first language converted in step S200 into character data of the second language through the character translation service of the translation / interpretation service providing server 200, -1) to be displayed on the screen (S300).

Next, after converting the character data of the second language translated in step S300 into voice data of the second language through the translation / interpretation service providing server 200, (S400).

Thereafter, based on the current location information transmitted from the first user terminal 100-1 through the translation / interpretation service providing server 200, the local characteristic information data corresponding to the current location (for example, , Local merchant information, etc.) to the first or second user terminal 100-1 or 100-2 in real time (S500).

In addition, after the above-described step S200, the character data is converted into character data of the first language through the speech recognition service of the translation / interpretation service providing server 200, and then displayed on the screen of the first user terminal 100-1 (Step S200). The translation / interpretation service providing server (or the translating / interpreting service providing server) of the first user terminal 100-1 modifies the character data of the first language, 200). ≪ / RTI >

In addition, the translation / interpretation service providing server 200 searches the converted character data of the first language for the existence of a local dialect corresponding to the current location information transmitted from the first user terminal 100-1, If there is a dialect, the local dialect may be converted into a standard language of the first language, and then a service may be provided so that it is displayed on the screen of the first user terminal 100-1.

Further, after step S100, the voice data of the second language transmitted from the second user terminal 100-2 through the voice recognition service of the translation / interpreter service providing server 200 is converted into the character data of the second language Translating the converted character data of the second language into character data of the first language through the character translation service of the translation / interpretation service providing server 200, Providing a service to be displayed on a screen of the translation / interpretation service providing server 200, converting the translated character data of the first language into speech data of the first language through the translation / interpretation service providing server 200, Providing a service to be transmitted to the user terminal 100-1 in real time; and providing a service based on the current location information transmitted from the second user terminal 100-2 through the translation / interpretation service providing server 200, Local features corresponding to The data (e.g., location-area description information, area information, and merchant) providing the service to real-time transmission to the first or the second user terminal (100-1 or 100-2) may be further included.

In addition, after converting the text data into character data of a second language through the speech recognition service of the translation / interpreter service providing server 200, it provides a service to display it on the screen of the second user terminal 100-2 And modifying the converted character data of the second language using the translation / interpretation related application service of the second user terminal 100-2 and transmitting the modified character data to the translation / interpreter service providing server 200 You may.

In addition, the translation / interpretation service providing server 200 searches whether the local dialect corresponding to the current location information transmitted from the second user terminal 100-2 exists in the converted character data of the second language, If the dialect exists, the local dialect may be converted into a standard language of the second language and then displayed on the screen of the second user terminal 100-2.

After the step S100, the first and second language voice-and-character storage modules 220a and 220b of the translation / interpreter service providing server 200 transmit the voice data corresponding to the voice data of the first and second languages, 1 and the second language through the first and second language translation storage modules 230a and 230b of the translation / interpretation service providing server 200, (DB) of dictionary and translation information of each language for translation of the two languages, a step of converting the first language voice-to-character conversion module 240a of the translation / interpretation service provision server 200 and the first language Converting the voice data of the first language transmitted from the first user terminal 100-1 to character data of the first language through the voice-character storing module 220a; Through the first language translation module 250a and the first language translation storage module 230a, Translating the character data of the first language converted from the character conversion module 240a into character data of the second language and translating the first and second local information storage modules 260a and 260b of the translation / And translating the first language translation module 250a from the first language translation module 250a through the translation / interpretation service provision server 200 and storing the feature information of the first and second languages in a database (DB) Providing a service to display character data of the second language voice-to-character conversion module of the translation / interpretation service providing server 200 on the screen of the first user terminal 100-1; Converts the translated character data of the second language from the first language translation module 250a into voice data of the second language through the first language translation module 240b and the second language voice-character storage module 220b, Providing a service to be transmitted in real time to the terminal 100-2; Based on the current location information transmitted from the first user terminal 100-1 through the translation / interpretation service providing server 200, local feature information data corresponding to the current position stored in the first local information storage module 260a (E.g., location-based area introductory information, local merchant information, etc.) to the first or second user terminal 100-1 or 100-2 in real time.

In addition, a step of storing the standard language and dialect information of the first language into a database (DB) through the first language information storage module 270a of the translation / interpretation service providing server 200, Whether there is a local dialect corresponding to the current location information transmitted from the first user terminal 100-1 among the converted character data of the first language using the first language information storage module 270a And if the local dialect exists, converting the local dialect into a standard language of the first language and providing the service to display it on the screen of the first user terminal 100-1.

Also, the second language voice-to-character conversion module 240b and the second language voice-character storage module 220b of the translation / interpretation service providing server 200 receive the data transmitted from the second user terminal 100-2 Translating the second language translation module 250b and the second language translation storage module 230b of the translation / interpretation service providing server 200 into the second language character data, Translating the character data of the second language converted from the language voice-to-character conversion module 240b into character data of the first language; and translating the second language translation module 250b through the translation / interpretation service provision server 200, Providing a service so that the character data of the first language translated from the first language voice-text server 200 is displayed on the screen of the second user terminal 100-2; Conversion module 240a and the first language voice-and-character storage module 220a, Translating the translated character data of the first language from the module 250b into voice data of the first language and providing the service to the first user terminal 100-1 so as to transmit the voice data to the first user terminal 100-1 in real time, Based on the current location information transmitted from the second user terminal 100-2 via the providing server 200, local characteristic information data (e.g., location information) corresponding to the current location stored in the second local information storage module 260b Based area introduction information, local merchant information, etc.) to the first or second user terminal 100-1 or 100-2 in real time.

In addition, a step of converting the standard language and dialect information of the second language into a database (DB) through the second language information storage module 270b of the translation / interpretation service providing server 200, Whether or not a local dialect corresponding to the current location information transmitted from the second user terminal 100-2 exists among the converted character data of the second language using the second language information storage module 270b And if the local dialect exists, converting the local dialect into a standard language of the second language and providing a service to display it on the screen of the second user terminal 100-2 .

On the other hand, the location information-based real-time automatic translation and interpretation service method of the present invention can be performed through one user terminal (e.g., 100-1).

In other words, it is possible to set different first and second languages using the translation / interpretation related application service of the user terminal 100-1, Converting the speech data of the first language transmitted from the translator / translator service providing server (200-1) into character data of the first language; Translating the data into character data of a second language and providing the service so that the translated data is displayed on the screen of the user terminal 100-1; Providing a service to translate character data of a second language into voice data of a second language and then transmitting the voice data to the user terminal 100-1 in real time; (100-1) (E.g., location-based area introduction information, local merchant information, etc.) corresponding to the current location based on the transmitted current location information to the user terminal 100-1 in real time can do.

At this time, after the step of converting the voice data of the first language transferred from the user terminal 100-1 to the character data of the first language through the voice recognition service of the translation / interpreter service providing server 200, Providing a service to be displayed on a screen of the user terminal 100-1 after converting into character data of a first language through a voice recognition service of the service providing server 200, 1) using the translation / interpretation-related application service, and transmitting the modified character data of the first language to the translation / interpreter service providing server 200. [

In addition, the translation / interpretation service providing server 200 searches whether the local dialect corresponding to the current location information transmitted from the user terminal 100-1 exists in the converted character data of the first language, The local dialect may be converted into a standard language of the first language and then displayed on the screen of the user terminal 100-1.

Meanwhile, the location-based real-time automatic translation and interpretation service method according to an embodiment of the present invention can also be implemented as a computer-readable code on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

For example, the computer-readable recording medium includes a ROM, a RAM, a CD-ROM, a magnetic tape, a hard disk, a floppy disk, a removable storage device, a nonvolatile memory, , And optical data storage devices.

In addition, the computer readable recording medium may be distributed and executed in a computer system connected to a computer communication network, and may be stored and executed as a code readable in a distributed manner.

Although the present invention has been described with respect to a preferred embodiment of the system and method for real-time automatic translation and interpretation service based on location information according to the present invention, the present invention is not limited thereto, And the present invention also belongs to the present invention.

100-1 to 100-N: a user terminal,
200: translation / interpretation service providing server,
210: communication module,
220a and 220b: first and second language voice-character storage modules,
230a and 230b: first and second language translation storage module,
240a and 240b: first and second language voice-to-character conversion module,
250a and 250b: first and second language translation module,
260a and 260b: first and second local information storage modules,
270a and 270b: first and second language information storage modules,
280: Control module

Claims (16)

First and second user terminals for performing translation / interpreting application services; And
The first language and the second language are synchronized with each other using the translation / interpretation application service of the first and second user terminals, And converting the converted character data of the first language into character data of the second language through a character translation service to convert the character data of the first language into character data of the second language, A translating / interpreting service providing server for providing a service to be displayed on a screen of the terminal, converting character data of the translated second language into voice data of the second language, and providing a service to the second user terminal in real- , ≪ / RTI &
The translation / interpretation service providing server may transmit at least one local characteristic information data of the location-based area introduction information and the regional merchant point information corresponding to the current location on the basis of the current location information provided from the first user terminal, 1 or the second user terminal,
The translation / interpretation service providing server converts the text data into character data of the first language through the speech recognition service, and provides a service to be displayed on the screen of the first user terminal,
Translating character data of the first language by using the translation / interpretation-related application service of the first user terminal, and transmitting the modified character data to the translation / interpretation service providing server,
Searching for a local dialect corresponding to the current location information provided from the first user terminal among the converted character data of the first language, and if the local dialect exists, converting the local dialect into a standard language of the first language And providing a service to be displayed on the screen of the first user terminal.
delete The method according to claim 1,
The translation / interpretation service providing server receives the voice data of the second language and the current location information from the second user terminal, converts the voice data into character data of the second language through the voice recognition service, Translating the converted character data of the second language into character data of the first language and displaying the converted character data on the screen of the second user terminal, Based on the current location information provided from the second user terminal, the location-based area introduction information and the regional merchant information corresponding to the current location, The local characteristic information data is transmitted to the first or second user terminal in real time Location-based real-time automated translation and interpretation services system, comprising a step of providing a.
The method of claim 3,
Wherein the translation / interpretation service providing server converts the text data into character data of the second language through the speech recognition service and provides a service to be displayed on the screen of the second user terminal,
Translating character data of the second language using the translation / interpretation-related application service of the second user terminal, and transmitting the modified character data to the translation / interpretation service providing server,
Searching for a local dialect corresponding to the current location information provided from the second user terminal among the converted character data of the second language, and if the local dialect exists, converting the local dialect into a standard language of the second language And providing a service to be displayed on a screen of the second user terminal.
The method according to claim 1,
The translation / interpretation service providing server,
First and second language voice-and-character storing modules for storing character data of the first and second languages respectively corresponding to the voice data of the first and second languages into a database (DB);
First and second language translation storage modules for storing dictionary and translation information of each language for translation of the first and second languages in a database;
Converting the voice data of the first and second languages into character data of the first and second languages, respectively, and converting the character data of the first and second languages into the first and second language data, respectively, First and second language voice-to-character conversion modules for converting voice data into voice data of a language;
First and second language translation modules for translating character data of the first and second languages converted from the first and second language voice-to-character conversion modules into corresponding counterpart languages;
First and second local information storage modules for storing characteristic information for each country and region of the first and second languages in a database; And
Receiving the voice data of the first language from the first user terminal and controlling the voice data to be converted into character data of the first language by using the first language voice-to-character conversion module and the first language voice-and-character storage module A translation module for receiving the character data of the first language converted from the first language voice-to-character conversion module and translating the character data into character data of the second language using the first language translation module and the first language translation storage module And providing a service for displaying character data of a second language translated from the first language translation module on the screen of the first user terminal, and for providing the second language voice-to-character conversion module and the second language voice- Converts the voice data into voice data of the second language using a storage module and provides the voice data to the second user terminal in real time, The method of claim 1, further comprising the step of: receiving current location information from the first user terminal and using the first local information storage module to transmit at least one local characteristic information data of the location- And a control module for providing a service to the second user terminal so as to be transmitted in real time.
6. The method of claim 5,
Further comprising a first language information storage module for storing a standard language of the first language and dialect information of each region in a database,
Wherein the control module searches the first language information storage module for the presence of a local dialect corresponding to the current location information provided from the first user terminal among the converted character data of the first language, And converting the local dialect into a standard language of the first language and displaying the converted dialect on a screen of the first user terminal.
6. The method of claim 5,
Wherein the control module receives the voice data of the second language from the second user terminal and receives character data of the second language by using the second language voice-to-character conversion module and the second language voice- And a second language translation module for receiving the character data of the second language converted from the second language voice-to-character conversion module and using the second language translation module and the second language translation storage module, Wherein the first language voice-to-character conversion module and the second language voice conversion module provide a service for displaying the translated character data of the first language from the second language translation module on the screen of the second user terminal, Language voice-and-character storage module to convert the voice data into voice data of the first language and to transmit the voice data to the first user terminal in real- Wherein the second local information storage module receives the current location information from the second user terminal and receives at least any one of the local feature information data of at least one of the location- To be transmitted to the first or second user terminal in real time.
8. The method of claim 7,
And a second language information storage module for storing the standard language of the second language and the dialect information of each region in a database,
Wherein the control module searches the second language information storage module for the presence of a local dialect corresponding to the current location information provided from the second user terminal among the converted character data of the second language, If it is found, translating the local dialect into a standard language of a second language and providing a service to be displayed on the screen of the second user terminal.
The method according to claim 1,
Wherein the first and second user terminals comprise a GPS receiving module for receiving latitude, longitude and altitude information using a plurality of Global Positioning System (GPS) satellites to obtain current position information. Information based real time automatic translation and interpretation service system.
A method for providing a location-based real-time automatic translation and interpretation service using a system including a translation / interpretation service providing server connected to a first user terminal and a second user terminal through a communication network,
(a) synchronizing the first and second user terminals with each other using a translation / interpretation related application service, and then setting the first and second languages as different first and second languages;
(b) converting the voice data of the first language transmitted from the first user terminal through the voice recognition service of the translation / interpretation service providing server into character data of the first language;
(c) translating the character data of the first language converted in the step (b) into character data of the second language through the character translation service of the translation / interpretation service providing server, Providing a service to be displayed on a screen;
(d) translating the character data of the second language translated in the step (c) into voice data of the second language through the translation / interpretation service providing server, and transmitting the translated voice data to the second user terminal ; And
based on the current location information transmitted from the first user terminal through the translation / interpretation service providing server, and (e) providing at least one local characteristic information data To the first or second user terminal in real time,
Providing a service to be displayed on the screen of the first user terminal after converting the character data of the first language through the voice recognition service of the translation / interpreter service providing server after the step (b) ,
Further comprising the step of correcting the character data of the first language converted in the step (b) by using the translation / interpretation related application service of the first user terminal and transmitting the modified character data to the translation / interpretation service providing server,
If the local dialect corresponding to the current location information transmitted from the first user terminal exists in the converted character data of the first language through the translation / interpretation service provision server, if the local dialect exists, Is translated into a standard language of a first language and then displayed on the screen of the first user terminal.
delete 11. The method of claim 10,
Converting the voice data of the second language transmitted from the second user terminal through the voice recognition service of the translation / interpretation service providing server into the character data of the second language after the step (a)
Translating the converted character data of the second language into character data of the first language through a character translation service of the translation / interpreter service providing server, and providing the service to display it on the screen of the second user terminal Step,
Translating the translated character data of the first language into voice data of the first language through the translation / interpretation service providing server, and providing the translated service data to the first user terminal in real time;
Based on the current location information transmitted from the second user terminal through the translation / interpretation service providing server, local feature information data of at least one of the location-based area introduction information and the regional franchise point information corresponding to the current location, 1 < / RTI > or 2 < nd > user terminal in real time.
13. The method of claim 12,
Translating the text data into character data of the second language through a speech recognition service of the translation / interpreter service providing server and providing the translated text data to a display unit of the second user terminal;
Further comprising the step of correcting the converted character data of the second language by using the translation / interpretation related application service of the second user terminal and transmitting the corrected character data to the translation / interpretation service providing server,
If the local dialect corresponding to the current location information transmitted from the second user terminal exists in the converted character data of the second language through the translation / interpretation service provision server, if the local dialect exists, To a standard language of a second language and displays the same on a screen of the second user terminal.
11. The method of claim 10,
The method of claim 1, wherein after the step (a), the first and second languages corresponding respectively to the voice data of the first and second languages through the first and second language voice-and-character storage modules of the translation / (DB), and storing the character data in a database
Storing and translating dictionaries and translation information of the respective languages for translation of the first and second languages through the first and second language translation storage modules of the translation / interpretation service providing server;
A first language voice-to-character conversion module of the translation / interpreter service providing server and voice data of a first language transmitted from the first user terminal through the first language voice-character storage module, ,
Converting the character data of the first language converted from the first language voice-to-character conversion module into the character data of the second language through the first language translation module and the first language translation storage module of the translation / interpretation service providing server Translating,
Storing the feature information for each country and region of the first and second languages in a database through the first and second local information storage modules of the translation / interpretation service providing server,
Providing a service for displaying character data of a second language translated from the first language translation module on the screen of the first user terminal through the translation / interpretation service providing server;
The second language voice-to-character conversion module of the translation / interpretation service providing server and the second language voice-character storage module translate the character data of the second language translated from the first language translation module to the voice of the second language Converting the data into data, and providing the service to the second user terminal in real time;
Based on the current location information transmitted from the first user terminal through the translation / interpretation service providing server, at least one of the location-based area introduction information and the regional merchant information corresponding to the current location stored in the first area information storage module Further comprising the step of providing a service to transmit one local characteristic information data to the first or second user terminal in real time.
15. The method of claim 14,
Storing the standard language and dialect information of the first language in a database through a first language information storage module of the translation / interpretation service providing server,
The translation / interpretation service providing server searches the character data of the converted first language using the first language information storage module to see if there is a local dialect corresponding to the current location information transmitted from the first user terminal If the local dialect exists, translating the local dialect into a standard language of the first language and providing the service to be displayed on the screen of the first user terminal. Automatic translation and interpretation service method.
15. The method of claim 14,
The second language voice-to-character conversion module of the translation / interpretation service providing server and the voice data of the second language transmitted from the second user terminal through the second language voice-character storage module, Data;
Converting the character data of the second language converted from the second language voice-to-character conversion module into character data of the first language through the second language translation module and the second language translation storage module of the translation / interpretation service providing server Translating,
Providing a service for displaying character data of a first language translated from the second language translation module on the screen of the second user terminal through the translation / interpretation service providing server;
A first language voice-to-character conversion module of the translation / interpreter service providing server and character data of a first language translated from the second language translation module through the first language voice-character storage module, Converting the data into data and providing the service to the first user terminal in real time;
Based on the current location information transmitted from the second user terminal through the translation / interpretation service providing server, at least one of the location-based area introduction information and the regional merchant information corresponding to the current location stored in the second area information storage module Providing a service to transmit one local characteristic information data to the first or second user terminal in real time;
Translating the standard language and dialect information of the second language into a database through a second language information storage module of the translation / interpretation service providing server;
And searches for a local dialect corresponding to the current location information transmitted from the second user terminal among the character data of the converted second language using the second language information storage module through the translation / interpretation service provision server If the local dialect exists, translating the local dialect into a standard language of a second language and providing the service to be displayed on the screen of the second user terminal. Automatic translation and interpretation service method.

Images