KR102642456B1 - Method and system for call content storage service/call translation service based on intelligent network - Google Patents

Abstract

An intelligent network-based call content storage service/call translation service method and system are disclosed. The call content storage service method includes: upon receiving an outgoing signal from a caller terminal, requesting recipient information from the caller terminal; requesting a call from the called party terminal using the called party information received from the calling party terminal; When the called terminal accepts the call request, relaying a two-way call between the calling terminal and the called terminal; It may include the step of distinguishing call content received from the sender terminal and call content received from the recipient terminal and storing them in a call recording system along with a time stamp.

Description

Intelligent network-based call content storage service/call translation service method and system {METHOD AND SYSTEM FOR CALL CONTENT STORAGE SERVICE/CALL TRANSLATION SERVICE BASED ON INTELLIGENT NETWORK}

The present invention relates to an intelligent network-based call content storage service/call translation service method and system. More specifically, a method of storing call content while relaying a call between a caller and a recipient, translating the call content, and delivering it to the other party; It's about the system.

Call content storage applications are being developed to confirm call content and secure data.

However, the conventional call content storage application had the inconvenience of having to install the call content storage application on at least one of the caller's calling terminal or the recipient's terminal in order to save the call content.

In addition, since the call content is being recorded on either the sender's terminal or the recipient's terminal, there was a limitation in that when the call content was converted into text for easy identification of the call content, it was difficult to identify the speaker who spoke the call content from the text. .

Accordingly, there is a demand for a call content storage service that facilitates speaker identification and search.

The present invention provides a call content storage service that facilitates speaker identification and search by relaying a two-way call between a sender terminal and a recipient terminal and separately storing the call content received from the sender terminal and the call content received from the recipient terminal. Provides a method and system for doing so.

The present invention relays a two-way call between a caller's terminal and a recipient's terminal, translates the caller's call content received from the caller's terminal into the recipient's language used by the recipient, transmits it to the recipient's terminal, and transmits the caller's call content received from the caller's terminal. Provided is a method and system for providing a real-time call translation service between a caller and a receiver who use different languages by translating into the caller's language used by the caller and transmitting it to the caller's terminal.

A call content storage service method according to an embodiment of the present invention includes the steps of: upon receiving an outgoing signal from a caller terminal, requesting recipient information from the caller terminal; requesting a call from the called party terminal using the called party information received from the calling party terminal; When the called terminal accepts the call request, relaying a two-way call between the calling terminal and the called terminal; It may include the step of distinguishing call content received from the sender terminal and call content received from the recipient terminal and storing them in a call recording system along with a time stamp. The step of relaying the two-way call in the call content storage service method according to an embodiment of the present invention includes receiving the IP address of the recipient terminal from the recipient terminal; Requesting a call from the caller terminal; Receiving the IP address of the sender terminal from the sender terminal; And transmitting the call content received from the caller terminal to the caller terminal using the IP address of the caller terminal, and transmitting the call content received from the caller terminal to the caller terminal using the IP address of the caller terminal. May include steps.

The call recording system of the call content storage service method according to an embodiment of the present invention converts the call content received from the caller terminal and the call content received from the called party terminal into text, and sends caller information, recipient information, and text. The converted call contents can be transmitted to the call contents server.

The call content server of the call content storage service method according to an embodiment of the present invention matches the call content received from the caller terminal among the call content converted to text with caller information, and matches the call content received from the caller terminal with caller information. The content of the call can be matched with the recipient's information and converted to MMS (Multimedia Messaging Service) or the web, and the converted information can be transmitted to the sender's terminal.

The step of requesting the recipient information in the call content storage service method according to an embodiment of the present invention requests language information used by the caller and the recipient, and the step of relaying the two-way call is based on the language information. The call content of the caller can be translated into the recipient's language used by the recipient and transmitted to the recipient's terminal, and the recipient's call content can be translated into the caller's language used by the sender and transmitted to the sender's terminal.

The step of relaying the two-way call in the call content storage service method according to an embodiment of the present invention includes receiving call content pronounced in the caller's language from the caller terminal; Converting the content of the call pronounced in the caller's language into text; translating the text into the recipient language; converting the text translated into the recipient's language into voice to generate call content pronounced in the recipient's language; And it may include transmitting the call content pronounced in the recipient's language to the recipient's terminal.

The step of relaying the two-way call in the call content storage service method according to an embodiment of the present invention includes receiving call content pronounced in the recipient's language from the recipient terminal; Converting the content of the call pronounced in the recipient's language into text; translating the text into the sender's language; converting the text translated into the caller's language into voice to generate call content pronounced in the caller's language; And it may include transmitting the call content pronounced in the caller's language to the caller's terminal.

A call translation service method according to an embodiment of the present invention includes the steps of, upon receiving an outgoing signal from a caller terminal, requesting caller information and language information used by the caller and receiver respectively from the caller terminal; Requesting a call from a called party terminal using the called party information received from the calling party terminal; When the recipient terminal accepts the call request, it includes relaying a two-way call between the caller terminal and the recipient terminal, and relaying the two-way call includes transmitting the call content of the caller to the recipient based on the language information. It can be translated into the recipient's language used and transmitted to the recipient's terminal, and the recipient's call content can be translated into the sender's language used by the sender and transmitted to the sender's terminal.

The call translation service method according to an embodiment of the present invention includes the steps of distinguishing the call content of the caller received from the caller terminal and the call content of the recipient received from the caller terminal and storing them in a translation storage server along with a time stamp. may further include.

The translation storage server of the call translation service method according to an embodiment of the present invention stores at least one of the call content of the caller pronounced in the caller's language and the call content of the caller translated into the recipient's language. Matches caller information, and converts at least one of the call content of the recipient pronounced in the recipient's language and the content of the call translated into the caller's language into MMS or web by matching the content of the call with the recipient information. Information can be transmitted to the sender's terminal.

The step of relaying the two-way call in the call translation service method according to an embodiment of the present invention includes receiving call content pronounced in the caller's language from the caller terminal; Converting the content of the call pronounced in the caller's language into text; translating the text into the recipient language; converting the text translated into the recipient's language into voice to generate call content pronounced in the recipient's language; And it may include transmitting the call content pronounced in the recipient's language to the recipient's terminal.

The step of relaying the two-way call in the call translation service method according to an embodiment of the present invention includes receiving call content pronounced in the recipient's language from the recipient terminal; Converting the content of the call pronounced in the recipient's language into text; translating the text into the sender's language; converting the text translated into the caller's language into voice to generate call content pronounced in the caller's language; And it may include transmitting the call content pronounced in the caller's language to the caller's terminal.

When the call content storage service system according to an embodiment of the present invention receives an outgoing signal from a caller terminal, it requests caller information from the caller terminal, and requests a call to the caller terminal using the callee information received from the caller terminal. And, when the called terminal accepts the call request, a call relay system that relays a two-way call between the calling terminal and the called terminal; And it may include a call recording system that separates call content received from the sender terminal and call content received from the recipient terminal and stores them with a time stamp.

The call recording system of the call content storage service system according to an embodiment of the present invention converts call content received from the sender terminal and call content received from the recipient terminal into text, sender information, recipient information, and text. The converted call contents can be transmitted to the call contents server.

The call content server of the call content storage service system according to an embodiment of the present invention matches the call content received from the caller terminal among the call content converted to text with caller information, and matches the call content received from the caller terminal with caller information. The content of the call can be matched with the recipient's information and converted to MMS (Multimedia Messaging Service) or the web, and the converted information can be transmitted to the sender's terminal.

When a call translation service system according to an embodiment of the present invention receives an outgoing signal from a caller terminal, it requests the caller terminal for recipient information and language information used by the caller and the recipient, respectively, and calls the caller information received from the caller terminal. Requesting a call from a called party using a call terminal, and when the called party accepts the call request, comprising a translation brokerage system that relays a two-way call between the caller terminal and the called party terminal, wherein the translation brokerage system includes the language Based on the information, the call content of the caller can be translated into the recipient's language used by the recipient and transmitted to the recipient's terminal, and the recipient's call content can be translated into the caller's language used by the sender and transmitted to the sender's terminal.

The call translation service system according to an embodiment of the present invention further includes a translation storage server that distinguishes the call content of the caller received from the caller terminal and the call content of the recipient received from the caller terminal and stores them with a time stamp. It can be included.

The translation storage server of the call translation service system according to an embodiment of the present invention stores at least one of the call content of the caller pronounced in the caller's language and the call content of the caller translated into the recipient's language. Matches caller information, and converts at least one of the call content of the recipient pronounced in the recipient's language and the content of the call translated into the caller's language into MMS or web by matching the content of the call with the recipient information. Information can be transmitted to the sender's terminal.

The translation brokerage system of the call translation service system according to an embodiment of the present invention receives call content pronounced in the caller's language from the caller terminal, converts the call content pronounced in the caller's language into text, and converts the call content pronounced in the caller's language into text. is translated into the recipient's language, the text translated into the recipient's language is converted into voice, the call content pronounced in the recipient's language is generated, and the call content pronounced in the recipient's language can be transmitted to the recipient's terminal.

The translation brokerage system of the call translation service system according to an embodiment of the present invention receives call content pronounced in the recipient language from the recipient terminal, converts the call content pronounced in the recipient language into text, and converts the call content pronounced in the recipient language into text. is translated into the caller's language, the text translated into the caller's language is converted into voice, the call content pronounced in the caller's language is generated, and the call content pronounced in the caller's language can be transmitted to the caller's terminal.

According to an embodiment of the present invention, by relaying a two-way call between a sender terminal and a recipient terminal and separately storing the call content received from the sender terminal and the call content received from the recipient terminal, speaker identification and search are easy. A call content storage service can be provided.

According to an embodiment of the present invention, a two-way call between a caller terminal and a callee terminal is relayed, the caller's call content received from the caller terminal is translated into the caller's language used by the callee, transmitted to the callee terminal, and received from the caller terminal. By translating the content of a call from one recipient into the caller's language used by the caller and transmitting it to the caller's terminal, it is possible to provide a real-time call translation service between callers and recipients who use different languages.

1 is a diagram illustrating a service system according to an embodiment of the present invention.
Figure 2 is a diagram illustrating a call content storage service of a service system according to an embodiment of the present invention.
Figure 3 is a diagram showing a process for providing a call content storage service according to an embodiment of the present invention.
Figure 4 is a diagram illustrating a process of delivering stored call contents to a caller according to an embodiment of the present invention.
Figure 5 is a diagram illustrating a call translation service of a service system according to an embodiment of the present invention.
Figure 6 is a diagram showing the process of providing a currency translation service according to an embodiment of the present invention.
Figure 7 is a diagram illustrating the process of translating and transmitting the caller's call content into the recipient's language according to an embodiment of the present invention.
Figure 8 is a diagram illustrating the process of translating and transmitting the recipient's call content into the sender's language according to an embodiment of the present invention.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. However, various changes can be made to the embodiments, so the scope of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents, or substitutes for the embodiments are included in the scope of rights.

The terms used in the examples are for descriptive purposes only and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

In addition, when describing with reference to the accompanying drawings, identical components will be assigned the same reference numerals regardless of the reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiments, if it is determined that detailed descriptions of related known technologies may unnecessarily obscure the gist of the embodiments, the detailed descriptions are omitted.

Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

1 is a diagram illustrating a service system according to an embodiment of the present invention.

As shown in FIG. 1, the service system according to an embodiment of the present invention includes a mediation system 110, a call recording system 120, an STT server 130, a call content server 140, and a translation storage server 150. , translation server 160, and TTS server 170.

The relay system 110 can relay a two-way call between the caller's calling terminal 101 and the called party's called terminal 102. In addition, the relay system 110 can distinguish the call content received from the sender terminal 101 and the call content received from the recipient terminal 102 and store them in the call recording system 120 along with a time stamp. At this time, the caller may be a subscriber who has subscribed to a call content storage service or a call translation service.

The call recording system 120 may transmit the call content received from the relay system 110 to the STT server 130 to convert it into text, and transmit the call content converted to text to the call content server 140.

The STT server 130 can use a voice recognition function to recognize the voice included in the call content and perform a Speech-to-Text (STT) operation to convert the content of the recognized voice into text.

The call content server 140 matches the call content received from the sender terminal 101 with the caller information among the call content converted to text, and matches the call content received from the recipient terminal 101 with the recipient information to send MMS (MMS). Multimedia Messaging Service), or can be converted to the web. For example, the call content server 140 may generate an MMS or a web composed of a format such as “Sender: call content of the sender, recipient: content of the callee.” And, the call content server 140 can transmit the converted information to the caller terminal 101.

When providing a call translation service, the relay system 110 may request language information used by the caller and receiver from the caller terminal 101, respectively. And, based on the language information, the relay system 110 uses the STT server 130, translation server 160, and TTS server 170 to translate the caller's call content into the recipient's language used by the recipient and transmits it to the recipient's terminal. It can be transmitted to (102), and the recipient's call content can be translated into the sender's language used by the sender and transmitted to the sender's terminal (101). In addition, the relay system 110 can distinguish between the call content of the sender received from the sender terminal 101 and the content of the recipient's call received from the receiver terminal 102 and store them in the translation storage server 150 along with a time stamp. .

The translation storage server 150 includes caller information, recipient information, call content of the caller pronounced in the caller's language, call content translated from the caller's call content into the recipient's language, content of the caller's call pronounced in the recipient's language, and content of the caller's call. At least one of the call contents translated into the caller's language may be transmitted to the call contents server 140. At this time, among the received call contents, the call content server 140 matches the call content of the caller pronounced in the caller's language or the content of the call translated into the recipient's language with the caller information, and pronounces the content of the call in the recipient's language. The recipient's call content, or the call content translated into the sender's language, can be converted to MMS or the web by matching it with the recipient's information. And, the call content server 140 can transmit the converted information to the caller terminal 101.

The translation server 160 may include a function to translate sentences included in the text into another language. At this time, the translation server 160 may translate the call content written in the text in the sender's language into the recipient's language and generate a text translated into the recipient's language. Additionally, the translation server 160 may translate the call content written in the text in the recipient's language into the sender's language to generate text translated into the sender's language. And, the translation server 160 may reply with a text translated into the recipient's language and a text translated into the sender's language.

Additionally, the translation server 160 may further include a voice recognition function and a voice generation function along with a translation function. At this time, the service system does not include the STT server 130 and the TTS server 170, and in this specification, the transmission and reception operations to the STT server 130 and the TTS server 170 are targeted to the translation server 160. You can change it. At this time, the translation server 160 may receive call content pronounced in the caller's language, translate the call content pronounced in the caller's language into call content pronounced in the recipient's language, and reply. Additionally, the translation server 160 may receive call content pronounced in the recipient's language, translate the call content pronounced in the recipient's language into call content pronounced in the caller's language, and reply.

The TTS server 170 can convert sentences included in text into speech using a speech synthesis function (TTS: Text to Speech). Specifically, the TTS server 170 may convert the text translated into the recipient's language by the translation server 160 into voice and generate call content pronounced in the recipient's language. Additionally, the TTS server 170 can convert text translated into the caller's language into voice and generate call content pronounced in the caller's language.

The service system according to an embodiment of the present invention relays a two-way call between the sender terminal 101 and the receiver terminal 102, and records the call contents received from the sender terminal 101 and the call contents received from the receiver terminal 102. By distinguishing and storing, it is possible to provide a call content storage service that facilitates speaker identification and search.

The service system according to an embodiment of the present invention relays a two-way call between the sender terminal 101 and the receiver terminal 102, and translates the sender's call content received from the sender terminal 101 into the receiver's language used by the receiver. and transmits it to the receiver terminal 102, and translates the receiver's call content received from the receiver terminal 102 into the sender's language used by the sender and transmits it to the sender terminal 101, so that the sender and receiver who use different languages It can provide real-time call translation services between users.

Figure 2 is a diagram illustrating a call content storage service of a service system according to an embodiment of the present invention.

If an operator wishes to provide only a call content storage service, the call content storage service can be provided using a system as shown in FIG. 2 using some of the components shown in FIG. 1. The call brokerage system 200 of FIG. 2 may have the same configuration as the brokerage system 110 of FIG. 1, or may be a system in which protocols or functions related to call translation services are omitted from the brokerage system 110.

When the call brokerage system 200 receives an outgoing signal from the caller terminal 101, it can request recipient information from the caller terminal 101. Additionally, the call brokerage system 200 may request a call from the called party terminal 102 using the called party information received from the calling party terminal 101. When the called terminal 102 accepts the call request, the call brokerage system 200 can relay a two-way call between the calling terminal 101 and the called terminal 102.

At this time, the call brokerage system 200 receives the IP address (ip-2) of the called terminal from the called terminal 102 and initiates a call between the call brokered system 200 and the called terminal 102 (ip-2<->ip). -c) can be connected. Next, the call brokerage system 200 may request a call from the caller terminal 101 and receive the IP address (ip-1) of the caller terminal from the caller terminal 101. At this time, the call brokerage system 200 may connect a call (ip-1<->ip-c) between the call brokerage system 200 and the caller terminal 101. Next, the call brokerage system 200 transmits the call content received from the caller terminal 101 through the call (ip-1<->ip-c) through the call (ip-2<->ip-c). Transmitted to the recipient terminal 102, and the call content received from the recipient terminal 102 through the call (ip-2<-> ip-c) is sent to the sender terminal through the call (ip-1<->ip-c) It can be sent to (101).

Additionally, the call brokerage system 200 can distinguish the call content received from the caller terminal 101 and the call content received from the recipient terminal 102 and store them in the call recording system 120 along with a time stamp.

The call recording system 120 can transmit the call content received from the sender terminal 101 and the call content received from the recipient terminal 102 to the STT server 130 and convert them into text. Additionally, the call recording system 120 may transmit caller information, recipient information, and call contents converted into text to the call contents server 140.

Among the call contents converted to text, the call content server 130 matches the call content received from the sender terminal 101 with the caller information, and matches the call content received from the recipient terminal 102 with the recipient information to send MMS, Alternatively, it can be converted to the web and the converted information can be transmitted to the sender terminal 101.

Figure 3 is a diagram showing a process for providing a call content storage service according to an embodiment of the present invention.

In step 310, the caller terminal 101 may transmit an outgoing signal to the call brokerage system 200 requesting a call content storage service.

In step 320, the call brokerage system 200 may request recipient information from the caller terminal 101. For example, the recipient information may be the number of the recipient terminal 102.

In step 325, the call brokerage system 200 may receive recipient information from the caller terminal 101.

In step 330, the call brokerage system 200 may request a call from the recipient terminal 102 using the recipient information received in step 325. And, when the recipient accepts the call request through the recipient terminal 102, the call brokerage system 200 may perform step 335. If the called party does not accept the call request, the call brokerage system 200 may deliver a message to the calling party terminal 101 that the called party has rejected the call and end the operation.

In step 335, the call brokerage system 200 may receive the IP address (ip-2) of the called terminal from the called terminal 102. At this time, the call brokerage system 200 may connect a call (ip-2<->ip-c) 352 between the call brokerage system 200 and the recipient terminal 102.

In step 340, the call brokerage system 200 may request a call from the caller terminal 101.

In step 345, the call brokerage system 200 may receive the IP address (ip-1) of the caller terminal from the caller terminal 101. At this time, the call brokerage system 200 may connect the call (ip-1<->ip-c) 351 between the call brokerage system 200 and the caller terminal 101.

In step 350, the call brokerage system 200 uses the call (ip-1<->ip-c) 351 and the call (ip-2<->ip-c) 352 to call the caller terminal 101. ) and the recipient terminal 102 can relay a two-way call. At this time, the call brokerage system 200 transfers the call content received from the caller terminal 101 through the call (ip-1<->ip-c) 351 to the call (ip-2<->ip-c)( 352), and sends the call content received from the recipient terminal 102 through call (ip-2<-> ip-c) 352 to call (ip-1<->ip). -c) It can be transmitted to the sender terminal (101) through (351).

In step 360, the call brokerage system 200 can distinguish the call content received from the caller terminal 101 and the call content received from the recipient terminal 102 and transmit them to the call recording system 120 along with a time stamp. .

In step 370, the call recording system 120 may store and manage the information received in step 360.

In step 380, when the call between the caller and the recipient is terminated, the call brokerage system 200 terminates the two-way call relay between the caller terminal 101 and the recipient terminal 102, and may also terminate call content storage. .

Figure 4 is a diagram illustrating a process of delivering stored call contents to a caller according to an embodiment of the present invention. At this time, FIG. 4 may be a detailed operation of step 370 of FIG. 3 or an operation performed after step 380.

In step 410, the call recording system 120 transmits the call content received from the sender terminal 101 and the call content received from the recipient terminal 102 to the STT server 130 and may request conversion to text. .

In step 420, the STT server 130 may convert the call content into text according to the request in step 410 and generate call content text including the call content. And, the STT server 130 may transmit the call content text to the call recording system 120.

In step 430, the call recording system 120 may transmit caller information, recipient information, and call content text to the call content server 140.

In step 440, the call content server 140 may store the information received in step 430. In addition, the call content server 140 matches the call content received from the caller terminal 101 with the caller information among the call content included in the call content text, and matches the call content received from the recipient terminal 102 with the caller information. It can be converted to MMS or web by matching.

In step 450, the call content server 140 may transmit the information converted in step 450 to the caller terminal 101.

In step 460, the sender terminal 101 stores the information received in step 450 and provides it to the sender according to the caller's request. At this time, the subscriber can check the call content through MMS or web-converted information and search for a desired word or section in the call content.

Figure 5 is a diagram illustrating a call translation service of a service system according to an embodiment of the present invention.

If an operator wishes to provide only a call translation service, the call translation service can be provided using a system as shown in FIG. 5 using some of the configurations shown in FIG. 1. Additionally, the translation intermediary system 500 of FIG. 5 may have the same configuration as the intermediary system 110 of FIG. 1, or may be a system in which protocols or functions related to the call content storage service are omitted from the intermediary system 110.

When the translation brokerage system 500 receives an outgoing signal from the sender terminal 101, it can request recipient information and language information used by the sender and receiver respectively from the sender terminal 101. Additionally, the translation brokerage system 500 may request a call from the recipient terminal 102 using the recipient information received from the sender terminal 101.

If the recipient terminal 102 accepts the call request, the translation brokerage system 500 may relay a two-way call between the sender terminal 101 and the recipient terminal 102.

At this time, the translation brokerage system 500 translates the call content of the caller into the recipient's language used by the recipient based on the language information and transmits it to the recipient terminal 102, and translates the content of the caller's call into the caller's language used by the caller. This can be transmitted to the sender terminal 101.

Specifically, when receiving call content pronounced in the caller's language from the caller terminal 101, the translation brokerage system 500 requests the STT server 130 to convert the call content pronounced in the caller's language into call content text. You can. Next, the translation brokerage system 500 may request the translation server 160 to translate the content of the call content text into the recipient's language. Next, the translation brokerage system 500 may request the TTS server 170 to convert the text translated into the recipient's language into speech. At this time, the TTS server 170 may convert the text translated into the recipient's language into voice and generate call content pronounced in the recipient's language. Additionally, the TTS server 170 may transmit the content of the call pronounced in the recipient's language to the translation brokerage system 500. Finally, the translation brokerage system 500 can transmit the call content pronounced in the recipient's language to the recipient terminal 102.

In addition, when receiving call content pronounced in the recipient's language from the recipient terminal 102, the translation brokerage system 500 may request the STT server 130 to convert the call content pronounced in the recipient language into call content text. there is. Next, the translation brokerage system 500 may request the translation server 160 to translate the content of the call content text into the caller's language. Next, the translation brokerage system 500 may request the TTS server 170 to convert the text translated into the sender's language into voice. At this time, the TTS server 170 may convert the text translated into the caller's language into voice and generate call content pronounced in the caller's language. Additionally, the TTS server 170 may transmit the content of the call pronounced in the caller's language to the translation brokerage system 500. Finally, the translation brokerage system 500 can transmit the call content pronounced in the caller's language to the caller terminal 101.

In addition, the translation brokerage system 500 can distinguish the call content of the sender received from the sender terminal 101 and the content of the call of the recipient received from the receiver terminal 102 and store them in the translation storage server 150 along with a time stamp. there is. At this time, the translation brokerage system 500 includes caller information, recipient information, call content of the caller pronounced in the caller's language, call content translated from the caller's call content into the recipient's language, content of the caller's call pronounced in the recipient's language, and call content of the caller pronounced in the caller's language. At least one of the call contents translated into the caller's language may be transmitted to the translation storage server 150.

In addition, the translation storage server 150 matches at least one of the call content of the caller pronounced in the caller's language and the content of the call translated into the language of the recipient with the caller information, and the content of the call of the caller pronounced in the language of the recipient. At least one of the content, the call content translated into the sender's language, can be converted to MMS or the web by matching it with the recipient information. And, the translation storage server 150 can transmit the converted information to the sender terminal 101.

Figure 6 is a diagram showing the process of providing a currency translation service according to an embodiment of the present invention.

In step 610, the caller terminal 101 may transmit an outgoing signal requesting a call content storage service to the translation brokerage system 500.

In step 620, the translation brokerage system 500 may request recipient information and language information used by the sender and recipient from the sender terminal 101.

In step 625, the translation brokerage system 500 may receive recipient information and language information used by the sender and recipient, respectively, from the sender terminal 101. For example, the sender language used by the sender may be Korean, and the receiver language used by the receiver may be English.

In step 630, the translation brokerage system 500 may request a call from the recipient terminal 102 using the recipient information received in step 625. And, when the recipient accepts the call request through the recipient terminal 102, the translation brokerage system 500 may perform step 635. If the recipient does not accept the call request, the translation brokerage system 500 may deliver a message to the sender terminal 101 that the recipient rejected the call and end the operation.

In step 635, the translation brokerage system 500 may receive the IP address (ip-2) of the recipient terminal from the recipient terminal 102. At this time, the translation brokerage system 500 may connect a call (ip-2<->ip-c) 652 between the translation brokerage system 500 and the recipient terminal 102.

In step 640, the translation brokerage system 500 may request a call from the caller terminal 101.

In step 645, the translation brokerage system 500 may receive the IP address (ip-1) of the sender terminal from the sender terminal 101. At this time, the translation brokerage system 500 may connect a call (ip-1<->ip-c) 651 between the translation brokerage system 500 and the sender terminal 101.

In step 650, the translation brokerage system 500 uses the call (ip-1<->ip-c) 651 and the call (ip-2<->ip-c) 652 to communicate with the sender terminal 101. ) and the recipient terminal 102 can relay a two-way call. At this time, the translation brokerage system 500 converts the call content (Korean) received from the sender terminal 101 through the call (ip-1<->ip-c) 651 into the recipient's language (English) used by the recipient. After translation, it can be transmitted to the recipient terminal 102 through the call (ip-2<->ip-c) 652. In addition, the translation brokerage system 500 converts the call content (English) received from the recipient terminal 102 through the call (ip-2<->ip-c) 652 into the caller's language (Korean) used by the caller. After translation, it can be transmitted to the sender terminal 101 through the call (ip-1<->ip-c) 651.

In step 660, the translation brokerage system 500 may distinguish the call content received from the sender terminal 101 and the call content received from the recipient terminal 102 and transmit them to the translation storage server 150 along with a time stamp. .

In step 670, the translation storage server 150 may store and manage the information received in step 660. For example, the translation storage server 150 matches the call content (Korean) of the caller pronounced in the caller's language with the caller information, and matches the content of the call (Korean) translated into the caller's language with the callee information. You can create and manage call content in one caller's language (Korean). In addition, the translation storage server 150 matches the call content (English) translated into the recipient's language with the caller information, and matches the recipient's call content (English) pronounced in the recipient's language with the recipient information. You can create and manage language (English) call content. Then, the translation storage server 150 matches both the call content of the caller pronounced in the caller's language (Korean) and the content of the call translated into the callee's language (English) with the caller information, and pronounces the content in the caller's language. By matching one recipient's call content (English) and the call content translated into the caller's language (Korean) with the recipient's information, a call content containing both the sender's language (Korean) and the recipient's language (English) is created. You can also manage it.

In step 680, when the call between the sender and the receiver is terminated, the translation brokerage system 500 terminates the two-way call relay between the sender terminal 101 and the receiver terminal 102, and may also end storage of the call content. .

Figure 7 is a diagram illustrating the process of translating and transmitting the caller's call content into the recipient's language according to an embodiment of the present invention. Steps 710 to 760 of FIG. 7 may be included in step 650 of FIG. 6 .

In step 710, the translation brokerage system 500 may receive the call content (Korean) pronounced in the caller's language from the caller terminal 101. At this time, depending on the embodiment, the translation brokerage system 500 may perform step 715.

In step 715, the translation brokerage system 500 may transmit the call content (Korean) pronounced in the caller's language to the recipient terminal 102 without translation.

In step 720, the translation brokerage system 500 may request the STT server 130 to convert the call content (Korean) pronounced in the caller's language into text.

In step 725, the STT server 130 may convert the call content (Korean) pronounced in the caller's language into call content text (Korean) upon request. Additionally, the STT server 130 may transmit the call content text (Korean) to the translation brokerage system 500.

In step 730, the translation brokerage system 500 may request the translation server 160 to translate the content of the call content text (Korean) into the recipient's language.

In step 735, the translation server 160 may translate the content of the call content text (Korean) into the recipient's language (English) and generate a text (English) translated into the recipient's language. Additionally, the translation server 160 may transmit the text (English) translated into the recipient's language to the translation brokerage system 500.

In step 740, the translation brokerage system 500 may request the TTS server 170 to convert the text (English) translated into the recipient's language into voice.

In step 745, the TTS server 170 may convert text (English) translated into the recipient's language into voice and generate call content (English) pronounced in the recipient's language. Additionally, the TTS server 170 may transmit the content of the call (English) pronounced in the recipient's language to the translation brokerage system 500.

In step 750, the translation brokerage system 500 may store the call content pronounced in the caller's language (Korean) and the call content pronounced in the recipient's language (English).

In step 760, the translation brokerage system 500 may transmit the call content (English) pronounced in the recipient's language to the recipient terminal 102.

Figure 8 is a diagram illustrating the process of translating and transmitting the recipient's call content into the sender's language according to an embodiment of the present invention. Steps 810 to 860 of FIG. 8 may be included in step 650 of FIG. 6 .

In step 810, the translation brokerage system 500 may receive the call content (English) pronounced in the recipient's language from the recipient terminal 102. At this time, depending on the embodiment, the translation brokerage system 500 may perform step 815.

In step 815, the translation brokerage system 500 may transmit the call content (English) pronounced in the recipient's language to the sender terminal 101 without translation.

In step 820, the translation brokerage system 500 may request the STT server 130 to convert the call content (English) pronounced in the recipient's language into text.

In step 825, the STT server 130 may convert the call content (English) pronounced in the recipient's language into call content text (English) upon request. Additionally, the STT server 130 may transmit the call content text (English) to the translation brokerage system 500.

In step 830, the translation brokerage system 500 may request the translation server 160 to translate the content of the call content text (English) into the caller's language.

In step 835, the translation server 160 may translate the content of the call content text (English) into the caller's language (Korean) and generate a text (Korean) translated into the caller's language. Additionally, the translation server 160 may transmit the text (Korean) translated into the sender's language to the translation brokerage system 500.

In step 840, the translation brokerage system 500 may request the TTS server 170 to convert the text (Korean) translated into the sender's language into voice.

In step 845, the TTS server 170 may convert the text (Korean) translated into the caller's language into voice and generate call content (Korean) pronounced in the caller's language. Additionally, the TTS server 170 may transmit the content of the call (Korean) pronounced in the caller's language to the translation brokerage system 500.

In step 850, the translation brokerage system 500 may store the call content pronounced in the recipient's language (English) and the call content pronounced in the caller's language (Korean).

In step 860, the translation brokerage system 500 may transmit the call content (Korean) pronounced in the caller's language to the caller terminal 101.

The present invention relays a two-way call between the sender terminal 101 and the receiver terminal 102, and separately stores the call contents received from the sender terminal 101 and the call contents received from the receiver terminal 102, thereby A call content storage service that is easy to identify and search can be provided.

The present invention relays a two-way call between the sender terminal 101 and the receiver terminal 102, translates the sender's call content received from the sender terminal 101 into the receiver's language used by the receiver, and transmits it to the receiver terminal 102. And, by translating the recipient's call content received from the recipient terminal 102 into the caller's language used by the caller and transmitting it to the caller terminal 101, it is possible to provide a real-time call translation service between the caller and the recipient who use different languages. You can.

Meanwhile, the service system or service method according to the present invention is written as a program that can be executed on a computer and can be implemented in various recording media such as magnetic storage media, optical read media, and digital storage media.

Implementations of the various techniques described herein may be implemented in digital electronic circuitry, or in computer hardware, firmware, software, or combinations thereof. Implementations may include a computer program product, e.g., a machine-readable storage device, for processing by or controlling the operation of a data processing device, e.g., a programmable processor, a computer, or multiple computers. It can be implemented as a tangibly embodied computer program in an available medium). Computer programs, such as the computer program(s) described above, may be written in any form of programming language, including compiled or interpreted languages, and may be written as a stand-alone program or as a module, component, subroutine, or part of a computing environment. It can be deployed in any form, including as other units suitable for use. The computer program may be deployed for processing on one computer or multiple computers at one site or distributed across multiple sites and interconnected by a communications network.

Processors suitable for processing computer programs include, by way of example, both general-purpose and special-purpose microprocessors, and any one or more processors of any type of digital computer. Typically, a processor will receive instructions and data from read-only memory or random access memory, or both. Elements of a computer may include at least one processor that executes instructions and one or more memory devices that store instructions and data. Generally, a computer may include one or more mass storage devices that store data, such as magnetic, magneto-optical disks, or optical disks, receive data from, transmit data to, or both. It can also be combined to make . Information carriers suitable for embodying computer program instructions and data include, for example, semiconductor memory devices, magnetic media such as hard disks, floppy disks, and magnetic tapes, and Compact Disk Read Only Memory (CD-ROM). ), optical media such as DVD (Digital Video Disk), magneto-optical media such as Floptical Disk, ROM (Read Only Memory), RAM , Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). The processor and memory may be supplemented by or included in special purpose logic circuitry.

Additionally, computer-readable media may be any available media that can be accessed by a computer, and may include both computer storage media.

Although this specification contains details of numerous specific implementations, these should not be construed as limitations on the scope of any invention or what may be claimed, but rather as descriptions of features that may be unique to particular embodiments of particular inventions. It must be understood. Certain features described herein in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination. Furthermore, although features may be described as operating in a particular combination and initially claimed as such, one or more features from a claimed combination may in some cases be excluded from that combination, and the claimed combination may be a sub-combination. It can be changed to a variant of a sub-combination.

Likewise, although operations are depicted in the drawings in a particular order, this should not be construed as requiring that those operations be performed in the specific order or sequential order shown or that all of the depicted operations must be performed to obtain desirable results. In certain cases, multitasking and parallel processing may be advantageous. Additionally, the separation of various device components in the above-described embodiments should not be construed as requiring such separation in all embodiments, and the described program components and devices may generally be integrated together into a single software product or packaged into multiple software products. You must understand that it is possible.

Meanwhile, the embodiments of the present invention disclosed in the specification and drawings are merely provided as specific examples to aid understanding, and are not intended to limit the scope of the present invention. It is obvious to those skilled in the art that in addition to the embodiments disclosed herein, other modifications based on the technical idea of the present invention can be implemented.

110: Brokerage system
120: Call recording system
130: STT server
140: Call content server
150: Translation storage server
160: Translation server
170: TTS server

Claims (20)

Upon receiving an outgoing signal from a sender terminal, requesting recipient information and language information used by the sender and receiver respectively from the sender terminal;
Requesting a call from a called party terminal using the called party information received from the calling party terminal;
When the recipient terminal accepts the call request, the call content of the caller is translated into the recipient language used by the recipient based on the language information and transmitted to the recipient terminal, and the recipient's call content is translated into the caller language used by the sender. transmitting the message to a sender terminal to relay a two-way call between the sender terminal and the receiver terminal;
Separating the call content received from the sender terminal and the call content received from the recipient terminal and storing them in a call recording system along with a time stamp
The step of relaying the two-way call is,
Receiving call content pronounced in the caller's language from the caller terminal;
Converting the content of the call pronounced in the caller's language into text;
translating the text into the recipient language;
converting the text translated into the recipient's language into voice to generate call content pronounced in the recipient's language;
Transmitting the call content pronounced in the recipient's language to the recipient's terminal;
Receiving call content pronounced in the recipient's language from the recipient terminal;
Converting the content of the call pronounced in the recipient's language into text;
translating the text into the sender's language;
converting the text translated into the caller's language into voice to generate call content pronounced in the caller's language; and
Step of transmitting the call content pronounced in the caller's language to the caller's terminal
A call content storage service method including. In paragraph 1
The step of relaying the two-way call is,
Receiving the IP address of the recipient terminal from the recipient terminal;
Requesting a call from the caller terminal;
Receiving the IP address of the sender terminal from the sender terminal; and
Transmitting call content received from the caller terminal to the caller terminal using the IP address of the caller terminal, and transmitting call content received from the caller terminal to the caller terminal using the IP address of the caller terminal
A call content storage service method including. According to paragraph 1,
The call recording system is,
A call content storage service method that converts the call content received from the sender terminal and the call content received from the recipient terminal into text, and transmits the caller information, recipient information, and call content converted into text to a call content server. According to paragraph 3,
The call content server,
Among the call contents converted to text, match the call contents received from the sender terminal with caller information, and match the call contents received from the recipient terminal with receiver information to convert them to MMS (Multimedia Messaging Service) or the web; , A call content storage service method that transmits the converted information to the caller's terminal. delete delete delete Upon receiving an outgoing signal from a sender terminal, requesting recipient information and language information used by the sender and receiver respectively from the sender terminal;
Requesting a call from a called party terminal using the called party information received from the calling party terminal;
When the recipient terminal accepts the call request, the call content of the caller is translated into the recipient language used by the recipient based on the language information and transmitted to the recipient terminal, and the recipient's call content is translated into the caller language used by the sender. transmitting it to the sender terminal to relay a two-way call between the sender terminal and the recipient terminal.
Including,
The step of relaying the two-way call is,
Receiving call content pronounced in the caller's language from the caller terminal;
Converting the content of the call pronounced in the caller's language into text;
translating the text into the recipient language;
converting the text translated into the recipient's language into voice to generate call content pronounced in the recipient's language;
Step of transmitting the call content pronounced in the recipient's language to the recipient's terminal
Receiving call content pronounced in the recipient's language from the recipient terminal;
Converting the content of the call pronounced in the recipient's language into text;
translating the text into the sender's language;
converting the text translated into the caller's language into voice to generate call content pronounced in the caller's language; and
Step of transmitting the call content pronounced in the caller's language to the caller's terminal
A currency translation service method comprising: According to clause 8,
Separating the call contents of the caller received from the sender terminal and the call contents of the receiver received from the receiver terminal and storing them in a translation storage server together with a time stamp
A currency translation service method further comprising: According to clause 9,
The translation storage server is,
Matching at least one of the call content of the caller pronounced in the caller's language and the call content translated into the language of the caller with the caller information, and the content of the call of the caller pronounced in the language of the callee, A call translation service method that matches at least one of the call contents translated into the caller's language with the callee information, converts it into MMS or web, and transmits the converted information to the caller's terminal. delete delete When an outgoing signal is received from the sender terminal, the caller information and the language information used by the caller and the receiver are requested from the caller terminal, and a call is requested from the caller terminal using the receiver information received from the caller terminal. If the terminal accepts the call request, based on the above language information, the caller's call content is translated into the recipient's language used by the recipient and transmitted to the recipient's terminal, and the recipient's call content is translated into the caller's language used by the sender and sent to the caller. A call relay system that transmits to a terminal and relays a two-way call between the caller terminal and the recipient terminal; and
A call recording system that separates call content received from the sender terminal and call content received from the recipient terminal and stores them with a time stamp.
Including,
The call relay system is,
Receive call content pronounced in the caller's language from the caller terminal, convert the call content pronounced in the caller's language into text, translate the text into the callee's language, and convert the text translated into the caller's language into voice. This generates call content pronounced in the recipient's language, and transmits the call content pronounced in the recipient's language to the recipient terminal.
Receive call content pronounced in the recipient language from the recipient terminal, convert the call content pronounced in the recipient language into text, translate the text into the caller language, and convert the text translated into the caller language into voice. A call content storage service system that generates call content pronounced in the caller's language and transmits the call content pronounced in the caller's language to the caller's terminal. In paragraph 13
The call recording system is,
A call content storage service system that converts the call content received from the sender terminal and the call content received from the recipient terminal into text, and transmits the caller information, recipient information, and call content converted into text to a call content server. According to clause 14,
The call content server,
Among the call contents converted to text, match the call contents received from the sender terminal with caller information, and match the call contents received from the recipient terminal with receiver information to convert them to MMS (Multimedia Messaging Service) or the web; , A call content storage service system that transmits the converted information to the caller's terminal. When an outgoing signal is received from the sender terminal, the caller information and the language information used by the caller and the receiver are requested from the caller terminal, and a call is requested to the caller terminal using the receiver information received from the caller terminal. If the terminal accepts the call request, based on the above language information, the caller's call content is translated into the recipient's language used by the recipient and transmitted to the recipient's terminal, and the recipient's call content is translated into the caller's language used by the sender and sent to the caller. Translation brokerage system that transmits to a terminal and relays a two-way call between the sender terminal and the recipient terminal
Including,
The translation brokerage system is,
Receive call content pronounced in the caller's language from the caller terminal, convert the call content pronounced in the caller's language into text, translate the text into the callee's language, and convert the text translated into the caller's language into voice. This generates call content pronounced in the recipient's language, and transmits the call content pronounced in the recipient's language to the recipient terminal.
Receive call content pronounced in the recipient language from the recipient terminal, convert the call content pronounced in the recipient language into text, translate the text into the caller language, and convert the text translated into the caller language into voice. A call translation service system that generates call content pronounced in the caller's language and transmits the call content pronounced in the caller's language to the caller's terminal. According to clause 16,
A translation storage server that separates the call content of the caller received from the sender terminal and the call content of the recipient received from the recipient terminal and stores them with a time stamp.
A currency translation service system further comprising: According to clause 17,
The translation storage server is,
Matching at least one of the call content of the caller pronounced in the caller's language and the call content translated into the language of the caller with the caller information, and the content of the call of the caller pronounced in the language of the callee, A call translation service system that matches at least one of the call contents translated into the caller's language with the callee information, converts it into MMS or web, and transmits the converted information to the caller's terminal. delete delete

Images