KR102299900B1 - Live chat device - Google Patents

Abstract

A chat device is provided. The chatting device may include: an acquisition unit configured to acquire a first message written in a first language from the first terminal participating in the chat room; a grasping unit for recognizing a second language set by the second terminal participating in the chat room; a conversion unit converting the first message written in the first language into a second message written in the second language; and a providing unit that provides the second message to the second terminal.

Description

Live chat device {LIVE CHAT DEVICE}

The present invention relates to an apparatus for supporting real-time chatting between users using a plurality of languages.

Recently, as the penetration rate of mobile terminals including smart phones has rapidly increased, various applications for providing instant messaging services have appeared in mobile user terminals. As described above, it is possible to not only transmit and receive messages but also share various contents through an application providing an instant messaging service. In particular, recently, due to the globalization of business, conversations between people who speak various languages occur frequently, and translation technology is also rapidly developing for communication between users who speak different languages.

Korean Patent Application Laid-Open No. 2019-0049665 discloses a method for providing automatic translation for chat rooms.

Korean Patent Publication No. 2019-0049665

An object of the present invention is to provide a chatting device capable of communicating with a counterpart in real time by message without a language barrier.

The chatting device of the present invention includes: an acquisition unit for acquiring a first message written in a first language from the first terminal participating in the chat room; a grasping unit for recognizing a second language set by the second terminal participating in the chat room; a conversion unit converting the first message written in the first language into a second message written in the second language; and a providing unit that provides the second message to the second terminal.

The chatting device of the present invention may translate a message input by the first user participating in the chat room in a specific language into the language designated by the second user participating in the chat room, and may provide the translated message to the second user. The message translation process according to the present invention may be performed interactively for a plurality of users. Therefore, each user participating in the chat room managed by the chatting device of the present invention can chat normally with various users from around the world.

In addition, the chatting device of the present invention may not only provide a translated message to the counterpart, but may additionally provide an original message. Since the other party is provided with both the original message and the translated message, language exchange and cultural exchange with users from all over the world can take place. A learning effect on the language used by the other party can also be expected.

1 is a schematic diagram showing a chatting device of the present invention.
Figure 2 is a schematic diagram showing the operation of the chatting device of the present invention.
3 is a schematic diagram illustrating a chatting window displayed on a first terminal.
4 is a schematic diagram illustrating a chatting window displayed on a second terminal.
5 is a diagram illustrating a computing device according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

In the present specification, duplicate descriptions of the same components will be omitted.

Also, in this specification, when it is mentioned that a certain element is 'connected' or 'connected' to another element, it may be directly connected or connected to the other element, but another element in the middle. It should be understood that there may be On the other hand, in this specification, when it is mentioned that a certain element is 'directly connected' or 'directly connected' to another element, it should be understood that the other element does not exist in the middle.

In addition, the terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention.

Also, in this specification, the singular expression may include the plural expression unless the context clearly dictates otherwise.

Also in this specification, terms such as 'include' or 'have' are only intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, and one or more It should be understood that the existence or addition of other features, numbers, steps, operations, components, parts or combinations thereof is not precluded in advance.

Also in this specification, the term 'and/or' includes a combination of a plurality of listed items or any of a plurality of listed items. In this specification, 'A or B' may include 'A', 'B', or 'both A and B'.

Also, in this specification, detailed descriptions of well-known functions and configurations that may obscure the gist of the present invention will be omitted.

1 is a schematic diagram showing a chatting device 100 of the present invention.

The chatting device 100 shown in FIG. 1 may include an acquiring unit 110 , a grasping unit 130 , a converting unit 150 , and a providing unit 170 .

The acquisition unit 110 may acquire the first message written in the first language from the first terminal 10 participating in the chat room. A plurality of terminals such as the first terminal 10 , the second terminal 20 , and the third terminal 30 may participate in the chat room. The first user who uses the first terminal 10 , the second user who uses the second terminal 20 , and the third user who uses the third terminal 30 can communicate through the chat room. Conversation using a chat room may be performed through a text message input and displayed in a chat window displayed on each terminal. Alternatively, the conversation using the chat room may be performed through a message in the form of a voice input using a voice input means such as a microphone provided in each terminal and outputted using a voice output means such as a speaker. Alternatively, a conversation using a chat room may be performed through a message in the form of an image input using a camera provided in each terminal and provided to the other party. Alternatively, a conversation using a chat room may be performed in such a way that at least two or more of a text message, a voice message, and a video message are provided together. A voice and video call function may be added to the acquisition unit 110 . Alternatively, the acquisition unit 110 may acquire voice data and image data related to chatting from the terminal.

Acquisition unit 110 may create a chat room to obtain the first message. As an example, the acquiring unit 110 opens a chat room at the request of any one of the first terminal 10 , the second terminal 20 , and the third terminal 30 , and receives input from each terminal participating in the chat room. Messages (including the first message) can be obtained.

As an example, the acquisition unit 110 may implement a basic chat window using the following programs 1 and 2.

[Program 1]

When using 'socket.io', it is necessary to connect the app to http and connect this http to socket.io again. This is because socket.io cannot directly accept express. socket.io can be used in the server with the variable name 'io'.

[Program 2]

io.on(EVENT, function) can be an event listener that recognizes the EVENT delivered to the server and executes the function.

'connection' is code that occurs only once when an event occurs in the event listener.

emit is a function that generates an event.

socket.on(EVENT, function) can be an event listener that recognizes the EVENT delivered to the socket and executes the function.

The 'send message' event is a user-defined event written in client.html and occurs when a visitor sends a chat message. This event transmits the name of the contact who sent the chat message and the chat message as parameters. After receiving this event, the 'send message' event listener delivers the event to all clients using io.emit.

The identification unit 130 may determine the type of language set by each terminal participating in the chat room. For example, the grasper 130 may detect the second language set by the second terminal 20 . When the second user selects 'English' through the language selection menu of the second terminal 20 , the grasper 130 may determine that the second language is English.

The conversion unit 150 may convert the first message written in the first language into a second message written in the second language. The conversion unit 150 may perform a translation function of changing the first language to only the second language while maintaining the contents of the first message. For example, when the first language is English and the second language is Korean, the first message corresponding to the original message may be written in English. The conversion unit 150 may translate the first message written in English into Korean and generate a second message written in Korean. The first message and the second message may have the same content except for a language different from each other.

The providing unit 170 may provide the second message to the second terminal 20 . A plurality of terminals may be participating in the chat room. It is not preferable that the second message translated into the second language set by the second terminal 20 is provided to the third terminal 30 in which the third language is set. Therefore, it is preferable that the target to which the second message is provided by the providing unit 170 is limited to the second terminal 20 in which the second language based on the generation of the second message is set.

Figure 2 is a schematic diagram showing the operation of the chatting device 100 of the present invention.

The conversion unit 150 may directly perform translation for various languages by using various translation algorithms.

Alternatively, the conversion unit 150 may perform translation for each language with the help of a separate translation server 90 . When the translation server 90 is assisted, the conversion unit 150 may communicate with the translation server 90 . The conversion unit 150 may request the translation server 90 to convert the first message ① into the second message ②. The conversion unit 150 may provide the translation server 90 with data indicating the type of the first message acquired through the acquisition unit 110 and the second language acquired through the identification unit 130 .

The translation server 90 may generate a second message obtained by translating the first message into the second language and provide it to the conversion unit 150 . As an example, the translation server 90 may include the Google translation server 90 and the like, and may use the 'Google Translation API' of the Google Cloud Platform in software. To use the 'Google Translation API', you can create an account, register to use the API, and obtain a private key. The conversion unit 150 may communicate with the Google translation server 90 using the private key and request translation of the first message.

The conversion unit 150 may receive the second message from the translation server 90 and transmit it to the provider 170 . The providing unit 170 may provide the second message to the second terminal 20 participating in the chat room by wire or wireless.

According to the above embodiment, when the first user participating in the chat room inputs the first message in Vietnamese, the acquiring unit 110 may acquire the first message. The grasper 130 may grasp the second language set by the second user participating in the same chat room, for example, English. The conversion unit 150 may generate a second message by translating the first message in Vietnamese into English by itself. Alternatively, the conversion unit 150 may provide the first message and information in the second language to the translation server 90 , and obtain the second message translated into English from the translation server 90 . The providing unit 170 may receive the second message from the converting unit 150 and provide it to the second user.

As a result, when the first user inputs Vietnamese through the first terminal 10 , the second user can view the first user's message translated into English through the second terminal 20 .

FIG. 3 is a schematic diagram illustrating a chatting window displayed on the first terminal 10 , and FIG. 4 is a schematic diagram illustrating a chatting window displayed on the second terminal 20 .

The providing unit 170 may provide the first message to the second terminal 20 together with the second message. Accordingly, the first message corresponding to the original message may be displayed on the second terminal 20 as shown in FIG. 4 , and the second message corresponding to the translation of the original message may be displayed.

According to the present embodiment, since the first language and the second language of the same meaning are displayed together on the second terminal 20, from the point of view of the second user using the second language, the chatting of the present invention is useful for learning the first language. Device 100 may be used.

When the first message and the second message are displayed together on the same line in the chat window, the matching or visibility for identifying which part of the first message matches the specific word of the second message is rapidly reduced, so the language The effectiveness of learning can be very low.

In order to improve the effect of language learning, the first message and the second message are preferably displayed side by side in different chat windows. In other words, the first message and the second message provided to the second terminal 20 may be formed to have independence using a chatting window that is distinct from each other.

When any one of the first message and the second message provided to the second terminal 20 is displayed in a specific chat line of the second terminal 20, the providing unit 170 is the other one immediately following the chat line of the specific chat line It may be provided to the second terminal 20 in a state in which the first message and the second message are linked to be displayed in a row.

을 각각 부여받을 수 있다. 'user40'은 제1 사용자에게 부여된 시스템 닉네임일 수 있다. 'user50'은 제2 사용자에게 부여된 시스템 닉네임일 수 있다. 도 4의 하단을 살펴보면, 제2 사용자 'user50'의 언어 설정 메뉴에 영어가 선택되어 있다. 영어 선택에 기인하여 제2 단말기(20)에는 영어로 번역된 메시지가 표시될 수 있다.As shown in FIG. 4 , the first message and the second message having independence are not the text input by the user, but the system nickname 'user40' or

can be assigned to each. 'user40' may be a system nickname given to the first user. 'user50' may be a system nickname given to the second user. Referring to the lower part of FIG. 4 , English is selected in the language setting menu of the second user 'user50'. Due to the selection of English, a message translated into English may be displayed on the second terminal 20 .

은 사용자를 구분하는 구분자인 동시에, 메시지의 입력행을 안내하는 안내자일 수 있다. 시스템 닉네임

은 채팅창의 맨앞에 표시되므로, 높은 시인성을 제공할 수 있다.system nickname

may be a delimiter for distinguishing users and a guide for guiding the input line of a message. system nickname

is displayed in the front of the chat window, so it is possible to provide high visibility.

을 이용해서 용이하게 파악할 수 있다. 한편, 제1 메시지와 제2 메시지 각각에 시스템 닉네임

이 부여되었다는 것은 제1 메시지와 제2 메시지의 사이에 다른 사용자가 입력한 다른 메시지 또는 시스템 경고창의 안내 메시지, 경고 메시지 등이 끼어들 수 있는 여지가 있음을 의미할 수 있다.The user calls the start of the first message unfamiliar to him as the system nickname.

can be easily identified using On the other hand, the system nickname in each of the first message and the second message

This may mean that another message input by another user or a guide message of a system warning window, a warning message, etc. may be inserted between the first message and the second message.

In order to improve the learning effect, it is preferable that the first message and the second message are displayed directly adjacent to each other as shown in FIG. 4 .

According to the present invention, even if a display event of another message occurs between the first message and the second message due to the association state of the first message and the second message, the other message is transmitted to the first message in the second terminal 20 Instead of being displayed between the and the second message, it may be displayed in the next chat line of the first message and the second message.

As a result, the first message and the second message provided together to the second terminal 20 may be displayed in adjacent rows, respectively, as shown in FIG. 4 .

In FIG. 4 , the first message is first displayed on a specific line, and the second message is displayed on the immediately following line.

First message in Vietnamese on a specific line

가 표시될 수 있다.

may be displayed.

Second message translated into English on the next line of a specific line

가 표시될 수 있다.

may be displayed.

에 의해 정렬된 상태이므로, 제2 사용자는 제1 메시지와 제2 메시지의 각 단어를 직관적으로 매칭시킬 수 있다.Both the first message and the second message are system nicknames

Since they are sorted by , the second user can intuitively match each word of the first message and the second message.

Meanwhile, when a plurality of users participate in a chat room, the first message obtained from the first terminal 10 may be converted into various types of languages. In this case, the time required for the conversion unit 150 to translate or convert the first message into various types of languages may be different from each other. For example, even when the second message translated into the second language is generated, the process of converting the first message into the third language may be continued. In this case, if the second message is directly provided to the second terminal 20 , the second user may check and respond to the content of the first message input by the first user. On the other hand, since the third user who has not received the third message cannot check the contents of the first message, it is virtually impossible to use the chat room normally. Even from the perspective of the first user, since there is no response from the third user in a situation where there is a response from the second user, the user may feel uncomfortable. Therefore, it is preferable that the second message in which the first message is converted into another language is provided to each terminal at the same time. In summary, it is preferable to synchronize the timing at which the plurality of converted messages translated into various languages of the first message are transmitted to the respective terminals.

For example, when the third terminal 30 set in the third language participates in the chat room, the conversion unit 150 may convert the first message into a third message written in the third language.

The providing unit 170 may adjust the timing of transmitting the second message to the second terminal 20 and the timing of transmitting the third message to the third terminal 30 as the second time in the same way.

When the second message and the third message are obtained from the conversion unit 150 before the set time has elapsed based on the first time point at which the obtaining unit 110 acquires the first message, the providing unit 170 receives the set time. The viewpoint may be set as the second viewpoint. Alternatively, the provider 170 may set a later acquisition time of the acquisition time of the second message and the acquisition time of the third message as the second time point. According to the present embodiment, the transmission time of the second message and the transmission time of the third message may be synchronized with the second time. As a result, the second user and the third user can chat normally with the first user.

When the second message is obtained and the third message is not received by the time of arrival of the set time, the providing unit 170 may transmit the second message to the second terminal 20 at the time of the arrival of the set time. Also, the providing unit 170 may transmit the first message to the third terminal 30 as it is when the set time arrives. According to the present embodiment, the second message may be provided to the second terminal 20 while excluding the third message whose translation is excessively delayed. In order to inform the third user that the first message has been provided, a first message corresponding to the original text may be provided to the third terminal 30 instead of a third message that has not yet been generated. In order to implement a real-time chat, it is preferable that the set time is 10 seconds or less. If the set time exceeds 10 seconds, the chat flow is likely to be interrupted.

As the number of users or terminals participating in the chat room increases, the load of the conversion unit 150 may increase rapidly. If the translation takes a long time due to an increase in load, the possibility that the first message will be provided to another terminal as it is in the original text may increase.

In order to quickly translate the first message into a plurality of different languages, a plurality of conversion means may be provided in the conversion unit 150 . Returning to FIG. 1 again, the conversion unit 150 may be provided with a second conversion means 151 for handling the second language and a third conversion means 152 for handling the third language.

The grasper 130 may grasp the second language set by the second terminal 20 participating in the chat room. The identification unit 130 may recognize the third language set by the third terminal 30 participating in the chat room.

The first message acquired by the acquiring unit 110 may be input to the second converting means 151 and simultaneously input to the third converting means 152 according to the identification result of the grasping unit 130 .

A process in which the first message is converted into a second message by the second conversion means 151 and a process in which the first message is converted into a third message written in a third language by the third conversion means 152 are simultaneously processed in parallel or can be performed in parallel.

According to the present embodiment, the first message acquired by the acquiring unit 110 may be simultaneously input to a plurality of conversion means, and may be converted into different languages by each conversion means. Translated messages converted into other languages by each conversion means may be synchronized with the transmission time for each terminal by the providing unit 170 . According to this embodiment, an environment can be provided in which a high speed is possible due to parallel processing of language translation and a plurality of users can participate in a chat room at the same time due to synchronization.

5 is a diagram illustrating a computing device according to an embodiment of the present invention. The computing device TN100 of FIG. 5 may be a device described herein (eg, the chatting device 100 , etc.).

In the embodiment of FIG. 5 , the computing device TN100 may include at least one processor TN110 , a transceiver device TN120 , and a memory TN130 . In addition, the computing device TN100 may further include a storage device TN140 , an input interface device TN150 , an output interface device TN160 , and the like. Components included in the computing device TN100 may be connected by a bus TN170 to communicate with each other.

The processor TN110 may execute a program command stored in at least one of the memory TN130 and the storage device TN140. The processor TN110 may mean a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to an embodiment of the present invention are performed. The processor TN110 may be configured to implement procedures, functions, methods, and the like described in connection with an embodiment of the present invention. The processor TN110 may control each component of the computing device TN100 .

Each of the memory TN130 and the storage device TN140 may store various information related to the operation of the processor TN110 . Each of the memory TN130 and the storage device TN140 may be configured as at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory TN130 may include at least one of a read only memory (ROM) and a random access memory (RAM).

The transceiver TN120 may transmit or receive a wired signal or a wireless signal. The transceiver TN120 may be connected to a network to perform communication.

On the other hand, the embodiment of the present invention is not implemented only through the apparatus and/or method described so far, and a program for realizing a function corresponding to the configuration of the embodiment of the present invention or a recording medium in which the program is recorded may be implemented. And, such an implementation can be easily implemented by those skilled in the art from the description of the above-described embodiments.

Although the embodiment of the present invention has been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention as defined in the following claims are also presented. It belongs to the scope of the invention.

10...First terminal 20...Second terminal
30...third terminal 90...translation server
100...Chat Device 110...Acquisition Department
130 ... grasping unit 150 ... converting unit
151...second conversion means 152...third conversion means
170...provider

Claims (4)

an acquisition unit for acquiring a first message written in a first language from the first terminal participating in the chat room;
a grasping unit for recognizing a second language set by the second terminal participating in the chat room;
a conversion unit converting the first message written in the first language into a second message written in the second language;
Including a; providing unit for providing the second message to the second terminal,
The providing unit provides the first message together with the second message to the second terminal,
The first message and the second message provided to the second terminal use different chat lines, and a system nickname assigned to the first user is given to each of the first message and the second message, and the system The first message and the second message to which nicknames are respectively assigned are formed to have independence that other messages can intervene therebetween,
The system nickname is a delimiter that distinguishes users and a guide for guiding the input line of a message, and a chat device displayed at the front of the chat line.
According to claim 1,
The provision unit so that when any one of the first message and the second message provided to the second terminal is displayed in a specific chat line of the second terminal, the other one is displayed in the chat line immediately following the specific chat line , provided to the second terminal in a state in which the first message and the second message are linked,
Due to the association state of the first message and the second message, even if a display event of another message occurs between the first message and the second message, the other message is transmitted between the first message and the second message in the second terminal. A chatting device displayed in the next chat line of the first message and the second message instead of being displayed between the second message.
According to claim 1,
When a third terminal set in a third language participates in the chat room, the conversion unit converts the first message into a third message written in the third language,
The providing unit adjusts the timing of transmitting the second message to the second terminal and the timing of transmitting the third message to the third terminal to be the same as the second time,
When the second message and the third message are obtained from the conversion unit before the lapse of a set time based on the first time point at which the obtaining unit acquires the first message, the providing unit determines the arrival time of the set time. Set as the second time point, or set the later acquisition time point among the acquisition time of the second message and the acquisition time of the third message as the second time point,
When the second message is received and the third message is not received by the time of arrival of the set time, the providing unit transmits the second message to the second terminal at the time of arrival of the set time and sends the second message to the third terminal A chatting device that transmits the first message as it is.
According to claim 1,
The conversion unit is provided with a second conversion means for handling the second language and a third conversion means for handling the third language,
The grasping unit grasps the second language set by the second terminal participating in the chat room, and grasps the third language set by the third terminal participating in the chat room,
The first message acquired by the acquiring unit is inputted to the second transformation means and simultaneously input to the third transformation means according to the identification result of the identification unit,
A process in which the first message is converted into the second message by the second conversion means and a process in which the first message is converted into a third message written in the third language by the third conversion means are simultaneously processed in parallel Being a chat device.

Images