WO2019221385A1

WO2019221385A1 - Method for operating messaging application

Info

Publication number: WO2019221385A1
Application number: PCT/KR2019/003706
Authority: WO
Inventors: 김진욱
Original assignee: Kim Jin Wook
Priority date: 2018-05-16
Filing date: 2019-03-29
Publication date: 2019-11-21
Also published as: KR20190131355A

Abstract

The present invention relates to a method for operating a messaging application and, more particularly, to a method for operating a messaging application in which, when an emoticon and a text are received as one group from a user terminal during messaging by means of a messaging application, a synthesized image is generated by combining a speech bubble and the emoticon, the synthesized image is transmitted to an opponent terminal and thus messaging between a user and an opponent can be performed in a more entertaining manner by means of messaging using emoticons. The position in which a speech bubble is to be generated is identified in accordance with an emoticon selected by the user in the user terminal, and a synthesized image comprising the speech bubble for the respective emoticon in the identified position is generated, and thus the synthesized image having the speech bubble positioned precisely on or near the mouth of the emoticon in accordance with the emoticon is generated.

Description

How chat applications work

The present invention relates to a method of operating a chat application, and more particularly, when receiving a text message from a user terminal together with an emoticon from a user terminal while having a conversation through a chat application, generating a composite image by combining speech bubbles and emoticons. And send the composite image to the other terminal to communicate more easily with the user through the emoticon. The user can identify the location where the speech bubble is generated for each emoticon selected by the user terminal. The present invention relates to a method of operating a conversational application capable of generating a composite image in which a speech balloon is precisely placed around or around a mouth of an emoticon according to the emoticon by generating a composite image including speech bubbles for each emoticon.

In general, social network services (SNS) is a network or networking function, in which a user has a function to connect with other users and maintain and manage them. It functions to send and receive messages between them. Communication between these users can be open, public or private.

On the other hand, in recent years, an instant message service that enables instant information sharing by serving instant messages between friends in mobile and online environments by using a function as a communication platform of SNS has been commercialized.

Existing message service applications have a certain limitation to inspire the interest of the terminal users using the chat by providing a dry text service between the mobile terminal users to simply send and receive text only.

In recent years, text service applications have added emoticons and stickers to express various expressions of a mobile terminal user. In addition to the simple text, the user uses the emoticons or stickers with the texts to express the user's feelings or to have fun. The emoticons or stickers displayed with the texts in the chat window are different from each other by the letters. Because they are listed sequentially, there is a problem that it is insufficient to organize the user's conversation into an interesting story.

Korean Patent Laid-Open Publication No. 2002-0021940 is disclosed in connection with a conventional text service application.

The present invention is to solve the problems of the above-mentioned conventional conversation application, the object of the present invention to achieve the case of receiving a text together with the emoticon from the user terminal in a group during the conversation through the conversation application The present invention provides a method of operating a conversational application that generates a composite image by combining a speech bubble and an emoticon and transmits the composite image to the counterpart terminal.

Another object of the present invention is to identify a location where a speech bubble is generated for each emoticon selected by the user terminal in the user terminal for generating a composite image including a speech bubble for each emoticon and transmits the composite image to the other terminal To provide a way of operating.

Another object of the present invention is to determine a user's emotional expression during a user's conversation, adds an emotional image corresponding to the user's emotional expression to the emoticon, generates a composite image, and generates the composite image to which the emotional expression is added to the counterpart terminal. It is to provide a method of operating an application for a conversation to send.

Another object of the present invention is to provide a method for operating a conversational application in which a user selects a speech bubble shape or selects an arrangement method of characters represented in a speech bubble to generate a composite image and transmit the generated composite image to the counterpart terminal. It is.

In order to achieve the object of the present invention, a method of operating a conversational application according to the present invention includes receiving emoticon identifier information and text information to be transmitted to a counterpart terminal, inputted through a conversational application activated on a user terminal, and an emoticon; And a step of generating a composite image including the received characters in the searched emoticon by searching the emoticon corresponding to the identifier in the database unit, and transmitting the synthesized image to the counterpart terminal.

In the method for operating a conversational application according to the present invention, a speech bubble image including a received text is generated from the received text, and a synthesized image is generated by synthesizing the searched emoticon and the speech bubble image.

Preferably, the step of generating a composite image according to an embodiment of the present invention comprises the steps of retrieving the emoticon corresponding to the emoticon identifier in the database unit, generating a speech-rich image including the received character, and The method may include determining a predetermined speech bubble position at which a speech bubble image is synthesized in the emoticon, and generating a synthesized image by synthesizing the speech bubble image at the predetermined speech bubble position.

Here, the position of the speech bubble is characterized in that it is set differently for each emoticon.

Here, the position of the speech bubble is characterized in that it is set to be adjacent to the mouth of the emoticon or around the mouth.

Preferably, in the method for operating a chat application according to an embodiment of the present invention, determining whether emoticon identifier information and text information to be transmitted to a counterpart terminal through a chat application activated in a user terminal are input into one group. Further, when the emoticon identifier information and the character information is input in one group, the emoticon corresponding to the emoticon identifier is searched in the database unit, characterized in that for generating a composite image including the received character in the searched emoticon do.

Preferably, the method further includes the step of inputting a user command for selecting the type of speech bubble in the method of operating a conversation application according to an embodiment of the present invention, the speech bubble image including a character received using the selected type of speech bubble It characterized in that to generate.

Preferably, the method further includes the step of inputting a user command for selecting an arrangement method of characters up, down, left, and right of the received character in the method of operating a conversation application according to an embodiment of the present invention. Characterized in that the speech bubble image containing the received text.

Preferably, the method further includes adding an emotion image representing a user's emotion to the composite image in a method of operating a conversational application according to an embodiment of the present invention, and transmitting the synthesized image to which the emotion image is added to the counterpart terminal. It is characterized by.

Preferably, the method further includes receiving user emotion expression information from a user terminal in a method of operating a conversational application according to an embodiment of the present invention, and searching for an emotion image corresponding to the user emotion expression information and adding the same to a composite image. Characterized in that.

Preferably, the method for operating a conversational application according to another embodiment of the present invention further comprises the step of determining whether a word representing the user emotion is included in the text information received from the user terminal, the word representing the user emotion Is included in the character information, the emotion image mapped to a word representing the user emotion is searched and added to the synthesized image.

On the other hand, the method for generating a composite image according to an embodiment of the present invention comprises the steps of inputting the emoticon identifier information and the text information to be transmitted to the counterpart terminal through the conversation application activated in the user terminal, and the emoticon identifier information and the text information Judging whether a group is inputted together as a group, and generating a speech bubble image including the received characters when inputted as a group, searching the database for an emoticon corresponding to an emoticon identifier, and synthesizing the speech bubble image from the found emoticons. And determining a predetermined speech bubble position, and synthesizing the speech balloon image at the predetermined speech bubble position to generate a synthesized image to be transmitted to the counterpart terminal.

The method of operating a conversational application according to the present invention has various effects as follows.

First, the method of operating a conversational application according to the present invention generates a composite image by combining speech balloons and emoticons when receiving a character from a user terminal together with an emoticon while having a conversation through a conversational application and generating a composite image. By sending the composite image to the user, the conversation between the user and the counterpart can be performed more fun by talking through an emoticon.

Second, the method of operating a conversational application according to the present invention identifies a location where a speech bubble is generated for each emoticon selected by the user terminal and generates a composite image including speech bubbles for each emoticon to identify the location of the emoticon according to the emoticon. It is possible to create a composite image of the speech bubble accurately positioned around the mouth.

Third, the method of operating a conversational application according to the present invention determines the expression of the user's emotion in the user's conversation, and adds the emotion image corresponding to the expression of the user's emotion to the emoticon to generate a composite image, so that the same emoticon is also applied to the user's emotion. Various changes can be made to create a composite image.

Fourth, the method of operating a conversational application according to the present invention generates a composite image by selecting a speech bubble shape or a method of arranging characters represented in the speech bubble, so that various speech bubble shapes or character arrangement methods are used according to a user's preference. You can create a composite image and change the character arrangement during the conversation to freely display the characters you want to emphasize.

1 is a view for explaining a conversational application operating system according to the present invention.

FIG. 2 is a functional block diagram illustrating a conversation application management server in a conversation application operating system according to an embodiment of the present invention.

3 is a functional block diagram illustrating a composite image generator according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating a method of operating a chat application server according to an embodiment of the present invention.

5 illustrates an example of conversation information displayed in a chat window in a method of operating a chat application server according to the present invention.

6 is a flowchart illustrating a method of generating a composite image according to an embodiment of the present invention.

7 illustrates an example of a composite image formed differently according to a speech bubble image selected by a user in the present invention.

8 illustrates an example of a character list method selected by a user in the present invention.

FIG. 9 illustrates an example of a location of speech bubbles for each emoticon in which a speech bubble image is disposed in a user selected emoticon.

10 is a view for explaining a position where the speech bubble image is disposed in the emoticon.

FIG. 11 illustrates an example of a composite image that is activated at a location of detailed speech bubbles for each emoticon constituting the combined emoticon.

12 illustrates an example of a composite image to which an emotion image is added.

Technical terms used in the present invention are merely used to describe specific embodiments, it should be noted that it is not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as meanings generally understood by those skilled in the art unless the present invention has a special meaning defined in the present invention, and is excessively comprehensive. It should not be interpreted in the sense of or in the sense of being excessively reduced. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be replaced with a technical term that can be properly understood by those skilled in the art.

Also, the singular forms used in the present invention include plural forms unless the context clearly indicates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various components or steps described in the invention, and some of the components or some of the steps are included. It should be construed that it may not be, or may further include additional components or steps.

In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

Hereinafter, a method of operating a conversational application according to the present invention will be described in detail with reference to the accompanying drawings.

Referring to FIG. 1, the user application 30 and the counterpart terminal 50 are connected to the application server 10 for dialogue through a network 20. Here, the network 20 may transmit and receive data between the application manager server 10 for communication and the user terminal 30 or various types of data that may transmit and receive data between the application manager server 10 for communication and the counterpart terminal 50. Wired or wireless networks may be used. Meanwhile, the user terminal 30 or the counterpart terminal 50 may install and drive a conversation application, and various types of terminals, such as a smart phone and a notebook, which may transmit and receive data through the network 20, may be used. .

Here, the conversation application operating server 10 provides a conversation application to the user terminal 30 or the counterpart terminal 50 when a user or the counterpart registers, and stores and manages user information or counterpart information registered at the time of membership registration. Meanwhile, when there is a request for emoticon content from the user terminal 30 or the counterpart terminal 50, the conversation application operating server 10 may request emoticon content requested from the user terminal 30 or the counterpart terminal 50 for a fee or free of charge. Can provide.

The user and the counterpart may perform a conversation by activating a chat application through the user terminal 30 and the counterpart terminal 50 in which the chat application provided from the chat application operating server 10 is installed. 30) when the emoticons are input together as a group together with the text, a speech bubble image including the text and the emoticon are synthesized to generate a synthesized image, and the generated synthesized image is transmitted to the counterpart terminal 50.

In the dialog application operating system according to an embodiment of the present invention, the composite image may be generated in the dialog application operating server 10, and in the dialog application operating system according to another embodiment of the present invention, the composite image is a user terminal. It may be generated in the user terminal 30 or the counterpart terminal 50 through the chat application installed in the 30 or the counterpart terminal 50.

FIG. 2 is a functional block diagram illustrating a conversation application server in a conversation application operating system according to an exemplary embodiment of the present invention. Referring to FIG. 2, the user member from the user terminal through the communication unit 110 is described in detail. When receiving the subscription information, the user manager 130 registers and stores the received user member subscription information in the user database unit 151, and provides a chat application requested by the user to the user terminal through the communication unit 110. The user registration information may be a user's ID, password, address, contact, name, and the like.

The user manager 130 may search for the emoticon content requested from the user terminal at the time of membership registration or login later, and provide the emoticon database unit 153 to the user terminal. The user manager 130 may identify an identifier of the emoticon provided for each user. May be mapped to user member information and registered and stored in the user database unit 151 or the emoticon database unit 153.

Meanwhile, the composite image generator 170 determines whether to receive the text information and the emoticon identifier information together in one group during the conversation between the user terminal and the counterpart terminal through the application for conversation, and determines the text information and the emoticon identifier. When the information is received together in one group, a speech balloon image including a character is generated, and an emoticon corresponding to the emoticon identifier information is searched in the emoticon database unit 153 to generate a composite image combining the speech bubble image and the emoticon. The composite image generator 170 transmits and controls the generated composite image to the counterpart terminal through the communication unit 110.

Referring to FIG. 3 in more detail, the group determination unit 171 determines whether text and emoticons are simultaneously received in one group during a conversation received from a user terminal. When the text and the emoticon are received in one group, the speech bubble image generator 173 generates a speech bubble image including the text. Meanwhile, the emoticon identification unit 175 searches the emoticon database unit for an emoticon corresponding to the emoticon identifier based on the emoticon identifier information received from the user terminal. Preferably, the emoticon identification unit 175 may compare the emoticon identifier information received from the user terminal and the emoticon identifier registered in the user database unit available to the user and determine whether the user can use the received emoticon identifier.

The synthesizing unit 179 determines the location of the speech bubble in which the speech bubble is synthesized in the searched emoticon, and generates a synthesized image composed of the speech bubble image and the emoticon by placing the speech bubble image at the determined speech bubble position.

According to the field to which the present invention is applied, a composite image may be directly generated through a conversation application installed in a user terminal. In this case, when a character and an emoticon are input through the conversation application activated in the user terminal, the synthesis image described above is synthesized. In the same manner as the operation of the image generator, the composite image may be generated by the user terminal.

Referring to FIG. 4, in more detail, conversation information is received or input from a user terminal through a conversation application (S110), and the conversation information is received or input from the user terminal to a counterpart terminal during reception or input. It is determined whether the text information and the emoticon identifier information are simultaneously received in one group (S130).

The conversation application may be configured to transmit conversation information to the counterpart terminal by inputting conversation information to be transmitted to the counterpart terminal, for example, a text and an emoticon using a user interface, and then pressing a send button. When the send button is input, that is, when the text and the emoticon are requested to be transmitted to the counterpart terminal together, it may be determined that the text and the emoticon are simultaneously received or input in one group.

When text and emoticons are received or input in one group at the same time at the user terminal, a speech image including text and an emoticon are synthesized to generate a synthesized image (S150), and the generated synthesized image is transmitted to the counterpart terminal (S170). ).

FIG. 5 (a) shows an example of conversation information displayed in a chat window in a conventional method of operating an application server for conversation, and FIG. 5 (b) is displayed in a chat window in an operation method of an application server for conversation according to the present invention. An example of the conversation information is shown.

As shown in FIG. 5 (a), in the method of operating a conventional application server for conversation, the text and the emoticon of the conversation are sequentially expressed in the order of input, respectively, as shown in FIG. 5 (b). In the method of operating a chat application server according to the present invention, when a text and an emoticon are input in one group at the same time during a conversation, the speech image is expressed as a composite image including a speech bubble image at a speech bubble position set for each emoticon.

Referring to FIG. 6, when a text and an emoticon are input or received in a group at the same time in a conversation input or received at the user terminal, a speech bubble image including the text is generated (S151).

Preferably, the user may select a desired speech bubble shape, and the user may reflect the individuality of the user when generating the composite image by selecting the speech bubble of the desired shape in the speech bubble image database unit to generate a composite image. 7 illustrates an example of a composite image formed differently according to a speech bubble image selected by a user in the present invention.

More preferably, the user selects a speech balloon having a desired shape and creates a composite image by selecting one of left and right or up and down directions of the characters expressed in the speech balloon, thereby arranging the characters to reflect the importance or individuality of the characters in the conversation. You can change the way. 8 illustrates an example of a character list method selected by a user in the present invention.

Referring to FIG. 6 again, the position of the speech bubble in which the speech bubble image is to be placed on the emoticon for each emoticon input to the user terminal is determined (S153). The user can perform a conversation using various kinds of emoticons provided by the application for dialogue. The position where the speech bubble image is placed is set differently according to the type of emoticon, and the speech bubble where the speech bubble image is placed according to the type of emoticon. Determine the location.

Figure 9 is the location where the balloon images arranged according to the type of emoticon P as shown in there is shown an example of a balloon located by emoticons which the bubble images arranged in the emoticon selected by the user in the present invention, and FIG. ₉₁ , P ₂ , P ₃ , and P ₄ are set differently from each other.

Preferably, the position where the speech bubble image is placed in the emoticon is set to the mouth or around the mouth of the emoticon. As shown in FIG. 10 (a), the mouth P of the emoticon is set to the position of the speech bubble where the speech bubble image is placed. As illustrated in FIG. 10 (b), the area PA around the mouth of the emoticon may be set to the location of the speech bubble where the speech bubble image is disposed. More preferably, the position where the speech bubble image is placed in the emoticon may be set by the user according to the user's preference.

In the case where a combination of a plurality of emoticons of the emoticon is formed as shown in FIG. If so, the text input or received at the detailed speech bubble position may be expressed individually or by deleting a group. For example, when the text information of "blink!" Is input or received, the primary character of "blink" is activated first at the first detailed speech bubble, and the secondary character of "pair" is activated at the second detailed speech bubble position. In addition, the third character may be activated at the third detailed speech bubble position by activating an individual character “!”. The detailed speech bubbles activated at the first detailed speech bubble location, the second detailed speech bubble location, and the third detailed speech bubble location are sequentially activated. Finally, the entire input or received text information may be activated as a speech bubble image at the fourth detailed speech bubble location.

Referring back to FIG. 6 in more detail, texts and emoticons of conversations inputted from a user terminal are simultaneously input or received in one group, and expressions of the user's emotions are displayed in characters of conversations simultaneously input or received in one group. It is determined whether it is included (S155).

If the emotional expression of the user is included in the character of the dialogue, the emotional image corresponding to the emotional expression of the user is determined (S157), and the synthesized image is generated by adding the determined emotional image (S159).

Preferably, in one embodiment of the present invention, the conversation application includes a user interface for selecting a user emotion expression. When receiving the user emotion expression information together with a text and an emoticon from the user terminal, the conversation application corresponds to the user emotion expression information. Search for the emotion image and add the searched emotion image to the emoticon to generate a composite image.

In another embodiment of the present invention, it is determined whether the word representing the user's emotion is included in the text information received or input from the user terminal, and when the word representing the user's emotion is included in the text information, the user's emotion is expressed. Searching for an emotion image mapped to a word and adding the searched emotion image to the emoticon to generate a composite image.

Preferably, the emotion expression database registers and stores an emotion word representing an emotion expression and an emotion image mapped to each emotion word or emotion expression information. When the emotion word or emotion expression information is input, the mapped emotion image is added to the emoticon. To generate a composite image.

FIG. 12 illustrates an example of a composite image including an emotion image. When receiving emotion expression information corresponding to “love” from a user terminal, FIG. 12 searches for an additional image mapped to love and adds it to the composite image. Alternatively, when a word representing the emotion expression of the user is input or received among the character information input or received from the user terminal, the emotion image mapped to the emotion expression word may be searched and added to the synthesized image.

When receiving emotion expression information together according to the field to which the present invention is applied, a separate emotion image identifier may be received from a user terminal, the emotion image corresponding to the received emotion image identifier is searched, and the retrieved emotion image is synthesized. Can be added to

Meanwhile, the above-described embodiments of the present invention can be written as a program that can be executed in a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable recording medium.

The computer-readable recording medium may be a magnetic storage medium (for example, a ROM, a floppy disk, a hard disk, etc.), an optical reading medium (for example, a CD-ROM, DVD, etc.) and a carrier wave (for example, the Internet). Storage medium).

Although the present invention has been described with reference to the embodiments shown in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

Claims

Receiving emoticon identifier information and text information to be transmitted to a counterpart terminal, which is input through a conversational application activated on a user terminal;

Searching for a emoticon corresponding to the emoticon identifier in a database unit and generating a composite image including the received text in the searched emoticon; And

And transmitting the composite image to the counterpart terminal.
The method of claim 1, wherein the conversation application is operated.

A method of operating a conversational application comprising generating a speech bubble image including a received text from a received text and synthesizing the searched emoticon with the speech bubble image
The method of claim 2, wherein generating the composite image

Searching an emoticon corresponding to the emoticon identifier in a database unit;

Generating a speech-rich image including the received text;

Determining a location of a predetermined speech bubble in which a speech bubble image is synthesized from the searched emoticons; And

And synthesizing the speech bubble image at a predetermined speech bubble location to generate a composite image.
The method of claim 3, wherein the speech bubble location is set differently for each emoticon.
The method of claim 4, wherein the speech bubble location is set to be adjacent to or around the mouth of the emoticon.
The method according to any one of claims 1 to 5, wherein in the method of operating the conversational application,

The method may further include determining whether emoticon identifier information and text information to be transmitted to the counterpart terminal are input into one group through the conversation application activated in the user terminal.

When the emoticon identifier information and the text information are input in one group, searching for an emoticon corresponding to the emoticon identifier in a database unit and generating a composite image including the received text in the searched emoticon How the application works
The method according to any one of claims 2 to 5, wherein in the method of operating the conversational application,

The method may further include inputting a user command for selecting a speech bubble type.

And a speech bubble image including the received text by using the selected type of speech bubble.
The method according to any one of claims 2 to 5, wherein in the method of operating said conversational application,

The method further includes the step of inputting a user command for selecting a character arrangement of the received character up, down, left and right,

The method of operating a chat application, characterized in that for generating a speech balloon image including the received text in the selected character arrangement method.
The method according to any one of claims 1 to 5, wherein in the method of operating the conversational application,

Adding an emotion image representing the emotion of the user to the composite image;

And transmitting a composite image to which the emotion image is added to the counterpart terminal.
The method of claim 9, further comprising:

Receiving user emotion expression information from the user terminal,

And searching for and adding an emotion image corresponding to the user emotion expression information to the composite image.
The method of claim 9, further comprising:

Determining whether a word representing a user emotion is included in the text information received from the user terminal;

And when the word representing the user emotion is included in the character information, searching for and adding an emotion image mapped to the word representing the user emotion to the synthesized image.
Inputting emoticon identifier information and text information to be transmitted to the counterpart terminal through a conversation application activated on the user terminal;

Determining whether the emoticon identifier information and the text information are input together in one group, and generating a speech bubble image including the received text when inputted in one group;

Searching for an emoticon corresponding to an emoticon identifier in a database unit and determining a preset speech bubble position at which a speech bubble image is synthesized from the searched emoticon; And

And synthesizing the speech bubble image at a predetermined speech bubble location to generate a synthesized image to be transmitted to a counterpart terminal.
The method of claim 12, wherein the speech bubble position

Method for generating a composite image for a conversation, characterized in that the emoticon is set to be adjacent to the mouth or around the mouth of the different emoticons.
15. The method of claim 13, wherein in the method of generating the interactive composite image

And adding an emotion image representing the emotion of the user to the composite image.
The method of claim 14, wherein the generating of the interactive synthetic image is performed.

The method may further include inputting user emotion expression information from the user terminal.

And searching for and adding an emotion image corresponding to the user emotion expression information to the composite image.
The method of claim 9, wherein the generating of the interactive synthetic image is performed.

The method may further include determining whether a word representing the emotion of the user is included in the text information input through the conversation application activated on the user terminal.

And when the word representing the user emotion is included in the character information, searching for and adding an emotion image mapped to the word representing the user emotion to the synthesized image.