KR102128631B1 - Method for Transmitting and Receiving Message Incorporating Picture, Voice, and Touch Information - Google Patents

Abstract

A method of transmitting and receiving a message in which photo, voice, and touch information are combined according to an aspect of the present invention, which can maximize the sender's sentiment through a message by generating a message by expressing the sender's emotion with pictures, voice, and touch information. In the transmission, when the user's first touch signal is input on the picture displayed on the screen of the terminal, recording the user's voice for a predetermined recording time; And when the user's voice recording is completed, generating and transmitting a message including the photo, the recorded voice, and information on the first touchpath generated according to the first touch signal during the recording time, And upon receiving, displaying the first touch pass on the photo for a time during which a second touch signal by a user is input on the photo included in the received message, and reproducing the recorded voice. do.

Description

Method for Transmitting and Receiving Message Incorporating Picture, Voice, and Touch Information}

The present invention relates to the transmission and reception of messages using a communication terminal.

As the functions and performance of devices such as smartphones or tablets and devices such as terminals and notebooks have been improved, various services using them have been provided. In the case of a communication terminal, various functions such as a function of playing multimedia such as music or a movie, a function of transmitting and receiving a text or voice message, and an Internet function can be provided based on a call function with a counterpart.

In particular, among the functions of transmitting and receiving a message using a communication terminal, a service capable of combining a picture selected by a sender and a voice of the sender is provided. An example of such a service is disclosed in Korean Patent Publication No. 10-2003-0051941.

However, in the case of the prior art including Korean Patent Publication No. 10-2003-0051941, since the sender's emotion is generated when the message is generated, it is simply a combination of the picture selected or taken by the sender and the voice of the sender as a message. There is no choice but to visually or audibly express, and the recipient can only feel the emotion of the sender visually or audibly from the received message. Accordingly, the message transmission/reception service according to the related art has limitations in terms of transmitting the sender's sensitivity to the receiver.

The present invention is to solve the above-mentioned problems, by generating a message by expressing the sender's sensibility with pictures, voice, and touch information, there is a picture, voice, and touch information that can maximize the sender's sentiment through the message It is a technical task to provide a method and apparatus for transmitting and receiving a combined message.

In addition, the present invention provides a method and apparatus for transmitting and receiving a message in which pictures, voices, and touch information are combined to provide a predetermined event to a recipient according to touch information input by the sender and touch information input by the receiver when viewing the received message. What is provided is another technical task.

In order to achieve the above object, a method for transmitting/receiving a message in which pictures, voices, and touch information are combined according to an aspect of the present invention is performed in advance when a user's first touch signal is input on a picture displayed on a screen of a terminal during transmission. Recording a user's voice for a predetermined recording time; And when the user's voice recording is completed, generating and transmitting a message including the photo, the recorded voice, and information on the first touchpath generated according to the first touch signal during the recording time, And upon receiving, displaying the first touch pass on the photo for a time during which a second touch signal by a user is input on the photo included in the received message, and reproducing the recorded voice. do.

In order to achieve the above object, a method for transmitting/receiving a message in which picture, voice, and touch information is combined according to another aspect of the present invention is performed in advance when a first touch signal is input by a user on a picture displayed on a screen of a transmitting terminal. Recording a user's voice for a predetermined recording time; When the voice recording is completed, generating a message including the photo, the recorded voice, and the information of the first touchpath generated according to the first touch signal during the recording time, and transmitting the generated message to the receiving terminal; Displaying the picture on a screen of the receiving terminal; And reproducing the recorded voice while displaying the first touch path on the photo for a time during which a second touch signal is input by the user on the photo.

In one embodiment, in the transmitting, the first coordinate values of a plurality of touch points constituting the first touch path are converted into second coordinate values according to a ratio of a screen resolution of the transmitting terminal and a predetermined reference value. Converting; Generating information of the first touch path by arranging second coordinate values of the plurality of touch points according to a time sequence in which each touch points are input; And combining the photo, the recorded voice, and the information of the first touchpath to generate the message, and transmitting the generated message to a receiving terminal.

The reproducing may include converting second coordinate values of a plurality of touch points constituting the information of the first touch path into third coordinate values according to the ratio of the screen resolution and the reference value of the receiving terminal. And, the first touch path may be displayed according to the third coordinate value on a picture displayed on the screen of the receiving terminal.

Further, the reproducing may further include displaying a predetermined animation effect on the screen of the receiving terminal when the second touch path generated according to the second touch signal intersects the first touch path. Can.

In the displaying step, the clarity of the picture included in the message is reduced by a predetermined value to be displayed on the screen of the receiving terminal, and in the playing step, while the recorded voice is being played, the receiving terminal The sharpness of the picture displayed on the screen can be gradually increased to the original value.

Before the recording step, when an application installed in the transmitting terminal is executed, activating a camera module of the transmitting terminal to take the picture; And displaying the picture on a screen of the transmitting terminal.

Between the photographing step and the displaying step, the method may further include inserting text selected or input by the user in a color selected by the user at a location selected by the user on the photographed picture. .

In the reproducing step, the first touch path may be displayed on the photo by moving an indicator having a predetermined shape according to the first touch path on the photo.

According to the present invention, the sender's sensibility is visually expressed through a photograph taken by the sender, the sender's sensibility is auditoryly expressed through the voice input by the sender, and the touch information input by the sender There is an effect that the sender's emotion can be transmitted through the message by generating the message by tactilely expressing the sender's emotion.

In addition, according to the present invention, when viewing a received message, if a touch path according to the sender's touch information and a touch path according to the receiver's touch information intersect, the animation effect is provided as an event to double the fun of the message transmission and reception service. There is an effect.

1 is a flowchart showing a message transmission method in which picture, voice, and touch information are combined according to an embodiment of the present invention.
Figure 2 is a flow chart showing a method for receiving a message combined with photo, voice, and touch information according to an embodiment of the present invention.
3 is a diagram showing an example of a first touchpath input when a message is written.
4 is a diagram illustrating an example of a first touch path displayed when a message is viewed.

The meaning of the terms described in this specification should be understood as follows.

It should be understood that a singular expression includes a plurality of expressions unless the context clearly defines otherwise, and the terms "first", "second", etc. are used to distinguish one component from another component, The scope of rights should not be limited by these terms.

It should be understood that terms such as “include” or “have” do not preclude the existence or addition possibility of one or more other features or numbers, steps, actions, components, parts or combinations thereof.

It should be understood that the term “at least one” includes all possible combinations from one or more related items. For example, the meaning of “at least one of the first item, the second item, and the third item” means 2 of the first item, the second item, and the third item, as well as the first item, the second item, and the third item, respectively. Any combination of items that can be presented from more than one dog.

Hereinafter, for convenience of description, the same reference numerals will be assigned to the same components to describe the corresponding components.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart showing a method of transmitting a message in which photo, voice, and touch information are combined according to the present invention, and FIG. 2 is a flow diagram showing a method of receiving a message in which photo, voice, and touch information is combined according to the present invention It is a chart.

A method of transmitting a message in which photo, voice, and touch information is combined will be described first with reference to FIG. 1, and a method of receiving a message in which photo, voice, and touch information is combined will be described with reference to FIG. 2.

A message transmission method in which pictures, voices, and touch information shown in FIGS. 1 and 2 are combined (hereinafter referred to as a'message transmission method') or a message reception method in which pictures, voices, and touch information are combined (hereinafter, The term'message receiving method' may be performed by a controller of a terminal equipped with an application for performing a message transmitting and receiving method. Hereinafter, for convenience of description, the controller of the terminal will be displayed as a terminal for convenience.

The generation, transmission, reception, and viewing of messages can all be performed in one terminal, but in order to more clearly explain the contents of the present invention, a terminal for generating and transmitting a message is displayed as a transmitting terminal. Then, the terminal for receiving and viewing the message will be displayed as the receiving terminal. In addition, a user requesting generation and transmission of a message is displayed as a sender using a transmitting terminal, and a user receiving and reading a message is displayed as a receiver using a receiving terminal.

First, when the execution of an application installed on the sender terminal is selected by the sender (S100), the sender terminal activates the camera module so that the sender can take a picture to be included in the message, and uses the activated camera module to take a picture. Take a picture (S120).

In one embodiment, the sender terminal can select a text selection window (not shown) and a color of text to select text to be included in a message on the view of the sender terminal through a camera on the screen. It can be displayed with a text color selection window (not shown).

At this time, if the sender selects any one of a plurality of texts included in the text selection window, the sender terminal can display the text selected by the sender on the screen of the sender terminal. For example, when the sender selects the text "thank you" in the text selection window, the sender terminal displays the text "thank you", which is the text selected by the sender, on the screen of the sender terminal. That is, the view viewed through the camera module and the text selected by the sender are overlapped and displayed on the screen of the transmitting terminal.

In one embodiment, when the sender terminal displays the text selected by the sender on the screen, the text selected by the sender is displayed on the text display position selected by the sender by receiving a selection request for the text display position from the sender can do.

Next, the transmitting terminal displays the photographed picture through the screen of the transmitting terminal (S130). At this time, the photographed picture may be displayed on the screen together with the text selected by the sender.

Then, when an input of the first touch signal by the sender is detected on the picture displayed on the screen of the sender terminal (S140), the sender terminal activates the recording module to make a voice of the sender, and generates according to the first touch signal Acquire first coordinate values of touch points constituting the first touch path to be obtained (S150). At this time, recording may be performed for a predetermined time (eg, 15 seconds).

In one embodiment, in order to guide the user's voice recording when recording the user's voice, the transmitting terminal may overlap and display a guide menu for guiding voice recording on the photographed picture. At this time, the transmitting terminal may display the picture sharpened by reducing the sharpness of the photographed picture by a predetermined value in order to improve the visibility of the guide menu displayed overlapping the photographed picture.

In the above-described embodiment, the transmitter-side terminal may allow voice recording to be performed only when the first touch signal by the sender is continuously input, but may be removed after the input of the first touch signal by the sender is detected. Even if a touch signal is not continuously input, voice recording can be performed for a predetermined time.

In the above-described embodiment, although the sender has been described as recording the voice of the sender, the present invention is not limited to this, and the sender may record various sounds desired to be transmitted to the receiver.

Meanwhile, as illustrated in FIG. 3, the transmitting terminal generates a first touch pass 320 generated according to a first touch signal continuously input while recording is in progress after the input of the first touch signal on the screen is detected. ) To obtain first coordinate values of a plurality of touch points. At this time, the first coordinate value is composed of the x-coordinate and y-coordinate of each touch point on the screen, the x-coordinate represents the width, which is the horizontal resolution of the screen, and the y-coordinate represents the height, which is the vertical resolution of the screen. Shows.

Next, the transmitting terminal converts the first coordinate value obtained during the voice recording process into the second coordinate value according to the ratio of the screen resolution of the transmitting terminal and a predetermined reference value (S160). At this time, the second coordinate value is also composed of the x and y coordinates of the touch point.

In one embodiment, the transmitting terminal may convert the first coordinate value to the second coordinate value using Equations 1 and 2 below.

In Equation 1, X _S represents the X coordinate of the first coordinate value, W _S represents the width that is the vertical resolution of the terminal screen of the transmitting side, R _V represents the reference value, and X _T represents the X coordinate of the second coordinate value. Indicates. In addition, in Equation 2, Y _S denotes the Y coordinate of the first coordinate value, H _S denotes the height that is the horizontal resolution of the transmitting terminal screen, R _V denotes the reference value, and Y _T denotes the second coordinate value. Y coordinate.

Hereinafter, a method in which the transmitting terminal converts the first coordinate value to the second coordinate value will be described as an example.

Assuming that the width of the transmitting terminal screen is 200, the height is 500, the first coordinate value is (1,1), and the reference value is 1000, the X coordinate of the second coordinate value is 5 by Equation (1). Since the Y coordinate of the 2 coordinate value becomes 2 by Equation 2, the second coordinate value is converted to (5,2).
As described above, in the case of the present invention, since the first coordinate values of a plurality of touch points constituting the first touch path 320 are stored and converted into second coordinate values at a time, conversion efficiency can be improved.

Next, when the voice recording of the sender is completed, the sender terminal generates a message including the photographed picture, the recorded voice, and the information of the first touch path (S170).

In one embodiment, the information of the first touch path is composed of a set of second coordinate values, and the second coordinate value may be arranged according to a temporal order in which touch points constituting the second coordinate value are generated.

Next, when the sending terminal receives a selection request for a recipient to send a message from the sender (S180), the message generated through the above-described process is transmitted to the recipient's terminal selected by the sender (S190). In one embodiment, the sender terminal may provide the sender with a list of recipients synchronized with the address book stored in the sender terminal, so that the sender can more conveniently select the recipient.

In the above-described embodiment, it has been described that the transmitting terminal activates the camera module to generate a message and takes a picture, but this is only an example, and uses a pre-stored picture or a pre-stored picture. You can also create a new photo by compositing with a photo or editing a pre-stored photo using the taken photo.

Next, with reference to FIG. 2, a method of receiving a message in which pictures, voices, and touch information are combined will be described.

First, when a message is received at the receiving terminal, the receiving terminal notifies the recipient of the message through an application installed in the receiving terminal (S200).

Thereafter, when the recipient selects viewing of the message received through the execution of the application (S210), the receiving terminal displays the picture included in the message on the screen of the receiving terminal (S220).

In one embodiment, the receiving terminal displays a picture included in the message on the screen of the receiving terminal, in order to guide a method of reproducing the voice of the sender included in the message, guides voice reproduction on the received picture The guide menu for doing this can be displayed by overlapping. At this time, the receiving terminal may display the reduced sharpness of the received picture by a predetermined value in order to improve the visibility of the guide menu displayed overlapping with the received picture.

Thereafter, the receiving terminal converts the second coordinate values of the plurality of touch points constituting the information of the first touch path included in the received message into third coordinate values according to the ratio of the screen resolution and the reference value of the receiving terminal. (S225). At this time, the third coordinate value is composed of the x coordinate and the y coordinate of the touch point corresponding to the second coordinate value on the screen of the receiving terminal.

In one embodiment, the receiving terminal may convert the second coordinate value to the third coordinate value using Equations 3 and 4 below.

In Equation 3, X _R represents the X coordinate of the third coordinate value, W _R represents the width that is the horizontal resolution of the receiver terminal screen, R _V represents the reference value, and X _T represents the X coordinate of the second coordinate value. Indicates. In addition, in Equation 4, Y _R represents the Y coordinate of the third coordinate value, H _R represents the height that is the vertical resolution of the receiver terminal screen, R _V represents the reference value, and Y _T represents the second coordinate value. Y coordinate.

Next, when the input of the second touch signal by the receiver is detected on the picture displayed on the screen of the receiving terminal (S230), the first coordinate according to the third coordinate value on the picture displayed on the receiving terminal screen The recorded voice is reproduced while displaying the touch path (S240).

At this time, in order to improve the visibility of the first touch path displayed on the screen, the receiving terminal reduces and displays the clarity of the picture displayed on the screen by a predetermined value than the original clarity, while the recorded voice is played back. Sharpness can be displayed in increments up to the original value.

In one embodiment, in displaying the first touch path according to the third coordinate value, the receiving terminal, as shown in FIG. 4, displays an indicator 420 of a predetermined shape on the third coordinate value on the picture. The first touch path may be displayed on the picture by moving according to the first touch path 430 according to.

On the other hand, the receiving terminal determines whether the input of the second touch signal is continuously detected during the process of performing S240, and performs the S240 when the input of the second touch signal is continuously detected during the process of performing S240, If the input of the second touch signal is not continuously performed during the process of performing S240, the display of the first touch path and the reproduction of the recorded voice are temporarily stopped. Then, when the input of the second touch signal is detected again, the recorded voice is reproduced while displaying the first touch path.

On the other hand, the receiving terminal determines whether the second touch path and the first touch path generated according to the second touch signal continuously input during the process of performing S240 intersect (S250), and if they cross, a predetermined animation effect Is displayed on the screen of the receiving terminal (S260).

Then, when the reproduction of the recorded voice is completed (S270), the receiving terminal provides a guide screen to guide the processing of the received message to the recipient (S280), and processes the message according to the recipient's selection. In one embodiment, a method of processing a received message may include storing, deleting, generating a reply message for the received message, and listening to the received message again.

The above-described method of transmitting and receiving a message in which picture, voice, and touch information is combined may be implemented in a program form that can be performed using various computer means, and also a method of transmitting and receiving a message in which picture, voice, and touch information is combined. The program for execution is stored in a computer-readable recording medium such as a hard disk, CD-ROM, DVD, ROM, RAM, or flash memory.

Those skilled in the art to which the present invention pertains will understand that the above-described present invention can be implemented in other specific forms without changing its technical spirit or essential features.

Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. The scope of the present invention is indicated by the following claims rather than the above detailed description, and it should be interpreted that all changes or modifications derived from the meaning and scope of the claims and equivalent concepts are included in the scope of the present invention. do.

Claims (9)

When transmitting, when the user's first touch signal is input on the picture displayed on the screen of the terminal, recording the user's voice for a predetermined recording time; And when the user's voice recording is completed, generating and transmitting a message including the photo, the recorded voice, and the information of the first touchpath generated according to the first touch signal during the recording time.
Upon reception, while the second touch signal is input by the user on the photo included in the received message, sequentially displaying the first touch path on the photo in the order in which the first touch path was generated. Playing the recorded voice; And displaying a predetermined animation effect on the screen of the terminal when the second touch path generated according to the second touch signal intersects with the first touch path. How to send and receive messages combined with information. The method of claim 1, wherein the step of transmitting,
Converting first coordinate values of a plurality of touch points constituting the first touch path into second coordinate values according to a ratio of the screen resolution of the terminal and a predetermined reference value;
Generating information on the first touch path by arranging second coordinate values of the plurality of touch points according to a time sequence in which each touch points are input; And
And combining the photo, the recorded voice, and the information of the first touchpath to generate the message and transmitting the generated message. How to send and receive. According to claim 2,
The reproducing may further include converting second coordinate values of a plurality of touch points constituting the information of the first touch path into third coordinate values according to the ratio of the screen resolution of the terminal and the reference value. ,
The first touch path is a picture, displayed on the screen of the terminal according to the third coordinate value, characterized in that the picture, voice, and a message transmission and reception method combined with touch information. delete According to claim 1,
In the regenerating step,
Decreasing the sharpness of the picture included in the message by a predetermined value and displaying it on the screen of the terminal, and gradually increasing the sharpness of the picture displayed on the screen of the terminal to the original value while the recorded voice is being played. Characterized in that the picture, voice, and a message transmission and reception method combined with touch information. According to claim 1,
In the regenerating step,
A method of transmitting and receiving a message in which pictures, voices, and touch information are combined, characterized by displaying the first touch path on the photo by moving an indicator of a predetermined shape according to the first touch path on the photo. According to claim 1,
In the regenerating step,
When the second touch signal is generated at a predetermined location, the method of transmitting and receiving a message in which pictures, voices, and touch information are combined is characterized by reproducing the recorded voice while displaying the first touch path. Recording a voice for a predetermined recording time when a user's touch signal is input on the picture displayed on the screen of the terminal, and obtaining touchpath information generated according to the touch signal during the recording time;
Generating and transmitting a message including the picture, the touchpath information, and the recorded voice; And
When the message is received and a second touch signal is input by the user on the picture included in the message, the recorded voice is displayed while sequentially displaying the touchpath information on the picture in the order in which the touchpath information was generated. And reproducing the message. The method of claim 8,
And before the transmitting, converting the touchpath information into reference coordinate information according to a ratio between the screen resolution of the terminal and a predetermined reference value.

Images