KR20090105198A - Method and apparatus for providing message based on emotion - Google Patents

Abstract

PURPOSE: A sensibility message transferring method and a device according to the mood of a user are provided to supply a respond and recognize the mood of the user by using voice data and image data. CONSTITUTION: A sensibility message transferring method is as follows. A message is received(S310). The message includes video data in which a subject is image-picked up from a communication terminal. The pattern information is obtained in received video data(S330). The pattern information includes the face pattern information, the shape of mouth pattern information and operation pattern information. The sensibility message corresponding to the determined mood is generated(S370). The generated sensibility message is transmitted to the communication terminal(S380).

Description

Method and apparatus for sending emotion message {Method and apparatus for providing message based on emotion}

The present invention relates to a method and apparatus for transmitting an emotional message, and more particularly, to a method and apparatus for transmitting an emotional message according to an emotional state of a user.

Recently, with the rapid development of electronic engineering, communication engineering, and communication terminal technology, mobile communication terminals also have various functions. That is, with the rapid development of wireless communication and wireless data processing technology, people can use not only voice calls but also message transmission using mobile communication terminals.

In addition, due to the rapid dissemination of mobile communication terminals, a considerable amount of communication occurs in human relationships through mobile communication terminals, and thus mobile communication terminals have become an essential means of communication in modern life.

On the other hand, with the development of communication technology, SMS (Short Message Service), MMS (Multimedia Message Service) and the like are commercialized as information transmission and reception means as well as voice call service. Here, the message service is a service for transmitting data including texts in a communication network, and transmits and receives a message through a communication network.

However, in the related art, a mobile communication terminal has become a mainstream message service for transmitting and receiving messages with other communication terminals. Accordingly, when busy modern people do not have a counterpart to receive a message, there is a disadvantage in that a conventional message service cannot be used.

Recently, when a mobile communication terminal transmits a message to a specific server of a communication network, a technique for automatically replying from a server has been disclosed. The conventional automatic reply service mainly provides a realistic answer to a question, and uses a general search tool.

However, the conventional reply service has a problem in that it cannot provide a message in consideration of subjective aspects such as user emotion.

In addition, the conventional reply service has a problem in that it does not provide adequate content in real time in consideration of feelings such as the user's freeness or sadness.

Accordingly, the present invention has been made to solve the above-described problem, the present invention has an object to determine the emotional state of the user using the received image data or audio data, and to provide a reply.

In addition, another object of the present invention is to identify the emotional state of the user, and to provide a reply containing the content according to the identified emotional state.

According to an aspect of the present invention, a method for transmitting an emotional message is disclosed.

In a method of transmitting an emotional message according to an embodiment of the present invention, a method of transmitting an emotional message to a communication terminal connected through a communication network may include: (a) receiving a reception message including image data of a subject photographed from the communication terminal; step; (b) analyzing the received image data to determine an emotional state of the subject; (c) generating an emotional message corresponding to the determined emotional state; And (d) transmitting the generated emotion message to the communication terminal.

According to another aspect of the present invention, a method for transmitting an emotional message is disclosed.

According to another aspect of the present invention, there is provided a method of transmitting an emotional message to a communication terminal connected through a communication network, the method comprising: (a) receiving a received message including voice data of a recorder from the communication terminal; (b) determining an emotional state of the recorder by obtaining a voice characteristic from the received voice data; (c) generating an emotional message corresponding to the determined emotional state; And (d) transmitting the generated emotion message to the communication terminal.

According to another aspect of the present invention, an emotional message transmission apparatus is disclosed.

An emotional message transmission device according to an embodiment of the present invention, the emotional message transmission device connected to the communication terminal through a communication network, the receiving unit for receiving a received message including the image data photographed the subject from the communication terminal; A determination unit which analyzes the received image data to determine an emotional state of the subject; A message generator for generating an emotional message corresponding to the determined emotional state; And a transmitter for transmitting the generated emotion message to the communication terminal.

According to another aspect of the present invention, an emotional message transmission apparatus is disclosed.

An emotional message transmission device according to an embodiment of the present invention, the emotional message transmission device connected to the communication terminal through a communication network, comprising: a receiving unit for receiving a received message including voice data of a recorder from the communication terminal; A determination unit to obtain a voice characteristic from the received voice data to determine an emotional state of the recorder; A message generator for generating an emotional message corresponding to the determined emotional state; And a transmitter for transmitting the generated emotion message to the communication terminal.

Therefore, the present invention has the effect of identifying the emotional state of the user by using the received image data or audio data and providing a reply.

In addition, there is an effect that can determine the emotional state of the user, and provide a reply containing the content according to the identified emotional state.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers, such as second and first, may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the second component may be referred to as the first component, and similarly, the first component may also be referred to as the second component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be denoted by the same reference numerals regardless of the reference numerals and redundant description thereof will be omitted.

1 is a block diagram of an emotional message transmission system according to an embodiment of the present invention.

Referring to FIG. 1, the emotional message transmission system may include a communication terminal 110, a communication network 120, and an emotional message transmission device 130.

In the present specification, the communication terminal 110 is a PDA (Personal Digital Assistant), cellular phone, PCS (Personal Communication Service) phone, WCDMA phone, CDMA-2000 phone, MBS (Mobile Broad and System) to communicate with the mobile communication network 120 In addition to the phone, the communication terminal 110 may communicate with a wired or wireless Internet network, such as a personal computer (PC), a hand-held PC, a notebook PC, and the like.

Hereinafter, a description will be given on the assumption that the communication terminal 110 is a mobile communication terminal 110 such as a WCDMA phone implemented to use a communication service while moving. However, the communication terminal 110 is connected to the type of the communication terminal 110. It is obvious to those skilled in the art that there is no limitation.

The communication terminal 110 may store image data. Here, the image data may include moving image data, still image data such as a picture, and picture image data such as a character. Here, the stored image data may be captured by an imaging device such as a camera provided in the communication terminal 110. Alternatively, the image data may be an image captured during a video call or image data provided from a content providing server.

In addition, the communication terminal 110 may store voice data. That is, the user may record a voice (of course, need not necessarily be the voice of the user) to the communication terminal 110.

In addition, the communication terminal 110 may use the mobile communication network 120 and the message service. For example, the communication terminal 110 may transmit or receive the created message to another communication terminal 110 via a message center (eg, SMSC, MMSC) of the mobile communication network 120. In this case, the communication terminal 110 may attach video data or audio data to the message, and the attached video data or audio data may be transmitted to the communication network 120 together with the message.

In the present invention, the communication terminal 110 transmits a message to which the image data or audio data is attached to the emotional message transmission device 130 (to be described later), and receives the emotional message generated from the emotional message transmission device 130.

The communication network 120 includes not only CDMA or WCDMA, but also all wired and wireless communication networks 120 capable of providing a message transmission service to the communication terminal 110. Here, the message transmission service may include a short message service (SMS), a multimedia message service (MMS), and a long message service (LMS).

WCDMA will be described below as an example. A WCDMA network providing a plurality of contents according to an embodiment of the present invention includes a radio base station (Node B), a radio control station (RNC), a serving GPRS support node (SGSN), and a gateway GPRS support node (GGSN). And a message transfer server (eg, SMSC, MMSC, etc.). Since the WCDMA network is a known technology, detailed descriptions are omitted to clarify the gist of the present invention.

The emotional message transmitting device 130 receives a message (hereinafter, referred to as a "receive message") containing image data photographed by a subject from the communication terminal 110. Here, the received message may be a message transmitted using a specific number. For example, if a user attaches video data to a message to be transmitted and enters a preset number, for example, "## 332 #" in a space for inputting a recipient's telephone number, the message is transmitted through the communication network 120. Sent to the emotional message transmission device 130.

In addition, the emotional message transmitting device 130 may extract image data from the received message. The emotional message transmission device 130 analyzes the extracted image data to determine the emotional state of the subject of the image data.

Subsequently, the emotional message transmission device 130 generates an emotional message in response to the determined emotional state. In detail, the emotional message transmission device 130 may generate a text message of “good enough” when the determined emotional state is “joy”. Alternatively, the emotional message transmission device 130 may generate a text message of “Gee ~~ ^^ *” when the determined emotional state is “sadness”.

Thereafter, the emotion message transmitting device 130 transmits the generated emotion message to the corresponding communication terminal 110 (the communication terminal 110 which has transmitted the received message).

Therefore, the emotional message transmission device 130 receives the image data from the communication terminal 110, and transmits the emotional message in response to the received image data. According to the present invention, a user can transmit a message to which image data (or audio data) is attached and receive a reply of the transmitted message even by himself. In addition, the user may receive an emotional message suitable for the transmitted video data (or audio data) in reply.

In the present specification, the emotional message transmission device 130 is described as being separated from the communication network 120. However, the emotional message transmission device 130 may be implemented as one server of the communication network 120. In particular, it will be apparent to those skilled in the art that the emotional message transmission device 130 may be implemented in various forms, such as implemented in a form included in a message service center (SMSC, MMSC, etc.).

So far, the emotional message transmission system according to an embodiment of the present invention has been described with reference to FIG. 1. Hereinafter, the emotional message transmission device 130 will be described in detail with reference to FIG. 2.

2 is a block diagram of an emotional message transmission device 130 according to an embodiment of the present invention.

Referring to FIG. 2, the emotional message transmission device 130 may include a receiver 210, a determiner 220, a message generator 230, a transmitter 240, and a storage 250.

The reception unit 210 receives a reception message from the communication terminal 110. Here, the received message may include video data or audio data. Here, the image data may be a still image (for example, a picture) or video data captured by the communication terminal 110. In addition, the voice data may be data regarding voice of a person recorded by a user of the communication terminal 110.

In addition, the receiving unit 210 may receive the received message through a specific number (eg, "## 332 #", etc.) that provides a service for transmitting the emotional message. For example, when the user transmits a message, the user may input and transmit a telephone number to receive the message to the specific number described above.

The determination unit 220 analyzes the received image data to determine the emotional state of the subject. In detail, the determination unit 220 may obtain certain pattern information from the received image data. The determination unit 220 compares the acquired pattern information with the reference pattern information to determine the emotional state of the subject (surprise, fear, sadness, anger, hate, calmness and joy, etc.).

Here, the pattern information includes face pattern information, mouth pattern information, and motion pattern information. In addition, the reference pattern information is pattern information classified for each emotional state. That is, the reference pattern information includes preset pattern information (face, mouth shape, motion or voice characteristics, etc.) of the "joy" state, pattern information of the "sadness" state, and the like.

For example, the determination unit 220 obtains mouth pattern information from the received image data. Here, the mouth pattern information is information including feature point data of the mouth pattern, and may be, for example, position information of an edge of the lip portion. In this case, the feature point data may be detected by various methods such as Principle Component Analysis (PCA), Independent Component Analysis (ICA), Wavelet Gaber filtering, and the like.

At this time, the determination unit 220 determines the emotional state of the subject from the mouth-shaped pattern information. According to one embodiment of the present invention, the determination may be made by comparing the mouth-shaped pattern information with the reference pattern information stored in the reference pattern information storage unit 250. Here, the reference pattern information is information including data on mouth-shaped patterns for each emotional state such as joy and surprise.

According to another exemplary embodiment of the present disclosure, the determination unit 220 may obtain facial pattern information or operation pattern information from the received image data, and determine the emotional state of the subject. In this case, the determination unit 220 may obtain face pattern information or motion pattern information by using a similar method of obtaining mouth-shaped pattern information. For example, when the subject is performing a heart-shaped operation, the determination unit 220 may determine that the emotional state is “joy” or “dating relationship”.

Of course, even in this case, the determination unit 220 may determine the emotional state by comparing the previously stored reference pattern information with the acquired face or motion pattern information.

In addition, when the voice message is included in the received message, the determination unit 220 may obtain a voice characteristic from the voice data. Here, the voice characteristic may include voice intensity, voice height, voice speed, voice tremor, and voice frequency characteristic.

The determination unit 220 may determine the emotional state of the recorder by comparing the acquired voice characteristic with reference pattern information (pattern information for each voice characteristic).

The message generator 230 generates an emotional message according to the emotional state determined by the determiner 220. In detail, the message generator 230 receives the emotional state of the subject from the determiner 220. And generates an emotional message that reflects or responds to the emotional state.

According to an embodiment of the present invention, the message generator 230 may select predetermined content (hereinafter referred to as "recommended content") based on the determined emotional state. For example, assume that the determination unit 220 determines the emotional state as "sorrow." Meanwhile, the emotion message transmitting device 130 may store contents classified for each emotional state in the storage area. In this case, the message generator 230 may select one or more contents as recommended contents from contents classified as an emotional state of “sorrow”.

Here, the recommended content may include broadcast content, movie content, music content, literature content such as a novel or a poem. For example, the message generator 230 may select sad movie content for mood change as a recommended content in the emotional state of "sorrow," and if it is determined that the emotional state of "in love," recommends romantic movie content. You can also select by content.

The message generator 230 may generate an emotional message including the selected recommended content. Alternatively, the message generator 230 may generate an emotional message including address information on a storage location of the selected recommended content, for example, a Uniform Resource Locator (URL). In this case, the emotional message may include the access information together with the address information. Therefore, when receiving a sentiment message, the communication terminal 110 may immediately connect to a server that provides the corresponding recommendation content when a predetermined button (for example, a "call" button) is input from the user.

The transmitter 240 may transmit the generated emotion message to the communication terminal 110. Here, the communication terminal 110 is a communication terminal 110 that has transmitted the above-described received message, the emotional message may be transmitted as a reply of the received message.

The storage unit 250 stores the above-described reference pattern information. In addition, the storage unit 250 may store not only the recommended content classified as the emotional state, but also a predetermined program for controlling the overall operation of the emotional message transmitting device 130, data input / output, and various data processed.

In addition, the storage 250 may store data necessary for the message generator 230 to select recommended content. According to an embodiment of the present invention, the storage unit 250 may store collection data of contents classified by emotional states. Accordingly, the message generator 230 may read recommended content suitable for the emotional state from the storage.

In the present specification, the receiver 210, the determiner 220, the message generator 230, the transmitter 240, and the storage 250 are functionally represented. That is, although each functional unit is expressed separately, this is for convenience of description and may be implemented in one circuit.

In particular, the determination unit 220 and the message generator 230 may be implemented in a microcircuit as one logic unit, and the receiver 210 and the transmitter 240 may also be implemented through one communication module. It is obvious to those skilled in the art.

Up to now, the emotional message transmission apparatus 130 according to an embodiment of the present invention has been described with reference to FIG. 2. Hereinafter, the emotional message transmission method will be described in detail with reference to FIGS. 2 and 3.

3 is a flowchart illustrating a process of transmitting an emotional message according to a first embodiment of the present invention.

In the first embodiment of the present invention, the emotional message transmission device 130 determines the emotional state of the subject based on the image data received from the communication terminal 110. The emotional message transmission device 130 generates an emotional message according to the determined emotional state and transmits the emotional message to the communication terminal 110. According to the present invention, a user can transmit a message by himself or herself and receive a reply of the transmitted message. Moreover, the user attaches a picture or the like to the message to receive a reply corresponding to the picture.

Hereinafter, a method of transmitting a first emotional message will be described with reference to FIG. 3.

In step S310, the emotional message transmission device 130 receives a received message from the communication terminal 110. In this case, the received message includes image data such as a picture or a video.

Subsequently, in step S320, the emotional message transmitting device 130 determines whether the received message received in step S310 is transmitted through a specific number.

In detail, the emotional message transmitting device 130 determines whether the message is a message which is transmitted using the general message service (SMS, MMS, etc.), that is, transmitted to another communication terminal 110, or whether the emotional message is desired to be provided. .

In the present specification, the determination of step S320 may be made in a message center (SMSC or MMSC, etc.) belonging to the communication network 120. That is, the present invention may be implemented so that only the message determined by the message center and provided with the emotional message is transmitted to the emotional message transmission device 130. In this case, step S320 may be omitted.

On the other hand, in step S330, the emotional message transmission device 130 extracts the image data from the received message, if the received message is transmitted through a specific number as a result of the determination in step S320. The emotional message transmission device 130 obtains pattern information from the image data.

Here, as described above, the pattern information includes face pattern information, mouth pattern information, and operation pattern information.

Subsequently, in step S340 and step S350, the emotional message transmission device 130 compares the obtained pattern information with reference pattern information (S340). The emotional message transmission device 130 determines the emotional state of the subject (S350). Here, the reference pattern information is information for setting a specific face pattern, an operation pattern, and a mouth shape pattern for each emotional state.

For example, the emotion message transmitting device 130 may store information about a smiley face pattern and a smiley pattern in a storage area with a feeling of joy.

In this case, the emotional message transmitting device 130 may determine that the acquired facial pattern information is closest to the smiley face pattern information. In this case, the emotional message transmitting device 130 may set the emotional state of the subject to a "joy" state. You can judge.

Subsequently, in step S360, the emotional message transmitting device 130 selects recommended content according to the determined emotional state. In this case, the recommended content may be classified for each emotional state and stored in the storage area.

For example, one or more contents such as movies, music, novels, and poems may be classified according to emotional states such as "joy", "sorrow", "angry," and stored in a table form. In this case, the emotional message transmitting device 130 may select recommended content suitable for the determined emotional state using the stored table.

In operation S370, the emotional message transmission device 130 generates an emotional message including the selected recommended content. Alternatively, the emotion message transmitting device 130 may generate an emotion message including address information (which may also include access information) of a location where the selected recommended content is stored.

Of course, the emotional message may be generated in the form of a text message. In this case, in step S370 of selecting recommended content, the emotional message transmission device 130 may select text data corresponding to an emotional state.

Subsequently, in step S380, the emotional message transmitting device 130 transmits the generated emotional message to the corresponding communication terminal 110. In detail, the emotion message transmitting device 130 transmits the emotion message generated to the communication terminal 110 which has transmitted the received message in step S310.

Therefore, according to the present invention, the user may attach image data to a message and transmit the message to a specific number. Thereafter, the emotion message transmitting device 130 determines the emotional state of the subject of the image data, and transmits the emotion message according to the determination result.

On the other hand, in step S390, if it is determined that the received message is a message using the general message service, that is, if the received message is not transmitted through a specific number providing the emotional message transmission service, the received message is included in the included recipient phone number It is transmitted to the corresponding communication terminal 110.

This is to provide a general message service (known technology), detailed description thereof will be omitted.

4 is a flowchart illustrating a process of transmitting an emotional message according to a second embodiment of the present invention.

In the second embodiment of the present invention, the emotional message transmission device 130 determines the emotional state of the recorder based on the voice data received from the communication terminal 110. The emotional message transmission device 130 generates an emotional message according to the determined emotional state and transmits the emotional message to the communication terminal 110. According to the present invention, a user can transmit a message by himself or herself and receive a reply of the transmitted message. Moreover, the user attaches a picture or the like to the message to receive a reply corresponding to the picture.

Hereinafter, referring to FIG. 4, the second emotional message transmission method will be described, but in the case of overlapping with the description of FIG. 3, the description may be cited and the description may be omitted.

In step S410, the emotional message transmission device 130 receives a received message from the communication terminal 110. In this case, the received message includes voice data.

Here, the voice data is a voice stored in the communication terminal 110, and may be a voice recorded by a user of the communication terminal 110 or a voice of the other party during a call by the user of the communication terminal 110. Hereinafter, voice data recorded by a user of the communication terminal 110 will be described as a representative example.

Subsequently, in step S420, the emotional message transmitting device 130 determines whether the received message received in step S410 is transmitted through a specific number.

In detail, the emotional message transmitting device 130 determines whether the message is a message which is transmitted using the general message service (SMS, MMS, etc.), that is, transmitted to another communication terminal 110, or whether the emotional message is desired to be provided. .

In the present specification, the determination of step S420 may be made in a message center (SMSC or MMSC, etc.) belonging to the communication network 120. In this case, step S420 may be omitted, similar to step S320 of FIG. 3.

Meanwhile, in step S430, the emotion message transmitting device 130 extracts voice data from the received message if the received message is transmitted through a specific number as a result of the determination in step S420. The emotional message transmission device 130 obtains the voice characteristic from the voice data.

Here, the voice characteristic may include the strength of the voice, the height of the voice, the speed of the voice, the vibration of the voice, and the frequency characteristics of the voice as described above.

Subsequently, in step S440 and step S450, the emotional message transmitting device 130 compares the obtained pattern information with reference pattern information (S440). The emotional message transmission device 130 determines the emotional state of the recorder (S450). Here, the reference pattern information is information on a voice characteristic set for each emotional state.

For example, the emotion message transmitting device 130 may store information about a high-pitched laughter pattern in an emotional state of “joy” in the storage area.

In this case, the emotional message transmitting device 130 may determine that the voice characteristic most similar to the obtained voice characteristic is most similar to the laughter sound pattern. In this case, the emotional message transmitting device 130 may determine the emotional state of the recorder as "joy." Can be determined.

Hereinafter, in step S460, step S470, step S480, and step S490, the emotional message transmitting device 130 performs a process similar to that in steps S360, S370, S380, and S390 described in the description of FIG. 3.

That is, the emotional message transmission device 130 selects the recommended content according to the determined emotional state and generates an emotional message including the selected recommended content (or location information in which the recommended content is stored). The emotion message transmitting device 130 transmits the generated emotion message to the corresponding communication terminal 110.

As described above, according to the second embodiment of the present invention, the emotional message transmission device 130 may determine the emotional state and perform a reply (emotional message) using not only the image data but also the audio data included in the message. have.

So far, a method of transmitting an emotional message according to an embodiment of the present invention has been described with reference to FIGS. 3 and 4. Hereinafter, a process of obtaining mouth shape pattern information for determining an emotional state will be described in detail with reference to FIG. 5.

5 is an exemplary view for explaining a process of acquiring mouth-shaped pattern information according to an embodiment of the present invention.

According to the present invention, the emotional message transmission device 130 obtains pattern information from the received image data. The emotional message transmission device 130 determines the emotional state by comparing the obtained pattern information with the reference pattern information, and generates an emotional message accordingly.

Here, the pattern information includes face pattern information, motion pattern information, and mouth shape pattern information. Hereinafter, as a representative example, mouth shape pattern information will be described a process of obtaining pattern information from image data.

The emotional message transmission device 130 first extracts the face image before extracting the mouth-shaped image. For example, the face image is extracted by grasping the RGB color of each pixel of each frame of image data and converting the RGB color of each pixel into a HS / Haturation (HS) color value of a Hue-Saturation-Value (HSV) color space. can do.

That is, the emotion message transmitting apparatus 130 detects an area of skin tone from the received image data, selects a candidate for an area similar to a face part, extracts an edge from the candidates, and has an eye having a triangular geometric structure, Find candidates for the nose and mouth to locate the face area and eye nose mouth that satisfy all three.

Thereafter, the emotion message transmitting apparatus 130 recognizes only the mouth area, which is an important determination area, as valid data, and detects the lip area by using a difference between RGB (Red, Green, Blue) values of the lip part and the skin part. In the extracted lip part, mouth shape information may be obtained by detecting position information of edges, which are line segments forming an inner boundary of the lip. At this time, the mouth pattern information may include the interval and the angle of the horizontal / vertical of the lips calculated using the position information of the edge.

Thereafter, the emotion message transmitting device 130 may compare the mouth pattern information with the reference pattern information to determine an emotional state and generate an emotion message.

The emotional message transmission device 130 transmits the generated emotional message to the communication terminal 110 that has transmitted the received message.

The invention can also be embodied as computer readable code on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored.

For example, the computer-readable recording medium may include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

It may also include the implementation in the form of a carrier wave (for example, transmission over the Internet).

The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

And functional programs, codes and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art to which the present invention pertains without departing from the spirit and scope of the present invention as set forth in the claims below It will be appreciated that modifications and variations can be made.

1 is a block diagram of an emotional message transmission system according to an embodiment of the present invention.

2 is a block diagram of an emotional message transmission apparatus according to an embodiment of the present invention.

3 is a flowchart illustrating a process of transmitting an emotional message according to a first embodiment of the present invention.

4 is a flowchart illustrating a process of transmitting an emotional message according to a second embodiment of the present invention.

5 is an exemplary view for explaining a process of obtaining the mouth-shaped pattern information according to an embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

110: communication terminal 120: communication network

130: emotion message transmission device 210: receiver

220: determination unit 230: message generating unit

240: transmission unit 250: storage unit

Claims (14)

In the method for transmitting an emotion message to a communication terminal connected through a communication network, (a) receiving a message including image data of a subject photographed from the communication terminal; (b) analyzing the received image data to determine an emotional state of the subject; (c) generating an emotional message corresponding to the determined emotional state; And (d) transmitting the generated emotion message to the communication terminal. The method of claim 1, In step (b), Acquiring pattern information including one or more of face pattern information, mouth pattern information, and motion pattern information from the received image data; And And comparing the obtained pattern information with reference pattern information to determine an emotional state of the subject. The method of claim 1, In step (c), Selecting recommended content based on the determined emotional state; And And generating an emotional message including address information of a location where the recommended content or the selected recommended content is stored. The method of claim 1, The emotional state is, Emotional message transmission method comprising one or more of surprise, fear, sadness, anger, hatred, serenity and joy. The method of claim 1, The video data, Emotional message transmission method comprising at least one of the video data and still image data. In the method for transmitting an emotion message to a communication terminal connected through a communication network, (a) receiving a received message including voice data of a recorder from the communication terminal; (b) determining an emotional state of the recorder by obtaining a voice characteristic from the received voice data; (c) generating an emotional message corresponding to the determined emotional state; And (d) transmitting the generated emotion message to the communication terminal. The method of claim 6, In step (c), Selecting recommended content according to the determined emotional state; And And generating an emotional message including address information of a location where the recommended content or the selected recommended content is stored. The method of claim 6, The voice characteristic is, And at least one of voice intensity, voice height, voice speed, voice tremor, and voice frequency characteristics. In the emotional message transmission device connected to the communication terminal through a communication network, A receiving unit for receiving a message including image data photographed by a subject from the communication terminal; A determination unit which analyzes the received image data to determine an emotional state of the subject; A message generator for generating an emotional message corresponding to the determined emotional state; And Emotional message transmission device comprising a transmitter for transmitting the generated emotional message to the communication terminal. The method of claim 9, The determination unit, Obtaining pattern information including at least one of face pattern information, mouth pattern information, and motion pattern information based on the received image data; And the emotion pattern of the subject is determined by comparing the acquired pattern information with reference pattern information. The method of claim 9, The message generator, And selecting the recommended content according to the determined emotional state, and generating an emotional message including address information of the recommended content or a location where the selected recommended content is stored. The method of claim 9, The message containing the video data, Emotional message transmission device, characterized in that received from the communication terminal through a specific number providing a service for transmitting the emotional message. In the emotional message transmission device connected to the communication terminal through a communication network, A receiving unit for receiving a received message including voice data of a recorder from the communication terminal; A determination unit to obtain a voice characteristic from the received voice data to determine an emotional state of the recorder; A message generator for generating an emotional message corresponding to the determined emotional state; And Emotional message transmission device comprising a transmitter for transmitting the generated emotional message to the communication terminal. The method of claim 13, The message generator, And selecting the recommended content according to the determined emotional state, and generating an emotional message including address information of the recommended content or a location where the selected recommended content is stored.

Images