KR100695392B1 - A method for converting SMS message to multimedia message and sending the multimedia message and text-image converting server - Google Patents

Abstract

The present invention relates to a method for converting and transmitting a short message into a multimedia message and a text image conversion server performing the same. The present invention extracts the morphemes of the standard words using the electronic dictionary for Hangul for the short messages sent by the sender, and grasps the contents and the emotional state of the short messages using the natural language processing technology. A multimedia message is selected by selecting a key word corresponding to the content, extracting multimedia data corresponding to the key word from previously stored information, selecting an avatar corresponding to the emotional state, and combining the multimedia data with the avatar corresponding to the emotional state. Create The created multimedia message is sent to the receiver after being confirmed and corrected by the sender. The present invention converts and transmits the SMS message sent by the sender into a multimedia message combined with multimedia data (pictures, videos, images, avatars, etc.) corresponding to the contents of the message, so that the receiver can easily grasp the contents of the message and be interested. To increase the profits of the operator.

Natural Language Processing, Message Conversion, SMS Multimedia, Emotion Recognition

Description

A method for converting SMS message to multimedia message and sending the multimedia message and text-image converting server}

1 is a network diagram illustrating a network environment according to an embodiment to which the present invention is applied.

Figure 2 is a block diagram of a character image conversion server according to an embodiment of the present invention.

3 is a block diagram of a message content analyzer according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating a method of converting a short message into a multimedia message according to an embodiment of the present invention.

5 is a data flow diagram illustrating a process of converting a short message into a multimedia message and transmitting the same according to an embodiment of the present invention.

6 is a diagram illustrating a conversion from a short message to a multimedia message according to an embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

10: SMSC (Short Message Service Center) 20: PDSN

100: text image conversion server 110: short message receiving unit

120: message content analysis unit 130: multimedia data extraction unit

140: multimedia data generation unit 150: multimedia data transmission unit

160: message confirmation unit 121: error correction unit

122: morphological extracting unit 123: neutral processing unit

124: parser 125: emotion recognition unit

126: main word extraction unit 127: avatar selection unit

The present invention relates to a mobile communication supplementary service, which converts a short message (SMS message) transmitted by a sender into a multimedia message corresponding to the contents thereof, and enables the sender to check or modify the converted multimedia message. The present invention relates to a method of transmitting a multimedia message to a receiver (mixed with the called party) according to a transmission request, and a service server (hereinafter referred to as a text image conversion server) for performing the same.

Among the services provided by mobile phones, the short message service is a service that provides the recipient with the text of the text to be delivered within a limited capacity of about 80 bytes. Short message service can replace voice call, and because it is text-based, it is easy to implement and many service agents can be easily implemented on Web or WAP. For this reason, short message services are frequently used by users.

The short message service has advanced in various forms to satisfy various needs of the user, such as a character text service and a color mail service.

The character text service is a service that transmits a character or item set by a user in response to a word of a short message, and the color mail service transmits an icon and a background of various colors mixed with the content of a short message. It is a service. The color mail service provides a variety of default forms to request a user's choice, and analyzes a word in the user's short message and converts the word into an icon corresponding to the meaning.

However, the character character service and the color mail service use simple image compositing techniques, so the characters of the text that are not converted into images must be used as they are, and accordingly, they cannot be represented in various forms to satisfy the user's vision.

SUMMARY OF THE INVENTION The present invention has been made to solve a conventional problem, and an object thereof is to convert a short message sent by a sender into a multimedia message expressed in a form corresponding to the meaning of the content and provide the same to a receiver.

The present invention for achieving the above object, in the method for converting a short message into a multimedia message in a text image conversion server connected to a mobile communication network,

Extracting a morpheme of a standard word using a stored electronic dictionary for a short message sent by the sender;

A second step of identifying the content and the emotional state of the short message using the natural language processing technique on the extracted morpheme;

Selecting a key word corresponding to a content of the short message;

Extracting multimedia data corresponding to the key word from previously stored information and selecting an avatar corresponding to the emotional state;

Generating a multimedia message by combining the extracted multimedia data and the avatar corresponding to the emotional state;

A sixth step of notifying the sender of generating the multimedia message; And

And a seventh step of transmitting the multimedia data to a receiving side according to a request for transmitting the multimedia message from the sender.

The second step may include storing a spacing error using a stem and a mother dictionary, correcting a typo and a spelling error using a spelling error algorithm and the stem and mother dictionary, and chatting using a chat terminology dictionary. It is preferable to include the step of performing the classification of the term and the emoticon term using the motive dictionary, and extracting the morphemes of the standard form using the standard term dictionary. The second step may further include a process of resolving neutrality using the neutrality table.

The present invention further provides a computer readable recording medium having recorded thereon a program for executing the method.

In another aspect, the present invention according to another aspect, the short message service center is a first step of transmitting a short message received from the mobile communication network to the text image conversion server;

The text image conversion server grasps the content of the received short message, converts the short message into a multimedia message composed of multimedia data and / or an emotional state display avatar corresponding to the content, and converts the converted short message into a sender. Informing a second step; And

The text image conversion server includes a third step of transmitting the converted multimedia message to a receiving side according to the request of the sender,

The short message service center provides a method for converting and transmitting a short message into a multimedia message, wherein the short message including a conversion instruction code in header information among the received short messages is transmitted to the text image conversion server.

In addition, the present invention according to another feature for achieving the above object, in the text image conversion server that is connected to the mobile communication network and converts the short message into a multimedia message to transmit,

A short message receiving unit for receiving a short message from a short message service center;

Extract the morpheme of the standard form by using the electronic dictionary for Hangul, grasp the content and emotional state of the short message by using natural language processing technology, extract the main words corresponding to the content of the short message, Message content analysis unit for grasping the state and providing an emotional state identification code according to the emotional state;

A multimedia data extracting unit for extracting multimedia data corresponding to a meaning of the word from its database for the main word output from the message content analyzing unit;

A multimedia message generating unit generating a multimedia message using the multimedia data provided by the multimedia data extracting unit and the avatar corresponding to the emotional state identification code provided by the message content analyzing unit;

Notify the caller of the completion of the multimedia message generation, and if the caller requests the contents of the generated multimedia message, provide a confirmation multimedia message including the generated multimedia message, and the sender can modify the message included in the confirmation multimedia message. A message checking unit for rewriting the generated multimedia message with multimedia data corresponding to the selected item when selecting at least one of the multimedia data list information; And

It provides a text image conversion server including a multimedia message transmission unit for providing a final multimedia message to the receiver in response to a request of the message confirmation unit receiving the message transmission request of the sender.

The message content analyzer is an error correction unit for correcting spelling errors, spacing errors, emoticons and chat terms using the electronic dictionary for Hangul with respect to the text of the received short message, the error-corrected short message A morpheme extraction unit for extracting morphemes from text characters, and applying the neighboring morphemes from the morphemes extracted by the morpheme extraction unit to the neutrality table to check the neutrality, and then, if the phrase has neutrality, Neutrality processing unit to make a morpheme of the set phrase, Syntax processing unit to perform the natural language processing on the morphemes output from the neutrality processing unit to grasp the contents of the sentence and extract a representative morpheme for the content of the sentence, Image or video among the representative morphemes provided by the parser A main word extracting unit for determining a main word that can be expressed as an image, a multimedia data extracting unit for extracting multimedia data corresponding to the main word provided by the main word extracting unit from its own stored database, and a word output from the neutrality processing unit In order to determine the words that can be recognized by the emotion, the emotion recognition emotional words are applied to the previously stored emotional recognition data DB to determine the emotional state of the sentence and includes an emotional recognition unit for determining the corresponding emotional state identification code.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, detailed descriptions of well-known functions or configurations will be omitted if it is determined that the detailed description of the present invention may unnecessarily obscure the subject matter of the present invention. Terms to be described later are terms defined in consideration of functions in the present invention, and may be changed according to intentions or customs of users or operators. Therefore, the definition should be made based on the contents throughout the specification.

Hereinafter, a network environment according to an example to which the present invention is applied will be described with reference to FIG. 1. 1 is a network configuration diagram illustrating a network environment to which the present invention is applied, and a typical cdma2000 1x. The service server, that is, the character image conversion server is added to the EVDO network environment to achieve the object of the present invention.

As shown in Figure 1, the network of the present invention is a mobile terminal (M) capable of accessing a mobile communication network, SMSC (Short Message Service System) (10) for providing a short message transmission service, and packet data of the mobile communication network Packet Image Serving Node (PDSN) 20, which is a synchronous CDMA packet data exchange system for providing a transmission service, and a text image conversion server 100 for converting a short message received from the SMSC 10 into a multimedia message and providing it to a receiver. ). Here, the text image conversion server 100 is connected to the SMSC 10 by the Internet or a local network, and is connected to the PDSN 20 by a local network.

Hereinafter, a text image conversion server 100 according to an embodiment of the present invention will be described with reference to FIG. 2. 2 is a block diagram of a text image conversion server according to an embodiment of the present invention.

As shown in FIG. 2, the text image conversion server 100 may include a short message receiver 110, a message content analyzer 120, a multimedia data extractor 130, a multimedia message generator 140, and a multimedia message transmitter. Unit 150, message confirmation unit 160, stem DB 161, mother DB 162, neutrality table DB 163, avatar DB 164, MD DB (Multimedia Data DB; 165), The recognition data DB 166 is included.

The stem DB 161 stores information on stems forming words, and the parent DB 162 stores information on stems forming words. According to the largest Korean electronic dictionary currently produced, the Dictionary contains about 100,000 vocabulary information and 139 information about the kanji qualities, and about 5,000 forms of mother information and 47 qualities of the mother dictionary. It is. The stem DB 161 includes information of the stem dictionary, and the mother DB 162 includes information of the parent dictionary.

The stem traits include circular information, neutrality, lexicality, dependency, noun, descriptive, rhetoric, verb, action, adjective, adverb, interjection, arabic numerals, tubular adjective, uniqueness, abstraction, specificity, oiliness, humanity, Esteem, narrative, question, personality, recursion, unity, connection, negation, verbal, passive, mobility, bestowal, psychology, hope, judgment, will, function, speech, speech, sense, relationship, bore, Aid, choice, time, period, part, body, natural, artifact, vehicle, food, currency, concrete place, area, artificial place, concrete organization, religion, property, space, direction, time, nature, appearance, type, Form, quantity, “R” rule, “R” rule, “R” rule, “R” rule, “R” rule, “R” rule, “R” rule, “R” rule, neutral treatment, etc.

And the parental qualities are neutrality, dependency, investigation, mother, subject, absolute, object, personality, common, place, origin, destination, tool, qualification, comparison, period, past, present, future, narrative, question, command , Solicitation, admiration, extravergence, driven, treatment, negation, connection, sequential, inversion, transition, condition, intention, reason, concession, result, choice, quotation, proportion, metaphor, conclusion, tubular, intercourse, recall, politeness, etc. have.

The neutrality table DB 163 stores about 65 neutrality tables. Originally, a sentence has one meaning, but sometimes a sentence with two or more meanings appears. The neutrality table contains information on a number of morphemes with a neutrality and a number of morphemes interpreted with a single meaning that allows the interpretation of two or more of these meanings. Stored.

The avatar DB 164 stores avatar data having different expressions, and the MD DB 165 stores words that can be illustrated as images or videos and information about images or videos that are individually matched to the words. Saving.

For example, the MD DB 165 stores the word 'love' and information of '♡' indicating love, the word 'telephone' and information of '☏' indicating a telephone.

On the other hand, when the service of the present invention is a membership system, the avatar DB 164 and the MD DB 165 are allocated a memory space for a subscriber, as well as a memory space for storing avatar or multimedia data provided by an operator. In the member-specific memory space, avatars or multimedia data for each facial expression purchased by the subscriber through cyber money are stored.

The present invention allows a user to purchase avatars and multimedia data for sale through an Internet site (a text image conversion server of the present invention or another Internet site). The purchase method of the sales avatar is in accordance with the conventional electronic commerce method currently provided on the Internet.

The emotion recognition data DB 166 stores words that can recognize emotion and an emotion state identification code matched thereto. For example, the emotion recognition data DB 166 would like to see. Sick, right, falling down love. I hate you. Stores a unique emotional state identification code that can identify a word such as hard and the emotional state represented by the word.

The short message receiving unit 110 receives the short message from the SMSC 10, and the message content analyzing unit 120 processes the natural language using the stem DB 161, the mother DB 162, and the neutral table DB 163. Analyze text characters in short messages according to Natural Language Processing (NLP). And the message content analysis unit 120 outputs an emotional state identification code indicating the emotional state included in the main words and the content of the short message to determine the content of the short message as a result of the analysis of the short message.

The multimedia data extracting unit 130 extracts multimedia data whose meaning matches the main word output from the message content analyzing unit 120 from the MD DB 165, and extracts the extracted multimedia data into the multimedia message generating unit 140. To provide.

The multimedia message generating unit 140 generates a multimedia message by combining the multimedia data provided by the multimedia data extracting unit 130 and the avatar corresponding to the emotional state identification code provided by the message content analyzing unit 120. . The multimedia message transmitter 150 transmits the multimedia message generated by the multimedia message generator 140 to the receiver.

The message checking unit 160 notifies the caller when the multimedia message generating unit 140 completes the generation of the multimedia message, and provides the caller if the caller requests the contents of the generated multimedia message. If the message is requested to be modified, the multimedia data list information that can be modified is provided to rewrite the multimedia message with the multimedia data selected by the user.

The modifiable multimedia data is multimedia data not used when generating multimedia data among two or more multimedia data matching the same main word. The modifiable multimedia data is provided by the user by default and registered by the user.

The message acknowledgment unit 160 provides the receiver with the multimedia message confirmed by the user when the user requests the transmission of the multimedia message.

6, a process of generating a multimedia message based on the content of the short message in the multimedia message generator 140 is illustrated. 6 is a diagram illustrating a conversion from a short message to a multimedia message according to an embodiment of the present invention.

As shown in FIG. 6, the multimedia message generating unit 140 responds to a local name of Gangnam Station for a short message "Meet at 6:00 at Gangnam Station" and shows the surrounding geographical information (GIS information) of Gangnam Station and Gangnam Station. And a multimedia message by combining the caller's avatar and the image “PM 18:00” indicating 6 pm determined from the current time. The multimedia message is then sent to the called party. At this time, the caller's avatar is an avatar selected according to emotion recognition.

Hereinafter, a configuration of the message content analyzer 120 for using natural language processing technology will be described with reference to FIG. 3. 3 is a block diagram of a message content analyzer according to an exemplary embodiment of the present invention.

As shown in FIG. 3, the message content analyzer 120 includes an error corrector 121, a morpheme extractor 122, a neutrality processor 123, a syntax analyzer 124, and an emotion recognizer 125. And a main word extracting unit 126 and an avatar selecting unit 127.

The error correction unit 121 corrects spelling errors with respect to the characters of the received short message, and performs spacing error correction, emoticons and chat terms. The error correction unit 121 corrects the spacing error using the stem DB 161 and the mother DB 162, and uses the spelling error processing algorithm and the stem DB 161 and the mother DB 162 to correct the typo and misspelling errors. It corrects and classifies and processes terms of chat terms and emoticons by using self-managed chat term dictionary and emoticon electronic dictionary.

The stem extractor 122 extracts the stem from the text characters of the error-corrected short message using the stem DB 161 and the parent DB 162. For example, the short message says' I'm up now. If you are going to study at 6 pm in Gangnam station this evening, the morpheme extracting unit 122 is "me", "now", "get up", "study", "go", "today", " Evening "," 6 o'clock "," Gangnam Station ", and" Meet "extract the morphemes of the standard morpheme extraction unit 122 extracts the morphemes of the standard words using the standard term dictionary.

 The neutrality processor 123 checks the neutrality by applying neighboring morphemes among the morphemes extracted by the morpheme extractor 122 to the neutrality table, and sets the morphemes of the corresponding phrases in the case of the neutrality phrases. Stemming phrases.

The parsing unit 124 uses the stem DB 161 and the mother DB 162 with respect to the morphemes output from the neutrality processor 123 to determine the contents of the sentence, and the representative morphemes for the contents of the sentence. The main word extraction unit 126 is provided. When using the short message used as the example again, the parser 124 is "study", "go", "me" "today", "evening", "Gangnam station", "6 o'clock", and "meet" A representative morpheme (representative word) is extracted and provided to the main word extraction unit 124.

The main word extracting unit 126 determines the main morphemes that can be expressed as an image or a video among the representative morphemes provided by the syntax analyzing unit 124 as the main words, and provides the determined main words to the multimedia data extracting unit 130. do. For example, when receiving the morphemes such as "study", "go", "me", "today", "evening", "6", "Gangnam station" and "meet" from the parser 124, the main word extraction The unit 126 extracts the words "me", "evening", "gangnam station", "meet", and "six o'clock".

The emotion recognition unit 125 grasps the emotion state identification code corresponding to the morpheme (word) output from the neutrality processing unit 123 from the emotion recognition DB 166. If none of the words output from the neutrality processing unit 123 is stored in the emotion recognition data DB 166, the emotion recognition unit 125 is assigned to the avatar defaulted by the service provider or the avatar registered as the default value by the user. The corresponding emotional state identification code is obtained.

The emotion recognition unit 125 first classifies the emotions into 50 kinds of emotions, and then classifies the emotions classified into small categories into 13 kinds of emotions.

The emotional subcategory is "love, hate, glad, excited, glad, sad, sad, satisfied, depressed, likes, dislikes, angry, shy, sorry, comfort, surprised, smile, wink Give, kiss, cry, laugh, worry, dizzy, celebrate, don't know, affirm, unclean, wonder, think, sleepy, sleep, guide, say, hide, quiet, busy, leisure , Tired, full, hungry, thirsty, rainy, snowy, sunny, call, send mail, receive mail, miss, promise, insensitive.

The emotional categories are classified into 13 items, such as "good emotion, bad emotion, happy emotion, sad emotion, smile emotion, crying emotion, angry emotion, love emotion, care emotion, consent emotion, rejection emotion, strange emotion, ordinary emotion". have.

Emotional state identification code of the present invention is for indicating the 13 categories of emotional state items.

The emotion recognition unit 125 performs a comprehensive evaluation on a plurality of emotions included in the content of the short message in order to recognize the emotion of the entire content of the short message. To this end, the emotion recognition unit 125 extracts the emotion words included in the content of the short message, grasps the emotions indicated by the extracted emotion words, and accumulates the emotions thus identified to evaluate the overall emotion as a cumulative result. In this case, the emotion recognition unit 15 assigns a weight according to the position of the emotion word in the sentence.

In other words, in the case of the sentence "I was feeling a little bit because the weather has been slowing", the emotional recognition unit 125 judges that 'squeeze × 100 (weight) = sad emotion 100' and the whole sentence emotion is sad. Recognize.

And in the case of the sentence "I was sad and depressed but now I feel good", the emotional recognition unit 125 judges that it is sad x 30 + depressed x 50 = sad emotional 80, and feels good x 100. = Judged to be good sensitivity 100 '. As a result, the emotional recognition unit 125 recognizes the whole sentence emotion as a good emotion because the good emotional index is larger than the sad emotional index.

Hereinafter, a method of converting a short message into a multimedia message according to an embodiment of the present invention will be described with reference to FIG. 4. 4 is a flowchart illustrating a method of converting a short message into a multimedia message according to an embodiment of the present invention.

The service of the present invention may be provided in three embodiments.

The first is to convert all text messages sent by the service sender into multimedia messages, and the second is to determine whether to convert to multimedia messages through the menu of the mobile terminal before the service sender writes the short message. The third is a case where a service subscriber decides whether to convert to a multimedia message through a menu of a mobile terminal after writing a short message. In the second and third cases, the header information of the short message transmitted from the user's mobile phone includes a specific conversion instruction code for instructing conversion into a multimedia message.

If the sender writes a short message and then enters the recipient's mobile phone number and presses the send button to send the short message (S401). The short message is transmitted to the text image conversion server 100 through the mobile communication network and the SMSC (10) (S402).

In this case, the SMSC 10 transmits all received short messages to the text image conversion server 100 in the first case, and grasps header information of the received short message in the second and third cases, and includes a conversion instruction code. The short message is transmitted to the text image conversion server 100.

In the second and third cases, it is necessary to determine whether the sender of the short message is a service subscriber for service restriction or billing. As a method of determining whether the subscriber is a service, the SMSC 10 or the text image conversion server 100 is connected with the home location register (HLR) to check whether the subscriber is a service subscriber from the home location register, and the text image conversion server ( 100) There is a method of identifying the service subscriber by storing the information of the service subscriber in itself.

On the other hand, when the text image conversion server 100 receives the short message, the message content analysis unit 120 analyzes the content of the short message using natural language processing technology (S403), and thereby grasps the content of the short message ( S404).

When the content of the short message is grasped as described above, the text image conversion server 100 uses the emotion recognition data DB 166 to determine whether an emotional word indicating the emotional state of the sender is included in the content, and the overall emotional state according to the emotional word is determined. Conduct emotional awareness to see how it is. If the sender's emotion appears in the content of the short message according to the emotion recognition (S405), the character image conversion server 100 extracts an avatar (or character) expressing the corresponding emotion through the avatar DB 164. (S406), the multimedia data corresponding to the word obtained through the content grasp is extracted using the MD DB 165 (S407).

If the sender's emotion does not appear in the content of the short message, it is determined whether the avatar is used (S408), and if the avatar is used for all message conversion, the avatar registered by the service provider or the service subscriber is extracted from the avatar DB 164. (S409). If the emotion is not shown in the determination process (S408), if the avatar is not used, the process of extracting the avatar is not performed.

The text image conversion server 100 generates a multimedia message by combining the extracted avatar and multimedia data, that is, converts the short message into a multimedia message and temporarily stores the multimedia message (S410).

When the multimedia message for the short message is generated as described above, the text image conversion server 100 transmits an SMS message indicating the completion of the multimedia message to the sender through the SMSC 10 and requests the sender to confirm the multimedia message (S411). .

When the sender confirms the completion of the multimedia message generation through the received SMS message, the caller selects one of the multimedia message confirmation item and the multimedia message transmission item included in the SMS message.

When the multimedia message confirmation item is selected, the sender terminal requests a multimedia message confirmation by accessing the URL of the text image conversion server 100 linked to the multimedia message confirmation item, and in response, the text image conversion server 100 temporarily sends a message. It provides the caller with the stored information of the multimedia message and the list of the multimedia data which can replace the multimedia data included in the multimedia message.

Eventually, the confirmation multimedia message transmitted when the multimedia message is requested includes the multimedia message information converted from the short message and the list information of the multimedia data (avatars, images, videos, texts, etc.) that can be modified by the sender.

Here, more than one multimedia data matched with key words. That is, the multimedia data matched to the key words are multimedia data provided by the operator by default and / or one or more multimedia data registered by the caller. Thus, the list of replaceable multimedia data is a list of identification information of the multimedia data matching the same key word.

 When the caller selects the multimedia data of the corresponding item from the list of editable multimedia data, the multimedia data is rewritten into a new multimedia message including the multimedia data selected by the user.

On the other hand, when the sender selects the multimedia message transmission item, the text image conversion server 100 transmits the currently stored multimedia message to the mobile phone number of the recipient designated by the sender (S413). Here, even when the multimedia is rewritten, the text image conversion server 100 transmits the rewritten multimedia message confirmation SMS to the sender.

Hereinafter, the operation of each component in the service network according to an embodiment of the present invention will be described with reference to FIG. 5. 5 is a data flowchart illustrating a process of converting a short message into a multimedia message and transmitting the same according to an embodiment of the present invention.

When the sender creates a short message (S501) and requests a conversion to a multimedia message while transmitting a short message to the SMSC 10 (S502), the SMSC 10 sends a conversion instruction included in the header information of the received short message. The short message received according to the code is transmitted to the character image conversion server 100 (S503).

The text image conversion server 100 detects the text of the received short message text using natural language processing technology and performs the emotional recognition (S504), according to the main word extracted according to the meaning of the sentence The multimedia message is generated by using the multimedia data and the avatar recognized through the emotion recognition, and stored according to the recipient and the caller's phone number (S505).

When the text image conversion server 100 generates a multimedia message corresponding to the short message, the SMSC 10 transmits an SMS message indicating the completion of the conversion to the sender (S506 and S507).

The sender knows that the conversion is completed through the SMS message received from the SMSC 10. When the caller selects the message confirmation item included in the short message to check the converted multimedia message, the sender's mobile phone sets the data call path with the text image conversion server 100 through the PDSN 20 and sets the text image conversion server. The multimedia message check request to the 100 (S508).

The text image conversion server 100 transmits the confirmation multimedia message including the multimedia data list information that can be modified together with the generated multimedia message according to the sender's message confirmation request to the sender through the PDSN 20 (S509).

Accordingly, the sender checks the editable multimedia data list information together with the converted multimedia message. If the sender does not like the multimedia message converted by the text image conversion server 100 selects the multimedia data to be modified from the list of modifiable multimedia data (S510), and transmits it to the text image conversion server 100 (S511). . At this time, the text image conversion server 100 is transmitted to the correction information for the multimedia data that the sender requested to modify.

When the text image conversion server 100 receives the correction information in response to the confirmation multimedia message from the caller, the text image conversion server 100 extracts the multimedia data corresponding to the correction information from the MD DB 165 and rewrites the multimedia message (S512). . When the rewriting of the multimedia message is completed, the text image conversion server 100 returns to S506.

On the other hand, after the S507 process, if the caller likes the content of the newly created or rewritten multimedia message, the text image conversion server 100 requests the multimedia message to be sent to the receiver (S513), and the text image conversion server 100 The Call Back URL message is used to send the stored multimedia message to the receiver according to the sender's request to send.

That is, the text image conversion server 100 provides the SMSC 10 with the recipient's phone number and his URL information, and requests the recipient to send the callback URL message (S514), whereby the SMSC 10 receives the message. The callback URL message notifying is transmitted to the receiver (S515).

After checking the callback URL message, the receiver accesses the URL information included in the message and requests a multimedia message to be transmitted to the recipient (S516). The text image conversion server 100 reads the multimedia message matched to the receiver's mobile phone number from the stored memory and transmits it to the receiver (S517).

Eventually, the receiver checks the multimedia message converted from the short message as shown in FIG. 6, and thus, the receiver knows that the content meets at the Gangnam station at 6 pm.

The technical spirit of the present invention has been described above with reference to the accompanying drawings, but this is by way of example only and not intended to limit the present invention. In addition, it is obvious that any person skilled in the art can make various modifications and imitations without departing from the scope of the technical idea of the present invention.

The present invention converts the SMS message sent by the sender into a multimedia message combined with multimedia data (pictures, videos, images, avatars, etc.) corresponding to the contents of the message, and transmits it to the sender to confirm the converted multimedia message to the user's intention. By enabling the rewriting of the corresponding multimedia message, the receiver can easily grasp the contents of the message, induce interest, and thus have the effect of increasing the profit of the operator.

Claims (16)

In the method for converting a short message into a multimedia message in a text image conversion server connected to a mobile communication network, Extracting a morpheme of a standard word using a stored electronic dictionary for a short message sent by the sender; A second step of identifying the content and the emotional state of the short message using the natural language processing technique on the extracted morpheme; Selecting a key word corresponding to a content of the short message; Extracting multimedia data corresponding to the key word from previously stored information and selecting an avatar corresponding to the emotional state; Generating a multimedia message by combining the extracted multimedia data and the avatar corresponding to the emotional state; A sixth step of notifying the sender of generating the multimedia message; And And a seventh step of transmitting the multimedia data to a receiving side according to a request for transmitting the multimedia message from the sender. The method of claim 1, Transmitting a confirmation message to the sender via a data channel when the sender is notified of the creation of the multimedia message, and then requesting confirmation of the multimedia message from the sender. How to convert and transfer. The method of claim 2, The acknowledgment multimedia message includes a list of modifiable multimedia data. Accordingly, when the caller selects one or more items of the modifiable multimedia data list, the multimedia message is rewritten with multimedia data corresponding to the selected item. And converting the short message into the multimedia message. The method according to claim 1 or 3, The second step is Storing a spacing error using a stemming and ending dictionary, correcting a misspelling spelling error using a spelling error algorithm and the stemming and ending dictionary, distinguishing a chat term using a chat term dictionary and an emoticon using an emoticon dictionary A method for converting and transmitting a short message to a multimedia message, comprising: performing a term distinction, and extracting a morpheme of a standard word using the standard terminology dictionary. The method of claim 4, wherein The second step further comprises the step of resolving the neutrality by using the neutrality table. The method of claim 1, Understanding the emotional state in the second step Emotional words representing the emotions included in the content of the short message are extracted, the emotional state of the subclassification is grasped from the extracted emotional words, and the emotional state of the overall subclassification is given to the emotional weight according to the position where the emotional word is located in the sentence. And identifying the emotional state of the large category including the overall emotional state of the small category. The method of claim 1, And the avatar corresponding to the emotional state and the multimedia data corresponding to the key word are either an avatar defaulted by a service provider or an avatar registered by a subscriber. The short message service center may include a first step of transmitting a short message received from a mobile communication network to a text image conversion server; The text image conversion server grasps the content of the received short message, converts the short message into a multimedia message composed of multimedia data and / or an emotional state display avatar corresponding to the content, and converts the converted short message into a sender. Informing a second step; And The text image conversion server includes a third step of transmitting the converted multimedia message to a receiving side according to the request of the sender, The short message service center converts and transmits a short message to a multimedia message, characterized in that for transmitting a short message including a conversion instruction code in header information of the received short message to the text image conversion server. The method of claim 8, The second step is Extracting the morpheme of the standard word using a stored electronic dictionary for the short message sent by the sender, Grasping the content and the emotional state of the short message using the natural language processing technology on the extracted morphemes; Selecting a key word corresponding to the content of the short message; Extracting multimedia data corresponding to the key word from previously stored information and selecting an avatar corresponding to the emotional state; Generating a multimedia message by combining the extracted multimedia data and the avatar corresponding to the emotional state; Informing the sender of generating the multimedia message; And transmitting the multimedia data to a receiving side according to a request for transmitting the multimedia message from the sender. The method of claim 9, The second step may further include the step of notifying the sender of the generation of the multimedia message and then transmitting the confirmation multimedia message to the sender through a data channel when the sender requests confirmation of the multimedia message. How to convert and send a short message to a multimedia message. The method of claim 10, In the second step, when the sender selects one or more items of the editable multimedia data list by including the modifiable multimedia data list information in the confirmation multimedia message, the multimedia data corresponding to the selected item is transmitted. And rewriting the multimedia message. The method of claim 1, further comprising rewriting the multimedia message. In the text image conversion server connected to the mobile communication network for converting a short message into a multimedia message, A short message receiving unit for receiving a short message from a short message service center; Extract the morpheme of the standard form by using the electronic dictionary for Hangul, grasp the content and emotional state of the short message by using natural language processing technology, extract the main words corresponding to the content of the short message, Message content analysis unit for grasping the state and providing an emotional state identification code according to the emotional state; A multimedia data extracting unit for extracting multimedia data corresponding to a meaning of the word from its database for the main word output from the message content analyzing unit; A multimedia message generating unit generating a multimedia message using the multimedia data provided by the multimedia data extracting unit and the avatar corresponding to the emotional state identification code provided by the message content analyzing unit; Notify the caller of the completion of the multimedia message generation, and if the caller requests the contents of the generated multimedia message, provide a confirmation multimedia message including the generated multimedia message, and the sender can modify the message included in the confirmation multimedia message. A message checking unit for rewriting the generated multimedia message with multimedia data corresponding to the selected item when selecting at least one of the multimedia data list information; And And a multimedia message transmitter for providing a receiver with a multimedia message, which is finally generated according to a request of the message acknowledgment unit receiving the sender's message transmission request. The method of claim 12, The message content analysis unit, Error correction unit for correcting the spelling error correction, spacing error correction, emoticons and chat terms by using the electronic dictionary for Hangul for the characters of the received short message, A morpheme extraction unit for extracting morphemes from the text characters of the error-corrected short message, Neutral processing unit for applying the neighboring morphemes from the morphemes extracted by the morpheme extracting unit to the neutrality table to check the neutrality, and in the case of the neutrality phrases, the morphemes of the corresponding phrases into morphemes of the set phrases; A syntax analysis unit for performing natural language processing on the morphemes output from the neutrality processor, grasping the content of the sentence, and extracting a representative morpheme for the content of the sentence; A main word extracting unit for determining a main word that can be expressed as an image or a video among representative morphemes provided by the parser; A multimedia data extracting unit extracting multimedia data corresponding to the main word provided by the main word extracting unit from a self-stored database; Determining the words that can be emotionally recognized from the words output from the neutrality processor, and applying the emotional words for emotion recognition to the previously stored emotional recognition data DB to determine the emotional state of the sentence and to determine the corresponding emotional state identification code Character image conversion server including an emotion recognition unit. The method of claim 13, The emotion recognition unit extracts the emotional words representing the emotions included in the content of the short message, grasps the emotional state of the subclassification from the extracted emotional words, assigns the emotional weights according to the positions of the emotional words in the sentences, and The emotional state is identified according to the cumulative value of the emotional weights of the emotional words, wherein the emotional weights are larger as the emotional words located at the rear of the sentence weight character conversion server, characterized in that. The method of claim 14, The avatar and the multimedia data included in the multimedia message are avatars defaulted by a service provider or avatars registered by a subscriber. The method of claim 12, And the modifiable multimedia data list information comprises information of multimedia data which is not included in a multimedia message generated by the multimedia data generating unit among a plurality of multimedia data corresponding to one main word.

Images