KR20060076476A - Method for administering multimedia call and message of mobile telecommunication terminal - Google Patents

Abstract

The present invention can recognize the voice received from the other party during the call by the mobile communication terminal to display the corresponding screen as an image on the mobile terminal of the receiver and to convert the image selected by the user to the corresponding voice to be delivered to the other party. When the received text message includes a predetermined text character, and converts it into a video or sound effect and outputs a multimedia call and message management method of the mobile communication terminal to enable a more lively call or message reception will be.

According to an aspect of the present invention, there is provided a method of managing a multimedia call of a mobile communication terminal having a voice recognition unit for recognizing a received voice and an image database storing predetermined voice data in correspondence with a corresponding image. a) determining whether an image key button is input while a communication path is opened; (b) when the image key button is input as a result of the determination in step (a), recognizing the voice received from the call partner in real time through the voice recognition unit, and inquiring into the image database; and (c) the step. If the same voice data exists as a result of the inquiry in (b), the method includes displaying the matched and stored image in real time.

Mobile communication, mobile, call, multimedia, image, voice recognition, sound effect

Description

Method for administering multimedia call and message of mobile telecommunication terminal

1A and 1B are front and rear views showing the appearance of a mobile communication terminal applicable to the present invention, respectively;

2 is an electrical block diagram of a mobile communication terminal that can be applied to the present invention;

3A and 3B are tables for explaining the structure of an image database and a sound effect database in a mobile communication terminal of the present invention, respectively;

4 is a flowchart illustrating a multimedia call and message management method of a mobile communication terminal of the present invention.

*** Explanation of symbols for the main parts of the drawing ***

100: mobile communication terminal 110: main body

112: numeric / character key buttons 113: microphone hole

114: Volume button 115: Camera button

116: Standard terminal slot 117: Camera lens

118: flash 119: infrared communication element

120: slider 121: function key button                 

122: flat panel indicator 123: speaker hole

130: antenna 140: battery pack

143: charging terminal

210: control unit 220: radio frequency transmitting and receiving unit

222: antenna 230: key input unit

232: Function key 234: Numeric / character keys

240: memory 242: program storage unit

244: data storage unit 250: voice signal processing unit

252: microphone 254: speaker

260: flat panel display driver 262: flat panel display

270: vibration generator 272: vibration motor

274: LED driver 276: LED

280: camera driver 282: CCD camera

284: Image Processing Unit 286: Infrared Transmitter / Receiver

288: speech recognition unit

The present invention relates to a method of managing a call and a message of a mobile communication terminal, and more particularly, to a method of managing a call and a message of a mobile communication terminal to insert and output an image or an effect sound during a call or message confirmation of the mobile communication terminal.

The mobile communication terminal, which is a necessity for modern people, is not only compact and lightweight due to steady development, but also is emerging as a complex communication terminal having various functions such as mp3, camera and navigation. In addition to the above functions, such a mobile terminal has a voice mail service (called a voice mail service) that allows a sender to leave a message in a recipient's voice mailbox or a fax mailbox when the receiver cannot answer a call. Voice Activated Dialing Service, a mobile communication terminal screen that allows you to make a voice call without having to dial a phone number. You can receive numbers and text messages (about 40 ~ 50 letters in English, about 80 letters in English) or various life information as texts. If you use the voice mail service, you will be notified by mobile phone when a message arrives at the voice mail. Various features and services, including support for Short Message Service (SMS) The offers.

On the other hand, in recent years, with the rapid development of semiconductor memory and communication fields, the processing performance of CPU cores mounted in mobile communication terminals has been greatly improved, and the memory capacity has also been developed in the direction of having a smaller capacity and a larger capacity. Accordingly, the ability to process multimedia data in the mobile communication terminal has been greatly improved.

However, in the conventional mobile communication terminal as described above, only the voice of the other party is simply transmitted during the voice call, so that the mobile communication terminal is not only monotonous but also does not exhibit the performance of the mobile communication terminal. Furthermore, the short message service (SMS) also has a problem in that it is monotonous because only a few text characters can be transmitted in Korean.

The present invention has been made to solve the above-described problem, and recognizes the voice received from the other party during the call by the mobile communication terminal to display the corresponding screen as an image on the mobile communication terminal of the receiver and to display the video selected by the user Transition to the corresponding voice to be delivered to the other party, and furthermore, if the received text message contains a predetermined text character to convert it into a video or sound effect and output it to make the call or message more lively An object of the present invention is to provide a multimedia call and message management method of a communication terminal.

According to an aspect of the present invention, there is provided a method for managing a multimedia call of a mobile communication terminal including a voice recognition unit for recognizing a received voice and an image database storing predetermined voice data in correspondence with a corresponding image. A multimedia call management method, comprising: (a) determining whether an image key button is input while a call path is opened; (b) when the image key button is input as a result of the determination in step (a), recognizing the voice received from the call partner in real time through the voice recognition unit, and inquiring into the image database; and (c) the step. If the same voice data exists as a result of the inquiry in (b), the method includes displaying the matched and stored image in real time.

According to another aspect of the present invention, there is provided a method for managing a multimedia call of a mobile communication terminal in the method of managing a multimedia call of a mobile communication terminal having an effect sound database that stores predetermined image data by matching a corresponding sound effect. Determining whether an effect key button is input while the furnace is opened; (b) displaying a selectable image list when a sound effect key button is input as a result of the determination in step (a); (c) selecting one image from the image list displayed in step (b) and (d) inquiring the image selected in step (c) in the sound effect database and delivering a matched sound effect to the call counterpart. It is made, including.

According to another aspect of the present invention, there is provided a method for managing a multimedia message of a mobile communication terminal, the method comprising: (a) a method of managing a multimedia message of a mobile communication terminal having an image database storing a predetermined text string corresponding to a corresponding image and storing the same; Receiving a text message to be checked from a text message list; (b) querying the character string included in the text message selected in step (a) in the image database when the image key button is input; and (c) the same character string is found as a result of the inquiry in step (b). If present, displaying the matched image together with the text message.

According to another aspect of the present invention, there is provided a method for managing a multimedia message of a mobile communication terminal, the method comprising: (a) a method of managing a multimedia message of a mobile communication terminal having an effect sound database storing a predetermined text string corresponding to a corresponding sound effect and storing the same; Receiving a text message to be checked from a text message list; (b) querying the character string included in the text message selected in step (a) in the sound effect database when the sound effect key button is input; and (c) as a result of the inquiry in step (b), If present, the method includes displaying a text message and outputting a matched sound effect through the speaker.

Hereinafter, a multimedia call and message management method of a mobile communication terminal according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1A and 1B are a front view and a rear view showing an appearance of a mobile communication terminal applicable to the present invention, respectively, illustrating a slide type mobile communication terminal. Of course, it should be noted that the present invention is not limited to the terminal of this manner and structure. As shown in FIGS. 1A and 1B, a mobile communication terminal (hereinafter, also referred to as a “terminal”) 100 to which the present invention can be applied includes a main body 110 and a flat panel display 122 having a main circuit built therein. ), The slider 120 may slide up and down in the main body 110.

In the above-described configuration, the front of the main body 110 has a number / letter key button 112 is used to receive the numbers and letters, the upper surface to perform infrared communication (IrDA) with the antenna and other external communication devices The infrared communication element 119 to be used is disposed, and a microphone hole 113 communicating with an internal microphone (not shown) is punctured at a lower position. The main body 110 is also provided with a rear surface in place, for example, a camera lens 117 and a flash 118 for illumination at night, and a battery pack 140 is detachable at the bottom thereof. The lower surface of the main body 110 is provided with a standard connection terminal slot 116 through which power for transmitting / receiving data with other terminals or charging the battery pack 140 coupled to the main body 110 is transmitted. .

On the other hand, the front surface of the slider 120 is provided with a flat panel display 122 for displaying various characters or graphic elements indicating the operation and operation state of the mobile communication terminal 100 and still images and moving pictures, and below the terminal ( A function key button 121 used to select or receive various functions included in 100 is arranged. The function key button 121 includes an image key button and an effect sound key button according to the present invention. Further, a speaker hole 123 communicating with an internal speaker (not shown) is drilled in place of the slider 120, for example, the flat display 122. In the drawing, reference numeral 114 denotes a volume button, 115 denotes a camera button, and 143 denotes a charging terminal exposed under the battery pack 140.

2 is an electrical block diagram of a mobile communication terminal to which the present invention can be applied. As shown in FIG. 2, the electrical configuration of the mobile communication terminal to which the present invention can be applied includes a radio frequency transmitter / receiver 220 and a number / character that transmit / receive a radio frequency signal with a base station through an antenna 222. The key input unit 230, which includes a function key input unit 232 and a numeric / character key input unit 234 for generating a corresponding key signal when the key button 112 or the function key button 121 is operated, A program storage unit 242 for storing various application programs such as an operating system (OS) or a program according to the multimedia call / message management method of the present invention, and image data and sound effect data according to the present invention, or data set by a user. Or a memory 240 including a data storage unit 244 for temporarily storing data generated during arithmetic operation, and converts an external sound wave into a corresponding analog type voice signal. The microphone 252, a speaker 254 for converting an analog voice signal generated inside the terminal into sound waves, and converts an analog voice signal input from the microphone 252 into a corresponding digital voice signal, When the voice signal processing unit 250, the flat panel display 262 and the flat panel display driver 260, and the terminal 100 for operating the audio signal to a corresponding analog voice signal to output to the speaker 254 in the vibration mode The voice processed by the vibration motor 272 generating the vibration, the driving unit 270, the LED 276 that visually displays the event when an event such as a call or a message is received, the driving unit 274, and the voice signal processing unit 250 The speech recognition unit 288 may include a voice recognition unit 288 and a control unit 210 that collectively controls the voice recognition unit 288. It may be implemented by applying a technology such as voice recognition dial service adopted in the.

In addition to the mobile communication terminal to which the present invention is applied, a camera driver 280 for driving the CCD camera 282 under the control of the control unit 210 and the CCD camera 282 installed in place of the main body 110 or the slider 120. ), An image processing unit 284 for processing image data output from the CCD camera 282, and an infrared ray transmitting / receiving unit 286 for emitting infrared rays and receiving infrared rays emitted from the outside as short-range communication means. Could be.

3A and 3B are tables in the data storage unit 244 of the memory 240 as tables for explaining the structure of the image database and the sound effect database in the mobile communication terminal of the present invention, respectively. As shown in FIG. 3A, the image database stores predetermined voice data, for example, a word voice composed of nouns, for each category, and a corresponding image image is matched with each voice data, and a corresponding text string This can be further matched. And the categories may include, for example, food, gifts, emotions, landscapes, pets, tourist attractions or transportation, and in the case of such categories, for example gift categories, one or more details such as bouquets or accessories. Items may be batched. Meanwhile, the matched and stored image may include an actual photo image or a video, but may be an icon having a small memory capacity by being iconized as a clip art.

Meanwhile, as shown in FIG. 3B, the sound effect database also stores predetermined image data, preferably image data such as clip art, for each category, and corresponding sound effects are matched to each image data. In addition to, a text string indicating the image may be further matched. The category may include, for example, emotions, pets, birds, landscapes or natural sounds, and such categories, for example, pet categories, may store dog images or cat images.

4 is a flowchart illustrating a method for managing a multimedia call and a message of a mobile communication terminal according to the present invention, and unless otherwise described, the controller 210 mainly performs the control. As shown in FIG. 4, first, in step S10, it is determined whether a call path is established between an external call counterpart. If a call path is opened, an image key button is input in step S12 while supporting a voice call. Determine if As a result of the determination in step S12, when the image key button is input, the process proceeds to step S14 to analyze in real time the voice received from the call counterpart and recognizes the result. The analysis and recognition is the result processed by the voice recognition unit 288. Will be performed by Next, in steps S16 and S18, the recognized voice data is queried from the image database shown in FIG. 3A to determine whether the same or similar voice data exists. If so, the process proceeds to step S20 to match the image matched thereto. The output is displayed on the flat panel display 262 in real time.                     

Next, in step S22, it is determined whether the sound effect key button is input, and when the sound effect key button is input, the list of sound effect images selectable from the sound effect database is output to the flat panel display 262. In this state, the desired sound effect image is selected from the user in step S26, and the sound signal processing unit 250 processes the sound effect data matched to the selected sound effect image in step S28, and then calls through the radio frequency transmitter / receiver 220. It will be delivered to the other party.

In step S30, it is determined whether the call has ended. If not, the process returns to step S12. If the image key button is not input in step S12 or does not exist in step S18, the flow goes directly to step S22, and if the sound effect key button is not input in step S22, the flow goes directly to step S30.

On the other hand, if the call path is not connected in step S10 and proceeds to step S40 to determine whether the text message confirmation key button is input, if not entered, performs another selected function, if entered, proceeds to step S42 Read selected text message from user. Next, in step S44, it is determined whether an image key button has been input, and if so, performing the steps S46 and S48 inquires the character string included in the text message from the image database, and if the same character string exists, The matched image is read out and displayed on the flat panel display 262 instead of or in parallel with the character string.

As a result of the determination in step S44, if the image key button is not input, the process proceeds to step S50 to determine whether the sound effect key button is input. In case of input, the character string included in the text message is performed by performing steps S52 and S54. If the same character string exists after being queried from the sound effect database, the read out sound effect is output through the speaker 254 and the step S56 is performed to display the corresponding text message through the flat panel display 262.

The multimedia call and message management method of the mobile communication terminal of the present invention is not limited to the above-described embodiment, and various modifications can be made within the scope of the technical idea of the present invention.

According to the multimedia call and message management method of the mobile communication terminal of the present invention as described above, by recognizing the voice received from the other party during a call by the mobile communication terminal to display the corresponding screen as an image on the mobile communication terminal of the receiver In addition, it is possible to provide a more vibrant voice call service by converting the video selected by the user to a corresponding voice to be delivered to the other party. Furthermore, when the received text message includes a predetermined text character, it is possible to provide a more lively message service by converting it into an image or sound effect and outputting the same.

Claims (6)

In the multimedia call management method of a mobile communication terminal having a voice recognition unit for recognizing a received voice and an image database for matching and storing predetermined voice data with a corresponding image, (a) determining whether an image key button is input while a communication path is opened; (b) if the image key button is input as a result of the determination in step (a), recognizing the voice received from the call partner in real time through the voice recognition unit and inquiring into the image database; and and (c) displaying the matched and stored images in real time when the same voice data exists as a result of the inquiry in step (b). The method of claim 1, wherein the image is an image of a clip art form. In the multimedia call management method of a mobile communication terminal having a sound effect database for storing predetermined image data by matching with a corresponding sound effect, (a) determining whether a sound effect key button is input while a communication path is opened; (b) displaying a selectable image list when a sound effect key button is input as a result of the determination in step (a); (c) receiving one image from the image list displayed in step (b); and (d) querying the image selected in the step (c) in the sound effect database and delivering a matched sound effect to a call counterpart. In the multimedia message management method of a mobile communication terminal having an image database for storing a predetermined text string matched with a corresponding image, (a) receiving a text message to be checked from a text message list; (b) inquiring, in the image database, the character string included in the text message selected in the step (a) when the image key button is input; (c) if the same character string exists as a result of the inquiry in step (b), displaying the matched image together with the text message. 5. The method of claim 4, wherein the image is an image in the form of a clip art. In the multimedia message management method of a mobile communication terminal having a sound effect database for storing a predetermined text string matched with a corresponding sound effect, (a) receiving a text message to be checked from a text message list; (b) searching for the character string included in the text message selected in step (a) in the sound effect database when the sound effect key button is input; and (c) if the same character string is present as a result of the inquiry in step (b), displaying a text message and outputting a matched sound effect through a speaker. How to manage multimedia messages.

Images