KR20070023182A - Mobile telecommunication terminal for forwarding multimedia message by means of voice guidance and method thereof - Google Patents

Abstract

The present invention relates to a mobile communication terminal equipped with a camera, and outputs a media guide voice for a multimedia message transmission service through voice guidance, and if the media selection information is obtained, the media for acquiring the selected media data from the camera or the microphone. Generating a multimedia message to output a data acquisition unit, a message receiver information input guide voice, a receiver information acquisition unit for obtaining message receiver information from the user input information, and to generate a multimedia message including the obtained receiver information and media data And a multimedia message transmission unit for converting and transmitting the generated multimedia message according to a communication method, so that the elderly and the weak user can easily and conveniently follow pictures, videos and videos according to voice guidance without complicated and many key operations. The same media can be sent to the desired party or attached as a text message.

Camera, mobile phone, voice, voice recognition, media, message

Description

Mobile telecommunication terminal for forwarding multimedia message by means of voice guidance and method

1 is a block diagram illustrating a mobile communication terminal according to an embodiment of the present invention.

2 illustrates a multimedia message processing procedure according to an embodiment of the present invention.

3 shows one embodiment of step S705.

4 shows another embodiment of step S705.

5 shows one embodiment of step S709.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile communication terminal equipped with a camera. More particularly, the present invention relates to a technology capable of easily and conveniently taking a picture and a video according to voice guidance and transmitting to a desired party or attaching to a text message without complicated key manipulation.

Recently, in order to satisfy various needs of consumers, various additional functions have been added to the mobile communication terminal in addition to the native call function. For example, additional functions such as a game, internet search, e-mail transmission and payment, and a camera function are also added to a mobile communication terminal so that a picture of an object can be taken and transmitted to a counterpart. Currently, a mobile communication terminal equipped with a camera has been developed and used to capture a desired image more clearly with a simple operation. Accordingly, mobile communication terminals having camera functions are expected to be continuously and widely used.

However, often the elderly or terminal users with low vision have a problem in that they cannot take a picture or video through complicated key manipulation, and also dare not attempt to send a picture or video attached to the text message after inputting a text message.

The present invention has been proposed in such a background, and allows the elderly and the user with low vision in a mobile communication terminal to easily and conveniently take pictures and videos according to voice guidance and transmit them to a desired party or to attach them to a text message. To provide technology.

It is an additional object of the present invention to provide a technique for generating a message by acquiring a message content and message receiver information through voice recognition in a terminal.

It is a further object of the present invention to provide a technique that enables a terminal user to conveniently enter message recipient information even if the terminal user does not remember the recipient telephone number.

The mobile communication terminal according to an aspect of the present invention for achieving the above object, outputs a selectable media guide voice for a multimedia message transmission service through voice guidance, and if the media selection information is obtained from the camera or microphone A media message acquiring unit for acquiring media data, a receiver information acquiring unit for outputting message recipient information input voice, and acquiring message recipient information from user input information, and a multimedia message including the obtained receiver information and media data; It characterized in that it comprises a multimedia message generating unit for generating a multimedia message transmission unit for converting and transmitting the generated multimedia message according to the communication scheme.

According to this aspect, the elderly and the user with low vision can easily and conveniently transmit media such as photos and videos to the desired party or attach to a text message according to voice guidance without complicated and many key operations.

A mobile communication terminal according to an additional aspect of the present invention includes a storage unit for storing a reference model of a feature vector for each phoneme generated by a voice input by a user, and a phoneme by dividing the phonemes of a user voice input from a microphone. Extracts a feature vector of each star and performs pattern matching on the extracted phoneme feature vectors with reference phoneme-based reference models stored in the storage unit, and outputs a message input guide voice and a message from the voice recognition unit. And a message data acquisition unit for acquiring data. According to this aspect, the terminal user can input a message by voice without complicated key manipulation.

The mobile communication terminal according to an additional aspect of the present invention is characterized in that the receiver information obtaining unit obtains the receiver information by receiving the message receiver information from the voice recognition unit and checking the input receiver information. According to this aspect, the terminal user can simply input the message recipient information by voice, and thus can input the message more conveniently. Here, the recipient information may be a recipient telephone number or a recipient mail address.

The mobile communication terminal according to another additional aspect of the present invention is characterized in that when the recipient information recognized by the receiver information obtaining unit is a message receiver name, the telephone number address book is searched by the receiver name to search for the recipient telephone number. According to this aspect, the mobile communication terminal is implemented to retrieve the recipient's telephone number using the stored telephone number address book when the recipient's name is voice input by the terminal user, so that the terminal user can conveniently store the message even if the recipient's telephone number is not remembered. Recipient information can be entered.

The foregoing and further aspects of the present invention will become apparent from the following examples. Hereinafter, the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily understand and reproduce the present invention.

1 is a block diagram illustrating a mobile communication terminal according to an embodiment of the present invention. As shown, as shown in the mobile communication terminal according to the present embodiment, the mobile communication terminal of the present invention is a wireless communication unit 210, operation unit 220, display unit 230, camera unit 240, storage unit 250, a voice input / output unit 260 and a control unit 270.

The wireless communication unit 210 is configured to include an antenna and RF circuit for communication with the base station. In the present specification, the wireless communication unit 210 is interpreted to cover not only various versions of CDMA but also existing methods such as cellular, GSM, and W-CDMA, as well as mobile communication methods to be introduced in the future. In one embodiment, the baseband circuit of the wireless communication unit 130 and most of the circuits of the control unit 270 are commercially provided as a single integrated circuit.

The operation unit 220 may be implemented as a means for inputting a user's operation command, and may be a keypad, a side key, a touch panel, a handwriting input unit, a voice recognition unit, and the like formed of numeric keys and function keys. The display unit 230, which is a general liquid crystal display, displays the progress of operation in the terminal, a user's menu selection screen, a call screen, and the like.

The camera unit 240 outputs image data of a subject photographed through the lens system. In one embodiment, the camera unit 240 is composed of a small one or a plurality of lenses, a lens system for condensing light, an imaging unit for converting an optical signal from the lens system into an analog electric signal, and output from the imaging unit It may include a conversion unit for processing the signal to be converted into a digital format and then converted into a format suitable for the input of the signal processing unit, and a camera controller for controlling the operation of the entire module.

The storage unit 250 stores executable programs and related data. In one embodiment, the storage unit 250 may include a static random access memory (SRAM) having a capacity of several megabits and a flash memory having a capacity of several tens of megabits. ) May be implemented in one chip. According to a characteristic aspect of the present invention, the storage unit 250 stores a multimedia message generating program through voice guidance.

The voice input / output unit 260 converts digital voice data from the wireless communication unit 210 into an analog voice signal and outputs the analog voice signal to the speaker. In addition, the voice input / output unit 260 converts the analog voice signal input from the microphone into a digital voice signal. The voice input / output unit 260 is a well-known configuration including an additional circuit such as an audio amplifying circuit or a filter.

The control unit 270 controls the entire system, and includes a dedicated hardware for processing communication therein, a digital signal processor, and a general purpose microprocessor. According to a characteristic aspect of the present invention, the controller 270 includes a multimedia message data obtaining unit 272, a multimedia message generating unit 273, and a multimedia message transmitting unit 274.

The multimedia message data acquisition unit 272 outputs an operation guide voice for generating multimedia data and accordingly acquires media data and message contents and message receiver information to be transmitted from a user voice input or a key input. In one embodiment, the multimedia message data acquisition unit 272 may include a media data acquisition unit 2721 and a receiver information acquisition unit 2723.

The media data acquisition unit 2721 outputs a selectable media guide voice, and acquires media data selected from a camera or a microphone when media selection information is acquired. According to an embodiment, the media data acquisition unit 2721 may drive the camera in the preview mode and output a photographing command input guide voice to acquire the subject image data photographed through the camera lens when the photographing command is input. . In another exemplary embodiment, the media data acquisition unit 2721 drives the camera in a preview mode, outputs a video recording command input guide voice, and inputs a voice from the microphone and a subject image photographed through the camera lens when the video recording command is input. The signal may be processed to obtain moving image data.

The receiver information obtaining unit 2723 outputs the message receiver information input guide voice and obtains the message receiver information from the user input information. In one embodiment, the receiver information acquisition unit 2723 may receive the message receiver information from the voice recognition unit and acquire the receiver information by checking the input receiver information. Here, the recipient information may be a recipient telephone number or an e-mail. In another exemplary embodiment, when the recognized recipient information is a message recipient name, the recipient information acquisition unit 2723 may search the telephone number address book by the recipient name and search for the recipient telephone number to obtain recipient information.

The multimedia message generator 273 generates a multimedia message including the obtained receiver information and media data. Here, the multimedia message can be generated using well known schemes. The multimedia message transmitter 274 converts the generated multimedia message according to a communication method and transmits the converted multimedia message.

According to an additional aspect of the present invention, the storage unit 250 stores a reference model of the feature vectors for each phoneme generated by the voice input by the user, and the controller 270 stores the phoneme of the user voice input from the microphone. Speech recognition unit 271 for extracting feature vectors for each phoneme and performing pattern matching on the extracted phoneme feature vectors with reference phoneme-based reference models stored in the storage unit, and a message input guide voice. And a message data acquisition unit 273 for outputting the message data from the voice recognition unit 271. Accordingly, the terminal user can input a message by voice without complicated key manipulation.

2 illustrates a multimedia message processing procedure according to an embodiment of the present invention. In one embodiment, the mobile communication terminal drives a multimedia message generating program through voice guidance according to a user operation command (S701). Thereafter, the mobile communication terminal outputs a media announcement voice attachable to the multimedia message (S702). Here, the attachable media may be a picture, a video, or the like. Thereafter, the mobile communication terminal acquires media selection information (S703). In one embodiment, the mobile communication terminal may acquire the media selection information by recognizing the media selection information input through the microphone, or may simply input by pressing a confirmation button. Thereafter, the mobile communication terminal acquires the selected media data (S705). Hereinafter, a process of acquiring media data will be described later with reference to FIGS. 3 and 4.

Thereafter, the mobile communication terminal outputs the message receiver information input guide voice (S708). Thereafter, the mobile communication terminal obtains message receiver information from user input information (S709). Here, the user input information may be input through a microphone or a keypad. Hereinafter, a process of obtaining message recipient information will be described later with reference to FIG. 5. Thereafter, the mobile communication terminal generates a multimedia message including the obtained receiver information and the media data, and transmits the generated multimedia message (S710). Here, the process of generating a multimedia message and transmitting the generated multimedia message may be implemented in a well-known manner.

According to an additional aspect of the present invention, a method of transmitting a multimedia message through voice guidance may include: outputting a message input guide voice (S706), and acquiring message data by recognizing a user voice signal input from a microphone ( S707) may be further included. According to this aspect, the terminal user can input a message by voice without complicated key manipulation.

Hereinafter, a process of acquiring media data will be described with reference to FIGS. 3 and 4. First, FIG. 3 shows one embodiment of step S705. As shown, the mobile communication terminal first drives the camera in the preview mode in order to acquire the media data (S501). In general, when the camera function is selected, the built-in camera is operated to perform a preview mode in which an image captured by the lens is displayed on the LCD screen. When the desired subject is displayed on the LCD screen, the camera is pressed. Capture the image taken through the lens. Thereafter, the mobile communication terminal outputs a photographing command input guide voice (S502). Subsequently, the mobile communication terminal waits for a photographing command input (S503), and when a photographing command is input (S504), acquires the subject image data photographed through the camera lens (S505).

4 shows another embodiment of step S705. As shown, the mobile communication terminal first drives the camera in the preview mode in order to acquire the media data (S511). Thereafter, the mobile communication terminal outputs a video recording command input guide voice (S512). Subsequently, the mobile terminal waits for input of a video recording command (S513), and when a video recording command is input (S514), the mobile terminal acquires video data by processing a subject image photographed through a camera lens and a voice signal input from a microphone ( S515).

Hereinafter, a process of obtaining the message receiver information will be described with reference to FIG. 5. 5 shows one embodiment of step S709. The mobile communication terminal waits for input of the receiver information after the message receiver information input guide voice output (S708) (S601). In one embodiment, the mobile communication terminal recognizes the message receiver information voice input through the microphone (S603). Here, the recipient information may be a recipient telephone number or a recipient mail address. Thereafter, the mobile communication terminal outputs the recognized recipient information confirmation voice (S606) and acquires the recipient information through the completion of the confirmation (S607). Accordingly, the terminal user can simply input the message recipient information by voice, and thus can input the message more conveniently.

In one embodiment, if the recognized recipient information is the message recipient name (S604), the mobile communication terminal may search the recipient phone number by searching the recipient address number by the recipient name to acquire the recipient information (S605). Accordingly, the terminal user can conveniently input the message receiver information even if the terminal user cannot remember the recipient telephone number.

As described above, the mobile communication terminal according to the present invention can easily and conveniently transmit media such as a picture or a video to a desired party or attach a text message to an elderly person or a user with low vision, according to voice guidance without complicated and many key operations. It has a useful effect.

In addition, according to the present invention, the terminal user can input the message content and the message receiver information by voice, thereby having a useful effect of inputting the message by voice without complicated key manipulation.

In addition, the mobile communication terminal according to the present invention is implemented to search for the recipient's telephone number using the stored telephone number address book when the recipient's name is inputted by the terminal user. There is a useful effect of entering information.

Although the present invention has been described with reference to the accompanying drawings, it will be apparent to those skilled in the art that many various obvious modifications are possible without departing from the scope of the invention from this description. Therefore, it should be interpreted by the claims described to include many such variations.

Claims (13)

In a mobile communication terminal capable of transmitting a multimedia message through voice guidance, the mobile communication terminal is: A media data acquisition unit for outputting a selectable media guide voice and obtaining media data selected from a camera or a microphone when media selection information is acquired; A receiver information obtaining unit which outputs message receiver information input guide voice and obtains message receiver information from user input information; A multimedia message generator for generating a multimedia message including the obtained receiver information and media data; A multimedia message transmitter for converting the generated multimedia message according to a communication scheme and transmitting the multimedia message; Mobile communication terminal comprising a. The method of claim 1, wherein the mobile communication terminal: A storage unit which stores a reference model of feature vectors for each phoneme generated by a voice input by a user; A speech recognition unit for classifying phonemes of a user's voice input from a microphone, extracting feature vectors for each phoneme, and performing pattern matching on the extracted phoneme feature vectors with reference phoneme-specific reference models stored in the storage unit; A message data acquisition unit for outputting a message input guide voice and obtaining message data from the voice recognition unit; A mobile communication terminal further comprising. The method of claim 1, wherein the media data acquisition unit drives the camera in the preview mode and outputs a photographing command input guide voice to acquire the subject image data photographed through the camera lens when the photographing command is input. Characterized in a mobile communication terminal. The apparatus of claim 1 or 2, wherein the media data acquisition unit drives the camera in a preview mode, outputs a video recording command input guide voice, and inputs from a subject image and a microphone photographed through a camera lens when a video recording command is input. A mobile communication terminal, characterized in that for processing video signals to obtain video data. The mobile communication terminal of claim 2, wherein the receiver information obtaining unit receives message receiver information from the voice recognition unit and obtains the receiver information by checking the input receiver information. 6. The mobile communication terminal of claim 5, wherein when the recipient information recognized by the receiver information obtaining unit is a message recipient name, the recipient information is retrieved by searching the telephone number address book by the recipient name to obtain the recipient information. In the method for transmitting a multimedia message through voice guidance executed in a mobile communication terminal, the method comprises: Outputting a media announcement voice attachable to the multimedia message; Obtaining media selection information; Obtaining the selected media data; Outputting message recipient information input guidance voice; Obtaining message receiver information from user input information; Generating a multimedia message including the obtained recipient information and the media data; Transmitting the generated multimedia message; Multimedia message transmission method through the voice guidance comprising a. The method of claim 7, wherein the multimedia message transmission method using the voice guidance: Outputting a message input guide voice; Recognizing a user voice signal input from a microphone to obtain message data; Multimedia message transmission method through the voice guidance, characterized in that it further comprises. 8. The method of claim 7, wherein obtaining media selection information comprises: Recognizing media selection information input through a microphone; Acquiring media selection information through the recognized media selection information; Multimedia message transmission method through the voice guidance, characterized in that it further comprises. 8. The method of claim 7, wherein acquiring the media data comprises: Driving the camera in preview mode; Outputting a photographing command input guide voice; Obtaining subject image data photographed through a camera lens when a photographing command is input; Multimedia message transmission method through the voice guidance comprising a. 8. The method of claim 7, wherein acquiring the media data comprises: Driving the camera in preview mode; Outputting a video recording command input guide voice; Obtaining a moving image data by processing a subject image photographed through a camera lens and an audio signal input from a microphone when a moving image photographing command is input; Multimedia message transmission method through the voice guidance comprising a. 12. The method of any of claims 7-11, wherein acquiring the message recipient information comprises: Recognizing message receiver information input through a microphone; Outputting a recognized recipient information confirmation voice; Multimedia message transmission method through the voice guidance comprising a. 13. The method of claim 12, wherein obtaining the message recipient information comprises: If the recognized recipient information is a message recipient name, retrieving the recipient telephone number by searching the telephone number address book by the recipient name; Multimedia message transmission method through the voice guidance, characterized in that it further comprises.

Images