KR20070071881A - Communication method of mobile phone for deaf mutism - Google Patents

Abstract

A conversation relay method of a mobile communication terminal for the deaf is provided to enable a deaf person who cannot hear and speak to have conversation with peripheral people by using a mobile communication terminal in daily life as well as to make a call by using the terminal. While a conversation relay program is executed, a text-to-speech conversion command or speech-to-text conversion command is inputted(S11-S15). If the text-to-speech conversion command is inputted, a text input window for receiving a text to be outputted as a voice is displayed, and voice data corresponding to a text inputted through the input window is reproduced by using a text-to-speech conversion engine(S17-S21). If the speech-to-text conversion command is inputted, a voice signal delivered from a microphone equipped in a terminal is temporarily stored, and a text corresponding to the voice signal is displayed by using the text-to-speech conversion engine(S23-S29).

Description

Communication method of mobile communication terminal for communication handicapped person {communication method of mobile phone for deaf mutism}

1A and 1B are front and rear views showing the appearance of a mobile communication terminal applicable to the present invention, respectively;

2 is an electrical block diagram of a mobile communication terminal to which the present invention can be applied;

3 is a flowchart illustrating a method of relaying a conversation in a mobile communication terminal for a communication disabled person according to the present invention.

*** Explanation of symbols for the main parts of the drawing ***

100: mobile communication terminal 110: main body

112: numeric / character key buttons 113: microphone hole

114: Volume button 115: Call answer button

116: Standard terminal slot 117: Camera lens

118: flash 119: infrared communication element

120: slider 121: function key button

122: flat panel indicator 123: speaker hole

130: antenna 140: battery pack

143: charging terminal 200: mobile communication terminal

210, 340: control unit 220: radio frequency transmitting and receiving unit

222: antenna 230: key input unit

232: function key input unit 234: numeric / character key input unit

240: memory 242: program storage unit

244: data storage unit 250: voice signal processing unit

252: microphone 254: speaker

260: Image processor 262: Flat panel display

264: switching unit 270: vibration generating unit

272: vibration motor 274: LED drive unit

276: LED 286: IrDA Transmit / Receive

288: communication port

The present invention relates to a communication relay method of a mobile communication terminal for a communication handicapped, in particular, a communication handicapped for a communication handicapped person who can not communicate without hearing or speaking to the people around the communication using the mobile communication terminal. It relates to a method of relaying a conversation of a terminal.

The mobile communication terminal (hereinafter referred to as 'terminal'), which is a necessity for modern people, is not only compact and lightweight due to steady development, but also combines various functions such as mp3, camera, digital multimedia broadcasting (DMB) and navigation. As a communication terminal, it is a wireless communication device that guarantees portability and mobility, and includes PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PPC (Pocket PC), HPC (Hand PC) PIP (Personal Infomation Processor), PDD (Personal Digital Device), PDA (Personal Digital Assistant) or smart phone (Smart Phone).

In particular, using such a mobile terminal, a short message service (SMS), a short message service capable of sending and receiving a message of about 80 bytes, that is, 40 to 50 or 80 English characters, using numbers and letters Multimedia Message Service (MMS), which can add sound, video, etc., and voice that allows the sender to leave a message in the recipient's voice mailbox or fax mailbox if the receiver cannot answer the call. Various functions and services such as an email service (aka voice mail service) may be provided. In addition, the voice recognition dial service (Voice) enables users to make voice calls without having to dial a phone number when the subscriber makes a call by storing / registering the voice of the subscriber with a text voice conversion engine and an inverse conversion engine in the mobile communication terminal. Activated Dialing Service), a voice password setting function that sets the user's voice as a password instead of a password when setting the outgoing lock function, and helps the visually impaired or the general public to use SMS or MMS while driving. Speech to Text (STT) and Text to Speech, as opposed to STT, converts text to speech and reads the text when a text message is received or a missed call is received. Voice / text recognition technology such as TTS) has been introduced into mobile communication terminals.

On the other hand, in the case of a communication impaired person, such as a deaf child who cannot hear or speak, the user can make a call using the TTS or STT described above. This situation is absent.

The present invention has been made to solve the above-described problems, the communication relay of the mobile communication terminal for the communication disabled person who can not hear or talk to the communication disabled person can communicate with the voice by using the mobile communication terminal The purpose is to provide a method.

In order to achieve the above object, a communication relay method of a mobile communication terminal for a communication handicapped person of the present invention is equipped with a text-to-speech engine that converts a voice data and a character corresponding to the voice data and converts them to each other. It is performed in a mobile communication terminal equipped with a conversation relay program which converts and outputs voice and text according to the situation using a conversion engine, and (a) a text-to-speech command or a speech- Receiving a character change command; (b) when the text-to-speech command is input in step (a), a text input window for receiving a text to be output by voice is displayed and then input through the text input window using the text-to-speech engine; Reproducing the voice data corresponding to a text; and (c) temporarily storing a voice signal transmitted from a microphone provided in the mobile communication terminal when the voice-text switching command is input in step (a). The present invention provides a conversation relay method for a mobile communication terminal for a communication handicapped person, comprising: displaying a character corresponding to the temporarily stored voice signal using a text-to-speech engine.

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the communication relay method of the mobile communication terminal for the communication disabled in accordance with a preferred embodiment of the present invention.

1A and 1B are a front view and a rear view showing an appearance of a mobile communication terminal applicable to the present invention, respectively, illustrating a slide type mobile communication terminal. Of course, it should be noted that the present invention is not limited to the terminal of this manner and structure. As shown in FIGS. 1A and 1B, a mobile communication terminal (hereinafter, also referred to as a "terminal") 100 to which the present invention can be applied includes a main body 110 and a flat panel display 122 having a main circuit built therein. It may be made to include a slider 120 that slides up and down in the main body 110 while mounting.

In the above-described configuration, the front of the main body 110 is arranged with a number / letter key button 112 used to receive the numbers and letters, the upper surface and the infrared communication (IrDA) with the antenna 130 and other external communication devices Infrared communication element 125 is used to arrange the microphone hole 113 is in communication with the microphone (not shown) in the lower portion of the lower portion is perforated. The main body 110 is also provided with a rear surface in place, for example, a camera lens 117 and a flash 118 for illumination at night, and a battery pack 140 is detachable at the bottom thereof. The lower surface of the main body 110 is provided with a standard connection terminal slot 116 through which power for transmitting / receiving data with other terminals or charging the battery pack 140 coupled to the main body 110 is transmitted. .

On the other hand, the front surface of the slider 120 is provided with a flat panel display 122 for displaying various characters or graphic elements indicating the operation and operation state of the mobile communication terminal 100 and still images and moving pictures, and below the terminal ( A function key button 121 used to select or receive various functions included in 100 is disposed. Further, a speaker hole 123 communicating with an internal speaker (not shown) is drilled in place of the slider 120, for example, the flat display 122. In the drawing, reference numeral 114 denotes a volume button, 115 denotes a dialogue relay button for communicating with surrounding persons using a text-to-speech engine and an inverse transformation engine, and 143 denotes a lower portion of the battery pack 140. The charging terminal is shown.

2 is an electrical block diagram of a mobile communication terminal to which the present invention can be applied. As shown in FIG. 2, the electrical configuration of the mobile communication terminal 200 to which the present invention can be applied includes a radio frequency transmitter / receiver 220 that transmits / receives a radio frequency signal with a base station through an antenna 222. A key input unit 230 including a function key input unit 232 and a number / character key input unit 234 for generating a corresponding key signal when the numeric / character key button 112 and the function key button 121 are operated. The program storage unit 242 stores various application programs such as an operating system (OS), a text-to-speech engine, and a conversation relay program of the terminal, and voice data and a user temporarily storing data generated during a calculation process or matching a predetermined character. Memory 240 including a data storage unit 244 for storing data set by the microphone, a microphone 252 for converting an external sound wave into a corresponding analog form of voice signal, generated inside the terminal After converting the analog form of the audio signal is converted according to the situation by amplifying and outputting the sound form of the speaker 254, the microphone 252, the analog form of the audio signal to the corresponding digital voice signal and converts the digital voice signal The audio signal processor 250 converts the analog audio signal to the speaker 254 and outputs the same to the speaker 254. The video signal processor 260 processes the video signal generated inside the terminal and outputs the signal to the flat panel display 262. The communication port 288, the vibration motor 272 for generating a vibration when the terminal 100 operates in the vibration mode and its generating unit 270, LED for visually displaying this when an event such as receiving a call or message ( 276, its driver 274, and a controller 210 for controlling them collectively.

In the above configuration, the communication port 288 is preferably implemented as a 24-pin standard connection terminal based on the input and output terminal connection standard of the mobile communication terminal established by the Korea Information and Communication Technology Association, the 24-pin standard connection terminal is a battery charge 7 pins (1, 4, 5, 12, 19, 21, 22) for hands free, 5 pins (2, 7, 8, 9, 11) for hands free, data communication 8 pins (3, 13, 14, 18, 17, 20, 23, 24) and other 4 pins related to USB (6, 10, 15, 16) Four pins are assigned as options to accommodate as many functions as possible.

In addition, the mobile communication terminal to which the present invention is applied may further include an infrared transmitting / receiving unit 286 that emits infrared rays and receives infrared rays emitted from the outside as a short range communication means.

In the above-described configuration, the dialogue relay program is executed when there is an input from the dialogue relay button 115, and relays the dialogue between the user and the people around by using the text-to-speech engine and the inverse transformation engine.

3 is a flowchart illustrating a method of relaying a conversation in a mobile communication terminal for a communication disabled person according to the present invention.

As shown in FIG. 3, the method for relaying a conversation of a mobile communication terminal for a communication disabled person according to the present invention first determines whether there is a key input in step S11.

As a result of the determination in step S11, if there is no key input, step S11 is repeated until there is a key input, and if there is a key input, the flow advances to step S13 to determine whether the conversation relay button is present.

As a result of the determination in step S13, if it is not the conversation relay button, the flow proceeds to step S31 to perform a command corresponding to the key input. In the case of the conversation relay button, the flow proceeds to step S15 and the text-to-speech command or the voice-to-text switch command. Judge.

As a result of the determination in step S15, in the case of a text-to-speech command, the process proceeds to step S17 to display a text input window and receives a text to be converted to voice.

Subsequently, in step S19, it is determined whether the transfer command is input. If the transfer command is not input, the character is input until the transfer command is input. If the transfer command is input, the process proceeds to step S21 and the character-to-speech engine The audio data corresponding to the input character is outputted, ie, reproduced using.

On the other hand, as a result of the determination in step S15, in the case of the voice-text switching command, the flow advances to step S23 to determine whether the voice input start command has been input.

As a result of the determination in step S23, if the voice input start command is not input, step S23 is repeated until the voice input start command is inputted, and if the voice input start command is inputted, proceed to step S25 to temporarily store the input voice. After that, the flow advances to step S27 to determine whether a voice input end command has been input.

As a result of the determination in step S27, if the voice input end command is not input, the input voice continues to be stored until the voice input end command is input. If the voice input end command is input, the process proceeds to step S29 and the text-to-speech engine By using the character corresponding to the input voice is displayed, that is, displayed on the flat panel display 262.

On the other hand, the above-described character may be achieved by a syllable, a word or a sentence, and after displaying the character input window, the syllable or word or sentence may be automatically output whenever the syllable or word or sentence is completed.

In addition, the above-described voice input start command and voice input end command may be achieved by a predetermined function key. When the corresponding function key is one, it may be determined as a key input pattern, that is, the number of times or the length of the pressing.

On the other hand, when the above-mentioned voice data is provided in various types, such as female voice, male voice, male adult voice or female adult voice, it will be possible to select according to the user's condition and taste.

The communication relay method of the mobile communication terminal for the communication handicapped person of the present invention is not limited to the above-described embodiments and can be modified in various ways within the scope of the technical idea of the present invention.

According to the communication relay method of the mobile communication terminal for a communication disabled person of the present invention as described above, the communication disabled person who can not hear and speak using the mobile communication terminal as well as the call using the mobile communication terminal in everyday life It is effective to talk.

Claims (4)

It is equipped with a text-to-speech engine that converts voice data and characters corresponding to the voice data and converts each other, and has a dialogue relay program for converting and outputting voices and texts according to circumstances using the text-to-speech engine. Performed in a mobile communication terminal, (a) receiving a text-to-speech command or a voice-to-text switch command while the conversation relay program is executed; (b) when the text-to-speech command is input in step (a), a text input window for receiving a text to be output by voice is displayed and then input through the text input window using the text-to-speech engine; Playing the voice data corresponding to a character; and (c) when the voice-text switching command is input in step (a), temporarily storing a voice signal transmitted from a microphone provided in the mobile communication terminal, and then temporarily storing the voice signal using the text-to-speech engine. Communication relay method of the mobile communication terminal for the disabled, comprising the step of displaying a character corresponding to the communication. The method of claim 1, The step (b) is for moving the communication disabled, characterized in that for reproducing the voice data corresponding to the character entered in the text input window only when the voice output command is input after displaying the text input window Communication relay method of communication terminal. The method of claim 1, The step (b) is a dialogue relay method of a mobile communication terminal for a communication disabled, characterized in that automatically outputs a voice every time the syllable, word or sentence is completed after displaying the text input window. The method according to any one of claims 1 to 3, Step (c) temporarily stores the voice signal transmitted from the microphone provided in the mobile communication terminal until the voice input end command is input when the voice input start command is input after the voice-text switching command is input. And when the voice input end command is input, using the text-to-speech engine to display text corresponding to the temporarily stored voice signal.

Images