KR20070038392A - Method for reading mobile communication phone having the multi-language reading program - Google Patents

Abstract

The present invention can greatly improve the reading ability of the user by playing the reading content produced in a plurality of languages by reading the user and answering questions through voice recognition, and enhances the learning effect of studying a foreign language. The present invention relates to a reading method using a display, displaying images and subtitles on a display unit, outputting subtitles by voice, and receiving an answer voice signal corresponding to a character or graphic displayed on the display unit by receiving the letters or numbers and the subtitles. Answer It relates to a reading method using a mobile communication terminal characterized in that it comprises a mobile communication terminal for determining the presence or absence of a correct answer of the voice signal to display to the user.

Mobile terminal, voice recognition, text, reading, foreign language

Description

TECHNICAL FOR READING MOBILE COMMUNICATION PHONE HAVING THE MULTI-LANGUAGE READING PROGRAM}

1 is a view schematically showing a mobile communication terminal having a reading function according to an embodiment of the present invention.

2 is a block diagram schematically illustrating the mobile communication terminal shown in FIG. 1;

3 is a flow chart schematically showing a reading method using a mobile communication terminal according to an embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

100: user 200: mobile communication terminal

210: display unit 220: control unit

230: wireless processing unit 240: voice processing unit

250: key pad portion 260: memory

270: TTS engine unit 280: audio processor

The present invention relates to a mobile communication terminal, and in particular, using a mobile communication terminal having a voice recognition function and a TTS function, a reading function that allows a user to listen to a text document by voice and learn according to the voice information input by the user. The present invention relates to a mobile communication terminal and a reading method using the mobile communication terminal.

In general, a mobile communication terminal has been widely used due to its simplicity and portability.

In the early stages of the terminal's dissemination, most of the purpose of the mobile terminal was the one-to-one communication purpose. However, as the dissemination of the terminal became popular and various contents of wireless communication were developed and distributed. In addition to the purpose of two-way communication, two-way text and graphic transmission, Internet / PC communication search, e-mail search, online game, user information management, various data service transmission and reception, etc. Widely used for the purpose, it is further accelerating the evolution of mobile communication.

In the development of such a mobile communication terminal, a voice recognition function and a TTS function are added to the mobile communication terminal so that a user of the mobile communication terminal can operate the mobile communication terminal more conveniently.

However, to date, the voice recognition function or the TTS function is implemented only as a function for key manipulation, text / graphic transmission / reception, and current time notification of a mobile communication terminal of a specific person such as a disabled person. Only functionality is provided.

Accordingly, an object of the present invention is to provide a mobile communication terminal having a reading function for reading a user using the TTS function and a reading method using the mobile communication terminal.

It is also an object of the present invention to provide a reading method using a mobile communication terminal having a learning effect to review and associate contents read by a user by using a voice recognition function.

In addition, another object of the present invention is to provide a reading method using a mobile communication terminal that can increase the foreign language learning effect is embedded because the reading content is supported a plurality of languages.

Therefore, the present invention for achieving the above object, the mobile communication terminal is configured to be configured to drive a stored application program, the display unit for outputting a graphic or video to display the progress of the reading program; A voice processor connected to a microphone to receive a voice of a user and connected to a speaker to output a voice of a mobile communication terminal; A keypad unit having a switching key for switching the mobile communication terminal to a reading mode; A memory for storing a reading program including a plurality of graphic files, a video file, an audio file, and a text file supported in a plurality of languages; Connected to the display unit, the voice processing unit, the keypad unit, and the memory to control the overall operation of the mobile communication terminal, converts the user's answer voice signal received from the voice processing unit into command data, and calculates the reading program. A control unit for extracting data stored in the memory according to a result of the comparison operation and outputting the data from a speaker or a display unit; A TTS engine connected to one side of the controller and converting a text sentence input in a predetermined language transmitted from the controller into audio wave data; Is connected to one side of the TTS engine, it is achieved by a mobile communication terminal having a reading function characterized in that it comprises an audio processing unit for converting the audio wave data converted in the TTS engine to an analog voice signal and delivered to the speaker .

According to the present invention, the mobile communication terminal is connected to one side of the control unit, under the control of the control unit further comprises a wireless processing unit for receiving the reading program data and transmitting the reading program data to the control unit via an antenna. desirable.

According to the present invention, it is preferable that the operation of the reading program compares the answer voice signal transmitted from the voice processing unit with the correct answer on the program and determines whether the correct answer corresponds to the correct answer.

According to the present invention, there is provided a method of driving an application program embedded in a mobile communication terminal, comprising: a first step of recognizing an operation of a keypad unit of a user to access a reading program and setting a function of the mobile communication terminal as a reading function; A second step of recommending a user's option setting on a display unit after the reading program is driven due to the access of the reading program; A third step of the program playing step of starting reading according to the on-screen guidance after the user's option selection is completed; When playback of the program is completed, it is preferable that the user has a fourth step of responding to the question of the program according to the option specified by the user.

According to the present invention, in the second step, it is preferable that the option of the reading program selected by the user is provided so as to select one or more of reading genres, learning after reading, subtitles during playback, and background music.

In addition, according to the present invention,

In the second step, the option of the reading program selected by the user preferably includes language selection to be reproduced in a language selected from a plurality of foreign languages.

In addition, according to the present invention, it is preferable that in the third step of the program reproduction step, graphics corresponding to the contents are output as an illustration on the display unit.

Further, according to the present invention, it is preferable that the text subtitle appears in the lower portion of the display unit in the third step of the program reproduction step.

In addition, according to the present invention, it is preferable to listen to the text corresponding to the subtitle through the speaker in the third step of the program playback step.

In addition, according to the present invention, the fourth step is preferably informed by evaluating the answers that the user answered by voice to the short-answer questions asked by the program as a score.

In addition, according to the present invention, the application program is downloaded over the wireless Internet via a mobile communication terminal, and further comprising a compressed video file provided with graphics, text for subtitles, the voice corresponding to the text without driving the TTS engine desirable.

Other objects and features of the present invention in addition to the above objects will be apparent from the description of the embodiments with reference to the accompanying drawings.

Hereinafter, exemplary embodiments of the present invention will be described with reference to FIGS. 1 to 3.

1 is a view showing a mobile communication terminal having a reading function according to an embodiment of the present invention.

Referring to FIG. 1, the mobile communication terminal 200 having a reading function according to an embodiment of the present invention displays characters (subtitles) or graphics on the display unit 210 according to a reading program stored in the terminal. A mobile communication terminal is configured to perform a reading function for receiving a voice signal of a user 100 corresponding to a character or graphic displayed on the display 210.

Although the reading program provides various genres, the embodiment of the present invention will be described using an implementation story as an example.

To this end, the mobile communication terminal 200 includes a display unit 210 displaying characters or graphics as shown in FIG. 2; A memory 260 for storing user voice, a plurality of texts or graphics, and reading content in which a plurality of languages are supported; Any one or all of the plurality of characters or graphics stored in the memory 260 is displayed on the display unit 210, the user receives an answer voice signal of the user 100 for the characters or graphics, and receives the input of the user 100. A control unit 220 comparing the answer voice signal to determine whether the correct answer is present and for instructing the reading content to be reproduced in an option selected language; A microphone 242 for transmitting the answer voice signal of the user 100; A speaker 244 for outputting the reply message so that the user 100 can hear and reproducing the user voice; The voice processor 240 transmits the answer voice signal from the microphone 242 to the control unit 220, and transmits various data to the mobile communication base station through the antenna 232 under the control of the control unit 220, as well as the antenna ( A wireless processor 230 which receives various data to the mobile communication base station through 232 and transmits the data to the controller 220; A TTS engine unit 270 for converting text into audio wave data; An audio processor 280 converts the converted audio wave data into an analog voice signal.

The display unit 210 is connected to one side of the controller 220 and may be formed of a display device such as a liquid crystal display (LCD).

The display unit 210 displays a state of the mobile communication terminal 200 or a program progress state under the control of the controller 220.

The display unit 210 may provide a graphic screen or a screen in which a graphic screen and a subtitle appear together according to the user's initial option setting.

The wireless processor 230 transmits various data to the mobile communication base station through the antenna 232 under the control of the controller 220 and receives various data to the mobile communication base station through the antenna 232 to control the controller 220. To pass on.

Here, the wireless processor 230 is connected to the mobile communication base station to download and upload the reading program and to download the reading content file of multilingual support.

The microphone 241 is connected to one side of the voice processor 240 and directly receives a voice signal and an answer voice signal from the user under the control of the controller 220 and transmits the voice signal to the voice processor 240.

The speaker 281 is connected to one side of the audio processor 280 and the voice processor 240, and the user can hear an analog voice signal transmitted from the audio processor 280 under the control of the controller 220. It converts to and outputs to the outside, and receives and reproduces the user voice stored in the memory from the voice processing unit.

One side of the voice processing unit 240 is connected to the speaker 281 and the microphone 241 and the other side is connected to the control unit 220, the control unit 220 controls the voice signal and the answer voice signal transmitted from the microphone 242 Supplies).

The key pad unit 250 is connected to the control unit 220 and includes a plurality of numeric keys, function keys for performing various functions, and voice recognition keys.

The memory 260 is connected to the controller 220 and may include a ROM that stores an operating program, an EEPROM and a RAM that are electrically programmable.

The memory 260 stores a reading program for reading a user. In this case, the reading program stores a plurality of text or graphic files.

In addition, the memory 260 stores the voice signal and the answer voice signal input through the microphone 241 while being converted into the user voice through the controller 220.

The controller 220 controls the overall operation of the mobile communication terminal 200. In particular, when the reading function is set by the user's operation, the controller 220 executes the reading program stored in the memory 260 to operate the mobile communication terminal in the reading function mode.

The TTS engine 270 is connected to one side of the control unit 220 to convert text sentences input in a predetermined language transmitted from the control unit 220 into audio wave data. In addition, according to an embodiment of the present invention, as the type of language to be supported is added, a TTS engine for a language to be supported may be added.

The audio processor 280 is connected to the column side of the TTS engine 270 to convert the audio wave data converted by the TTS engine 270 into an analog voice signal.

The audio processor 280 includes an audio driver as a general software module and an audio card as a hardware block.

When the voice signal and the answer signal, which are the voice of the user, are input to the microphone 241, the voice signal is transmitted to the controller 220 through the voice processor 240.

The transmitted voice signal and the answer signal are converted into user voices and stored in the memory 260.

In addition, the text file stored in the memory is transmitted to the TTS engine 270 through the control unit 220 to be converted into audio wave data, and the converted audio wave data is transferred to the audio processing unit 280 as an analog voice signal. It is converted and reproduced by the speaker 281.

3 is a flowchart illustrating a reading method using a mobile communication terminal in accordance with an embodiment of the present invention.

Referring to FIG. 3 in conjunction with FIG. 2, a reading method using a mobile communication terminal according to an exemplary embodiment of the present invention will be described as follows.

First, the first step S10 of recognizing a user's manipulation of the keypad unit 250 and setting a function of the mobile communication terminal 200 as a reading function is performed. Accordingly, the control unit 220 switches the mobile communication terminal 200 to the reading function mode by executing the reading program stored in the memory 260 in response to the setting of the reading function of the user.

That is, the first step is a process of searching the menu of the mobile communication terminal 200 until the reading program is accessed.

The reading program may be stored in the memory 260 of the mobile communication terminal, or may be downloaded by connecting to the wireless Internet.

The application program may be a compressed video file that is downloaded over the wireless Internet through a mobile communication terminal and provides graphics, text for subtitles, and voice corresponding to the text without driving the TTS engine.

When the reading program is driven due to the access of the reading program, the controller 220 may provide graphic or text data stored in the memory 260 to the display 210, and the graphic and text data may be a user's option. It goes through a second step (S20) that serves to guide the setting up.

Accordingly, the user 100 selects various options of the reading program according to the characters or graphics displayed on the display 210.

Options of the reading program include novels, fairy tales, poems, etc. for each genre of reading, and are provided with learning after reading, subtitles during playback, user voice recording, and music.

The post-learning learning is performed by a user receiving a simple short answer question about contents embedded in the reading program after the story of the reading program is finished through the speaker or the display unit 210.

For the short answer question, the user inputs the answer voice signal through the microphone 241.

In addition, whether or not the subtitles during playback is the option to select the subtitles appear at the bottom of the screen at the same time the graphic screen appears on the display unit 210 during the story, the presence or absence of the music to select the background music during the story This is an option.

In addition, the user's voice recording is to record the voice in accordance with the flow of the screen and the story in the state of playing the graphic screen in a state in which the subtitle of the display unit 210 and the speaker's voice are not output.

When the user's voice recording ends, the display unit 210 displays the screen and the subtitle at the same time, and the voice signal recorded by the user is reproduced through the speaker.

Can also be recycled

When the user's option selection is completed, the user goes through the third step (S30) of the program playback step of starting the implementation story according to the on-screen instructions.

In the third step, the graphics stored in the memory 260 are output to the display unit 210 according to the corresponding illustration on the contents of the implementation story.

At this time, the control unit 220 sends the text received from the memory 260 to the display unit 210 to be output as a subtitle appearing below the screen, and at the same time delivers the text to the TTS engine 270.

Accordingly, the TTS engine 270 converts the transmitted text data into audio wave data and transmits the converted audio data to the audio processor 280. The transmitted audio wave data is converted into an analog voice signal and output through the speaker.

Therefore, the user sees the subtitles and the texts corresponding to the subtitles through the speaker.

When the reproduction of such a program is completed, that is, when the story of the implementation story is finished, the user may go through the fourth step S40, which is a question and answer step according to the option set by the user.

The question answering step shows a simple short-answer question on the screen of the display unit 210 as to whether the story is grasped after the implementation story is completed, and the user answers.

The user's answer to the question is input to the mobile communication terminal 200 through a microphone as an answer voice signal, and the input voice is transmitted to the controller 220 through the voice processor 240.

The controller 220 compares the received answer voice signal with the correct answer on the program and teaches the correct answer through the display unit 210 or the speaker.

In addition, the user's answers are evaluated by the score, and the display unit 210 or the speaker 281 is notified.

Accordingly, in the mobile communication terminal having a reading function and the reading method using the mobile communication terminal according to an embodiment of the present invention, the reading ability of the user is greatly increased by reading a user by executing a reading program stored in the memory 260 through voice recognition. Can be improved.

In addition, if the user does not set the fourth step (S40) as an option, the program will be terminated after the third step (S30), and if the fourth step (S40) is set as an option as described above, the question and answer Will be terminated.

Once these question and answer steps are completed, you will be reviewed according to your options.

In the review process, as described above in the option setting step S20, the same graphic is reproduced from the beginning to the end in the display unit 210, and the user records the corresponding story content as a voice signal.

After the review process of recording the user's voice signal, the user's voice signal is reproduced simultaneously on the graphic screen with subtitles and compared with the story contents and the user's voice contents to grasp how well the user has known the story contents. After the screen playback process is finished.

As described above, the mobile communication terminal having a reading function and the reading method using the mobile communication terminal according to an embodiment of the present invention increase the reading ability of the user by reading a user by executing a reading program stored in a memory through voice recognition. Can be improved.

In addition, the present invention allows a user's reading regardless of time and place by embedding a reading function in a portable mobile communication terminal and reviewing reading contents through voice recognition.

Those skilled in the art will appreciate that various changes and modifications can be made without departing from the technical spirit of the present invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification but should be defined by the claims.

Claims (11)

In the mobile communication terminal is configured circuitry to drive a stored application, A display unit 210 for outputting a graphic or a video to display the progress of the reading program; A voice processor 240 connected to a microphone 242 to receive a voice of a user and connected to a speaker 244 to output a voice of the mobile communication terminal 200; A keypad unit 250 having a switching key for switching the mobile communication terminal 200 to a reading mode; A memory 260 that stores a reading program including a plurality of graphic files, a video file, an audio file, and a text file supported in a plurality of languages; In order to control the overall operation of the mobile communication terminal 200, it is connected to the display unit 210, the voice processing unit 240, the keypad unit 250, the memory 260, and transferred from the voice processing unit 240 Converts the received voice signal of the user into command data, performs the operation of the reading program, extracts data stored in the memory 260 according to the result of the comparison operation, and outputs the speaker 242 or the display unit ( A controller 220 for outputting from 210; A TTS engine 270 connected to one side of the controller 220 and converting a text sentence input in a predetermined language transmitted from the controller 220 into audio wave data; The audio processing unit 280 is connected to one side of the TTS engine 270 and converts the audio wave data converted by the TTS engine 270 into an analog voice signal and transmits the analog voice signal to the speaker 281. Mobile communication terminal having a reading function to. The method of claim 1, The mobile communication terminal 200 is connected to one side of the control unit 220 and is connected to the mobile communication base station through the antenna 232 under the control of the control unit 220 to receive reading program data to the control unit 220. Mobile communication terminal 200 characterized in that it further comprises a wireless processing unit 230 for transmitting. The method of claim 1, The operation of the reading program is a mobile communication terminal having a reading function, characterized in that by comparing the correct answer on the program and the answer voice signal transmitted from the voice processing unit 240 determines whether the correct answer. In the method of driving an application program embedded in the mobile communication terminal, A first step (S10) of recognizing an operation of the keypad unit 250 of the user to access a reading program and setting a function of the mobile communication terminal 200 as a reading function; A second step (S20) of recommending a user's option setting on the display unit 210 after the reading program is driven due to access of the reading program; A third step (S30) of the program reproduction step of reading starting according to the on-screen guidance after the user's option selection is completed; When the reproduction of the program is completed, the mobile communication terminal having a reading function, comprising a fourth step (S40) in which the user responds to the question of the program according to the option specified by the user. The method of claim 4, wherein In the second step (S20), the option of the reading program selected by the user is provided to select any one or more of the reading genre, learning after reading, subtitles during playback, background music How to read. The method of claim 4, wherein In a second step (S20), the option of the reading program selected by the user is a reading method using a mobile communication terminal, characterized in that it comprises a language selection to be reproduced in a language selected from a plurality of foreign languages. The method of claim 4, wherein In the third step (S30) of the program playback step, the reading method using a mobile communication terminal, characterized in that graphics corresponding to the content is output to the display unit 210 as an illustration. The method of claim 4, wherein In the third step (S30) of the program playback step, the reading method using a mobile communication terminal, characterized in that the text subtitles appear on the lower portion of the display (210). The method of claim 8, In the third step (S30) of the program playback step, the reading method using a mobile communication terminal, characterized in that for listening to the text corresponding to the subtitles through the speaker. The method of claim 4, wherein The fourth step (S40) is a reading method using a mobile communication terminal, characterized in that the user to answer the short-answer questions asked by the program by evaluating the answer with a score. The method of claim 4, wherein The application program is downloaded on the wireless Internet via a mobile communication terminal, the mobile communication terminal further comprises a compressed video file that provides graphics, text for subtitles, voice corresponding to the text without driving the TTS engine Reading method using.

Images