KR100879667B1 - Method of learning language in multimedia processing apparatus - Google Patents

Abstract

A language studying method of a multimedia processing device is provided to make the whole language studying such as listening, writing, speaking and reading possible without the necessity of separately manufacturing contents. A user stores a digital data file including a movie or drama in a multimedia processing device through a wire/wireless connection, and then tries to reproduce the digital file for the language studying(S1). The multimedia processing device parses a caption file from the digital data file, and generates a caption table which has time information and caption information as fields and in which the time information is arranged in the ascending order(S2,S3). The caption table passes the start time and the end time corresponding to the first sentence to a reproduction routine(S4). The multimedia processing device enters the playback mode by a key input of the user(S5). If the reproduction of a moving picture file such as the MPEG4 is completed as much as the start and end time with respect to the first sentence, the multimedia processing device enters the first learning mode after performing the file pause(S6-S8).

Description

Language learning method of multimedia processing device {METHOD OF LEARNING LANGUAGE IN MULTIMEDIA PROCESSING APPARATUS}

The present invention relates to a multimedia processing apparatus, and more particularly, to a language learning method of a multimedia processing apparatus using time information and subtitle information of a subtitle file.

Nowadays, multimedia processing devices such as mobile phones and PDAs (Personal Digital Assistants) are used to receive and transmit various types of information in the form of text or images in addition to wireless communication functions and to receive information through the wireless Internet.

Various additional service functions added to the multimedia processing apparatus include Internet access, game download and play, video download and watch, video communication, music file download and play, text communication, phone book record management, memo function, etc. There is a great variety and many more kinds of supplementary services are being developed and provided.

Recently, a multimedia processing apparatus first reads a caption data file included in a digital data file consisting of an audio and video file and a caption file, downloads the caption data, and then reads the caption data while playing the audio and video data. And playback in conjunction with video data.

Accordingly, since users can watch audio and audio at the same time while watching subtitle images superimposed on a video image, there is an increasing number of cases of using digital data files for language learning.

However, there is a problem in a general multimedia processing device that a user needs to check necessary learning contents such as listening and writing by pressing a stop or pause key for language learning, and accurately searches audio and video data at a specific location. There is a problem that it cannot be reproduced.

In Korean Patent Publication No. 2007-0018202 ("Jump method using subtitle information control"), a preview jump is performed while playing a digital data file such as a Divix file including an audio and video file and a subtitle file. Or Next Jump is requested, search for Start Time information or Frame information of the previous subtitle, check and jump to the corresponding recording position, and the caption data from the jumped recording position. By reproducing and outputting audio and video data, the audio and video data can be easily searched and reproduced from the start point of the preview caption data or the start point of the next caption data on the basis of the caption data.

Accordingly, the Korean Laid-Open Patent Publication No. 2007-0018202 can more easily utilize subtitle data, such as a Divix file, as language learning data, and can greatly improve user convenience.

According to the conventional method, in order to use subtitle data such as a digital data file as language learning data, a content provider needs to purchase content produced by a content provider and use a digital device that supports the purchased content. Difficult, limited and content-dependent language learning was achieved.

In addition, in the case of learning by learning English learning video or audiovisual textbook, it is difficult to maintain continuous learning due to the structured learning contents, and the user frequently loses interest in the middle and often gives up.

In particular, the Korean Patent Application Publication No. 2007-0018202 allows accurate and easy navigation to the starting position of the previous subtitle data and the subsequent subtitle data according to a user's request. There is a problem in that it is impossible to efficiently and comprehensively learn a language.

Accordingly, an object of the present invention is to provide a language learning method of a multimedia processing apparatus capable of efficiently and comprehensive language learning such as listening, writing, speaking, reading, etc., and capable of supporting at least one or more languages without producing content. .

Language learning method of the multimedia processing apparatus according to an aspect of the present invention for achieving the above object of the present invention, in the digital data file including an audio file, a video file, a subtitle file, parsing the subtitle file time information Generating a subtitle table having subtitle information as a field; Upon entering the play mode, playing the video file or the audio file by a predetermined subtitle unit based on the time information of the subtitle table, pausing and proceeding to the first learning mode, and when the first learning mode is completed, And outputting the caption information for the reproduction portion of the first learning mode to proceed to the second learning mode.

The language learning method of the multimedia processing apparatus may further include performing a learning management mode in which a user's learning progress and learning results are statistically calculated and user learning progress can be managed.

In the digital data file including the audio file, the video file, and the subtitle file, generating the subtitle table by parsing the subtitle file as a field of time information and subtitle information, wherein the subtitle table includes the time information as an ascending key. The start time and the end time corresponding to one sentence may be passed to a play routine using the time information and the subtitle information.

When entering the play mode, the step of pausing after playing the video file or the audio file for each predetermined subtitle unit based on the time information of the subtitle table and proceeding to the first learning mode may include a start time and an end of the specific sentence. Video files and audio files can be played and file paused for a period of time.

The first learning mode may be a learning input mode including at least one of listening, dictation, and speaking. The first learning mode may use an interval repeating function and a hint function.

The second learning mode may be a translation mode for outputting caption information on a reproduction part of the first learning mode on a screen. The second learning mode may be a translation mode for outputting caption information for at least one foreign language on the screen. The second learning mode may use a foreign language dictionary function. The second learning mode may use a function of storing words or sentences for a specific playback portion.

The predetermined subtitle unit may be one sentence unit, one line unit, or one time unit.

According to the language learning method of the multimedia processing apparatus as described above, a caption table having a time information and caption information of a caption file as a field is generated from a digital data file including an audio file, a video file, and a caption file. Based on the time information, the audio file and the video file are played only one sentence or a predetermined unit, and then paused and enters the learning mode to enable speaking, listening, dictating, and reading.

Therefore, video files, audio files, and subtitle files, which are widely used at present, are used as learning tools. In particular, only the sync information and language information of the subtitle files can be used to easily implement them. Listening, speaking, writing, and reading are all possible at the same time, as learning the dictation and speaking is possible.

In addition, you can add / edit subtitle files to learn at least one language at the same time, and there is no need to purchase English learning videos or audiovisual materials, greatly reducing the economic burden of language learning, and users' favorite movies. By using video files such as dramas, dramas, and learning in the form of a quiz can cause users' continuous interest.

In addition, because it uses movie files such as movies and dramas, it is possible to listen to the pronunciation of various people, and to access various phrases and sentences, enabling real-life-oriented learning, and existing language learning such as section repetition and electronic dictionary connection. All the features of the program can be used in addition, so you can easily keep track of your learning trends and progress.

As the present invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description.

However, this is not intended to be limited to the specific embodiment of the present invention, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Hereinafter, with reference to the accompanying drawings, it will be described in detail a preferred embodiment of the present invention. Hereinafter, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are only used to distinguish one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

Hereinafter, in the embodiment of the present invention, a digital data file is a concept including an audio and / or video file and a subtitle file.

In describing the drawings, similar reference numerals are used for similar components.

Hereinafter, with reference to the accompanying drawings, it will be described in detail a preferred embodiment of the present invention. Hereinafter, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

1 is a flowchart of a language learning method of a multimedia processing apparatus according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating an example screen of a language learning method of the multimedia processing apparatus according to an embodiment of the present invention. 3 is a diagram illustrating an example screen for simultaneously supporting a multinational language according to an embodiment of the present invention.

1 to 3, in a language learning method of a multimedia processing apparatus according to an embodiment of the present invention, a user stores a digital data file such as a movie or drama through a wired or wireless connection to a multimedia processing apparatus, and learns language. Attempt to play the digital file (step S1).

In the above, the multimedia processing apparatus according to an embodiment of the present invention can be applied to devices such as mobile terminals, mobile phones, PMPs, PDAs, and MP3s that perform multimedia processing.

The multimedia processing apparatus parses the caption file from the digital data file to generate a caption table with the time information and the caption information as fields and the time information as an ascending key (steps S2 and S3).

In the caption table, the start time and the end time corresponding to one sentence are passed to the playback routine, and the playback mode is entered by the user's key input. (Steps S4 and S5) At this time, as shown in FIG. Similarly, the playback mode is a mode for reproducing a general video, and plays only audio files and video files in a digital data file, and does not display subtitle files.

As shown in (b), (c), and (d) of FIG. 2, when the multimedia processing apparatus finishes playing a video file such as MPEG4 by the start time and the end time for the first sentence based on the subtitle table, the file is processed. After the pause is performed, the first learning mode is entered (steps S6, S7, and S8).

The first learning mode is a dictation or speaking input mode for the first sentence, and various learning methods such as listening, speaking, hearing dictation, dictation, speaking, dictation, and speaking are possible. The first learning mode may be performed using various input tools such as a keypad and a touch pad in the case of dictation, and may be performed using an input device such as a voice recognition device in the case of speaking. In the first learning mode, the user may repeatedly play the part that the user does not know, and may add a hint function to guide the user easily to speak or dictate.

For example, as shown in (d) of FIG. 2, when the user performs the dictation, the first sentence is input as "I love you so OOOO", and the word input for the 'OOOO' portion may be delayed for a predetermined time or more. If the user uses the hint function, the first letter of the word '0000' is printed.

If the user requests the section repetition reproduction for the first sentence, the audio and video file is reproduced once for the first sentence, or only the word at a specific position is repeatedly reproduced (step S9).

When the first learning mode is completed, a second learning mode is entered, which is a translation mode in which subtitle information of the first sentence, which is a reproduction part of the first learning mode, is displayed on the screen.

In the translation mode, as shown in FIGS. 2E and 2F, the subtitle information of the first sentence is displayed on the screen, and the subtitle information of the multilingual language, for example, Japanese language, is selected according to the user's selection. Will print the screen.

Alternatively, as illustrated in FIG. 3, the translation mode may simultaneously support multilingual languages such as English, Japanese, Chinese, and Korean by adding or editing subtitle files. For example, subtitles may be simultaneously displayed in at least one or more languages from among multiple languages such as Korean, English, Japanese, Chinese, and Russian, or only a language subtitle selected by a user. The user can also select a language to change at any time during playback.

In the translation mode, the foreign language dictionary function can be used to further increase the learning efficiency, and the user can save a specific word or sentence along with the corresponding audio file and video file for further repetitive learning.

In the case where the current time exceeds the end time of the first sentence, the learning management mode provides statistics for the user's learning progress and learning results, and manages the individual learning progress (steps S11 and S12).

In the above description, the time information and subtitle information are extracted from the subtitle file, and the language learning is performed in the dictation or speaking mode by cutting by one sentence unit, but the language is determined in the dictation or speaking mode by cutting in the predetermined subtitle unit instead of one sentence unit. Of course, you can learn. Here, the predetermined subtitle unit may be one line unit or a predetermined time unit. For example, when one sentence included in the subtitle information is too long to be used for language learning, the language learning may be performed in a dictation or speaking mode by cutting a predetermined length of time suitable for language learning.

For example, the language learning method of the multimedia processing apparatus according to an embodiment of the present invention operated as described above uses a subtitle table generated by parsing a subtitle (SAMI) file from a digital data file. same.

The subtitle file includes playback start / end time information or start / end frame information for cooperative reproduction with audio and video data included in the digital data file. SYNC)) is included and recorded.

Accordingly, the start position of the subtitle can be known using the start attribute value of the synchronization information, and the play mode, the first learning mode, and the second learning mode can be switched based on the start position information. You can also select the language of a foreign language through the Class attribute value of.

The following shows the format of SAMI subtitles that simultaneously support Korean, English, and Japanese by using the time (SYNC) and subtitle information of the subtitle (SAMI) file.

<SAMI>

<HEAD>

<Title> Test subtitle </ Title>

</ HEAD>

<BODY>

<SYNC Start = 1951> <P Class = KRCC> First subtitle line.

<SYNC Start = 1951> <P Class = ENCC> This is first sentence.

<SYNC Start = 1951> <P Class = JRCC> こ れ は 最初 の 字幕 で す。

(Subtitle line is displayed after 1951ms, "This is first sentence.". "こ れ は 最初 の 字幕 で す。")

<SYNC Start = 3304> <P Class = KRCC> &nbsp;

<SYNC Start = 3304> <P Class = ENCC> &nbsp;

<SYNC Start = 3304> <P Class = JRCC> &nbsp;

(Subtitles in Korean, English and Japanese disappear in 3304ms when the video is first played)

<SYNC Start = 5116> <P Class = KRCC> This is the second subtitle line.

<SYNC Start = 5116> <P Class = ENCC> This is second <br> sentence.

<SYNC Start = 5116> <P Class = JRCC> Koreha 二 番 目 の <br> 字幕 で す ね.

(5116ms after the first video is played. "This is the second subtitle line.", "This is second <br> sentence.". "こ れ は 二 番 目 の <br> 字幕 で す ね。" )

<SYNC Start = 6178> <P Class = KRCC> &nbsp;

<SYNC Start = 6178> <P Class = ENCC> &nbsp;

<SYNC Start = 6178> <P Class = JRCC> &nbsp;

(Subtitles in Korean, English, and Japanese disappear after 6178 ms of initial video playback)

<SYNC Start = 7494> <P Class = KRCC> Last subtitle line.

<SYNC Start = 5116> <P Class = ENCC> This is last <br> sentence.

<SYNC Start = 5116> <P Class = JRCC> こ れ は 最後 の <br> 字幕 だ よ。

(Subtitle line is "Last subtitle line", "This is last <br> sentence.". "Koreha 最後 の <br> 字幕 だ よ。" after 5116ms when the first video is played.)

<SYNC Start = 8440> <P Class = KRCC> &nbsp;

<SYNC Start = 8440> <P Class = ENCC> &nbsp;

<SYNC Start = 8440> <P Class = JRCC> &nbsp;

(Subtitles in Korean, English, and Japanese disappear after 8440 ms when the video is first played)

</ BODY>

</ SAMI>

In the above description, <br> is a display of one line spacing, and when the actual screen is output, the corresponding section is spaced one line.

For example, a subtitle file of "<SYNC Start = 5116> <P Class = ENCC> This is second <s>" is displayed on the screen after 5116 ms based on the initial video playback.

 "This is second

sentence. "

The SAMI subtitle is a subtitle format used by Microsoft Media Player, and other subtitle files can be converted to a playback mode, first and second learning modes based on time information in the same manner as the SAMI subtitle file. Is self explanatory.

As such, the language learning method of the multimedia processing apparatus according to an embodiment of the present invention is a foreign language such as dictation, speech, listening, reading while watching a movie or drama through time information and subtitle information of a subtitle file that is currently being used in general. Learning is possible, and above all, multi-language support is possible, and custom learning videos can be produced with simple operation using the video tool.

In the above description, an embodiment of executing a digital data file in a mobile communication terminal has been described, but the language learning method of the present invention is not limited to being performed in a mobile communication terminal, and may be applied to a multimedia processing device such as a computer and a television. have.

Although described with reference to the embodiments above, those skilled in the art will understand that the present invention can be variously modified and changed without departing from the spirit and scope of the invention as set forth in the claims below. Could be.

1 is a flow chart of a language learning method of a multimedia processing apparatus according to an embodiment of the present invention.

2 is a diagram illustrating an example screen of a language learning method of a multimedia processing apparatus according to an embodiment of the present invention.

3 is a diagram illustrating an example screen for simultaneously supporting a multinational language according to an embodiment of the present invention.

Claims (11)

Parsing the caption file in a digital data file including an audio file, a video file, and a caption file to generate a caption table having time information and caption information as fields; When entering a play mode, playing the video file or the audio file for each predetermined subtitle unit based on the time information of the subtitle table, pausing the first learning mode; And And when the first learning mode is completed, outputting the caption information on the playback portion of the first learning mode to proceed with a second learning mode. The language learning method of claim 1, further comprising: performing a learning management mode in which statistics of a user's learning progress and learning results are statistically calculated and user's learning progress is managed. The subtitle table of claim 1, wherein the subtitle table is generated by parsing the subtitle file in a digital data file including the audio file, a video file, and a subtitle file. The caption table uses the time information as an ascending key, and transmits a start time and an end time corresponding to one sentence to a play routine using the time information and the caption information. Way. 4. The method of claim 3, wherein, when the play mode is entered, the video file or the audio file is paused after the predetermined subtitle unit is played based on the time information of the subtitle table and the first learning mode is paused. And reproducing and pausing the video file and the audio file by the start time and the end time of the specific sentence. The language learning method of claim 1, wherein the first learning mode is a learning input mode including at least one of listening, dictation, and speaking. The language learning method of claim 1, wherein the first learning mode uses an interval repeating function and a hint function. The language learning method of claim 1, wherein the second learning mode is a translation mode that outputs subtitle information of a reproduction part of the first learning mode on a screen. The language learning method of claim 7, wherein the second learning mode is a translation mode for outputting subtitle information of at least one foreign language on the screen. The language learning method of claim 7, wherein the second learning mode may use a foreign language dictionary function. The language learning method of claim 7, wherein the second learning mode uses a function of storing a word or a sentence for a specific playback portion. The language learning method of claim 1, wherein the predetermined subtitle unit is one sentence unit, one line unit, or a predetermined time unit.

Images