KR100380779B1 - Management apparatus and method of script caption data - Google Patents

Abstract

The present invention relates to a caption data processing apparatus and a method thereof, and more particularly, to a caption data processing apparatus and a method for processing caption data, such as Synchronized Accessible Multimedia Interchange (SAMI) with a script.

According to the present invention, a script extraction means for receiving the caption data to which the control script is added to extract and analyze the control script, and outputs the analysis information; Analyzing means for analyzing the script extracted by the script extracting means and generating and outputting a control signal according to the interpreted script; And display means for reading and outputting caption data of a corresponding position in accordance with a control signal input by the analyzing means.

Description

Management apparatus and method of script caption data

The present invention relates to a caption data processing apparatus and a method thereof, and more particularly, to a caption data processing apparatus and a method for processing caption data, such as Synchronized Accessible Multimedia Interchange (SAMI) with a script.

Caption is developed to synchronize the text to the broadcast video or audio, to help understand the video, and is provided in the form of "subtitles" for people with a different language.

In caption processing, the closed caption is called 'Open Caption' and the closed caption is called 'Closed Caption'.

The machine that decodes the caption signal and displays it on the screen is called a caption decoder.

In the United States, closed captioning is provided to help people with hearing impairments, and it is conspicuous that it can bring educational effects to those who study English as a second language. For example, cassette players that output captions to the screen using special signals on language tapes, and mechanical devices that decode caption signals embedded in video tapes and broadcast images and output them at the bottom of the screen are also developed.

Synchronized Accessible Multimedia Interchange (SAMI), one of the most representative captions, introduces the HTML tag format, which allows capturing multiple languages simultaneously and has the advantage of being easy to write, making it one of the most popular captions for digital media. Format.

On the other hand, many multimedia players currently used by language learning support the caption function to provide additional information. However, as shown in FIG. There is a problem that it is difficult to meet the characteristics of language learning, which requires the mastery of vocabulary, sentences, and pronunciation through practice.

In other words, the implementation of learning scenarios such as "the first and second sentences are repeated twice, the tenth sentence is heard only once and the eleventh sentence is heard and dictated twice" was not possible with the existing simple caption form.

Accordingly, the present invention devised to solve the above problems, the caption data processing apparatus and the control device for adding the control script for producing language learning content, the media flow is controlled by the script added to the caption and its Its purpose is to provide a method.

1 is a conceptual diagram illustrating a caption data processing process according to the prior art.

2 is an exemplary view showing the structure of a SAMI file compared to HTML.

3 is an exemplary view showing a basic format of a script caption used in the present invention.

4 is a diagram illustrating a learning scenario to which the present invention is applied.

5 is an exemplary diagram of SAMI-based script caption data used in the present invention.

6 is a diagram illustrating a logic structure of SAMI-based script caption data according to an embodiment of the present invention.

7 is a structural diagram of a SAMI-based script caption data processing apparatus according to an embodiment of the present invention.

FIG. 8A is a block diagram of the parser of FIG. 7, FIG. 8B is a block diagram of the interpreter of FIG. 7, and FIG. 8C is a block diagram of the browser of FIG. 7.

9 is a flowchart illustrating a SAMI-based script caption data processing method according to an embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

100: parser 110: interpreter

120: browser 130: display

In order to achieve the above object, according to the present invention, a script extraction means for receiving the caption data to which the control script is added to extract and analyze the control script, and outputs the analysis information; Analyzing means for analyzing the script extracted by the script extracting means and generating and outputting a control signal according to the interpreted script; And display means for reading and outputting caption data of the corresponding position according to the control signal inputted by the analyzing means.

In addition, according to the present invention, a first step of extracting the script by receiving the caption data added with the script; A second step of generating a control signal according to the script extracted in the first step; And a third step of reading and displaying caption data according to the generated control signal.

Now, with reference to the drawings of Figure 2 will be described in detail a preferred embodiment of the present invention.

There is no domestic technology of captions for broadcasting at present, and it is a level of producing decoders in accordance with US standards. The purpose of the caption is to broadcast for the visually impaired, but at present, it is gaining more attention as an alternative to language learning for foreigners and broadcasting in noisy places.

Captions for digital media have been developed and released by domestic companies. However, incompatibilities are the biggest problem because each company is produced in a format only for its own software. Microsoft is developing and distributing SAMI, a standard for captioning for broadcast as well as digital media.

SAMI is very easy to use and has the important advantage of supporting multiple languages at the same time, but because it is designed for general purpose captions, you need to implement essential features for language learning only.

The proposed technology (S-SAMI: Script-SAMI) is based on SAMI, a media caption format used by Microsoft as a standard, and (1) provides additional control scripts for producing language learning contents. (2) By implementing the synchronization between the S-SAMI and digital media data, the technology enables the construction of an environment that can produce learning content that can interact with scenarios and users.

In normal captions it is simply a form that only shows characters in the playback of the media. It is also very difficult to edit the captions of the public because of the caption file format. SAMI makes these common captions easier to read and write through the structure of HTML and Cascading Style Sheets (W3C-enhanced standards for supplementing HTML layout functionality), and is a standardized format for Microsoft's Windows Media or Real. It is compatible with the system's real player. 2 shows the structure of a SAMI file compared to HTML.

S-SAMI, a scripted caption created based on SAMI, is a method of playing media files based on captions, rather than being dependent on media like conventional captions. In other words, it is a caption language that allows captions to control the playback of media. Thus, it has the following features and advantages.

1) Control multimedia data playback by caption

2) Scenario-based learning environment such as repetition, repeat reading, one-on-one conversation, pronunciation correction, dictation

3) Developer-friendly environment in a format similar to HTML

4) Provide an effective learning environment through scripts in the form of programming languages

5) Simultaneously or selectively create and provide captions for different languages

On the other hand, assuming that there is a caption with the same content as in FIG. 3 and multimedia data synchronized therewith, the following learning scenario is possible.

<Example of learning scenario>

(1) One-to-one conversation: Induce appropriate answers to the produced voice and repeat to the appropriate level.

(2) Pronunciation Correction: Measure the similarity between pronunciation and intonation through the comparison of waveforms and repeat to the appropriate level.

(3) Dictation: Induces the user to listen to the produced voice and record the contents of the listening.

(4) Repetitive Listening: Reproduce and master long sentences or major expressions a certain number of times.

4 is a diagram illustrating a learning scenario to which the present invention is applied.

First, in step S100, the voice of position "0" is output, the user's voice is input in step S102, and the similarity is measured in step S104. Do this.

Next, after outputting the voice of the position "2500" in step S106, and outputting the voice of the position "S5000" in step S108, after receiving the user text in step S110 and determining the similarity in step S112, if the next step is similar If not, it repeats from step S106 to support dictation.

Subsequently, in step S114, the repeated listening is supported by outputting the audio at the " 6500 " position three times.

Meanwhile, in FIG. 5, the left side shows caption contents written in the form of a SAMI, and the right side shows an example of an S-SAMI script.

Such a script caption technique is a foundation technology for enabling scenario-based language learning, and is the basis of logic for implementing software and hardware.

6 is a conceptual diagram of a caption scheme using an S-SAMI according to an embodiment of the present invention.

Referring to the figure, the caption flow is defined using the S-SAMI, and the media is played according to the defined flow.

First, play the sentence 10, then play the sentence 100 twice, play the sentence 400, play the sentence 300, play the sentence 400, play the sentence 700.

This flow shows how the caption controls the flow of media.

7 is a structural diagram of a SAMI-based script caption data processing apparatus according to an embodiment of the present invention.

Referring to the drawings, the SAMI-based script caption data processing apparatus according to an embodiment of the present invention, S-SAMI parser 100, S-SAMI interpreter 110, S-SAMI browser 120, S-SAMI The display 130 is provided.

The parser 100 includes a syntax analysis unit 101 and a grammar analysis unit 102 when referring to 8a.

Next, the interpreter 110 includes a processor 111 and an interface 112.

The browser 120 also includes an interface 121, a caption processor 122, and a media processor 123.

Now, operation of the script caption data processing apparatus according to an embodiment of the present invention will be described in detail.

First, the parser 101 of the parser 100 receives caption data attached to the script, extracts the script, and then parses the extracted script to separate keyword variables and the like.

Next, the grammar analysis unit 102 of the parser 100 analyzes the accuracy of the grammar and outputs the analysis result.

Subsequently, the processor 111 of the analysis unit 110 receives the analysis data processed by the parser and interprets the script command while reading line by line, capturing control signals according to the analysis result via the interfaces 112 and 121. Send to processor 122.

At this time, the control signals include repeating, dictation, pronunciation correction, repeated listening, and the like. The caption processor 122 reads and outputs the data according to the command.

9A is a flowchart of a SAMI-based script caption data processing method according to an embodiment of the present invention.

First, the caption data to which the script is added is received (step S110), and the script is extracted (step S112). Thereafter, the syntax is analyzed (step S114), the grammar is analyzed (step S116), and the analysis information is output.

Next, the script is analyzed (step S118), a control signal is generated according to the analyzed script (step S120), and the generated control signal is output to the player (step S122).

The player reads and outputs caption data in accordance with the control signal (step S124).

Although the present invention has been described in detail with reference to preferred embodiments, the scope of the present invention is not limited to the specific embodiments, and should be interpreted by the appended claims.

According to the present invention as described above, as the execution algorithm and the player are separated, the fixed content of the CD-ROM title is removed from the one-time, and thus it is effective to receive the new format of digital media in the language learning field.

In addition, according to the present invention, it is possible to secure the continuity that can provide effective content with continuous lectures, and to reduce the production cost due to the ease of content production has the effect of enabling affordable supply.

In addition, according to the present invention, there is an effect that not only induces the learner's interest through the serial format, various scenario experiences, but also enables continuous learning on a portable player, online, and offline.

In addition, according to the present invention, by planning and directing various situations through a caption generated like a programming script language, not just a character motive, it has the effect of pioneering a new field of digital broadcasting as well as a language learning field in the future.

Claims (10)

Script extraction means for receiving caption data added with a control script including a learning scenario algorithm of an instructor, extracting and analyzing the control script, and outputting analysis information; Analyzing means for analyzing the script extracted by the script extracting means and generating and outputting a control signal according to the interpreted script; And And display means for reading and outputting caption data of a corresponding position in accordance with a control signal input by the analyzing means. The method of claim 1, And a control signal is at least one of repeating, dictation, pronunciation correction, and repeated listening. The method according to claim 1 or 2, The script extraction means, A syntax analyzer configured to receive digital media caption data to which a control script including a learning scenario algorithm of the instructor is added, extract a control script, and analyze a classification of the extracted control script; And Caption data processing apparatus comprising a grammar analysis unit for receiving the analyzed script data from the syntax analysis unit to analyze the accuracy of the grammar. The method of claim 3, wherein The analysis means, A processing unit which receives a script including a learning scenario algorithm of an instructor extracted from the script extracting means, interprets each script language, and generates a control signal according to the script language; And And a first interface unit for providing an interface function between the processing unit and the display means. The method of claim 4, wherein The display means, A media data processor configured to read and output media data; A second interface unit for converting a signal input from the first interface unit into caption data and outputting the caption data; A caption processor for reading and processing caption data according to a signal input from the second interface unit; And And a display for receiving and displaying media data from the media data processor and for receiving and displaying captions from the caption processor. A first step of extracting a script by receiving caption data added with a script including an instructor's learning scenario algorithm; A second step of generating a control signal according to the script extracted in the first step; And And a third step of reading and displaying caption data according to the generated control signal. The method of claim 6, And the third step is to repeatedly output predetermined caption data when the control signal is repeated. The method of claim 6, In the third step, when the control signal is pronunciation correction, the caption data is output, and the caption data is repeatedly output until a predetermined similarity is received by receiving the user's voice according to the output caption data. How to process caption data. The method of claim 6, In the third step, when the control signal is a dictation, the caption data is output, and the caption data is repeatedly output until the user's character input according to the output caption data reaches a predetermined similarity. How data is processed. The method of claim 6, The third step is a caption data processing method characterized in that for outputting the caption data repeatedly, if the control signal is repeated listening.