KR20180129486A - Method for chunk-unit separation rule and display automated key word to develop foreign language studying, and system thereof - Google Patents

Abstract

The present invention relates to a method and system for enacting a chunk unit separation rule and an automatic keyword accent display for foreign language learning. The method comprises: a first step in which a conversion application (100) for enacting a chunk unit separation rule and an automatic keyword accent display for foreign language learning recognizes voice and generates text subtitles by sentence from images having voice information; a second step in which the conversion application (100) parses a sentence structure by part-of-speech separation by sentence for the text subtitles and separates a part-of-speech information-based text by sentence generated through parsing into a chunk unit as a sound unit sentence structure through a predetermined chunk separation algorithm; and a third step in which the conversion application (100) extracts a keyword from at least one chunk unit based on each chunk unit, generates an accent display for the extracted keyword, provides the generated information to a smart device (200), and displays the information. The present invention provides a new chunk unit called a sound unit sentence structure, instead of focusing on learning through an existing text sentence unit for foreign language learning, especially English learning and provides an automatic accent for the keyword, which can be extracted from each chunk unit, based on newly reorganized English learning in a chunk unit. Therefore, through a minimal algorithm, actual English learning is significantly transformed from traditional visual text learning to learning to speak and hear.

Description

{METHOD FOR CHUNK-UNIT SEPARATION RULE AND DISPLAY AUTOMATED KEY WORD TO DEVELOP FOREIGN LANGUAGE STUDYING AND SYSTEM THEREOF}

The present invention relates to a chunk unit separation (chunk) rule for foreign language learning and a method and system for implementing automatic keyword emphasis display of a keyword, and more specifically, to English learning contents such as elementary, The present invention relates to a method and a system for implementing a chunk unit separation rule and keyword automatic stress indication for English learning.

The spread of personal computers and high-speed Internet services and the spread of mobile smart devices such as smart phones and smart pads have made it easier to access various multimedia contents, And learning methods are being developed.

However, the conventional education of images and contents for learning English is merely a substitute for the offline learning method as it is online, and therefore, it has not gained much effect in speaking and listening mainly in reading.

Accordingly, it provides a complete solution for speaking / listening English learning in the technical field, as well as providing learning methods that are indispensable for English learning video contents, so that trends in the English learning market can be heard in the conventional market of reading / It is required to develop the technology to meet the customer needs in the rapidly changing trend in the speech learning market.

Korean Patent Application No. 10-2009-0119555 "SYSTEM AND METHOD FOR OPERATING LANGUAGE TRAINING ELECTRONIC DEVICE AND REAL-TIME TRANSLATION TRAINING APPARATUS OPERATED THEREOF " Korean Patent Laid-Open Publication No. 10-2015-0055921 "METHOD AND APPARATUS FOR CONTROLLING PLAYING VIDEO" Korean Patent Registration No. 10-0879667 entitled " METHOD OF LEARNING LANGUAGE IN MULTIMEDIA PROCESSING APPARATUS "

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems and it is an object of the present invention to provide a speech recognition method and a speech recognition method which can solve a problem of learning a foreign language, A chunk unit separation rule for foreign language learning to provide a new chunk unit called unit syntax, and a method and system for implementing a key word automatic highlighting display.

In addition, the present invention provides an automatic emphasis based on a key word extractable from each chunk unit based on a newly re-organized foreign language learning unit in a chunk unit, so that the actual English learning can be learned from the existing eye, The present invention provides a method and system for implementing a chunk unit separation rule for a foreign language learning and a key word automatic highlighting display in order to enable the epochal conversion to be performed through a minimum algorithm.

In addition, the present invention can be implemented by switching through a minimum algorithm by adding language information for language identification to a second foreign language such as Japanese, Chinese, German, etc. in addition to learning a foreign language, especially English, The present invention provides a method and system for implementing a chunk unit separation rule and a key word automatic emphasis indication for English learning.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention, there is provided a chunk unit separation rule and a key word automatic high-

A first step in which a conversion application (100) for implementing a chunk unit separation rule for a foreign language learning and a keyword automatic word display implementation performs speech recognition and text subtitle generation for sentences in a video having voice information; The conversion application 100 performs parsing by text-to-text subtitling (Part-of-Speech) and text-to-speech-based text generated by the classification analysis, A second step of separating the data into chunks; The conversion application 100 extracts key words in at least one or more chunk units based on each of the separated chunk units and generates an accent indication for the extracted key words and provides the generated information to the user smart device 200 (3) . ≪ / RTI >

Herein, the first step is a step of converting the chunks into the chunks according to the chunk unit separation rule and the key word automatic highlighting display method according to another embodiment of the present invention. A step 1-1) of performing English speech audio recognition on a video having information by a digital conversion method after acquisition of an analog signal through a speech interface 141; And a converting step of converting the speech recognition digital signal generated in the step 1-1 into a caption text. . ≪ / RTI >

In the chunk unit separation rule and key word automatic highlight indication implementation method according to still another embodiment of the present invention, in the step 1-2, the conversion application 100 converts the speech recognition digital signal into a text-by-sentence It is preferable to extract it in a SubRip Text file format (SRT) having a start time and an end time.

In addition, in the chunk unit separation rule and key word automatic highlighting display method according to another embodiment of the present invention, in the first and second steps, voice information is common to each of the subtitle formats generated by the conversion application 100 And synchronization information such as a synchronization start time, a synchronization holding time, and a synchronization end time for synchronization of image reproduction may be included in each sentence.

According to another embodiment of the present invention, there is provided a chunk unit separation rule and a key word automatic emphasized display implementation method, wherein the second step is a step in which the conversion application 100 performs a subtitle semantic unit analysis, It is desirable to perform time analysis, stress unit time analysis, phoneme unit analysis, and chunk separation.

According to another embodiment of the present invention, there is provided a chunk unit separating rule and a key word automatic emphasizing display implementation method, wherein the second step is a step of parsing the subtitle text generated by the transcoding application (100) A second step of performing Part-of-Speech for each sentence through a Tokenizer algorithm to generate a part-of-speech information based text for each sentence; A second step of separating the sentence-based piecemeal information-based text into chunk units by a chunk separation algorithm set in advance; . ≪ / RTI >

According to another embodiment of the present invention, the chunk unit separation rule and the keyword automatic word display method are implemented in the step 2-2. In the chunk unit separation, (Comma), "Pause" standard separation process, character syllable number calculation process, functional word and key word syllable number calculation process, word and function word / key word syllable for chunk unit distinguished by one of plural chunk separation algorithms Number of phonemes, number of phonemes, number of phonemes, number of phonemes, number of phonemes, number of phonemes, number of phonemes, number of phonemes, number of phonemes and number of phonemes.

Further, in the chunk unit separation rule and key word automatic indication method according to another embodiment of the present invention, in the third step, the conversion application 100 divides the chunk unit real time required for each chunk unit in the second step A step 3-1 of extracting a key word in the chunk and setting the stress of the syllable with respect to the extracted key word; (1) for chunk unit by sentence, and key word extraction / emphasis display module (130) using the stress information of syllable finally extracted by the conversion application (100) A chunk unit intensified learning file including information (2) about key word emphasis among the chunk units extracted by the chunk unit intensified learning file, and providing the generated chunk unit compilation learning file to the user smart device 200; . ≪ / RTI >

In order to achieve the above object, according to an embodiment of the present invention,

In the chunk unit separation rule and key word automatic stress display implementation system for English learning including the conversion application 100 and the user smart device 200, the conversion application 100 includes a chunk unit separation rule for foreign language learning, A speech recognition / caption generation module 110 for performing a speech recognition and a text caption generation for a sentence on a video having a speech information by the conversion application 100 for implementing automatic emphasis display; The parsing by text-based part-of-speech for text subtitles and the segmentation of chunks by the chunk separation algorithm, A parsing / chunk separation module 120; Extracting key words in at least one or more chunk units based on each of the separated chunk units, generating a stress indicator for the extracted key words, and providing the generated information to the user smart device 200, An accent marking module 130; . ≪ / RTI >

In this case, the speech recognition / caption generation module 110 may generate the speech recognition / caption generation module 110 based on the speech recognition Open API (Open Application Programming Interface) Voice recognition means (111) for performing English speech audio recognition in a video image having a plurality of images by performing a digital conversion method after collection of analog signals through a voice interface (141); And subtitle generation means (112) for converting the speech recognition digital signal generated by the speech recognition means (111) into a subtitle text; . ≪ / RTI >

According to another embodiment of the present invention, in the chunk unit separation rule and keyword automatic word display implementation system, the caption generation unit 112 generates a caption generation digital signal by a start time (Start Time) And a SubRip Text file format (SRT) having an end time.

In addition, in the chunk unit separation rule and keyword automatic word display implementation system according to another embodiment of the present invention, the caption generation unit 112 generates a caption generation rule for each of the caption formats, The synchronous start time, the synchronous holding time, and the synchronous end time for each sentence.

In the chunk unit separation rule and key word automatic emphasized display implementation system according to another embodiment of the present invention, the syntax analysis / chunk separation module 120 performs a syntax analysis / chunk separation module 120, Analysis, accent unit time analysis, chunk separation can be performed together.

In addition, in the chunk-unit separating rule and key word automatic emphasizing display implementation system according to another embodiment of the present invention, the syntax analysis / chunk separation module 120 performs syntax analysis (parts analysis) on the subtitle text generated for each sentence, A phrase analysis part (speech analysis part) 121 for performing a part-of-speech on each sentence through an algorithm (Tokenizer algorithm) to generate a part-of-speech information based text for each sentence; And a chunk separating means (122) for separating the converting application (100) into chunk units by a predetermined chunk separation algorithm for sentence-based parts-of-speech information based text; . ≪ / RTI >

In addition, in the chunk unit separation rule and keyword automatic word display implementation system according to another embodiment of the present invention, the chunk separation unit 122 may include a chunk standard sentence setting process in chunk unit separation, a predetermined chunk separation algorithm (Comma), "Pause" standard separation process, character syllable number calculation process, function word and key word syllable number calculation process, word and function word / key word syllable number, phoneme number division for chunk unit distinguished by one of them The time of the frequency waveform of the analog signal recognized by the speech recognition means 111 is calculated, and the actual required time for each chunk unit classified in the reference separation process can be calculated.

In the chunk unit separation rule and key word automatic stress display implementation system according to another embodiment of the present invention, the key word extraction / emphasis display module 130 is constructed by a syntax analysis / chunk separation module 120, Key word extraction means (131) for extracting key words in the chunks divided by the actual required time; And an emphasis display means (132) for setting the stress of the syllable with respect to the extracted key word; (1) for a sentence chunk unit, and a key word extraction / emphasis display module (1) for each sentence by using the stress information of the syllable finally extracted by the conversion application (100) 130 to generate chunk unit intensified learning file including information (2) about the key word accent, and then provide the file to the user smart device (200).

The chunk unit separation rule for foreign language learning according to the embodiment of the present invention and the method and system for implementing the automatic word highlighting display of a key word are provided for a long time period which is a disadvantage of learning based on an existing text sentence unit for foreign language, And to provide a new chunk unit of sound unit syntax in order to overcome limitations of learning English in practice.

In addition, according to another embodiment of the present invention, a chunk unit separation rule for a foreign language learning and a method and system for implementing an automatic highlighting display of key words are newly reorganized English learning bases in chunk units, By providing the accent, it is possible that the actual English learning can be carried out through a minimal algorithm, that is, an epochal transition from learning to learning and listening through the existing eye.

In addition, according to another embodiment of the present invention, a chunk unit separation rule for a foreign language learning and a method and system for implementing automatic keyword emphasis display of a key word may include a language for language identification of a second foreign language such as Japanese, Chinese, Information can be added and executed through a minimum algorithm, and it can be widely applied to a mobile device, a PC player, and the like.

FIG. 1 is a diagram illustrating a chunk unit separation rule for a foreign language learning and a system for implementing automatic keyword highlighting according to an embodiment of the present invention.
FIG. 2 is a diagram specifically illustrating the components and operation principles of the conversion application 100 among the chunk unit separation rules for foreign language learning and the keyword automatic word display implementation system according to the embodiment of the present invention.
3 is a diagram illustrating a user interface screen implemented in the smart smart device 200 among the chunk unit separation rules for foreign language learning and the system for implementing key word automatic highlighting according to an embodiment of the present invention.
FIG. 4 is a diagram showing a chunk unit separation rule for foreign language learning according to an embodiment of the present invention, and a part-by-speech segmentation through a syntax analysis (Tokenizer algorithm) .
FIG. 5 is a diagram for explaining the setting of the chunks according to the chunk unit separation rule for foreign language learning according to the embodiment of the present invention and the emphasis setting by the emphasis display unit 132 in the system for implementing automatic keyword emphasis display of key words.
FIG. 6 is a diagram illustrating a chunk unit separation rule for foreign language learning and a method for implementing automatic keyword highlighting according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.

FIG. 1 is a diagram illustrating a chunk unit separation rule for a foreign language learning and a system for implementing automatic keyword highlighting according to an embodiment of the present invention. FIG. 2 is a diagram specifically illustrating the components and operation principles of the conversion application 100 among the chunk unit separation rules for foreign language learning and the keyword automatic word display implementation system according to the embodiment of the present invention. 3 is a diagram showing a user interface (UI) screen implemented in the user smart device 200 among the chunk unit separation rules for foreign language learning and the keyword automatic word display implementation system according to the embodiment of the present invention to be.

Referring to FIGS. 1 to 3, a chunk unit separation rule for a foreign language, especially an English language learning, and a keyword automatic word display implementation system may include a conversion application 100 and a user smart device 200.

Here, the conversion application 100 may be installed in the user smart device 200 or may be installed in a separate external server (not shown), and may then transmit the resulting chunk unit compilation learning file to the user smart device 200 through the network . In the present invention, a chunk means a sound separation unit for each sentence.

The conversion application 100 may include a speech recognition / caption generation module 110, a parsing / chunk separation module 120, and a keyword extraction / emphasis module 130. In this specification, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware. Can be easily deduced to the average expert in the field of < / RTI >

The voice recognition / caption generation module 110 may be divided into a voice recognition unit 111 and a caption generation unit 112.

The speech recognition means 111 can perform recognition of English speech audio in a movie, a moving picture, and the like through a speech conversion by using a digital interface after collecting an analog signal through a speech interface 141 based on a speech recognition Open API (Open Application Programming Interface) have. Here, the voice interface 141 may be a microphone for recognizing an external sound, or a storage database when a movie, movie, or the like is stored in the storage medium.

Here, the speech recognition means 111 may generate a speech recognition digital signal as a result of performing English speech audio recognition on a sentence-by-word or word-by-word basis, and then provide the generated speech recognition digital signal to the caption generation means 112. Here, the speech recognition Open API includes a conventional speech recognition engine.

The caption generation means 112 can convert the speech recognition digital signal recognized by the speech recognition means 111 into a caption text. In one embodiment of the present invention, the subtitle generating means 112 generates a subtitle for a speech recognition digital signal in a subtitle text format (SRT) having a start time and an end time for each sentence in the subtitle text format .

In addition, in another embodiment of the present invention, the subtitle generating unit 112 may include an SMI (Synchronized Accessible Media Interchange) subtitle format (SMI) having a start time and an end time for each sentence, Or Sub Station Alpha), and Advanced SSA Subtitles (ASS). For each sentence, synchronous information such as a synchronous start time, a synchronous holding time, and a synchronous end time for synchronizing reproduction of a movie, a moving picture and the like in common for each of the subtitle formats generated by the subtitle generating means 112. [

The parsing / chunk separation module 120 can be divided into a parsing (parts analysis) unit 121 and a chunk separation unit 122.

The parsing means 121 performs a part-of-speech process for each sentence through a parsing algorithm (Tokenizer algorithm) for the caption text generated for each sentence by the caption generating means 112 , And generates a part-of-speech information-based text for each sentence. Meanwhile, FIG. 4 is a diagram showing that a sentence-by-speech segmentation is performed through a syntax analysis (Tokenizer algorithm).

In one embodiment of the present invention, the parsing means 121 may utilize a parsing Open API (Apache Open NLP) as a parsing algorithm.

The chunk separating means 122 may separate the sentence-based speech information-based text into chunks by a preset chunk separation algorithm.

In the embodiment of the first chunk separating algorithm, the chunk separating means 122 separates the chunk separating means 122 into a plurality of chunk separating means It is possible to calculate the number of dictionary chunks by separating chunks for each sentence based on the continuous and discontinuous information stored in the symbol continuity classification DB 142.

Also, in this specification, a DB may mean a functional and structural combination of software and hardware for storing information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the database.

Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

In the embodiment of the second chunk separation algorithm, the chunk separating means 122 separates chunking information based texts for each sentence based on sentence key words and sentence function words pre-stored in the phrase DB 143, After dividing into key words, syllable chunks can be computed by separating chunks by sentence based on functional words and key words.

It should be noted that the chunk separating means 122 can calculate the number of chunks by separating chunks by syllable unit and phoneme unit.

In the embodiment of the third chunk separating algorithm, the chunk separating means 122 separates the sentence-based piece-of-speech information based text into a frequency waveform previously stored in the syntax frequency DB 144 previously stored in the frequency waveform DB 144, The number of frequency chunks can be calculated by separating the chunks by sentence by analyzing the chunks for each sentence and analyzing the time for each syllable.

More specifically, the chunk separating means 122 extracts the English emphasis frequency among the frequency waveforms of the analog signal recognized by the speech recognizing means 111, and then outputs the chord separating means 122 with a predetermined weighting value? ) Can be separated into chunks per sentence by calculating the frequency length characteristics before and after the English accent frequency.

In another embodiment of the present invention, a chunk reference sentence setting process based on various indicators such as a sentence symbol (?!.) As the "first chunk separation step & Separation based on an index such as "," (comma), or "Pause" for chunk units separated by one of the first to third chunk separation algorithms described in the "second chunk separation step & The process of calculating the number of syllables in the "third chunk separation step", the calculation of the number of syllables based on the functional word and the keyword in the "fourth chunk separation step", and the calculation of the actual time required for each chunk unit by the "fifth chunk separation step" Can be performed sequentially.

More specifically, in the third chunk separation step, the chunk separation means 122 performs character syllable number analysis on sentence-based information-based text contained in sentence elements separated by "," (comma) It is possible to calculate the number of dictionary syllables by analyzing the phonetic symbol of the words separated by each part of speech segmented by the phrase analysis unit 121.

Similarly, it goes without saying that the chunk separating means 122 can calculate the number of phonemes.

Thereafter, in the fourth chunk separating step, the chunk separating means 122 uses the number of lexical syllables, the continuity and the discontinuity between the dictionary syllables, The final syllable number can be calculated.

Thereafter, in the fifth chunk separating step, the chunk separating means 122 divides the words into words and functional words / key words and calculates the time of the frequency waveform of the analog signal recognized by the speech recognizing means 111, The actual time required for each chunk unit can be calculated.

In the present invention, the chunk reference sentence setting is set as a sentence symbol (?..) As a reference for separating chunks by the chunk separating means 122, and "," (commas) , "Pause ", and then calculates the number of character syllables and the number of functional words and the number of syllable-based syllables. However, the present invention is not limited to this, It is needless to say that it is possible to perform calculations in various chunks reference setting and phoneme units as much as possible.

The key word extraction / emphasis display module 130 can be divided into a key word extraction means 131 and an emphasis display means 132.

The key word extraction means 131 extracts key words in the chunks separated by the chunk separating means 122. That is, the key word extracting unit 131 extracts key words for each chunk by comparing with key words previously stored in the key word DB 144 constructed in advance. In an embodiment of the present invention, the key word extracted by the key word extraction means 131 as shown in FIG. 2 may be a single word when one word in one chunk is a single word, and a plurality of words in one chunk Can be set as a verb.

The emphasis display means 132 can set the intensity of the key word extracted by the key word extraction means 131. [ 5, the syllable is separated by applying an IPA (International Phonetic Alphabet) pronunciation based on the key word extracted by the keyword extracting unit 131, and then the stronger of the separated syllables Is extracted from the word-by-word accent DB 145.

Then, the emphasis display means 132 finally applies the emphasis of the key words in the chunks by using the extracted syllable information.

In this manner, the conversion application 100 having the above-described configuration is provided with the delimiter symbol (1) for the chunk unit for each sentence performed by the syntax analysis / chunk separation module 120, The chunk unit intensified learning file including the information (2) about the key word strength among the chunk units extracted by the chunk unit intensified learning file, and provides the file to the user smart device 200.

2, the user smart device 200 can be implemented separately from the original English subtitle text 21 and the Korean translation subtitle text 22 in the chunk unit separation rule for the English language learning and the keyword emphasis display area 10 have.

FIG. 6 is a diagram illustrating a chunk unit separation rule for foreign language learning and a method for implementing automatic keyword highlighting according to an embodiment of the present invention. Referring to FIG. 6, a conversion application 100 for implementing a chunk unit separation rule for English learning and a key word automatic highlighting display performs voice recognition and text caption generation for a moving picture, a movie, and the like (S10). More specifically, the conversion application 100 acquires English speech audio recognition from a movie, a moving picture, or the like based on a speech recognition Open API (Open Application Programming interface) through an audio interface 141, And converts the speech recognition digital signal into subtitle text.

After step S10, the conversion application 100 performs parsing and chunk separation (S20). In step S20, the conversion application 100 can perform subtitle semantic analysis, part-of-speech semantic analysis, video-audio unit-time analysis, stress unit time analysis, and chunk separation.

More specifically, the conversion application 100 performs a part-of-speech process for each sentence through a parsing algorithm (Tokenizer algorithm) for the subtitle text generated for each sentence in step S10 , And the sentence-based part-of-speech information-based text is generated, and then the sentence-based part-of-speech information-based text can be separated into chunks by a preset chunk separation algorithm.

In step S20, the conversion application 100 converts the chunk unit into a chunk unit (?!.) Reference chunk reference sentence setting process, a chunk unit divided by one of a plurality of predetermined chunk separation algorithms, The time of the frequency waveform of the analog signal recognized in step S10 is divided into the number of syllables, the number of syllables, the number of syllables, the number of syllables, the number of syllables, And calculates the actual time required for each chunk unit divided in the reference separation process.

After step S20, the conversion application 100 generates key words and an accent mark, and provides the generated information to the user smart device 200 so as to be implemented (S30). That is, in step S30, the key word extraction in the chunks, the extracted key word syllables, the phonemes, and the stress dictionary using the dictionary are performed, and the linked display is performed through the player.

More specifically, the conversion application 100 can extract the key words in the chunks separated by the actual required time for each chunk unit in step S20, and then set the key words for the extracted key words. The syllable is separated by applying an IPA (International Phonetic Alphabet) pronunciation-based articulation rule, and information about the stress in the separated syllable can be extracted from the word-oriented accent DB 145. The conversion application 100 finally applies the highlighting of the extracted syllable to the key words in the chunks and applies the discrimination symbol (1) for each chunk unit by sentence and the key word extraction / emphasis display module 130 A chunk unit intensified learning file including information (2) about the key word strength among the extracted chunk units may be generated and then provided to the user smart device (200).

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

100: conversion application
110: Speech Recognition / Subtitle Generation Module
120: parsing / chunking module
130: Key word extraction / stress indicator module
141: Voice interface
142: pronunciation symbol continuity classification DB
143: Syntax DB
144: Frequency waveform DB
145: Strength DB by word
200: User smart device

Claims (16)

A first step in which a conversion application (100) for implementing a chunk unit separation rule for a foreign language learning and a keyword automatic word display implementation performs speech recognition and text subtitle generation for sentences in a video having voice information;
The conversion application 100 performs a parsing by a sentence-based part-of-speech for text subtitles and a speech recognition by a predetermined chunk separation algorithm for the sentence-based partly-based text generated according to the classification analysis A second step of separating the data into chunk units as a unit syntax; And
The conversion application 100 extracts key words in at least one or more chunk units based on each of the separated chunk units and generates an accent indication for the extracted key words and provides the generated information to the user smart device 200 (3) Wherein the chunk unit separation rules for the foreign language learning and the automatic word highlighting implementation method for the key word are provided.
2. The method according to claim 1,
The conversion application 100 acquires the English speech audio recognition from the image having the voice information based on the speech recognition Open API (Open Application Programming Interface) through the speech interface 141 and performs the digital conversion after the acquisition of the analog signal Step 1-1; And
A 1-2 step of the conversion application 100 converting the speech recognition digital signal generated in the step 1-1 into a caption text; Wherein the chunk unit separation rules for the foreign language learning and the automatic word highlighting implementation method for the key word are provided.
The method according to claim 2,
Characterized in that the conversion application (100) extracts a voice recognition digital signal in a subtitle format of SRT (SubRip Text file format) having a start time and an end time for each sentence in a subtitle text format How to Implement Chunked Unit Separation Rules and Keyword Automatic Stress Indication for Learning.
3. The method according to claim 2,
And synchronization information such as a synchronization start time, a synchronization holding time, and a synchronization end time for synchronization of image reproduction having audio information common to each of the subtitle formats generated by the conversion application (100) How to Implement Chunked Unit Separation Rules and Keyword Automatic Stress Indicators for Foreign Language Learning.
The method according to claim 1,
Characterized in that the conversion application (100) performs a subtitle semantic unit analysis, a part-of-speech unit semantic analysis, a video-audio unit time analysis and an accent unit time analysis, a phonemic unit analysis, and a chunk separation. Unit Separation Rules and Keyword Automatic Strength Indication Method.
The method according to claim 1,
The conversion application 100 performs a part-of-speech for each sentence through a syntax analysis (Tokenizer algorithm) for the subtitle text generated for each sentence, Step 2-1 to generate And
A step 2-2 of separating the sentence-based piecemeal information-based text into chunks by a predetermined chunk separation algorithm; Wherein the chunk unit separation rules for the foreign language learning and the automatic word highlighting implementation method for the key word are provided.
7. The method of claim 6, wherein in step 2-2,
Quot ;, "Pause" criterion separation process, a character syllable (" Pause ") separation process for chunk units distinguished by one of a plurality of predetermined chunk separation algorithms, The number of syllables, the number of syllables, the number of phonemes, and the number of phonemes in the first step, and calculates the time of the frequency waveform of the analog signal recognized in the first step, A chunk unit separation rule for foreign language learning and a method for implementing automatic keying indication of key words, characterized by calculating the actual time required for each chunk unit.
2. The method of claim 1,
A step 3-1 of extracting a key word in a chunk divided into a real time required for each chunk unit in the second step and setting the stress of the syllable with respect to the extracted key word;
The conversion application 100 finally applies the highlighting of the extracted syllable to finally apply the key word accents in the chunks. The discrimination symbol (1) for the chunk unit by sentence and the key word extraction / emphasis display module 130 Generating a chunk unit compilation learning file including information (2) about key word emphasis among each chunk unit extracted by the chunk unit compilation learning file, and providing the generated chunk unit compilation learning file to the user smart device 200; Wherein the chunk unit separation rules for the foreign language learning and the automatic word highlighting implementation method for the key word are provided.
A chunk unit separation rule for a foreign language learning including a conversion application (100) and a user smart device (200)
The conversion application (100)
A speech recognition / caption generation module (110) for performing a speech recognition and a text caption generation for a sentence by a conversion application (100) for implementing a chunk unit separation rule for a foreign language learning and a key word automatic emphasis display implementation;
The parsing by text-based part-of-speech for text subtitles and the segmentation of chunks by the chunk separation algorithm, A parsing / chunk separation module 120; And
Extracting a key word in at least one or more chunk units based on each of the separated chunk units, generating a stress indication for the extracted key word, providing the generated information to the user smart device 200, An accent marking module 130; Wherein the chunk unit separation rules for foreign language learning and the automatic word highlighting display system for key words are provided.
[11] The method of claim 9, wherein the speech recognition / caption generation module (110)
Speech recognition means 111 for performing English speech audio recognition on an image having speech information based on a speech recognition Open API (Open Application Programming interface) through a digital conversion method after collection of an analog signal through a speech interface 141, ; And
Caption generation means (112) for converting the speech recognition digital signal generated by the speech recognition means (111) into a caption text; Wherein the chunk unit separation rules for foreign language learning and the automatic word highlighting display system for key words are provided.
[Claim 11] The method according to claim 10,
A chunk unit separation rule for foreign language learning characterized by extracting a speech recognition digital signal in a SubRip Text file format (SRT) having a start time and an end time for each sentence in the caption text format And Keyword Automatic Stress Indication Implementation System.
[Claim 11] The method according to claim 10,
A synchronous start time, a synchronous holding time, and a synchronous end time for synchronizing image reproduction with audio information common to each of the generated subtitle formats are included for each sentence, And Keyword Automatic Stress Indication Implementation System.
The method of claim 9, wherein the parsing / chunking module (120)
Chunk unit separation rule for Chinese language learning and automatic word highlighting implementation system for key words, characterized by performing subtitle semantic unit analysis, part - of - speech semantic analysis, video - audio unit time analysis, stress unit time analysis and chunk separation.
The method of claim 9, wherein the parsing / chunking module (120)
Part-of-Speech is performed through the parsing algorithm (Tokenizer algorithm) for sentence-generated subtitle texts to generate sentence-based information-based texts. Means 121; And
A chunk separating means (122) for separating, in chunk units, the sentence-based piecemeal information based text by the converting application (100) through a predetermined chunk separation algorithm; Wherein the chunk unit separation rules for foreign language learning and the automatic word highlighting display system for key words are provided.
15. The apparatus of claim 14, wherein the chunk separating means (122)
(Comma), "Pause" standard separation process, character syllable number calculation process, functional word, and key word for a chunk unit distinguished by one of a plurality of predetermined chunk separation algorithms The time of the frequency waveform of the analog signal recognized by the speech recognition means 111 is divided into the number of reference syllables, the number of words, the number of key words, the number of syllables, or the number of phonemes. A Chunked Unit Separation Rule for Foreign Language Learning and a Keyword Automatic Stress Indication Implementation System.
The system according to claim 9, wherein the keyword extraction / emphasis display module (130)
A key word extracting unit 131 for extracting key words in the chunks divided by the actual required time for each chunk unit by the parsing / chunking module 120; And
An emphasis display means 132 for setting a stress of the syllable with respect to the extracted key word; ≪ / RTI >
The conversion application 100 finally applies the highlighting of the extracted syllable to finally apply the key word accents in the chunks. The discrimination symbol (1) for the chunk unit by sentence and the key word extraction / emphasis display module 130 (2), and provides the chunk unit intensified learning file to the user smart device (200). The chunk unit separation rule for foreign language learning And Keyword Automatic Stress Indication Implementation System.

Images