KR101412722B1 - Caption management method and caption search method - Google Patents

Abstract

A subtitle management method and a subtitle searching method are provided. In the subtitle management method, words are extracted from subtitles of a moving picture and are recorded in the index DB together with the subtitle, the time code of the subtitle and the file name of the moving picture, and the subtitle is recorded in the subtitle DB together with the time code of the subtitle and the file name of the moving picture. Accordingly, it is possible to efficiently and effectively search the moving picture caption by generating / managing the index information for the moving picture captions. In addition, since the retrieval is easy, it is possible to dramatically reduce effort and time for caption editing / editing.

Description

Title: Caption management method and caption search method

The present invention relates to a subtitle management method and a subtitle searching method, and more particularly, to a method for managing subtitles added to a moving picture, and searching and providing subtitles to be searched.

Video subtitles are frequently edited and edited even after they are created. Such modification and editing of the subtitles are performed while watching the produced video, so that it takes considerable time and effort.

In particular, in the case where the subtitle creator and the edit / editor are different, it becomes more difficult because it is difficult to find where the subtitle required to be edited / edited is located.

Accordingly, a search for a method for facilitating subsequent editing / editing of the generated subtitle is requested. In addition, there is a need for a method for creating and managing subtitles more conveniently and efficiently.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide a subtitle management method for generating index information for moving subtitles and managing the index information together with moving subtitles.

It is another object of the present invention to provide a subtitle searching method capable of searching for moving subtitles more efficiently and efficiently by using index information for moving subtitles.

According to an aspect of the present invention, there is provided a subtitle management method comprising: extracting words from a subtitle of a moving picture; Storing the words in the index DB together with the caption, the time code of the caption, and the file name of the moving picture; And recording the caption in the caption database together with the time code of the caption and the file name of the moving image.

The subtitle management method may further include searching the index DB for extracted words if the number of extracted words is equal to or greater than a predetermined number. And determining that there is a similar caption for the caption if the matching ratio of the extracted words to the retrieved caption is equal to or greater than a certain ratio, and the caption DB recording step includes: A time code, a file name of the moving picture, and information on the similar subtitle.

The subtitle management method includes: receiving a text; Extracting words from the input text; Searching the index DB for the words; And listing the retrieved subtitles.

The listing step may list similar subtitles of the searched subtitles together.

The caption management method may further comprise: determining a time code of the selected caption among the listed captions; And reproducing the moving picture after the identified time code with the caption.

The method may further include generating a subtitle file in which subtitles for a specific moving image among the subtitles recorded in the subtitle DB are listed in order of time codes.

The subtitle management method further includes: reproducing the moving picture; Loading subtitles for the moving picture into the memory from the subtitle DB; And superimposing the subtitle of the current time code on the moving picture being read from the memory and reproducing the moving picture.

In the extracting step, the caption may be morpheme analyzed to extract the words.

According to another aspect of the present invention, there is provided a subtitle searching method comprising: inputting text; Extracting words from the input text; Searching the index DB for the words; And listing the searched captions. The index DB records the words extracted from the subtitles of the moving picture together with the subtitle, the time code of the subtitle, and the file name of the moving picture.

The listing step may list similar subtitles of the searched subtitles together.

The method may further comprise: determining a time code of a selected one of the listed subtitles; And reproducing the moving picture after the identified time code with the caption.

As described above, according to the present invention, it is possible to efficiently and efficiently search the moving picture subtitles by generating / managing index information for moving subtitles. In addition, since the retrieval is easy, it is possible to dramatically reduce effort and time for caption editing / editing.

In addition, since subtitles and moving pictures are managed separately, it is possible to facilitate the generation of subtitles for the hearing-impaired and the translation / replacement of the subtitles of the program.

1 is a diagram showing a subtitle management system to which the present invention is applicable,
2 shows a subtitle generation algorithm performed by the subtitle generation program,
FIG. 3 is a flowchart provided in the description of a process of processing / managing the subtitles generated in FIG. 2;
4 is a flowchart provided for explanation of a subtitle search process;
5 and 6 are views showing an execution screen of a program for generating a subtitle,
7 is a diagram showing an environment setting window of a program for generating a subtitle,
FIG. 8 is a diagram illustrating a search result list that may be provided in step S440 of FIG.

Hereinafter, the present invention will be described in detail with reference to the drawings.

1 is a diagram showing a caption management system to which the present invention is applicable. The subtitle management system generates subtitles for moving pictures, stores / manages the subtitles separately from the moving pictures, and reproduces the generated subtitles and moving pictures together. In addition, the caption management system manages the index information on the subtitles in order to search the subtitles and search for more useful subtitles.

1, the subtitle management system includes a workstation 110, a server 120, a moving picture DB 131, a subtitle DB 132, and an index DB 133 .

The workstation 110 is a terminal on which a moving picture caption generation operation is performed. In addition, the workstation 110 can perform subtitle editing / editing, 'moving picture' playback, 'moving picture + subtitle playback', and can input a subtitle search request.

The video, regardless of the format such as MPEG, AVI, etc., does not matter of drama, movie, sports, education, news, documentary,

The worker who creates the video subtitles does not depend on the author, the translator, the producer, etc., and the subtitles do not include the main-subtitles, auxiliary-subtitles, and translation-subtitles.

The server 120 may provide the moving image stored in the moving image DB 131 to the workstation 110 and may also store the moving image received from the workstation 110 in the moving image DB 131. [

The server 120 stores the subtitles received from the workstation 110 in the subtitle DB 132, generates index information from the received subtitles, and stores the index information in the index DB 133. [

In addition, the server 120 performs a subtitle search requested by the workstation 110 and provides search results. As a result of the search, the server 120 may provide a moving picture frame in which the subtitle is displayed in addition to the subtitle.

Hereinafter, the process of generating subtitles by the subtitle management system shown in FIG. 1 will be described in detail with reference to FIG. 2 is a caption generation algorithm performed by the caption generation program installed in the work station 110. [

As shown in FIG. 2, first, the moving picture to be generated in the workstation 110 is reproduced (S210).

The moving picture to be played back in step S210 may be stored in the moving picture database 131, downloaded from the server 120, or stored in the workstation 110. In the latter case, it is preferable that the workstation 110 uploads the moving image to the server 120 and stores the moving image in the moving image DB 131 at a later time.

The subtitle creator displays the video to be reproduced and displays the frame to insert the subtitle, stops the video playback, selects the video frame, and inputs the desired subtitle.

When the subtitle to be inserted into the selected moving picture frame is inputted at step S230, the work station 110 inputs the time code of the selected moving picture frame at step S220 in step S230 (S240).

The time code in step S240 is generated in the form of "hour: minute: second: frame-00: 00: 00: 00" in the subtitle start time and end time.

5 shows an execution screen of a program for generating a subtitle. As shown in FIG. 5, it can be confirmed that the moving picture is reproduced and the corresponding caption is displayed together. A voice view is shown at the bottom of the screen to allow you to observe the audio waveform of the movie.

In the right part of the execution screen of the program for generating a subtitle, a subtitle can be input, and a subtitle input window in which inputted subtitles are listed in order of time code is displayed. In this input window, subtitles can be input in two languages. In the second language subtitles, automatic input is possible as well as manual input.

On the other hand, in the execution screen of the program for generating a subtitle shown in FIG. 6, the red section indicated by the subtitle position corresponds to a section in which the subtitle appears, that is, a time code.

7 shows an environment setting window of a program for generating a subtitle. Through the shown setting window, it is possible to set caption fonts, borders, and the like, and to set automatic transmission related matters and audio output magnification.

Again, this will be described in detail with reference to FIG.

After step S240, the workstation 110 transmits the time code, the caption, and the video file name to the server 120 (S250). The transmission in step S250 can be performed in units of subtitles as well as in an integrated manner.

The integrated transmission means that the workstation 110 generates a plurality of subtitles and time codes for a moving picture as one subtitle file and transmits them to the server 120.

According to the integrated transmission according to subtitle transmission, the workstation 110 can store a plurality of subtitles and time codes for a moving picture as one subtitle file.

Hereinafter, a process of processing / managing the subtitles generated in FIG. 2 by the server 120 will be described in detail with reference to FIG.

3, when receiving the time code, the subtitle, and the video file name from the workstation 110 (S310), the server 120 morphs the received subtitles and extracts valid words (S320).

The effective word extraction in step S320 is possible by a method of defining parts of speech. For example, only nouns constituting subtitles can be set as valid words. In this case, the valid words extracted from the caption "Encounters with the wizard is not an accidental chance" are "Wizard", "Encounter" and "Opportunity".

If the number of valid words extracted in step S320 is three or more (S330-Y), the server 120 retrieves valid words from the index DB 133 (S340). The index DB 133 is a DB in which valid words are formed into a database for each subtitle.

If there is a subtitle searched in step S340 (S350-Y), the server 120 determines whether the matching ratio of the valid words extracted in step S320 and the subtitle searched in step S340 is 80% (S360). Here, the matching ratio is a numerical value indicating which of the valid words extracted in step S320 matches the valid words of the subtitle retrieved in step S340.

For example, if the 'valid words extracted at step S320' are 'Wizard', 'Encounter' and 'Opportunity' and 'Valid words of subtitles retrieved at step S340' are 'Wizard', 'Encounter' "And" price ", the matching ratio is 66.67% (= 2/3).

If the matching ratio exceeds 80% in step S360 (S360-Y), the server 120 determines that similar subtitles exist in the subtitles received in step S310 (S370).

Accordingly, the server 120 stores the similar caption information together with the time code, the caption, and the video file name received in step S310 in the caption database 132 (S380). Here, the similar caption information may include at least one of a time code, a caption, and a video file name for a caption determined as a similar caption.

In step S385, the server 120 records the valid words extracted in step S320 in the index DB 133 together with the caption, the time code, and the video file name.

If the number of valid words extracted in step S320 is less than three (S330-N), if there are three or more valid words but there is no caption found in step S340 (S350-N) Is less than 80% (S360-N), the server 120 determines that the similar subtitle does not exist in the subtitle received in operation S310 (S390).

Accordingly, the server 120 stores only the time code, the caption, and the video file name received in step S310 in the caption database 132 (S395).

On the other hand, the server 120 can generate a subtitle file in which subtitles for a specific moving image among the subtitles recorded in the subtitle DB 133 are recorded in time code order. This is useful when a moving picture file reproduction request is received from the workstation 110 and a subtitle file is transmitted together with the moving picture file.

On the other hand, when the moving picture file is requested to be reproduced from the workstation 110, the server 120 may add the subtitle while streaming the moving picture file stored in the moving picture DB 131 and provide the streaming to the workstation 110.

To do this, the server 120 reproduces the moving picture file, 2) loads the moving picture captions to be played back from the subtitle DB 132 into the internal memory, 3) reads the subtitle of the current time code from the internal memory, You can nest it on the video you're on.

Hereinafter, a subtitle searching process in the subtitle management system shown in FIG. 1 will be described in detail with reference to FIG.

As shown in FIG. 4, if the text is inputted through the work station 110 at step S410, the server 120 morphs the text input at step S410 and extracts valid words at step S420.

Thereafter, the server 120 retrieves valid words from the index DB 133 (S430), and provides the retrieved subtitles to the workstation 110 to list them in a list (S440).

FIG. 8 illustrates a list that can be provided in step S440 when an "encounter " as a one-word text is input. The subtitles listed in the list shown in Fig. 8 are the subtitles containing the encounters.

On the other hand, only the searched subtitles may be listed in the list provided in step S440, but it is possible to implement such that the similar subtitles of the searched subtitles are listed together.

If one of the subtitles provided in the list is selected through S440 (S450-Y), the server 120 recognizes the time code of the selected subtitle (S460) and reproduces the video after the determined time code with the subtitle To the work station 110 (S470).

On the other hand, it is possible to restrict / extend the playback time in step S470. For example, it is possible to extend the reproduction time to 10 seconds before / after time code (i.e., from 10 seconds before caption generation to 10 seconds after caption disappearance).

The subtitle search shown in FIG. 4 may be useful when it is necessary to search for modifying or editing previously generated subtitles.

Up to now, the management of caption management system and the management of caption creation, storage, retrieval, etc. have been described in detail.

In the above embodiment, it is assumed that the subtitles are generated through manual input at the workstation 110, but this is also an example, and it is possible to generate subtitles by other methods. For example, it is also possible to automatically generate subtitles by automatically converting a voice output from a moving picture into text.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

110: Workstation
120: Server
131: Movie DB
132: Subtitle DB
133: Index DB

Claims (11)

Extracting words from subtitles of a moving picture;
Storing the words in the index DB together with the caption, the time code of the caption, and the file name of the moving picture; And
And recording the caption in the caption database together with the time code of the caption and the file name of the moving image,
Retrieving the extracted words from the index DB if the number of extracted words is greater than or equal to a predetermined number; And
And determining that there is a similar caption for the caption if the matching ratio of the extracted words to the retrieved caption is greater than or equal to a certain ratio,
The subtitle DB recording step includes:
Characterized in that the caption is recorded in the caption database together with the time code of the caption, the file name of the moving picture, and information on the similar caption,
Receiving a text;
Extracting words from the input text;
Searching the index DB for the words; And
And retrieving the retrieved subtitles,
The step of listing,
And the similar subtitles of the retrieved subtitles are listed together,
And generating a caption file in which captions for a specific moving image among the captions recorded in the caption DB are recorded in order of time codes,
Reproducing the moving picture;
Loading subtitles for the moving picture into the memory from the subtitle DB; And
Further comprising the steps of: capturing a caption of a current time code from the memory and superimposing the caption of the current time code on a moving picture being reproduced; and displaying a plurality of caption-related control items on the execution screen of the caption of the moving picture, 1, a moving picture to be reproduced related to a search result of each search item corresponding to a search mode selected through the search interface is displayed in a second area, A voice view for observing a sound waveform of a moving picture is displayed, and the caption related state information is displayed in a fourth area.
delete delete delete The method according to claim 1,
Determining a time code of a selected one of the listed subtitles; And
And reproducing the moving picture after the identified time code with the caption.
delete delete The method according to claim 1,
Wherein the extracting step comprises:
And the words are extracted by morpheme analysis of the subtitles.
delete delete delete

Images