KR20090090053A - Method of processing subtitles data for edited video product using synchronizing video data and subtitles data - Google Patents

Abstract

A subtitle management method of edited images using the synchronization of subtitle data is provided to reduce caption session time by automatically generating the corresponding subtitle and edit the original image. A subtitle input unit is used based on a time code. A first caption data having a first caption time code is prepared corresponding to a first image having a first image time code(S110). A second image having the second image the time code in which the first image the time code is the re-ordering is generated(S120). The first caption time code of first caption data is rearranged by using the change value of the second image the time code. The second caption data having the second caption time code corresponding to the second image is generated(S130).

Description

Subtitle processing method of edited video using synchronization of subtitle data {METHOD OF PROCESSING SUBTITLES DATA FOR EDITED VIDEO PRODUCT USING SYNCHRONIZING VIDEO DATA AND SUBTITLES DATA}

The present invention relates to a caption processing method of an image, and more particularly, to a method capable of processing a caption of an edited image in a short time using synchronization of caption data.

Recently, as the proportion of foreign broadcasting such as dramas, movies, and documentaries has increased greatly, various translation subtitle processing technologies have been developed to improve the efficiency of translation work.

Conventionally, after a translator receives an analog tape such as a video home system (VHS) from a broadcaster or a movie producer, the translator repeatedly plays it and generates subtitle text. However, such a method requires excessive work time, and there is a problem in that work efficiency is greatly reduced by performing viewing of a video material and generating a subtitle text file in a separate device.

In addition, since the translator provides only the subtitle text file, the company providing the image had to generate a time code of the image with a separate manpower and re-synthesize the subtitle text on the time code of the image. In order to solve the problems of the conventional translation work, a technology has been developed in which a translation worker can simultaneously generate timecode and subtitle text information on a computer by converting an image into a digital file.

For example, Korean Patent No. 650410 filed by the present applicant (registered on November 21, 2011) discloses a method of processing translation subtitles of an image. According to the Patent No. 650410, a work time can be greatly shortened by a translator using a nonlinear editing method while generating a time code and directly inputting a subtitle while watching a video on a computer. In addition, the work efficiency is improved by generating caption data in the form of a picture file so that the caption data is automatically arranged at the position of the corresponding timecode.

However, if the first subtitle file is created and broadcasted, then edited and produced in a different version, the translated subtitle processing method of Patent No. 650410 reconstructs the subtitle text information according to the edited video material and regenerates the time code. This still causes inefficiency issues with subtitles.

In particular, the recent version of the mobile media platform such as digital multimedia broadcasting (DMB), digital video broadcasting for mobile devices (DVB-H), etc. At the same time, there are a number of cases in which video images of the same source are edited and processed into various versions, such as editing and broadcasting a long time video material into a plurality of short time video materials. Therefore, there is an urgent need to develop a method for automatically synchronizing subtitles according to editing of an image.

Accordingly, it is an object of the present invention to provide a caption processing method capable of synchronizing the caption data with the edited video when the caption data exists.

In accordance with an aspect of the present invention, a method for processing a caption of an edited video image using synchronization of caption data according to an aspect of the present invention, first, by using a caption input means based on a timecode, First subtitle data having a first subtitle time code is prepared to correspond to the first image having the same. Next, the first image is selected in units of blocks, and the selected blocks are moved or deleted and edited to generate a second image having a second image time code in which the first image time code is rearranged. Lastly, a first subtitle of the first subtitle data is performed by using a change value of a second video time code of the block in the second video with respect to a first video time code of the selected block among the first pictures. By rearranging the time codes, second subtitle data having a second subtitle time code corresponding to the second image is generated.

According to an embodiment of the present disclosure, the preparing of the first subtitle data may include generating a first image in a digital form having image information and audio information, and loading the first image to obtain image and audio information. Displaying a first window for outputting a time code and a second window for outputting a waveform of the voice information, and a third window for inputting subtitle text having a plurality of text input cells based on the time code. Setting first subtitle time codes for specific sections to which a subtitle is to be input, and inputting subtitle text corresponding to the sections, based on the image information, audio information, or waveform; Converting the caption texts having the code into first caption data in the form of a picture file.

According to another embodiment of the present invention, prior to converting into the first subtitle data, classifying the text input cells by a preset criterion including a character and an appearance background using a spreadsheet method, and a font; The method may further include setting caption text styles including font, color, and size, and applying the set caption text style to the classified text input cells.

According to another embodiment of the present invention, in the generating the second subtitle data, the first subtitle timecode of the block selected from the first subtitle data is determined by the first image timecode of the block in the first image. When included in the range, the second subtitle time code for the block in the second image may be automatically calculated by the following equations (i) and (ii).

In timecode = first subtitle of the block before editing In timecode-Δx .......... (ⅰ)

Out timecode = first subtitle of the block before editing Out timecode-Δx ....... (ii)

(Where Δx = time code of the first image of the pre-edit block-time code of the second image of the post-edit block)

In the generating of the second subtitle data, when the second half of the first subtitle time code of the block selected from the first subtitle data is included within the range of the first image time code of the block in the first image. The second subtitle timecode of the block in the second image may be automatically calculated by the following equations (i) and (i).

In time code = Second image in time block after editing In time code ... (ⅲ)

Out timecode = first subtitle of block before editing Out timecode-Δx ....... (ⅳ)

In the generating of the second subtitle data, when the first half of the first subtitle time code of the block selected from the first subtitle data is included within the range of the first image time code of the block in the first image. The second subtitle timecode of the block in the second image may be automatically calculated by the following equations (i) and (i).

In timecode = first subtitle of the block before editing In timecode-Δx ........... (ⅴ)

Out time code = Second picture of the block after editing Out time code ............. (ⅵ)

In the generating of the second subtitle data, when the central portion of the first subtitle time code of the block selected from the first subtitle data is included within the range of the first image time code of the block in the first image. The second subtitle timecode of the block in the second image may be automatically calculated by the following equations (i) and (i).

In time code = Second image in time code of the block after editing ........ (ⅶ)

Out time code = Second picture of the block after editing Out time code ............. (ⅷ)

Meanwhile, according to another exemplary embodiment, the method may further include synthesizing the second subtitle data with the second image material.

According to the present invention, when editing a video material in which a caption file is generated by completing a caption work, the caption of the edited video can be generated by synchronizing the edited video with the existing caption file.

Therefore, even if the video is arbitrarily edited, since the subtitles of the edited video are automatically generated, reworking of the subtitles is not necessary, thereby greatly reducing the preparation time, manpower, and cost of broadcasting.

Hereinafter, a subtitle processing method of an edited video image using synchronization of subtitle data according to preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is limited to the following embodiments. No, one of ordinary skill in the art may realize the present invention in various other forms without departing from the technical spirit of the present invention. In the accompanying drawings, the dimensions of each component is shown in an enlarged scale than actual for clarity of the invention. In the present invention, when one component is referred to as being formed on, above, or under another component, the one component is formed on or below the other component. It is meant to be positioned, or further components may be additionally formed on the other components. In addition, it is to be noted that the respective components are referred to as "first", "second", and / or "third", not merely to limit each component. Thus, "first", "second" and / or "third" can be used selectively or interchangeably for each component.

1 is a flowchart illustrating a caption processing method of an edited video image using synchronization of caption data according to an exemplary embodiment of the present invention, and FIG. 3 illustrates caption input means for generating first caption data of FIG. 1. It is a computer screen.

1 and 3, a caption processing method of an edited video image according to an embodiment of the present invention may first correspond to a first video having a first video time code 112 before editing, and thus, a first caption time code. The first subtitle data having 132 is prepared (S110).

Specifically, the first image and the first subtitle data corresponding to the first image of the present invention have respective time codes, that is, the first image time code 112 and the first subtitle time code 132. Here, the SMPTE Time Code (Society of Motion Picture and Television Engineers Time Code) is a continuous array of numbers that is a sophisticated tape counter that is recorded by combining audio, video, and film. This timecode is used as a standard for synchronizing audio, video, and film.

The number of timecodes controls the running speed reference and position reference. In other words, how fast a number elapses determines the speed, and what number advances determines the position. The information of the timecode can be used to perform movement of video and audio data and to synchronize operations between different equipment in equipment such as tape recorders, computers, digital recorders, and the like.

The first subtitle data may be in the form of a picture file such as PNG, BMP, or TGA, and the first subtitle timecode 132 may be generated similarly to an image. For example, the first subtitle data may be generated using a predetermined subtitle input means based on time code. This will be described in more detail with reference to FIGS. 2 and 3 as follows. First, a digital first image having image information and audio information is generated (S112). The first image may be an original image converted into an analog form by using a predetermined conversion means (not shown), or may be initially recorded in a digital form.

Next, the first image is loaded using a predetermined subtitle input software 100 (S114). The caption input software 100 executes the first image in the form of the digital file to display the first to third windows 110, 120, and 130. The first window 110 outputs the image and audio information together with the first image time code 112, the second window 120 outputs the waveform of the audio information, and the third window 130. Is a window for inputting caption text having a plurality of text input cells C based on the first subtitle timecode 132. Here, the text input cells C are implemented in a threaded sheet manner such as an Excel program, and the respective cells C may be time coded 132, style 134, person name 136, and captions. 138) or the like, or can be processed by other methods.

On the other hand, a video standard having a low resolution, for example, MPEG-1 (mpeg-1) or window media to smoothly execute the first image on the subtitle input software 100 or to reduce the data capacity of the first image. Can convert to video (wmv) file format.

Subsequently, the first subtitle timecode 132 and the caption text are input through the third or fourth windows 130 and 140 while watching the first image through the first or second windows 110 and 120. (S116). Here, the fourth window 140 is implemented so that one row of the third window 130 can be input separately. Accordingly, the first subtitle time code 132 and the subtitle text 138 may also be input through the fourth window 140.

For example, each first subtitle time code 132 is set for specific periods S into which subtitles are to be input based on the image, voice, or waveform, and each set first subtitle time code 132 is set. In the subtitle text 138).

In this case, a style for the input caption text may be set (S117). 4 and 5 are computer screens for explaining the caption style setting. Referring to FIGS. 4A and 4B, the cells C are classified according to preset criteria such as the person of the first image, the appearance background, and the like. Meanwhile, the fifth window 150 for setting the style is displayed to set the text style of the caption such as the font, color, size, display position, and the like. The set caption text style is applied to the classified text input cells C. FIG.

Referring to FIG. 5, when the subtitle text is subsequently reprocessed, the data type 136 of a predetermined column such as a person and an appearance background may refer to the set style 134 so that the text is automatically styled. have. This function may be performed by expressing the sixth window 160 in the subtitle input software 100. In addition, new text raw can be added or deleted, so that the subtitle text can be output together or selectively in a plurality of languages, and a unique style can be specified for each language.

In particular, the styling function may be useful for reusing the first subtitle data synthesized with the first image when the resolution is changed by reprocessing the first image. For example, when the resolution is lowered due to editing of the first image, the first subtitle data may be effectively utilized by reducing and re-rendering the font.

Referring to FIG. 2 again, first caption data in the form of a picture file is generated using the caption texts 138 having the first caption time code 132 in which the input is completed (S118). For example, the first subtitle data may be output in the form of a series of still image files such as PNG, TGA, and BMP, in which an area excluding subtitles is transparent.

Referring back to FIG. 1, a second image having a second image time code is generated by editing the first image (S120). Specifically, a plurality of frames, i.e., blocks B1 and B2, are divided into timecodes on the video track (or timeline) 210 by using image editing means (reference numeral 200 in FIG. 6). And select, or move or delete the selected blocks (B1, B2). Accordingly, since the first time code is rearranged, the second image has a second time code in which the first time code is rearranged. However, even if the first time code is rearranged, the blocks B1 and B2 still have the original time code, that is, the first time code information.

Referring back to FIG. 1, second subtitle data having a second subtitle time code 450 is generated by synchronizing the first subtitle data 350 of the first image 300 with the second image 400. (S130). Here, the second subtitle data is automatically generated based on the timecode change value of the edited block, so that a manual rearrangement operation is not required to correspond to the second subtitle data.

The time code change value is a change of a time code value before editing the block and a time code value after editing the block. That is, the time code value before editing the block is the first video time code in the first video, and the time code value after editing the block is the second video time code in the second video. Accordingly, the time code change value is a change value of the second video time code having the selected block with respect to the first video time code that the selected block has before editing.

Accordingly, the second caption data may be calculated by changing the caption timecode of the first caption data for the block by using the change value of the video timecode of the selected block. Hereinafter, an example of calculating second subtitle data of the second image by using first subtitle data of the first image generated before editing will be described in detail with reference to FIGS. 7A to 7C. do.

7 (a) to 7 (c) are schematic conceptual views for explaining a method of synchronizing subtitles according to an embodiment of the present invention.

Referring to FIG. 7A, each of the first image 300 and the first subtitle data 350 of the first image 300 has a time code of 1 to 14, respectively. For convenience of description, the first image 300 is divided into first to thirteenth blocks B1 to B13, and the subtitle 350 for the first image 300 including the blocks is a to z. Assume that it is an alphabet.

As an example, the first block B1 of the first image 300 is set to an image time code of 1 to 2 (first image in timecode = 1, first image out timecode = 2). The first subtitle timecode of the first block B1 has caption a from 1 to 1.5 and caption b from 1.5 to 2.

First, in generating the second subtitle data 450, the first subtitle time code of the block selected from the first subtitle data 350 is the first image time of the block in the first image 300. If it is included in the code. In this case, the second subtitle time code for the block in the second image 350 may be automatically calculated by the following equations (i) and (ii).

In timecode = first subtitle of the block before editing In timecode-Δx .......... (ⅰ)

Out timecode = first subtitle of the block before editing Out timecode-Δx ....... (ii)

Here, Δx is a difference value between the time code of the first video of the pre-editing block and the time code of the second video of the post-editing block.

In detail, the third block B3 has been moved to the seat of the tenth block B10 (FIG. 7B). Here, the subtitles of the third block B3 are e and f. That is, since the first subtitle time code of the third block B3 is 3 to 4, it is included in the range of the first video time code 3 to 4 of the third block B3. On the other hand, the second video time code of the third block B3 after editing is 10 to 11 (Δx = 3-10 = -7).

Accordingly, the second subtitle in time code of the third block B3 is 10 since Δx (= -7) is subtracted from the first subtitle time code (= 3) of the third block B3 before editing. Further, the second subtitle out time code of the third block B3 is 11 since the subtitle out time code 4 of the third block B3 before editing is subtracted Δx (= -7). That is, the second subtitle timecode of the third block B3 is automatically calculated from 10 to 11, which corresponds to the second subtitle timecode value of the third block B3 in FIG.

Secondly, in the step of generating the second subtitle data 450, the second half of the first subtitle time code of the block selected from the first subtitle data 350 is the first part of the block in the first image 300. When included in the range of the video time code, the second subtitle time code for the block in the second image 400 may be automatically calculated by the following equations (iii) and (iii).

In time code = Second image in time block after editing In time code ... (ⅲ)

Out timecode = first subtitle of block before editing Out timecode-Δx ....... (ⅳ)

(Δx = time code of the first image of the block before editing-time code of the second image of the block after editing)

Specifically, the sixth block B6 has been moved to the seat of the eighth block B8 (Fig. 7 (b)). Here, the subtitles of the sixth block B6 are j and k. That is, since the first video timecode of the sixth block B6 is 6 to 7, and the first subtitle timecode k is 5.5 to 6.5 and 6.5 to 7.5, the second half of j is the first of the sixth block B6. It is contained within the video timecode (6 to 7). On the other hand, the second video time code of the sixth block B6 after editing is 8 to 9 (Δx = 6-8 = -2).

Accordingly, the second subtitle in time code of the sixth block B6 j is 8 since the second video in time code of the sixth block B6 j before editing is 8. Also, the second subtitle out time code of the sixth block B6 j is 8.5 since the subtitle out time code (= 6.5) of the sixth block B6 is subtracted from Δx (= -2) before editing. . That is, the second subtitle timecode of the sixth block B6 j is automatically calculated from 8 to 8.5, which is consistent with FIG. 7C.

Third, in the step of generating the second subtitle data 450, the first half of the first subtitle timecode of the block selected from the first subtitle data 350 may be the first of the block in the first image 300. When included in the range of the video time code, the second subtitle time code for the block in the second image 400 may be automatically calculated by the following equations (iii) and (iii).

In timecode = first subtitle of the block before editing In timecode-Δx ........... (ⅴ)

Out time code = Second picture of the block after editing Out time code ............. (ⅵ)

(Δx = time code of the first image of the block before editing-time code of the second image of the block after editing)

Similarly, since the sixth block B6 has been moved to the eighth block B8, the subtitles of the sixth block B6 are j and k. That is, since the first video timecode of the sixth block B6 is 6 to 7 and the first subtitle timecode k is 6.5 to 7.5, the first half of k may include the first video timecode of the sixth block B6. 6 to 7) are included. On the other hand, the second video time code of the sixth block B6 after editing is 8 to 9 (Δx = 6-8 = -2).

Therefore, the second subtitle in time code of the sixth block B6 k is a value obtained by subtracting Δx (= -2) from the first subtitle in time code (= 6.5) of the sixth block B6 k before editing. to be. In addition, the second subtitle in time code of the sixth block B6 k is 9 since it is the second video out time code of the sixth block B6 before editing. That is, the second subtitle timecode of the sixth block B6 k is automatically calculated from 8.5 to 9, which is consistent with FIG. 7 (c).

Fourthly, in the generating of the second subtitle data 450, a central portion of the first subtitle time code of the block selected from the first subtitle data 350 is determined by the first image of the block in the first image 300. When included in the range of the video time code, the second subtitle time code for the block in the second image 400 may be automatically calculated by the following equations (iii) and (iii).

In time code = Second image in time code of the block after editing ........ (ⅶ)

Out time code = Second picture of the block after editing Out time code ............. (ⅷ)

Specifically, the tenth block B10 has been moved to the position of the third block B3 (FIG. 7B). Here, the subtitle of the tenth block B6 is p. That is, since the first video timecode of the tenth block B10 is 10 to 11, and the first subtitle timecode p is 9.5 to 11.5, the central portion of p is the first video timecode of the sixth block B6. 10 to 11). On the other hand, after editing, the second video time code of the sixth block B6 is 3 to 4.

Therefore, the second subtitle in time code of the sixth block B6 is 3 since the second video in time code of the sixth block B6 is edited, and the second subtitle out time code of the sixth block B6 is 4 since the second video out time code of the sixth block B6 is edited. Whether the calculation result is noon can be confirmed through FIG. 7C.

As described above with reference to FIGS. 7A to 7C, when the first to fourth methods are used, even if the first image 300 is edited into the second image 400, the changed caption code, In other words, all second subtitle timecodes can be automatically calculated. Therefore, the second subtitle data 450 may be easily extracted from the first subtitle data 350.

Finally, the generated second subtitle data 450 is combined with the second image 400 (S140). For example, there is a method of synthesizing second subtitle data in the form of a picture file on the second image. Alternatively, the second subtitle data may be processed by the standard at the final sending end. This enables the viewer to selectively watch the subtitles when the second subtitle data includes multilingual or various subtitles.

As described above, through the video caption processing method according to the present invention capable of reprocessing the caption data by tracking the original time code value of the original tape, the video is re-output when the video is edited, and the caption is closed. Operators can easily recapture, reordering subtitle data and reproducing timecode.

Although the above has been described with reference to the preferred embodiment of the present invention, those skilled in the art will be variously modified and modified within the scope of the present invention without departing from the spirit and scope of the present invention described in the claims below. It will be appreciated that it can be changed.

1 is a flowchart illustrating a caption processing method of an edited video image using synchronization of caption data according to an exemplary embodiment of the present invention.

FIG. 2 is a schematic flowchart for explaining a first image generating step illustrated in FIG. 1.

3 is a computer screen for describing a caption input unit for generating first subtitle data of FIG. 1.

4 and 5 are computer screens for explaining the caption style setting of FIG. 2.

FIG. 6 is a computer screen illustrating a second image generating step of FIG. 1.

7 is a schematic conceptual view illustrating a method of synchronizing subtitles according to an embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

300: first image 350: first subtitle data

400: second image 450: second subtitle data

Claims (8)

Preparing first subtitle data having a first subtitle time code to correspond to a first image having a first video time code before editing by using a caption input means based on a time code; Generating a second image having a second image timecode in which the first image timecode is rearranged by moving or deleting the selected blocks by selecting the first image in units of blocks; And Rearranging the first subtitle timecode of the first subtitle data using a change value of the second video timecode of the block from the second image with respect to the first video timecode of the selected block among the first video And generating second subtitle data having a second subtitle time code corresponding to the second image. 3. The method of claim 1, wherein the preparing of the first subtitle data comprises: Generating a first image in a digital form having image information and audio information; Subtitle text having a first window for loading the first image, outputting image and audio information with a time code, a second window for outputting the waveform of the audio information, and a plurality of text input cells based on time code Expressing a third window for inputting; Setting first subtitle time codes for specific sections to which a caption is to be input, based on the image information, audio information, or waveform, and inputting caption text corresponding to the sections; And And converting the subtitle texts having the first subtitle timecode into first subtitle data in the form of a picture file. The method of claim 1, wherein before converting to the first subtitle data, Classifying the text input cells by a predetermined criterion including a character and an appearance background using a spreadsheet method; Setting subtitle text styles including font, color, size; And And applying the set subtitle text style to the classified text input cells. The method of claim 1, wherein the generating of the second subtitle data comprises: When the first subtitle timecode of the selected block is included in the range of the first video timecode of the block, In timecode = first subtitle of the block before editing In timecode-Δx .......... (ⅰ) Out timecode = first subtitle of the block before editing Out timecode-Δx ....... (ii) (Where Δx = time code of the first image of the pre-edit block-time code of the second image of the post-edit block) The caption processing method of the edited video material using the synchronization of the caption data, characterized in that the second subtitle time code for the block in the second video is automatically calculated by the above equations (iii) and (ii). The method of claim 4, wherein the generating of the second subtitle data comprises: When the second half of the first subtitle timecode of the selected block is included in the range of the first video timecode of the block, In time code = Second image in time block after editing In time code ... (ⅲ) Out timecode = first subtitle of block before editing Out timecode-Δx ....... (ⅳ) The caption processing method of the edited video material using the synchronization of the caption data, characterized in that the second subtitle time code for the block in the second video is automatically calculated by the above formulas (iii) and (iii). The method of claim 4, wherein the generating of the second subtitle data comprises: When the first half of the first subtitle timecode of the selected block is included in the range of the first video timecode of the block, In timecode = first subtitle of the block before editing In timecode-Δx ........... (ⅴ) Out time code = Second picture of the block after editing Out time code ............. (ⅵ) The caption processing method of the edited video material using the synchronization of the caption data, characterized in that the second subtitle time code for the block in the second video is automatically calculated by the above formulas (iii) and (iii). The method of claim 4, wherein the generating of the second subtitle data comprises: When the central portion of the first subtitle timecode of the selected block is included in the range of the first video timecode of the block, In time code = Second image in time code of the block after editing ........ (ⅶ) Out time code = Second picture of the block after editing Out time code ............. (ⅷ) The caption processing method of the edited video material using the synchronization of the caption data, characterized in that the second subtitle time code for the block in the second video is automatically calculated by the above formulas (iii) and (iii). The method of claim 1, further comprising: synthesizing the second subtitle data with the second video material.

Images