KR100907216B1 - Apparatus and method for controlling video using subtitle information - Google Patents

Abstract

An apparatus and a method for controlling a video image by using subtitle information are provided to enhance the user convenience in video appreciation by editing only an image for dialogue section. A section determining unit(120) determines a dialogue section or a non-dialogue section based on subtitle information, and a controller(110) controls the reproduction of a video image based on the dialogue or non-dialogue section information. A video reproducing unit(130) reproduces the video image for the dialogue or non-dialogue section. A section displaying unit(140) displays the dialogue or non-dialogue section, and a video editing unit(150) extracts the image for the dialogue or non-dialogue section and generates the image in new image.

Description

Apparatus and Method for Controlling Video using Subtitle Information}

The present invention relates to an image control apparatus and method using caption information. More specifically, the user can distinguish between the metabolic section and the non-metabolic section according to the presence or absence of metabolism, and play back images based on the metabolite section and display the non-metabolic section, and extract and edit only the image of the metabolic section. An apparatus and method for controlling an image using caption information that provide convenience of viewing.

Many users are currently watching a variety of images using a video device such as a computer, a digital versatile disc (DVD) player, a portable multimedia player (PMP), or the like. These various videos may include subtitle files for watching movies and learning foreign languages. These subtitle files include subtitle information as text information that is played in conjunction with the video and include a variety of functions such as Micro DVD, RealText, SubRip, and SAMI. There is a format. This subtitle file provides efficiency and convenience of viewing video to users who cannot hear voice or need visual information for foreign language learning.

On the other hand, there may be a section in which the subtitle is displayed due to the presence of audio information in the image and a section in which the subtitle is not displayed because the audio information does not exist. Depending on the purpose of viewing the video, the section in which no subtitle is displayed because there is no audio information may be meaningless or unnecessary viewing section. For example, a point where there is no voice information for a user watching a video for learning a foreign language is a point that is unnecessary and a waste of time for learning a foreign language, and a user who wants to quickly navigate the contents of a movie has no voice information, that is, a subtitle information. Missing points become points that hinder quick navigation.

As described above, depending on the purpose and type of viewing of the image, it is necessary to reproduce the image in different ways for the section having the subtitle information and the subtitle information due to the dialogue or voice, and there have been many requests from users.

However, conventional video apparatuses do not provide a function for distinguishing a section having subtitle information and a section without subtitle information so that a user can check whether a subtitle exists or not, and provide a differentiated video playback function according to whether a subtitle exists. There is a problem that can not be.

On the other hand, there is a user request to create a new image by extracting only the image corresponding to the section having subtitle information, but the conventional video device does not provide such an image editing function.

An object of the present invention for solving the above problems is to provide a user with the convenience of viewing the image by distinguishing between the metabolic section and the non-metabolic section according to the presence or absence of the metabolite section and reproducing the image.

In addition, another object of the present invention is to provide a convenient image search function according to the presence or absence of subtitles by distinguishing between the metabolic section and the non-metabolic section according to the presence or absence of the metabolism section.

In addition, another object of the present invention is to distinguish between the metabolic section and the non-metabolic section according to the presence or absence of metabolism, and based on this, by extracting only the image corresponding to the metabolic section or the non-metabolic section, thereby creating a new image according to the presence or absence of a subtitle to the user It is to provide a video editing function.

According to an aspect of the present invention for achieving the above object, an image control apparatus for controlling an image by distinguishing a non-metabolic section, comprising: a section determination unit for determining a metabolic section or a non-metabolic section using caption information; A control unit for acquiring control information on the metabolic section or non-metabolizing section, determining a section, and controlling reproduction of an image; And an image reproducing unit reproducing an image of the metabolic section or the non-metabolizing section according to the obtained control information.

According to another aspect of the present invention for achieving the above object, in the image control method for controlling the image by distinguishing the non-metabolic section, (a) determining the metabolic section or non-metabolic section using the caption information; ; (b) obtaining control information for the metabolic section or the non-metabolizing section; And (c) reproducing an image of the metabolic section or the non-metabolizing section according to the obtained control information.

As described above, according to the present invention, by distinguishing between the metabolic section and the non-metabolic section according to the presence or absence of the metabolism, and based on this, the image is differentiated and reproduced, thereby providing the convenience of viewing the image to the user.

In addition, according to the present invention, by distinguishing the metabolic section and the non-metabolic section according to the presence or absence of the metabolic section, based on this, there is an effect of providing the user with a convenient image search function according to the presence or absence of subtitles.

In addition, according to the present invention, by classifying the metabolic section and the non-metabolic section according to the presence or absence of metabolism, based on this, by extracting only the image corresponding to the metabolic section or non-metabolized section to generate a new image, the image editing function according to the presence or absence of subtitles to the user Has the effect of providing.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are used as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function is apparent to those skilled in the art or may obscure the gist of the present invention, the detailed description thereof will be omitted.

1 is a block diagram of an image control apparatus 100 using caption information according to the present invention.

As shown in FIG. 1, the image control apparatus 100 for distinguishing a non-metabolic section and controlling an image may include a section determination unit 120, a metabolic section, or the like, for determining a metabolic section or a non-metabolic section using caption information. The control unit 110 obtains control information for the non-metabolization section, determines the section and controls the reproduction of the image, and the image reproducing unit 130 for reproducing the image for the metabolic section or the non-metabolization section according to the obtained control information. And the like.

In addition, the image control device 100 for controlling the image by distinguishing the non-metabolic section, the section display unit 140 for displaying the metabolic section or non-metabolized section and extracts the image for the metabolic section or non-metabolized section to generate a new image The video editing unit 150 may be further included. Here, the new image generated by the image editing unit 150 is one image generated by extracting only the image of the metabolic section and combining only the image of the extracted metabolic section, or extracting and extracting only the image of the non-metabolic section. It is an image generated by collecting only images of no metabolic sections.

The above-described image control apparatus 100 according to the present invention is a device for controlling image reproduction using subtitles linked to a video to be reproduced, and the linked subtitles include subtitle information as text information to be reproduced in conjunction with the image. "Subtitle information" is synchronized with the video and displayed on the screen together with the video. There may be a synchronization method using elapsed time and a synchronization method using a frame number as a method of synchronizing video and caption information. That is, the caption information may be information synchronized with the image in the elapsed time or information synchronized with the image in the frame number. In addition, the caption information may be one of various formats including Micro DVD, RealText, SubRip, SAMI, and the like.

In addition, the present invention is defined by dividing the above-described subtitles into "metabolism section" with the subtitle information due to the dialogue or voice, and "no metabolic section" without the dialogue or voice, and even if no dialogue or voice exists If the subtitle information interval between the subtitle information and the next subtitle information is less than or equal to the predetermined interval, the subtitle information interval is regarded as a metabolic section, where a predetermined interval is compared with the subtitle information interval to determine whether it is a metabolic section or a non-diabolic section. It is called the "critical interval". Referring to FIG. 3, which shows, for example, a caption corresponding to an image having an entire playing time, as described above, the caption includes a, b, c, d, e, f, g, h, and i. Metabolism section and metabolism section including A, B, C, D, E, F, G and H can be divided, and the image can be divided into the image corresponding to the metabolic section and the image corresponding to no metabolism section.

In addition, the image control apparatus 100 using the caption information according to the present invention described above, as shown in Figure 2, four image control functions, including the section determination function, image playback function, section display function and image editing function Do this.

Referring to FIG. 2, the four image control functions described above are controlled by the controller 110 included in the image control apparatus 100, and the controller 110 determines the section determination unit 120 according to the type of the image control function. ), The image reproducing unit 130, the section display unit 140, and the image editing unit 150 interwork with one or more to perform an image control function.

Referring to FIG. 2, the controller 110 included in the image control apparatus 100 starts an image control function by receiving control information according to a user or device internal setting value before or during image reproduction. The above-mentioned control information may be information related to a section determination function, an image playback function, an section display function, an image editing function, and the like. Based on this, the controller 110 determines the section determination function, the image playback function, the section display function, and the image editing. Recognizing which function to perform, how to perform the function, etc. and controlling the image in conjunction with at least one of the section determination unit 120, the image playback unit 130, the section display unit 140 and the image editing unit 150 Perform the function. More specifically, the control unit 110 receives control information before or during playback of an image, and corresponds to one of a section determination command, an image playback command, an interval display command, and an image editing command according to the received control information. Section (one of the section determining unit 120, the image reproducing unit 130, the section displaying unit 140 and the image editing unit 150), and the section determining function, the image reproducing function, the section displaying function, Controls to perform an image control function of one of the image editing functions.

Referring to FIG. 2, the section determination function is a function of determining whether a subtitle linked to play an image is a metabolic section in which metabolism or voice information exists or a metabolic section in which no metabolic or voice information exists. The 120 receives a section determination control command from the controller 110 to perform a section determination function on all or part of the subtitles.

Referring to FIG. 2, the image reproducing function is a function of reproducing various types of images corresponding to no metabolic section or metabolic section according to the acquired section determination result according to the execution of the section determination function. For example, the video corresponding to the non-memory section is played by N-speed playback, skipping, or playback by searching, or the audio output is adjusted, and the video corresponding to the metabolism section is played by N-speed playback. It can be played back by skipping, skipping, playing back, or playing back repeatedly. In the above-described image reproduction function, the controller 110 receives the interval determination result from the interval determination unit 120 and transmits the image reproduction control command and the interval determination result to the image reproduction unit 130 by the image reproduction unit 130. Is performed.

The image reproducing function corresponding to the non-diabetic section described above helps the foreign language-learning image to be quickly moved to a metabolic section having a foreign language metabolism by quickly playing or skipping the non-metabolic section for efficient foreign language learning. In addition, meaningless parts without dialogue in the subtitled movie can be quickly played or skipped to move to a meaningful section with dialogue, so that it can be enjoyed.

In addition, the image reproducing function corresponding to the metabolic section may be useful when the user wants to study listening by quickly searching only the place where the foreign language is spoken in the foreign language learning image. In addition, it provides the convenience of watching and watching only the dialogue part in the subtitled movie.

Referring to FIG. 2, the section display function is a function of displaying on the search bar by using the section determination result obtained by performing the section determination function. Through this, the user may check at which point there is no dialogue. The search bar in which no metabolism section is displayed by this section display function is illustrated in FIG. 4. Referring to FIG. 4, the illustrated image is currently being played at the P point, and there are eight non-metabolism sections including a, b, c, d, e, f, g, and h, except for the metabolism section. The above-described section display function is performed by the section display unit 140 by the controller 110 receiving the section determination result from the section determination unit 120 and transmitting the section display control command and the section determination result to the section display unit 140. .

Referring to FIG. 2, the image editing function is a function of generating a new image by using the acquired section determination result according to the execution of the section determination function. More specifically, a new image may be generated by extracting only an image corresponding to a metabolic section based on the result of the section determination, or a new image may be generated by extracting only an image corresponding to a non-metabolic section.

The above-described image editing function can reduce the learning time for the user by extracting and re-editing only the image corresponding to the metabolic section that is substantially helpful for foreign language learning from the foreign language learning image.

In other words, the above-described four image control functions, the control unit 110 receives the control information before or during the playback of the image, according to the control information thus received section determination command, image playback command, section display command and image One of the editing commands is transmitted to the corresponding unit, whereby one of the section determination function, the image reproducing function, the section display function, and the image editing function is performed. Here, an image playback function, a section display function, and an image editing function are performed based on the section determination result according to the section determination.

Hereinafter, the above-described image control function will be described in more detail for each component included in the image control apparatus 100.

The control unit 110 for centrally managing the image control function receives the control information related to the image control from the user or receives the predetermined control information to determine the section, image playback, section display and image editing for the image to be played back. To control. More specifically, the controller 110 starts the image control function by receiving control information according to a user or device internal setting value before or during the image playback. The above-mentioned control information may be information related to a section determination function, an image playback function, an section display function, an image editing function, and the like. Based on this, the controller 110 may determine the section determination function, the image playback function, the section display function, and the image editing function. Recognizing which function to perform, how to perform such as in the image control function in conjunction with one or more of the section determination unit 120, the image playback unit 130, the section display unit 140 and the image editing unit 150 Do this. More specifically, the control unit 110 receives the control information before or during the playback of the image, according to the received control information section determination command, video playback command, section display command and image editing command section determination unit And transmits to the image reproducing unit 130, the section display unit 140, and the image editing unit 150 to perform the image control function including the section determination function, the image reproducing function, the section display function, and the image editing function. .

The above-described section determination unit 120 receives a section determination command from the control unit 110, and if the subtitle information interval for the whole or part of the subtitle exceeds a predetermined threshold interval, the non-speaking section is present and the subtitle information exists or If the caption information interval is less than or equal to the threshold interval, it is determined as the metabolic section and the result of the section determination is provided to the controller 110. The section determination result provided to the control unit 110 is provided back to the image reproducing unit 130, the section display unit 140 and the image editing unit 150 to provide the image playback function, section display function and image editing function in each component. It serves as the information needed to perform.

The caption information used for the section determination by the section determination unit 120 is text information reproduced in association with the image, and is synchronized with the image by the "elapsed time" or the image by the "frame number", Micro DVD, RealText. It may be one of several formats, such as SubRip, AQTitle, and SAMI.

Among these formats, formats such as SubRip and RealText display synchronization information by elapsed time, and formats such as MicroDVD and AQTitle display synchronization information by frame number. For example, the most commonly used SAMI format has a <Sync Start => tag of the SAMI format, in which milliseconds are recorded for displaying caption data on the screen. For example, "<Sync Start = 1000> <P Class = KRCC> Hi." Means to output the subtitle data "Hello" to the screen at 1000ms after playing the video.

In addition, when the caption information is in the SAMI format, the section determination unit 120 may determine the non-verbal section by using a special tag in the SAMI format, and a blank string is displayed on the special tag. There is a & nbsp (non-breaking space entity) to do this. In other words, if there is tag & nbsp in SAMI format, it is determined as non-verbal section.

The above-described image reproducing unit 130 receives an image reproducing command from the control unit 110 and reproduces an image corresponding to the metabolic section or no metabolic section by using the section determination result by the section determining unit 120.

If the image reproducing unit 130 plays an image corresponding to the non-metabolizing section, the image is reproduced by N (N≥1) speed, skipped, played by searching, or played. Or you can adjust the audio output, such as reducing or turning off the audio output.

Referring to the reproduction of the image corresponding to the aforementioned non-metabolous section using the example shown in FIG. 3, when the metabolic section A is met while the non-metabolized section b is met, the image corresponding to the non-metabolized section b is normal speed (N = You can play faster than 1), skip and play from the next dialogue section, dialogue section B, or you can turn off the audio output in the dialogue section b. However, the image reproduction may be performed in the same manner for all non-metabolization sections, or the image reproduction may be performed in different ways for each non-metabolization section.

If the image reproducing unit 130 reproduces an image corresponding to the metabolic section, the N (N≥1) double speed playback, the skip playback, the seek playback, or the repeated playback Can be.

Referring to the reproduction of the image corresponding to the above-described metabolic section using the example shown in FIG. 3, when the metabolic section B is met, the image corresponding to the metabolic section B can be played faster than normal speed (N = 1) and skipped. It can also jump to another metabolic section or other non-metabolism section, or search for an image corresponding to another metabolic section or another non-metabolic section and play back the searched image. Metabolic section B can also be repeated. However, the image may be reproduced in the same manner for all the metabolic sections, or the image may be reproduced in a different manner for each metabolic section.

In addition, an image reproducing function corresponding to the metabolic section provided by the image reproducing unit 130 may be useful when a user wants to quickly search and reproduce only the place where the dialogue is spoken in English in the image for learning English. In addition, it provides the convenience of watching and watching only the dialogue part in the subtitled movie.

The above-described section display unit 140 receives a section display command from the controller 110 and displays a metabolic section or a non-metabol section on the seek bar using the section determination result by the section determining unit 120. .

4, the search bar displaying the non-metabolization section and the metabolic section by the section display unit 140 may be confirmed. In the search bar in the exemplary embodiment of FIG. 4, eight non-metabolous sections including a, b, c, d, e, f, g, and h are displayed in several places, and the remaining portions are metabolic sections.

The image reproducing unit 130 described above may move to a specific point by using the result displayed on the seek bar of the section display unit 140 to play the image or search for the image while moving to the specific point. At this time, the image reproducing unit 130 and the control unit 110 interlock with each other to reproduce and search for the image.

According to the image control apparatus 100 using the caption information according to the present invention described above, it is possible to determine by distinguishing whether there is a metabolic section with no metabolism or no metabolic section without metabolism. It is effective to provide convenience of viewing.

In addition, according to the image control apparatus 100 using the caption information according to the present invention described above, by distinguishing and displaying the metabolic section and non-diabolic section, there is an effect of providing the user with the image search according to the presence or absence of the subtitle.

In addition, according to the image control apparatus 100 using the caption information according to the present invention, it is possible to determine whether the metabolic section with metabolism or no metabolism section without metabolism to correspond to the metabolic section or metabolic section. Since only the image can be extracted, there is an effect of providing the user with image editing depending on the presence or absence of subtitles.

5 is a flowchart illustrating an image control method using caption information according to the present invention.

As shown in FIG. 5, in the image control method of controlling an image by distinguishing a non-metabolic section, a section determination step of determining a metabolic section or a non-metabolic section using subtitle information (S500), a metabolic section or a non-metabol section A control information acquisition step (S502) of acquiring control information for the step and an image reproduction step (S504) of reproducing an image for the metabolic section or the non-metabolic section according to the control information obtained in step S502.

In addition, the image control method for controlling an image by distinguishing the non-metabolic section may further include a section displaying step of displaying a metabolic section or a non-metabolizing section, and the aforementioned section displaying step searches for a metabolic section or a non-metabolizing section. You can play the video by displaying it in the bar but moving to another or other non-metabolism section through the search bar.

Referring to the above-described section determination step (S500) with reference to Figure 6, step determination step (S500), the step of setting the threshold interval (S5000), comparing the subtitle information interval and the critical interval for all or part of the subtitle And a step S5002 and determining that the subtitle information interval exceeds the predetermined threshold interval and determining the non-diabolism section, and when the subtitle information exists or the subtitle information interval is less than or equal to the threshold interval (S5004).

In the above-described image reproduction step (S504), the image corresponding to the non-metabolic section or the metabolic section can be played back at N times, skipped, played back by searching, or the audio output is adjusted. , Or can be played repeatedly.

After the above-described section determination step (S500), the image control method using the caption information according to the present invention extracts an image for the metabolic section or no metabolic section based on the section determination result in the section determination step (S500) to a new image The method may further include generating an image editing step. Here, the new image generated in the image editing step is one image generated by extracting only the image of the metabolic section and collecting only the image of the extracted metabolic section, or extracting only the image of the metabolic section and extracting the non-metabolizing section. One image generated by collecting only an image of a section.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

1 is a block diagram of an image control apparatus using subtitle information according to the present invention;

2 is a view showing an image control function provided by an image control apparatus using subtitle information according to the present invention;

3 is a diagram illustrating an image and a caption for explaining an image control function provided by an image control apparatus using caption information according to the present invention;

4 is a view showing a search bar in which a metabolic section is displayed by an image control apparatus using subtitle information according to the present invention;

5 is a flowchart illustrating an image control method using caption information according to the present invention;

6 is a flowchart illustrating a step determination step in the image control method using the caption information according to the present invention.

<Description of Symbols for Main Parts of Drawings>

100: video control device

110: control unit

120: section determination unit

130: video playback unit

140: the section display unit

150: video editing unit

Claims (17)

An image control apparatus for controlling an image by discriminating no metabolism intervals, A control unit for acquiring control information and controlling one of section determination, image playback, section display, and image editing according to the obtained control information; A section determination unit which interlocks with the control unit and determines a metabolic section or a non-metabolic section using caption information; An image reproducing unit interworking with the control unit to reproduce an image of the metabolic section or the non-metabolizing section determined by the section determining unit; A section display unit which displays the metabolic section or the non-metabolic section determined by the section determining unit in a search bar in association with the controller; And An image editing unit which extracts an image for the metabolic section or the non-metabolizing section determined by the section determining unit and collects the extracted image in association with the controller; Image control apparatus comprising a. delete The method of claim 1, The control unit, The control information is input before or during the playback of the video, and one of the section determination command, the image playback command, the section display command and the image editing command is transmitted according to the received control information. , So that one of the section display and the image editing is performed, And controlling the playback of the image, the display of the section, and the editing of the image based on the result of the determination of the section according to the determined section. The method of claim 1, The section determination unit, Receiving a section determination command from the controller, if the subtitle information interval for all or part of the subtitle exceeds a predetermined threshold interval, and determines that the non-verbal section and if the subtitle information is present or the subtitle information interval is less than the threshold interval; And determining the metabolic section to provide the section determination result to the controller. The method of claim 1, The video playback unit, And receiving an image playback command from the control unit and reproducing an image corresponding to the metabolic section or the non-metabolizing section by using the section determination result by the section determining section. The method of claim 1, The video playback unit, And play the image corresponding to the non-verbose section N times, play the skip, play the seek, or adjust the audio output. The method of claim 1, The video playback unit, And an image corresponding to the metabolic section is reproduced N times, skipped, played back, or repeatedly played. The method of claim 1, The section display unit, And receiving a section display command from the controller, and displaying the metabolic section or the non-metabolic section on the search bar by using a section determination result by the section determining section. The method of claim 8, The video playback unit, And control the image to move to a specific point by using the result displayed in the seek bar. The method of claim 1, The caption information is text information played in conjunction with the video, and is synchronized with the video by elapsed time or by the video by frame number, and has an image format of one of Micro DVD, RealText, SubRip, and SAMI. controller. The method of claim 10, If the subtitle information is the SAMI format, And the section determining unit determines the non-talk period using a special tag in the SAMI format. In the image control method for controlling the image by distinguishing no metabolism section, (a) a step determination step of determining a metabolic section or a non-metabolic section using caption information; (b) obtaining control information for acquiring control information for the metabolic section or the non-metabolic section; (c) an image reproducing step of reproducing an image for the metabolic section or the non-metabolizing section determined in the step (a) according to the obtained control information; (d) an interval display step of displaying, in the search bar, the metabolic section or the non-metabolic section determined in the step (a) according to the obtained control information; And (e) an image editing step of extracting an image of the metabolic section or the non-metabolizing section determined in the step (a) according to the obtained control information and collecting the extracted image; Including but not limited to: And the acquired control information is acquired before or during video playback, and indicates one of a section determination command, a video playback command, a section display command, and an image editing command. The method of claim 12, Step (a) is, (a1) setting a threshold interval; (a2) comparing the subtitle information interval with the threshold interval for all or part of the subtitle; And (a3) if the subtitle information interval exceeds a predetermined threshold interval, determine a non-diabolism section, and if the subtitle information exists or the subtitle information interval is less than or equal to the threshold interval, determining a metabolic section. Image control method comprising a. delete The method of claim 12, Step (b) is, An image, characterized in that for reproducing an image by moving to another metabolic section of the plurality of metabolic sections or another non-metabolized section of the plurality of metabolic sections through the search bar displaying a plurality of metabolic sections or a plurality of non-metabolic sections. Control method. The method of claim 12, Step (c) is, The video corresponding to the non-diabolic section or the metabolic section is played at N times, skipped to play, searched to play, adjusted to an audio output, or repeatedly played. The video control method. delete

Images