KR20110132066A - Apparatus and mehtod for searching a inage in a image dispaly device - Google Patents

Abstract

PURPOSE: A video searching apparatus of a video display apparatus and method thereof are provided to enable a user to change a display screen into the desired display screen by sensing the change of information. CONSTITUTION: A video display apparatus receives a video signal(205). The control unit of the video display apparatus compartmentalizes captions and the video(210). The control unit divides the caption and the video. The control unit compares the caption by a frame. The control unit determines the image change timing the caption(215). The control unit stores information about the change of the caption in a storage unit(220).

Description

Apparatus and mehtod for searching a inage in a image dispaly device}

The present invention relates to an image display device, and more particularly, to an apparatus and method for retrieving an image through subtitles in an image display device.

BACKGROUND With the development of video technology, video and audio signals are recorded and recorded in a video display device, and they are often re-provided by the user. In this case, in order to select a scene desired by the user from the stored video signal or the audio signal, it is inconvenient to check the scene output to the display means by using the rewind or fast forward function.

Therefore, in order to solve this inconvenience, a function for detecting and viewing a desired scene of a specific image is provided.

However, this function is a way to provide a 'highlight function' that provides a scene desired by the user, and extracts a highlight scene by detecting a change scene through analysis of a video stream within a video signal screen and calculating weighting importance through volume analysis. This is how you do it.

This is a disadvantage that the algorithm for generating highlights, such as the video scene comparator or determiner, and the audio signal measurer and highlight generator for analyzing the video stream, is very complex. If there is any change in image noise or volume, There may be a problem that the viewer does not properly implement the desired highlight.

Therefore, there is a disadvantage in that the user's inconvenience and time consumption is too much for the user to accurately and easily search for the location of the desired image or subtitle.

It is an object of the present invention to provide a display apparatus and method for easily searching for a desired playback time point using subtitles in a program that a user is watching.

Another object of the present invention is to provide a display apparatus and a method for determining whether a subtitle is changed to facilitate image search.

The present invention for achieving the above object is a step of inputting a caption selection signal from the input unit; Identifying an image corresponding to the selected subtitle according to the selection signal; Determining whether the pointer of the selected subtitle reaches the beginning or the end of the subtitle; And converting and displaying an image in a direction in which a pointer for selecting a subtitle is moved when the subtitle selection pointer reaches the beginning or the end of the subtitle as a result of the determination.

In addition, the present invention comprises the steps of selecting a subtitle search menu; Receiving a search word through an input unit; Searching for the input character in a subtitle including the search word and an index in which location information of the subtitle is stored; Displaying the searched subtitles and images corresponding thereto; Receiving at least one of the displayed search results; And reproducing an image and a subtitle corresponding to the selected search result.

In another aspect, the present invention provides an input unit for receiving a control signal or a search word for subtitle search; A control unit for selecting a subtitle according to a control signal input from the input unit, and searching for a subtitle including the input search word; A storage unit which stores caption data according to a control signal or a search word input from the input unit and an image corresponding thereto; And a display unit configured to read and display a subtitle stored in the storage unit and an image corresponding thereto according to a control signal of the controller.

As described above, the present invention has an effect of enabling the user to easily search for the desired screen by switching the screen by detecting the change of the caption information in the screen of the video signal.

In addition, the present invention has the effect of making it easy to search for a desired image by searching for a word included in the subtitle.

1 is a block diagram for scene search according to an embodiment of the present invention.
2 is a flowchart illustrating a process of performing an image search according to an embodiment of the present invention.
3 is a flowchart illustrating a process for searching for an image according to an embodiment of the present invention.
4 is an exemplary view of a screen displayed during a process for searching for an image according to an embodiment of the present invention.
5 is a flowchart illustrating a process for searching for an image according to another exemplary embodiment of the present invention.
6 is an exemplary view displayed during a process for searching for an image according to another embodiment of the present invention.

Hereinafter, an image searching method and apparatus according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a part of a display apparatus for searching a scene according to an exemplary embodiment of the present invention.

Referring to FIG. 1, a configuration for searching in a display apparatus according to an exemplary embodiment of the present invention is a display apparatus having an input unit 110, a display 130, a storage unit 140, and a controller 120. The controller 120 extracts at least one scene to be reproduced together with at least one text subtitle from the AV data 141 by referring to time information included in the text subtitle information 142 of the AV data 141. 121 and a search unit 122 that performs a user command such as a search command by using a correspondence between the at least one text subtitle and at least one scene extracted corresponding thereto when the command is input through the input unit 110. do. In addition, the controller 120 may include a playback unit 123 for playing back scenes or scenes requested by a user according to the search result.

The information 143 about the scenes extracted according to the AV data 141, the text subtitle information 142, and the text subtitle information 142 is stored in the storage 140, and the text subtitle information 142 is used for each text. Includes caption time information and caption information, and the scene information 143 may include information on a corresponding text caption, information on a location of an AV stream constituting a scene, or information on a representative video of a scene.

2 is a flowchart illustrating a process of performing an image search according to an embodiment of the present invention.

Referring to FIG. 2, the video display device receives a video signal including subtitles for each frame (step 205). The controller of the video display device distinguishes between a caption and an image using position information on the screen of the caption. ) The caption may include letters or numbers, and the position information on the screen of the caption may be a value stored as a default value, a value selected by a user, or a value included in a video signal and transmitted.

The caption is separated from the video, and the caption image is changed by comparing the caption by frame. That is, the time information regarding the change point of the caption according to the change of the image when the caption and the image are displayed in correspondence with the caption is checked.

According to the check result, information on the display time of the image and the display time of the subtitles and information on the change time of the subtitles according to the image are stored (step 220).

3 is a flowchart illustrating a process for searching for an image according to an embodiment of the present invention, and FIG. 4 is a diagram illustrating a screen displayed during the process for searching for an image according to an embodiment of the present invention.

An operation for searching for an image according to an embodiment of the present invention in a state in which the information about the caption and the image in FIG. 2 is stored will be described in detail with reference to FIGS. 3 to 4.

3 to 4, the image display apparatus performs an image reproduction mode for outputting an image and audio including subtitles stored in advance or received from the outside (step 305).

In operation 310, the input unit 110 confirms an input of a signal for selecting a subtitle included in the image from the input unit 110 and selects a corresponding subtitle (step 315).

The caption selection signal and the caption selection operation according to the above-described operation may be performed by a remote controller (not shown) or various inputs from the user while the caption is displayed on one side of the screen on which an image is displayed, as shown in FIG. The device receives a signal for operating in a selection mode for selecting the displayed subtitles. When the subtitle selection mode is operated, a cursor for subtitle selection is displayed at a predetermined position of the subtitle (first or end of the subtitle).

Accordingly, while operating in the caption selection mode, the caption selection signal received from the input unit is detected to select the caption. The subtitle selection operation according to an embodiment of the present invention may be selected through a drag and drop operation from the beginning or the end of the subtitle to be selected through the input unit 110 to the left / right or up / down side. . In an embodiment of the present invention, a subtitle is selected by dragging and dropping a left position from a predetermined position of a sentence of a subtitle.

Therefore, as shown in the screen example of FIG. 4, when the subtitle is selected when the user selects the subtitle through the input unit 110 in operation, a block 401 indicating that the subtitle is selected is designated.

The controller 120 determines whether the cursor for selecting a subtitle or the range of the selected subtitle reaches the beginning or the end of the subtitle while performing the subtitle selection operation through the input unit 110 (step 320), that is, the screen of FIG. 4. As shown in the example (a), it is determined whether the selected subtitle reaches the beginning of the sentence while selecting the first subtitle in the second column.

If it is determined that the caption selection reaches the beginning or the end of the sentence, the caption is selected and the image is switched in the dragging direction, and the caption corresponding to the converted image is continuously displayed (step 325).

For example, if it is determined that the cursor for caption selection reaches the beginning of the sentence as shown in (a) of FIG. 4, the image is switched to the previously displayed screen as shown in FIG. The subtitle corresponding to the displayed image is displayed.

At this time, if the end signal for the caption selection is not input, as shown in the screen example (b), the selection of the switched image and the corresponding caption is continuously performed.

During the operation according to the subtitle selection, the controller detects whether a signal for completing the subtitle selection is input (step 330). When a subtitle completion signal is detected, the video and subtitles for the selected subtitle section are repeatedly played or the corresponding subtitle is selected. The playback operation is performed again. (Step 335)

As described above, when the corresponding subtitle is selected for the image including the subtitle, the image corresponding to the subtitle is continuously switched and displayed according to the selected subtitle.

In addition, the selected subtitle may be repeatedly played a predetermined number of subtitles and images for a corresponding section, or can be replayed from the point of view including the corresponding section.

5 is a flowchart illustrating a process for searching for an image according to another embodiment of the present invention, and FIG. 6 is an exemplary view displayed when the process for searching for an image according to another embodiment of the present invention.

5 to 6, when the image display device receives an execution control signal for a subtitle search menu for searching for a subtitle included in an image such as a specific recording through the input unit 110 in the image output mode, FIG. 6. The subtitle search mode is performed as shown in the screen example of step S505.

When the subtitle search mode is executed, as shown in FIG. 6, a screen 600 for inputting a subtitle search word and outputting the result is displayed. The screen 600 includes an input window 608 for inputting a search word for subtitle search from a user. Accordingly, when a word to be searched is input to the input window 608 and a search is requested, the controller 120 searches for the caption information 142 of the storage 140 through the searcher 122 (step 515). The scene information 143 of the storage unit 140 is searched and extracted (step 520) and the corresponding result is output as shown in the screen example of FIG. 6 (step 525).

More specifically, when a word to be searched for in a subtitle is input and searched in the input window 608, a search result for displaying a representative thumbnail of an image or a section including the word and a part of the corresponding subtitle is displayed. . According to the search result, information about a corresponding scene and a playback section may be displayed, and information about a playback section including a corresponding word may be displayed in a progress bar form 604.

As shown in FIG. 6, when information about a subtitle including the corresponding search word is displayed according to a search word input from the user, any one of the displayed subtitle information is selected (602), or a progress bar including the corresponding information ( If one section 606 is selected in step 604 (step 530), the video and subtitles of the corresponding section are played back (step 535). The images may be sequentially displayed.

As described above, in another embodiment of the present invention, when a user inputs a search word included in a desired subtitle, a list including the subtitle including the search word and a representative image corresponding to the subtitle is displayed, and among the displayed list. Select one to play the video and subtitles from the selected playback time.

110: input unit
120: control unit
121: Scene extraction unit 122: Search unit
123: playback unit
130: display unit
140:
141: AV data 142: text subtitle information
143: Scene Information

Claims (13)

Inputting a caption selection signal from an input unit;
Identifying an image corresponding to the selected subtitle according to the selection signal;
Determining whether the pointer of the selected subtitle reaches the beginning or the end of the subtitle;
And converting and displaying an image in a direction in which a pointer for selecting a subtitle is moved when the subtitle selection pointer reaches the beginning or the end of the subtitle as a result of the determination. The method of claim 1, wherein the selection of the subtitles comprises selecting the subtitles through a drag and drop operation by using a cursor to select the subtitles. The image searching method of claim 2, wherein the screen is displayed as a screen before or after the currently played screen according to a direction in which the drag and drop operation is performed when the caption is selected. The method of claim 1, wherein the selected subtitle section is repeatedly played a predetermined number of times. Selecting a subtitle search menu;
Receiving a search word through an input unit;
Searching for the input character in a subtitle including the search word and an index in which location information of the subtitle is stored;
Displaying the searched subtitles and images corresponding thereto;
Receiving at least one of the displayed search results;
And reproducing an image and a subtitle corresponding to the selected search result. The method of claim 5, wherein the search result is a thumbnail of an image corresponding to a playback time corresponding to a subtitle including a search word. The method of claim 5, wherein the video and the subtitle corresponding to the selected search result are repeatedly played a predetermined number of times. The method of claim 5, wherein the search result is a plurality of search results, and when a plurality of search results are selected and a reproduction request signal is received, images and subtitles corresponding to the selected search results are sequentially displayed. . An input unit for receiving a control signal or a search word for searching for a subtitle;
A control unit for selecting a subtitle according to a control signal input from the input unit, and searching for a subtitle including the input search word;
A storage unit which stores caption data according to a control signal or a search word input from the input unit and an image corresponding thereto;
And a display unit configured to read and display subtitles stored in the storage unit and images corresponding thereto according to a control signal of the controller. The method of claim 9, wherein the control unit
A search unit for searching for a caption including a caption selection signal or a search word input from an input unit;
A scene extracting unit which extracts an image corresponding to a caption based on a result of the searching unit;
And a playback unit configured to control playback of the extracted image and the searched subtitles. The method of claim 9, wherein the control unit
And extracting caption information including a search word input through an input unit and displaying a search result including a thumbnail of an image corresponding to the extracted caption. The method of claim 9, wherein the control unit
And selecting a subtitle when the position of the pointer for selecting the subtitle reaches the beginning or the end of the subtitle, determines the direction in which the subtitle selection proceeds, and switches and displays the played image. The method of claim 12, wherein the control unit
And when the caption is displayed, when the caption corresponding to the switched image is displayed, controls to display the caption including the previously selected caption.

Images