KR20100022396A - Device for playing multimedia file and method for controlling object of caption - Google Patents

Abstract

PURPOSE: A multimedia file play device and a subtitle object control method using the same are provided to structuralize a subtitle display section in which a subtitle object is displayed in order to decide or detect a subtitle object activation section, thereby easily detecting the subtitle object activation section of various kinds of subtitle files. CONSTITUTION: A multimedia file play device includes a subtitle display unit(110) and a subtitle object activation unit(120). The subtitle display unit displays one or more subtitle objects comprising an entire subtitle file on a subtitle display section in which the subtitle file is displayed. The subtitle object activation unit performs preset operations to displayed subtitle objects when a pointing device cursor is located on a subtitle object activation section.

Description

Device for playing multimedia file and method for controlling object of caption

The present invention relates to a multimedia file reproducing apparatus and a caption object control method using the same. More specifically, the present invention relates to a multimedia file reproducing apparatus for reproducing a video file and a subtitle file corresponding thereto and a subtitle object control method using the same.

In recent years, the development of computer technology and the mass production of computers have made the use of personal computers popular. BACKGROUND Many software programs that can be used in personal computers are being developed, and multimedia file reproducing apparatuses for listening to or viewing various multimedia files such as music files, TVs, and videos are increasing.

In general, if a subtitle file with the same name as the video file name exists, the multimedia file playing device imports the subtitle file and plays it when the video file is played, or when the user specifies a specific subtitle file and plays it with the video file. Most of this is. The subtitle file is produced by inputting the translated content in accordance with the sound to be played and editing the timing.

The subtitle files and video files produced in this way are inputted in the multimedia file playback device with the video and subtitles separated, and the video layer and the caption layer are overlaid. Is output. By the way, such a multimedia file reproducing apparatus is faithful only to the original function of file reproducing for image viewing.

Of course, Korean Patent Laid-Open Publication No. 2002-0005174 (name of the invention: information providing method and apparatus using a video) for providing information using an object included in the video when transmitting a video on an interactive digital TV or an Internet broadcast is disclosed. It is.

However, such a technique is not related to a multimedia playback device but also provides information using a video object rather than a caption. However, pointing to a specific object on the video screen is not only easy, and in the current situation where the video screen is easy to change, it is very difficult to point to the video object according to the change in the size of the video screen. In addition, since the amount of calculation for pointing to the video object is also inconvenient, the time required to find the video object clicked by the actual user is considerable, which makes the user uncomfortable. Therefore, information retrieval using video is low in effectiveness and there are few examples of applying such technology on multimedia playback devices.

On the other hand, while the development of providing various services has been made in accordance with the increasing demand of the multimedia playback device, the user does not provide any service for acquiring information on the subtitle file.

In order to obtain desired information about the subtitle file, for example, a separate dictionary application must be executed in order to find the meaning of a word included in the subtitle when the language video is played. Or you need to go to a site that offers direct search and request information.

In addition, it is difficult to provide additional information on the basis of the subtitle file because the underlying technology has not been established even though it is trying to provide the information on the subtitle file until now.

An object of the present invention is to provide a multimedia file reproducing apparatus for activating subtitle objects displayed at a point where a cursor of a pointing device controlled by a user is located on an entire image reproducing screen, and a method for controlling a subtitle object using the same.

Another object of the present invention is to provide a multimedia file reproducing apparatus for providing additional information on activated subtitle objects and a method for controlling a subtitle object using the same.

In order to achieve the above object, the multimedia file playback apparatus according to the characteristics of the present invention,

A multimedia file playing apparatus for playing a video file and a caption file corresponding to the video file together, wherein the entire caption file is configured in a caption display section in which the caption file is displayed among the video screen and the entire screen in which the caption file is displayed. A subtitle display unit for displaying one or more subtitle objects, wherein the subtitle objects include letters, numbers, or symbols constituting a sentence; And position information of each of a plurality of subtitle object activation sections including the one or more subtitle objects, and when the cursor of a pointing device is positioned in the subtitle object activation section, for the subtitle objects displayed in the subtitle object activation section. It includes a subtitle object activation unit for executing a predetermined operation.

In addition, the caption object control method according to an aspect of the present invention,

A method of controlling a caption object constituting the caption file by a multimedia file playback apparatus that plays back a video file and a caption file corresponding to the video file, the method comprising: (a) a full screen on which the video file and the caption file are displayed; Expressing at least one subtitle object constituting the entire subtitle file in the subtitle display section in which the subtitle file is expressed, wherein the subtitle object includes letters, numbers, or symbols constituting a sentence; (b) whether the cursor of the pointing device is in a predefined subtitle object activation section of the subtitle presentation section, wherein the subtitle object activation section is composed of one or more subtitle objects displayed in the subtitle presentation section and is present in plurality. Determining; And (c) if it is determined that the cursor of the pointing device is positioned in the caption object activation section, executing a preset operation on the caption objects displayed in the caption object activation section.

According to the present invention, it is possible to easily detect a subtitle object activation section even in a conventional subtitle file by determining and detecting a subtitle object activation section by structuring a subtitle display section in which a subtitle object is displayed. In addition, the activation period of the caption object can be effectively detected with a much smaller calculation amount than the conventional video object search method.

In addition, it is possible to further enhance the user's convenience by implementing the highlight display so that the user can recognize the subtitle objects displayed in the subtitle object activation section.

In addition, the subtitle can provide not only the original screen description function but also various additional information, thereby enhancing the user's satisfaction.

In addition, there is an effect that can provide the desired additional information in real time only by clicking the subtitle object on the multimedia file playback screen of the information requester.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise. In addition, terms such as "... unit" described in the specification means a unit for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software.

Now, a multimedia file playing apparatus and a caption object control method using the same according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

First, the apparatus for reproducing a multimedia file according to an embodiment of the present invention is divided into a configuration of a first embodiment for controlling a subtitle object and a configuration of a second embodiment for providing additional information, that is, an interactive operation. Therefore, FIG. 1 and FIG. 8 will be described separately for each embodiment.

Here, the multimedia file playback apparatus refers to a device capable of playing a video file and a subtitle file corresponding to the video file in various formats, such as a moving picture expert group (MPEG), an audio video interleave (AVI), and an active streaming format (ASF). . The multimedia file reproducing apparatus is defined as a terminal apparatus on which an application for reproducing a multimedia file is mounted. The terminal device may correspond to a computer, a personal digital assistant (PDA), a mobile phone, or the like.

1 is a block diagram showing the configuration of a multimedia file playing apparatus according to a first embodiment of the present invention. That is, the configuration of the multimedia file reproducing apparatus for activating subtitle objects displayed in a specific section of the subtitle file is illustrated.

As shown in FIG. 1, the apparatus 100 for playing multimedia files includes a caption display unit 110, a caption object activation unit 120, a storage unit 130, a pointing device recognition unit 140, and a controller 150. .

The subtitle display unit 110 expresses one or more subtitle objects constituting the entire subtitle file in the subtitle display section in which the subtitle file is displayed among the full screen on which the video file and the subtitle file are displayed. Here, the caption object includes letters, symbols, or numbers constituting the sentence.

If the cursor of the pointing device is positioned in a plurality of subtitle object activation sections each composed of one or more subtitle objects, the subtitle object activation unit 120 executes a preset operation on the subtitle objects displayed in the corresponding subtitle object activation section. do. Here, the pointing device is an input device used to control the movement of the cursor on the display screen. Examples of the most representative pointing device include a mouse, and others include a remote controller, a track ball, an optical pen, and a joystick. In addition, the cursor (cursor) means a location indicating a moving position or position.

The configuration of the caption object activator 120 is a configuration that is different from that of the caption object in which the caption object has not performed any function other than the function of simply describing the video screen.

The storage unit 130 stores information for controlling the caption object by the multimedia file reproducing apparatus 100, and includes a caption object display information storage area 132 and a caption object activation period information storage area 134.

The caption object display information storage area 132 stores full screen size information, caption display section information, and position information of the caption display section. In this case, the caption display section will be described with reference to FIGS. 2 and 3.

2 and 3 are diagrams for explaining a caption display section according to an embodiment of the present invention.

First, the full screen size information is composed of a plurality of pixels 201 in which two or more pixels 201 are arranged at regular intervals and given respective coordinate values (x, y), as shown in FIG. . In this case, when the size of the full screen 200 is changed, the interval of the pixels 201 is narrowed or widened, and the number of pixels 201 constituting the full screen 200 is changed, but is assigned to each pixel 201. Coordinate values (x, y) do not change.

In addition, the caption display section information includes one or more square cells 205 and 207 formed by connecting one or more pixels 201 in the horizontal and vertical directions among the pixels 201 constituting the entire screen 200. In this case, the square cells 205 and 207 have position information in the form of pixel coordinate values x ₆₂ and y ₂₆ .

Here, the subtitle display section is selected using a known fact that the subtitle is limited to a specific area and displayed through experiments and experiences, and the like.

In addition, the position information of the caption display section 203 includes position information of each of a start point and an end point of the caption display section 203. At this time, the position information of the caption display section 203 is composed of the position information of the square cells 205 and 2007 in the form of pixel coordinate values (x, y). The positional information (x ₆₂ , y ₂₆ ) of the 205 and the positional information (x ₇₁₀ , y ₁₀₇ ) of the square cell 207 located at the end point of the subtitle display section 203.

The caption display unit 110 refers to the caption objects (red, red) in the caption display section 203 with reference to the full screen size information, the caption display section information, and the position information of the caption display section stored in the caption object display information storage area 132. Remember, hope is good.) That is, one caption object is expressed in one square cell 205 or 207. One or more subtitle objects (red) are included in a plurality of square cells starting from the square cell 205 positioned at the start point of the subtitle display section 203 and the square cell 207 positioned at the end point of the subtitle display section 203. , Remember, hope is good.)

In this case, the caption display section 203 may exist in a plurality of forms according to the display mode of the caption. That is, a mode in which subtitles are displayed together on a screen on which a video is displayed, a mode in which subtitles are displayed separately from a screen on which a video is displayed, and a mode in which subtitles are displayed in left, right, up, and down of the video, respectively. Here, since the mode is a technology already implemented in the conventional multimedia file reproducing apparatus, a detailed description thereof will be omitted.

Therefore, the position information of the caption display section 203 includes different position information according to the display mode of the caption.

2 illustrates an example of a mode in which subtitles are displayed on a video screen, and FIG. 3 illustrates an example of a mode in which subtitles are displayed separately from a video screen.

2 and 3 are the same in the form of the caption display section 203, but the position information of the caption display section 203, that is, the position information of the square cell 205 located at the start point and the square cell 207 located at the end point. Location information is different. As shown in FIG. 2, the position information of the caption display section 203 includes position information (x ₆₂ , y ₂₆ ) of the square cell 205 located at the start point and position information (of the square cell 207 located at the end point). x ₇₁₀ , y ₁₀₇ ). On the other hand, the position information of the caption display section 203 shown in FIG. 3 is the position information (x ₁₀₂ , y ₂₁₀ ) of the square cell 205 located at the start point and the position information (x) of the square cell 207 located at the end point. ₁₁₁₂ , y ₁₂₁₁ ).

The caption display unit 110 displays caption objects by referring to position information of each caption display section 203 according to a mode in which captions are displayed.

In addition, the position information of the caption display section 203 may be dynamically changed information. That is, the starting point and the ending point of the caption display section 203 calculated by applying the ratio information of the caption display section 203 to the size information of the full screen 200 and the size information of the caption display section 203 according to the change in the font size. The position information of each of the square cells 205 and 207 located at is stored.

The caption display unit 110 dynamically displays captions based on the position information of the square cells 205 and 207 calculated by applying the ratio information of the caption display section 203 and the size information of the caption display section 203. The section 203 is recognized and the corresponding caption objects are displayed.

Meanwhile, the caption object activation section information storage area 134 stores index information and position information of the caption object activation section.

Here, the index information includes information obtained by indexing each of the caption objects output first among the caption objects output corresponding to the video screen for each video screen. That is, an index number is assigned to each subtitle object output corresponding to each frame of the video screen.

In this case, the caption object activation section 209 will be described with reference to FIG. 4. 4 is a diagram illustrating a caption object activation section according to an embodiment of the present invention.

As shown in FIG. 4, the caption objects included in the caption object activation section 209 are grouped into predefined meaningful units among caption objects constituting the entire caption file to form a group. In this case, the caption object activation section 209 may be a plurality of different caption objects, and the caption object activation section 209 is stored in association with index information. The location information of the caption object activation section 209 is composed of the location information of the square cell 211 in the caption object activation section 209. That is, it is composed of the position information of the square cell 211 located at the start point of the caption object activation section 209 and the position information of the square cell 213 located at the end point of the caption object activation section 209.

The caption object activation unit 120 is positioned at any one of one or more square cells included in the caption object activation section 209, ie, three square cells 211, 213, and 215 shown in FIG. 4. In this case, a predetermined operation is performed on all subtitle objects (desired) displayed in three square cells 211, 213, and 215 included in the subtitle object activation section 209.

In this case, the position information of the caption object activation section 209 corresponds to the index number. Accordingly, the caption object activation unit 120 checks the index number corresponding to the frame of the current video screen, and the cursor of the pointing device is moved based on the position information of the caption object activation section 209 mapped to the identified index number. Check whether it is located in the activation section 209 and the caption objects to be activated.

The information stored in the caption object display information storage area 132 and the caption object activation interval information storage area 134 of the storage 130 described above may be implemented in the form of a specific code.

1 again, the pointing device recognizing unit 140 determines whether the cursor of the pointing device is located in the caption object activation section (209 of FIG. 4). When it is determined that the cursor of the pointing device is located in the caption object activation section 209, the determination result is transmitted to the caption object activation unit 120.

The controller 150 controls operations of the caption display unit 110, the caption object activation unit 120, the storage unit 130, the pointing device recognition unit 140, and the control unit 150, and various information between these components. To control the flow.

In addition, the caption display unit 110, the caption object activation unit 120, the storage unit 130, and the pointing device recognition unit 140 may be implemented as a function or module of a code, or as a standalone application. May be any combination of the two.

As such, the display area (ie, the caption display section) of the caption objects is structured to determine and detect the caption object activation section. Therefore, even if the existing subtitle file of any format, it is possible to easily detect the subtitle object activation interval. Subtitle objects can be effectively detected with much less computational amount than the conventional video detection method.

Next, a description will be given of a multimedia file reproduction apparatus for implementing an interactive operation for providing additional information on subtitle objects by using a technique of highlighting subtitle objects constituting the subtitle file described above.

5 is a diagram illustrating a network configuration for providing additional information by a multimedia file reproducing apparatus according to a second embodiment of the present invention.

As shown in FIG. 5, the multimedia file reproducing apparatus 100 is connected to an external server 400 through a communication network 300.

Here, the communication network 300 may include an Internet network and a wireless network including an X Digital Subscriber Line (XDSL), a LAN, a cable line, and the like.

The external server 400 plays a role of relaying the additional information on the subtitle object to the users directly through the multimedia file reproducing apparatus 100. That is, the server manages various pieces of content information that is the basis of additional information about the caption object.

The external server 400 may be a service server already built on the Internet, such as a portal site server. Alternatively, the server may be a separately constructed server for providing additional information about the subtitle object.

In addition, the external server 400 provides an environment (for example, a website) for the user's service use. Alternatively, in addition to providing additional information on the subtitle object, an event through a search, quiz, etc. based on the subtitle object may be provided.

In this case, the configuration of the multimedia file reproducing apparatus 100 will be described with reference to FIG. 6.

6 is a block diagram showing the configuration of a multimedia file playing apparatus according to a second embodiment of the present invention.

As shown in FIG. 6, the multimedia file reproducing apparatus 100 includes a caption display unit 110, a caption object activation unit 120, a storage unit 130, a pointing device recognition unit 140, a controller 150, and a display unit. 160, a highlight display unit 170, and a communication unit 180. In this case, a description overlapping with FIG. 1 will be omitted and only a configuration added according to the second embodiment of the present invention will be described.

The storage unit 130 includes a caption object display information storage area 132, a caption object activation interval information storage area 134, and an interactive motion information storage area 136.

The interactive motion information storage area 136 stores information about an interactive motion for providing additional information on subtitle objects defined in the subtitle object display information storage area 132 and the subtitle object activation interval information storage area 134. do.

In this case, the interactive operation includes a case in which the multimedia file reproducing apparatus 100 provides additional information processed by the interactive information defined in the external server 400 when only the caption object is delivered to the external server 400.

In addition, the interactive operation may include a case of providing an additional information by executing an application previously installed in the multimedia file reproducing apparatus 100.

In addition, the interactive operation includes a case in which additional information is provided by requesting a search result from the external server 400 using the caption objects as a search word.

The interactive operation may include, for example, a dictionary search service, a search service linked to a portal site, a service providing various related contents, and the like, but are not limited thereto.

The caption object activation unit 120 performs an interactive operation on the caption objects displayed in the caption object activation section by referring to the information stored in the interactive motion information storage area 136 and outputs the result to the controller 150. .

The caption object activator 120 executes a specific application embedded therein or performs additional information request and additional information in connection with an external server 400.

In addition, the caption object activator 120 generates a signal for requesting additional information about the caption objects displayed in the caption object activation section and transmits the signal to the external server 400.

In addition, the caption object activator 120 configures a semantic search term for searching for a content having a specific meaning based on the caption objects displayed in the caption object activation section. A search request signal for receiving a search result for the semantic search word is generated and transmitted to the external server 400. The search result is output to the controller 150.

In addition, the caption object activation unit 120 pops up a menu window in which one or more preset interactive operations defined to execute a specific embedded application or to be connected to an external server 400 are next to the caption object activation section. -up) After performing the interactive operation selected in the menu window, the result is displayed.

Meanwhile, the caption display unit 110 expresses caption objects as a hyperlink in which an interactive operation to be performed by the caption object activation unit 120 is defined. That is, a predetermined interactive operation on the caption object is defined using hyperlinks. That is, when a subtitle object is clicked within the subtitle object activation section, predefined additional information is provided or a specific interactive operation related to the subtitle object is performed.

The display unit 160 displays the caption objects displayed on the screen by the caption display unit 110 and the caption object activation unit 120 and displays the highlight function by the highlight display unit 170.

The highlight display unit 170 may display highlights on the caption objects activated by the caption object activator 120. Here, the highlight display means highlighting the caption objects displayed in the caption object activation section to be distinguished from other caption objects so that a user can recognize the caption objects. The highlight display may include any one of a letter color change, a background color change, a letter size change, and an underline change, but is not limited thereto, and various embodiments are possible.

The communication unit 180 is connected to the communication network 300 to perform data transmission and reception processing. The communicator 180 transmits a signal for requesting additional information about the caption objects generated by the caption object activation unit 120 to the external server 400.

The controller 150 may include the caption display 110, the caption object activator 120, the storage 130, the pointing device recognizer 140, the controller 150, the display 160, and the highlight display 170. It is connected to the communication unit 180 to control the operation of each component and the flow of various information.

7 and 8 are examples of additional information providing screens according to an embodiment of the present invention. 7 and 8 are examples of additional information providing screens when subtitles are displayed in different modes.

As shown in FIGS. 7 and 8, even when the subtitle display mode is changed, the subtitle display unit 110 and the subtitle object activator 120 can recognize the subtitle display section and the highlight display section dynamically. The same is provided.

In addition, when the cursor of the pointing device is positioned near the caption objects (desired) within the caption object activation section or clicks on the caption objects, the menu window 501 pops up separately from the screen on which the caption is displayed. The menu window 501 is a detailed information window about interactive operations defined for subtitle objects.

After performing an interactive operation according to a user's request among the interactive operations displayed on the menu window 501, the result may be provided through a search result window that provides separate searched information.

As such, it is easy to provide additional information on the caption objects by highlighting the caption objects and interactively exposing the caption objects.

Next, a method of controlling a caption object through the multimedia file playing apparatus 100 according to the first and second embodiments described above will be described with reference to three embodiments.

First, FIG. 9 is a flowchart illustrating a method of controlling a caption object according to the first embodiment of the present invention. That is, the method of controlling the caption object of the multimedia file reproducing apparatus 100 according to the first embodiment of FIGS. 1 to 4 is shown.

As shown in FIG. 9, the caption display unit 110 of FIG. 1 defines size information of a full screen on which a video file and a caption file are played in the caption object display information storage area 132 of the storage unit 130 (FIG. 1). (S101).

The caption display unit 110 sets a caption display period and stores the caption display section in the caption object display information storage area 132 of the storage unit 130 (S103).

The caption display unit 110 checks the location information of the caption display section selected and stored in step S103 and stores the caption object display information storage area 132 in the storage 130 (S105).

The caption object activation unit 120 of FIG. 1 selects a caption object activation section in which caption objects forming one group are expressed in a predetermined meaningful unit expressed in the caption display section, and then the caption object of the storage unit 130. The data is stored in the activation section information storage area 134 (S107).

The caption object activation unit 120 checks the location information of the caption object activation section selected and stored in step S107 and stores the location information in the caption object activation section information storage area 134 of the storage 130 (S109).

Thereafter, the pointing device recognition unit 140 of FIG. 1 checks the position value of the cursor of the current pointing device (S111) and determines whether the position value is included in the subtitle object activation section stored in step S109 (S113).

The pointing device recognition unit 140 repeats steps S111 and S113 when the location value is not included in the caption object activation section as a result of the determination in step S113.

The pointing device recognition unit 140 transmits the determination result to the caption object activation unit 120 when the determination result of step S113 and the position value are included in the caption object activation section.

Then, the caption object activator 120 executes a predefined operation on the caption objects expressed in the caption object activation section (S115).

Next, FIGS. 10 and 11 illustrate a method of controlling a caption object of the apparatus 100 for playing multimedia files according to the second embodiment of FIGS. 5 to 8.

10 is a flowchart illustrating a method of controlling a caption object according to the second embodiment of the present invention.

As shown in FIG. 10, the controller 150 of the multimedia file reproducing apparatus 100 plays a video file, and the subtitle display unit 110 displays corresponding subtitle files (S201 and S203).

The pointing device recognition unit 140 checks the position of the cursor of the pointing device (S205) and determines whether the cursor of the pointing device is located within the subtitle object activation section (S207).

When the pointing device recognizer 140 determines that the cursor of the pointing device is positioned within the caption object activation section, the caption object activator 120 activates the caption objects, and the highlight display unit 170 displays the cursor of the pointing device. A highlight is displayed on the caption objects in the caption object activation section (S209).

The caption object activator 120 analyzes an interactive operation defined for the highlighted caption objects (S211).

The caption object activator 120 determines whether the interactive operation analyzed in step S211 is execution of an application stored in itself or an external server request (S213).

If the caption object activation unit 120 executes the self-stored application as a result of the determination in step S213, the caption object activation unit 120 calls and executes the specific application (S215).

In addition, the caption object activation unit 120 transmits the interactive processing request to the external server 400 when the external server request is a result of the determination in step S213 (S217). In this case, the interactive processing request may include only subtitle object information. In this case, the external server 400 determines which interactive operation should be processed for the corresponding caption object. Alternatively, the interactive processing request may include caption object information and corresponding interactive motion information.

The external server 400 performs the processing according to the preset interactive information (S219) and then transmits the interactive processing result to the caption object activator 120 (S221).

The caption object activator 120 outputs an interactive processing result on the screen through the display 160 (S223).

11 is a flowchart illustrating a method of controlling a caption object according to a third embodiment of the present invention in detail. In particular, FIG. 10 is an embodiment showing the procedure after step S209 in detail.

As shown in FIG. 11, when the caption object activator 120 of the multimedia file playing apparatus 00 activates the caption objects in the caption object activation section (S301), the controller 150 stops the currently played video screen (S301). S303).

The caption object activator 120 outputs a menu window in which a plurality of interactive operations are defined (S305).

The caption object activation unit 120 receives a selection signal for a specific interactive operation from among a plurality of interactive operations included in a menu window from the user (S307).

The caption object activator 120 configures a semantic search term for the caption guest highlighted in step S301 (S309). Here, the semantic search term means searching based on the contents of the caption object. That is, a new search word for requesting to provide additional information is extracted by re-extracting only a subtitle object having a specific meaning among the highlighted subtitle objects.

The caption object activation unit 120 performs an interactive operation corresponding to the selection signal input in step S307 for the semantic search word configured in step S309 (S311). The interactive operation processing result is output to the screen (S313).

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

1 is a block diagram showing the configuration of a multimedia file playing apparatus according to a first embodiment of the present invention.

2 to 3 are diagrams for explaining a caption display section according to an embodiment of the present invention.

4 is a diagram illustrating a caption object activation section according to an embodiment of the present invention.

5 is a diagram illustrating a network configuration for providing additional information by a multimedia file reproducing apparatus according to a second embodiment of the present invention.

6 is a block diagram showing the configuration of a multimedia file playing apparatus according to a second embodiment of the present invention.

7 and 8 are exemplary screens for providing additional information according to an embodiment of the present invention.

9 is a flowchart illustrating a method of controlling a caption object according to the first embodiment of the present invention.

10 is a flowchart illustrating a method of controlling a caption object according to the second embodiment of the present invention.

11 is a flowchart illustrating a method of controlling a caption object according to a third embodiment of the present invention in detail.

Claims (25)

In the multimedia file playback apparatus for playing back a video file and a subtitle file corresponding to the video file, One or more subtitle objects constituting the entire subtitle file in the subtitle display section in which the subtitle file is displayed among the video file and the full screen on which the subtitle file is displayed, wherein the subtitle object includes letters, numbers, or symbols constituting a sentence. A caption display unit for displaying them; And Store location information of each of the plurality of subtitle object activation sections composed of the one or more subtitle objects, and if the cursor of a pointing device is positioned in the subtitle object activation section, the subtitle objects expressed in the subtitle object activation section are pre-set. Subtitle object activator that executes the set action Multimedia file playback device comprising a. The method of claim 1, Full screen information consisting of a plurality of pixels with two or more pixels listed at predefined intervals and given their respective coordinate values, and one or more square cells with one or more pixels extending horizontally and vertically to have position information in the form of pixel coordinate values. A subtitle storing subtitle display section information including subtitle display section information, position information of the square cell positioned at a start point of the subtitle display section, and position information of the square cell located at an end point of the subtitle display section. An object display information storage area; And The first subtitle objects of the subtitle file corresponding to each frame of the video file are indexed and stored, and one or more subtitle objects expressed in the square cell are formed by forming a group in a predefined meaningful unit. Subtitle object activation section information storage area for storing position information of a plurality of configured subtitle object activation sections in association with index information of the first subtitle objects Storage unit including Multimedia file playback device further comprising. The method of claim 2, The subtitle display unit, A subtitle object is expressed in one square cell with reference to the information stored in the storage unit, and a square cell starts from a square cell located at a start point of the subtitle display period and reaches a square cell located at an end point of the subtitle display period. Display one or more subtitle objects sequentially in cells, The subtitle object activation unit, When the cursor of the pointing device is located in any one of one or more square cells included in the subtitle object activation section, an operation set to all subtitle objects expressed in the one or more square cells included in the subtitle object activation section Multimedia file playback device running. The method of claim 2, The storage unit, A mode in which the caption object display information storage area is displayed together with the caption on the screen on which the video is displayed, a mode in which the caption is displayed separately from the screen on which the video is displayed, and the caption is displayed on the left, right, up, and down of the video. Store location information of each subtitle display section according to the mode, The multimedia file in which the caption object activation section information storage area stores position information of each of the plurality of caption object activation sections referring to position information of each caption display section according to the mode in association with index information of the first caption objects. Playback device. The method of claim 2, The storage unit, The start point and the end point of the subtitle presentation section calculated by applying the ratio information of the subtitle presentation section to the full screen size information, the size information of the subtitle presentation section according to a change in text size, and the ratio information or the size information. Stores the location information of each square cell located at The subtitle display unit, And displaying corresponding subtitle objects by recognizing the subtitle presentation section that is dynamically changed with reference to ratio information of the subtitle presentation section, size information of the subtitle presentation section, and position information of the square cell. The method of claim 1, A pointing device recognizer that determines whether a cursor of the pointing device is located in the caption object activation section and transmits a determination result to the caption object activation section if it is determined that the cursor of the pointing device is located in the caption object activation section. Multimedia file playback device further comprising. The method of claim 1, Highlighting the caption objects activated by the caption object activator, where highlighting means highlighting the caption objects displayed in the caption object activation section separately from other caption objects so that the user can recognize the caption objects. Highlight display to perform Multimedia file playback device further comprising. The method according to any one of claims 1 to 7, The subtitle object activation unit, And an interactive operation for providing additional information about the subtitle objects displayed in the subtitle object activation section. The method of claim 8, A communication unit connected to a communication network to transmit a signal for requesting additional information about the subtitle objects displayed in the subtitle object activation section to an external server; Multimedia file playback device further comprising. The method of claim 9, The subtitle object activation unit, Construct a semantic search word for searching for a content having a specific meaning based on the subtitle objects displayed in the subtitle object activation section, and provide a search request signal for receiving a search result for the semantic search word through the communication unit. Multimedia file playback device that outputs the search results received by sending to the screen. The method of claim 8, The subtitle object activation unit, And a menu window in which at least one interactive operation defined for the caption objects displayed in the caption object activation section is defined next to the caption object activation section. The method of claim 8, The subtitle display unit, And displaying hyperlinked caption objects in which an interactive operation to be performed by the caption object activation unit is defined. A method of controlling a caption object constituting a caption file by a multimedia file player for playing a motion picture file and a caption file corresponding to the motion picture file together, (a) one or more subtitle objects constituting the entire subtitle file in the subtitle display section in which the subtitle file is displayed among the video file and the full screen on which the subtitle file is displayed, wherein the subtitle object is a letter, number, or symbol constituting a sentence; Expressing-including; (b) whether the cursor of the pointing device is in a predefined subtitle object activation section of the subtitle presentation section, wherein the subtitle object activation section is composed of one or more subtitle objects displayed in the subtitle presentation section and is present in plurality. Determining; And (c) if it is determined that the cursor of the pointing device is located in the caption object activation section, executing a preset operation on the caption objects displayed in the caption object activation section; Subtitle object control method comprising a. The method of claim 13, Before step (a) above, (Iii) a square having two or more pixels arranged at regular intervals and having one or more of the pixels constituting the entire screen composed of a plurality of pixels given respective coordinate values, having a positional information in the form of pixel coordinate values in a horizontal and vertical direction; Selecting a caption display section including one or more cells; (Ii) identifying and storing the position information of the square cell located at the start of the caption display section and the position information of the square cell located at the end of the caption display section; And (Iv) indexing and storing each first subtitle object in the subtitle file corresponding to each frame of the video file, and forming one group in a predefined meaningful unit to express one or more one in the square cell Storing location information of a plurality of subtitle object activation sections including subtitle objects in association with index information of the first subtitle objects. Subtitle object control method further comprising. The method of claim 14, In step (a), One or more subtitle objects are sequentially displayed in square cells starting from a square cell positioned at a start point of the caption display section and a square cell located at an end point of the caption display section. Subtitle object control method to display sequentially. The method of claim 15, In step (b), Determining whether a cursor of the pointing device is located in any one of one or more of the square cells included in the caption object activation section; And Executing a preset operation on all subtitle objects displayed in one or more square cells included in the subtitle object activation section when the cursor of the pointing device is located in the one cell; Subtitle object control method comprising a. The method of claim 14, Step (ii), Each subtitle display according to a mode in which subtitles are displayed together on a screen on which a video is displayed, a mode in which the subtitles are displayed separately from a screen on which a video is displayed, and a mode in which the subtitles are displayed in left, right, up, and down of the video. A caption object control method for storing position information of a square cell of a section. The method of claim 14, Before step (a) above, (Iii) the ratio information of the caption display section calculated based on the ratio information of the caption display section to the size information of the entire screen, the size information of the caption display section according to a change in text size, and the ratio information or the size information; Storing position information of each square cell positioned at a start point and the end point; Subtitle object control method further comprising. The method of claim 18, In step (a), Recognizing the subtitle display period that is dynamically changed by referring to the ratio information of the subtitle display section stored in step (iii), the size information of the subtitle display section, and the position information of the square cell, and expressing corresponding subtitle objects. How to control subtitle objects. The method of claim 13, In step (c), Highlighting the caption objects displayed in the caption object activation section, where highlighting means highlighting the caption objects displayed in the caption object activation section separately from other caption objects so that the user can recognize the caption objects. How to control the closed caption object. The method according to any one of claims 13 to 20, In step (c), A subtitle object control method for performing a preset interactive operation for providing additional information on the subtitle objects displayed in the subtitle object activation section. The method of claim 21, In step (c), Subtitles that transmit a signal for requesting additional information about subtitle objects displayed in the subtitle object activation section to an external server through a communication network, and receive additional information about the subtitle objects from the external server and output them on the screen. Object control method. The method of claim 22, In step (c), A caption object for constructing a semantic search word for searching for a content having a specific meaning based on the caption objects displayed in the subtitle object activation section, and transmitting a search request signal for receiving a search result for the semantic search word to the external server. Control method. The method of claim 21, In step (c), One or more interactive operations for providing additional information on the subtitle objects displayed in the subtitle object activation section, wherein the interactive operations include an operation of executing a specific embedded application or connecting to an external server through a communication network. Displaying a box-defined menu window next to the caption object activation section; Receiving a user's selection signal for one or more interactive operations included in the menu window; And Outputting additional information according to a result of performing an interactive operation corresponding to the user's selection signal on a screen; Subtitle object control method comprising a. The method of claim 21, In step (a), The subtitle object control method of the interactive operation to express the subtitle objects defined as a hyperlink.

Images