JP2011259184A - Link-function-equipped moving image reproduction apparatus and link-function-equipped moving image reproduction program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a link-function-equipped moving image reproduction apparatus that displays information relating to a selected object in a moving image.SOLUTION: A link-function-equipped moving image reproduction apparatus 1 includes: meta information extraction means 13 for extracting meta information from link information meta data L where time information, area information, and link destination information of each object appearing in moving image data M are described; selected position identification means 160a for, when a position on a screen has been selected, identifying the selected position; object search means 160c for searching an object in the meta information, where the object's time information specifies a time section including a reproduction time of the moving image data M and the object's area information specifies an area including the selected position of the moving image data M; link destination information extraction means 162 for extracting, from the meta information, link destination information corresponding to the object found as a result of the search; and related information presentation means 17 for acquiring related information from a link destination designated by the link destination information and presenting the acquired related information.

Description

  The present invention relates to a moving image reproducing apparatus with a link function and a moving image reproducing program with a link function that present related information linked to an object included in the moving image at the time of reproducing the moving image.

  In recent years, an environment in which a moving image can be viewed on a personal computer has been prepared by improving the performance of a CPU or a graphics card. For example, in a personal computer, a media player or a web browser can play a moving image file stored in a local storage device, or a moving image content existing on a server can be played by streaming via a network.

As a business model of such a moving image distribution service, there is a model that presents an advertisement (banner advertisement, text advertisement) and provides moving image content free of charge.
As a way of showing this advertisement, for example, there is a technique in which an advertisement banner is displayed around a video, and a user selects (clicks) the advertisement banner with a mouse or the like, and presents detailed information related to the advertisement on a web browser. It is general (see, for example, Patent Document 1). Alternatively, there is a method of displaying detailed information by displaying an advertisement banner on a moving image and selecting by the user (see, for example, Patent Document 2).

  Thus, to present an advertisement together with moving image content, for example, it can be realized by a link tag (<a href=“...”>), an image tag (<img>), or the like of HTML (Hyper Text Markup Language). it can. That is, if a banner image (or character string) and a URL (Uniform Resource Locator) that is a link destination when clicked with a mouse are described in HTML using a link tag or an image tag, the user can use the mouse to display the banner. By clicking, related information of the link destination can be presented on the screen.

JP 2009-260902 A JP 2010-98730 A

As shown in Patent Document 1 described above, when an advertisement banner is displayed around a moving image, the moving image itself must be reduced and the advertisement banner displayed around the advertisement banner in order to secure a display area for the advertisement banner. . However, for a user who wants to watch a moving image on a large screen, there is a fear that the advertisement banner itself may be avoided or a movie with an advertisement banner may be avoided, which reduces the role as an advertisement.
In addition, as described in Patent Document 2 described above, when an advertisement banner is displayed on a moving image, a part of the moving image is always hidden. Therefore, there is a case where it is contrary to the intention of the copyright owner of the moving image. Advertising banners cannot be displayed in various formats.

  As described above, in the conventional technology, the object (object) in which the intention of the provider who provides the advertisement (related information) or the copyright owner of the moving image does not mesh with the intention of the user and the user shows interest on the moving image. However, there is a problem that related information cannot be provided to the user at an optimal timing.

  The present invention has been made in view of the above-described problems. When a moving image is reproduced, the user does not reduce the moving image and does not always display related information on the moving image. It is an object of the present invention to provide a moving image reproducing apparatus with a link function and a moving image reproducing program with a link function capable of displaying information related to the object at the stage of showing interest in the above object.

  The present invention has been made to solve the above-mentioned problems. First, the video playback apparatus with a link function according to claim 1 is associated with object identification information for identifying an object in the video data. The time information indicating the time interval in which the object appears in the moving image data, the region information indicating the region of the object in the playback screen of the moving image data in the time interval, and the link destination of the related information of the object Based on the link information metadata including the link destination information indicating as the meta information, when the moving image data is reproduced, the object is selected via the position input device, and the related information of the object is presented. A video playback device with a link function, wherein video playback means, selected position specifying means, object search means, And destination information extracting means, and configured to include a related information presenting means.

  In such a configuration, the moving image reproducing device with a link function reproduces moving image data by the moving image reproducing means. Then, the moving image playback apparatus with a link function includes position information indicating a position on the screen and selection instruction information indicating that the position is selected via a position input device such as a mouse or a touch panel by the selection position specifying unit. When the input signal is input, the position is specified as the selected position. This position information is, for example, coordinates on the screen. The selection instruction information is information indicating that a touch panel or a mouse button has been clicked (pressed and released), for example. That is, the stage where the position information and the selection instruction information are input as input signals refers to the timing when the user clicks the touch panel or the mouse button.

  Then, the moving image playback apparatus with a link function uses the object search means to include the playback time of the moving image data in the time section indicated by the time information in each meta information of the link information metadata, and the selected position is the region information. Search for objects contained within the indicated range. Thereby, it is determined whether or not an object linked with related information exists at the position pointed to by the user.

Then, the moving image reproducing apparatus with a link function extracts link destination information corresponding to the object searched by the object search means from the link information metadata by the link destination information extraction means.
Thereafter, the moving image reproducing apparatus with a link function acquires and presents the related information from the link destination indicated by the link destination information extracted by the link destination information extracting means by the related information presenting means.
As a result, when the related information is linked to the object pointed on the screen by the user, the moving image reproducing apparatus with a link function can present the related information on the screen.

  In addition, the video playback device with a link function according to claim 2 is the video playback device with link function according to claim 1, wherein the selection position specifying means starts the selection together with the position information as the input signal. When the selection start information indicating is input, the position in the reproduction screen based on the position information is specified as the first selection position, and the selection end information indicating the end of selection is input together with the position information. A function for specifying a position in the reproduction screen based on the position information as the second selection position is added, and a reproduction time subtracting unit is further provided.

In such a configuration, the moving image playback apparatus with a link function uses the playback time subtracting means to subtract a predetermined time according to the distance between the first selected position and the second selected position from the playback time of the operation data and perform past playback. Calculate time.
Then, when the second selection position is specified by the object search means, the moving image playback apparatus with a link function searches for the link information metadata object using the past playback time and the first selection position. This makes it possible to select an object that has appeared in the past in the currently reproduced moving image data.

  Further, the moving image reproducing apparatus with a link function according to claim 3 is the moving image reproducing apparatus with a link function according to claim 1, further comprising a pointer display means and a pointer position determination means.

  In such a configuration, the video playback device with a link function displays a pointer indicating the position on the screen by the pointer display means, and determines the position of the pointer based on the position information included in the input signal input from the position input device. Move.

  At this time, the moving image reproducing apparatus with a link function includes the reproduction time of the moving image data included in the time section indicated by the time information of the meta information by the pointer position determination unit, and the position of the pointer is indicated by the area information of the meta information. By determining whether or not it is included in the range, it is determined whether or not the position of the pointer exists on the object to which the related information is linked.

When the position of the pointer exists on the object to which the related information is linked, the pointer display means changes the shape of the pointer to a predetermined pointer shape indicating that the related information is linked to the object. change.
Thereby, the moving image reproducing apparatus with a link function can visually present to the user whether or not the related information is linked to the object indicated by the position of the pointer such as a mouse.

  Furthermore, the video playback device with a link function according to claim 4 is the group identification for identifying a group of two objects in the link information metadata in the video playback device with a link function according to claim 1. In association with the information, it further includes, as meta-information, in-group object identification information including two object identification information and second link destination information indicating a link destination of the related information of the group, The second selection position specifying means and the group object searching means are further provided.

  In such a configuration, the link function-equipped moving image playback apparatus receives the selection start information indicating the start of selection together with the position information as an input signal by the first selection position specifying unit, and displays the content within the playback screen based on the position information. The position is specified as the first selection position, and the playback time of the moving image data is specified as the first playback time. The selection start information is information indicating that a touch panel, a mouse button, or the like has been pressed.

In addition, the moving image playback apparatus with a link function determines the position in the playback screen based on the position information when the selection end information indicating the end of the selection is input together with the position information as the input signal by the second selection position specifying means. While specifying as a 2nd selection position, the reproduction | regeneration time of moving image data is specified as a 2nd reproduction | regeneration time. This selection end information is information indicating that the touch panel, mouse button, etc. have been released.
As described above, the moving image reproducing apparatus with a link function can detect the drag operation in the operation of the touch panel, the mouse, and the like by detecting the selection start information and the selection end information.

Then, the video playback device with a link function is included in the time section indicated by the time information of the meta information in the meta information of the link information metadata by the group object search means, and the first selection is performed. The first object identification information whose position is included in the range indicated by the area information of the meta information, the second reproduction time is included in the time interval indicated by the time information of the meta information, and the second selected position is A group including the second object identification information included in the range indicated by the area information of the meta information is searched.
Thereby, the moving image reproducing apparatus with a link function can specify two objects at the first selection position and the second selection position.

Then, when the group is searched for, the video playback device with a link function uses the link destination information extraction unit to replace the link destination information of the individual object with the second link corresponding to the group from the link information metadata. Extract destination information.
Thereby, the moving image reproducing apparatus with a link function can acquire and present the related information linked to the group including the two objects from the link destination indicated by the second link destination information by the related information presentation unit. it can.

  In addition, the moving image playback device with a link function according to claim 5 is the moving image playback device with a link function according to claim 1, wherein the link information metadata includes a group identification for identifying a group of a plurality of objects. In association with the information, the object further includes in-group object identification information including a plurality of object identification information and second link destination information indicating a link destination of the related information of the group as meta information, The second selection position specifying means and the group object searching means are further provided.

  In such a configuration, the link function-equipped moving image playback apparatus receives the selection start information indicating the start of selection together with the position information as an input signal by the first selection position specifying unit, and displays the content within the playback screen based on the position information. The position is specified as the first selection position, and the playback time of the moving image data is specified as the first playback time. The selection start information is information indicating that a touch panel, a mouse button, or the like has been pressed.

In addition, the moving image playback apparatus with a link function determines the position in the playback screen based on the position information when the selection end information indicating the end of the selection is input together with the position information as the input signal by the second selection position specifying means. While specifying as a 2nd selection position, the reproduction | regeneration time of moving image data is specified as a 2nd reproduction | regeneration time. This selection end information is information indicating that the touch panel, mouse button, etc. have been released.
As described above, the moving image reproducing apparatus with a link function can detect the drag operation in the operation of the touch panel, the mouse, and the like by detecting the selection start information and the selection end information.

Then, in the video playback device with a link function, the time interval indicated by the time information overlaps the time interval between the first playback time and the second playback time in each meta information of the link information metadata by the group object search means. In addition, a plurality of pieces of object identification information in which the range indicated by the area information overlaps with the rectangular area specified by the first selection position and the second selection position are searched as a group.
Thereby, the moving image reproducing apparatus with a link function can specify a plurality of objects at the first selection position and the second selection position.

Then, when the group is searched for, the video playback device with a link function uses the link destination information extraction unit to replace the link destination information of the individual object with the second link corresponding to the group from the link information metadata. Extract destination information.
As a result, the link function-equipped video reproduction device can acquire and present related information linked to a group composed of a plurality of objects from the link destination indicated by the second link destination information by the related information presenting means. it can.

  Furthermore, the moving image reproducing program with a link function according to claim 6 is associated with object identification information for identifying an object in the moving image data, and indicates time information indicating a time interval in which the object appears in the moving image data. And link information metadata including, as meta information, region information indicating the region of the object in the playback screen of the video data in the time interval and link destination information indicating a link destination of the related information of the object In order to present the related information of the object by selecting the object via the position input device when reproducing the moving image data, the computer is connected to the moving image reproducing means, the selected position specifying means, and the object searching means. , Function to function as link destination information extraction means, related information presentation means, and It was.

  In such a configuration, the moving image reproducing program with a link function reproduces moving image data by the moving image reproducing unit, and extracts individual meta information from the link information metadata corresponding to the moving image data by the meta information extracting unit.

  Then, the link function-added moving image reproduction program includes the position information indicating the position on the screen and the selection instruction information indicating that the position is selected via the position input device such as a mouse or a touch panel by the selection position specifying unit. When the input signal is input, the position is specified as the selected position.

  Then, the moving image playback program with a link function is included in the time section indicated by the time information by the object search means in the time information indicated by the time information in the meta information of the link information metadata, and the selected position is the region information. Search for objects contained within the indicated range.

  Then, the moving image reproduction program with a link function extracts link destination information corresponding to the object searched by the object search means from the link information metadata by the link destination information extraction means. Thereafter, the moving image reproduction program with a link function acquires and presents related information from the link destination indicated by the link destination information extracted by the link destination information extracting means by the related information presenting means.

The present invention has the following excellent effects.
According to the first and sixth aspects of the present invention, information related to an object can be displayed at the timing when the user selects an object that appears on the screen during reproduction of the moving image data. Accordingly, it is not necessary to always provide an area for displaying related information on the moving image, and the moving image can be reproduced on a large screen without reducing the moving image. Further, according to the present invention, since the related information is not always displayed on the moving image, the copyright holder's intention to reproduce the entire moving image can be met.

  According to the second aspect of the present invention, when a user selects an object that appears on the screen during reproduction of moving image data, the object is traced back to the past even if the object has disappeared from the screen. Can be selected. This allows the user to select an object that shows interest even if the object disappears from the screen immediately before selection.

  According to the third aspect of the present invention, when the shape of a pointer on the screen such as a mouse changes, the user can recognize that related information is linked to an object existing at that position. . Accordingly, the present invention can eliminate an operation such as a mouse click of the user on an object to which related information is not linked, and can prevent an unnecessary operation of the user.

  According to the fourth and fifth aspects of the present invention, when a user selects an object on the moving image screen by a drag operation, a plurality of objects are grouped and related information related to the group is presented at a time. be able to. As a result, the present invention can present related information common to a plurality of objects. Therefore, the related information rich in variations can be obtained depending on the combination of objects, as compared with the case where the related information of each object is individually presented. Can be presented.

1 is a system configuration diagram illustrating a configuration of a moving image distribution system according to an embodiment of the present invention. It is a block block diagram which shows the structure of the moving image reproducing device with a link function which concerns on 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the moving image reproducing device with a link function which concerns on 1st Embodiment of this invention. It is a data structure figure for demonstrating the content of the link information metadata used with the moving image reproducing apparatus with a link function which concerns on 1st Embodiment of this invention. It is a conceptual diagram for demonstrating the media time and moving image coordinate of link information metadata used with the moving image reproducing device with a link function concerning 1st Embodiment of this invention. It is a screen example (click operation) for demonstrating the screen at the time of the moving image reproduction of the moving image reproducing device with a link function which concerns on 1st Embodiment of this invention. It is a screen example (drag operation | movement) for demonstrating the screen at the time of the moving image reproduction of the moving image reproducing apparatus with a link function which concerns on 1st Embodiment of this invention. It is a block block diagram which shows the structure of the moving image reproducing device with a link function which concerns on 2nd Embodiment of this invention. It is a flowchart which shows operation | movement of the moving image reproducing device with a link function which concerns on 2nd Embodiment of this invention. It is a data structure figure for demonstrating the content of the link information metadata used with the moving image reproducing device with a link function concerning 2nd Embodiment of this invention. It is a screen example for demonstrating the screen at the time of the moving image reproduction of the moving image reproducing device with a link function which concerns on 2nd Embodiment of this invention. It is a block block diagram which shows the structure of the moving image reproducing device with a link function which concerns on 3rd Embodiment of this invention. It is a block block diagram which shows the structure of the moving image reproducing device with a link function which concerns on 4th Embodiment of this invention.

Embodiments of the present invention will be described below with reference to the drawings.
[Video content distribution system]
Initially, with reference to FIG. 1, the structure of the moving image delivery system including the moving image reproducing device with a link function according to the embodiment of the present invention will be described.

  The moving image distribution system S distributes moving image content and provides information related to the moving image content. Here, the moving image distribution system S is configured by connecting a moving image playback device with a link function 1, a moving image providing device 2, and a related information providing device 3 via a network N. The moving image distribution system S can be configured to include one or more of each device (1, 2, 3).

  The video playback device 1 with a link function acquires video content (moving image data M, link information metadata L) C provided from the video providing device 2 to play back the video, and also reproduces an object (person, object) on the playback screen. , Or time), the related information linked (associated) with the object is acquired from the related information providing device 3 and displayed. The configuration and operation of the moving image reproducing apparatus 1 with a link function will be described later in detail.

  The video providing device 2 is a content server that provides (distributes) the video content C to the video playback device 1 with a link function via the network N. The moving image providing apparatus 2 stores in advance the moving image content C in which the moving image data M and the link information metadata L are associated with each other in the storage unit 20, and the moving image content is received in response to a request from the moving image reproducing device 1 with a link function. Distribute C.

Here, the moving image data M is general video / audio content, and is data encoded in an encoding format such as MPEG, for example.
The link information metadata L is metadata related to an object that describes the arrangement (position, region, time) of objects (persons, objects, etc.) that appear (appear) in the video data M, and the link destination to the relevant information of the object. It is. By analyzing the link information metadata L, the video playback device with a link function 1 identifies the object currently displayed on the screen, and the related information linked to the object is obtained from the related information providing device 3. It becomes possible to acquire. The contents of the link information metadata L will be described in detail later.

  In the video content C, the video data M and the link information metadata L may be configured as separate files, or one file in a format such as MP4 which is one of the file formats for storing the video content. As a container.

  Here, the moving image providing apparatus 2 distributes the moving image content via the network N, but the moving image content C may be distributed via a broadcast wave. In that case, the moving image providing apparatus 2 distributes the moving image content C via the broadcast wave according to the program organization.

  The related information providing device 3 provides information (such as an advertisement) related to the moving image content C to the moving image reproducing device 1 with a link function via the network N. The related information providing device 3 stores in advance related information R related to the moving image content C in the storage unit 30 and distributes the related information R in response to a request from the moving image reproducing device 1 with a link function.

  Here, the related information R is information related to the object of the moving image data M, for example, data described in the HTML format. That is, the related information providing apparatus 3 can be configured by a general web server.

By configuring the moving image distribution system S in this way, the moving image reproducing device with a link function 1 analyzes the link information metadata L, and the position (area, time) of the object appearing on the reproduction screen of the moving image data M. ) Is specified, and it can be determined whether or not the position has been selected by the user with a mouse or the like. Then, the moving image reproducing apparatus with a link function 1 presents the related information R on the screen only when an object is selected by the user.
Hereinafter, a moving image reproducing apparatus with a link function according to an embodiment of the present invention will be described in detail.

<First Embodiment>
[Configuration of video playback device with link function]
First, with reference to FIG. 2 (refer to FIG. 1 as appropriate), the configuration of the moving image player with link function 1 according to the first embodiment of the present invention will be described.

  Here, the moving image playback apparatus 1 with a link function includes a communication unit 10, a content acquisition unit 11, a storage unit 12, a meta information extraction unit 13, a moving image playback unit 14, a pointer position input unit 15, and a link destination. Information specifying means 16, related information presentation means 17, pointer position determination means 18, and display control means 19 are provided.

  The communication means 10 communicates with a communication destination server (the moving image providing apparatus 2 and the related information providing apparatus 3) via a network N using a predetermined protocol such as TCP / IP. This communication means 10 can be realized by, for example, a NIC (Network Interface Card).

  The content acquisition unit 11 acquires the moving image content C (moving image data M, link information metadata L) from the moving image providing apparatus 2 via the communication unit 10. The content acquisition unit 11 acquires the moving image content C designated by the user from the moving image providing device 2 via an input unit such as a keyboard (not shown).

  Note that the content acquisition unit 11 outputs the video data M of the acquired video content C to the video playback unit 14 when performing playback (streaming playback) while sequentially acquiring the video content C according to an instruction from the user. The link information metadata L is output to the meta information extraction means 13.

  In addition, when the content acquisition unit 11 temporarily stores the video content C in the video playback device 1 with a link function according to an instruction from the user, the content acquisition unit 11 acquires the video content C (video data M, link information metadata L). Is stored in the storage means 12.

The storage unit 12 stores moving image content C (moving image data M, link information metadata L), and is a general storage device such as a hard disk or a magneto-optical disk.
Here, the moving image content C stored in the storage unit 12 is the same as the moving image content C provided by the moving image providing apparatus 2 described in FIG.

  That is, the moving image data M of the moving image content C is a general video / audio content, and is data encoded in an encoding format such as MPEG. The link information metadata L is meta information related to an object describing the arrangement (position, region, time) of objects (persons, objects, etc.) appearing in the moving image data M and the link destination to the relevant information of the object. is there.

  Here, the contents of the link information metadata L will be specifically described with reference to FIGS. As shown in FIG. 4, the link information metadata L includes “object identification information (object ID)”, “link destination information (URL)”, “time information (media time)”, and “region information (moving image coordinates)”. Is included as object information.

  The “object identification information (object ID)” is a unique identifier for identifying an object that appears (appears) in the moving image data M. This identifier is, for example, a character string such as alphanumeric characters. In this “object identification information”, a unique identifier as an object is assigned and set in advance to a person or thing appearing in the moving image data M. In FIG. 4, as an example, the identifiers of three persons appearing in the moving image data M are [PERSON1], [PERSON2], and [PERSON3], and the identifiers of objects (bags) appearing in the moving image data M are [BAG1. ] Is shown.

  “Link destination information (URL)” is information indicating a link destination to related information related to the object specified by “object identification information”. For example, “link destination information” is a URL indicating the location of related information. FIG. 4 shows an example in which the related information is an HTML file and the link destination of the object [PERSON1] is “http://nhk.or.jp/p1.html” (for other objects). The same). The related information at the link destination may be PHP (PHP Hypertext Preprocessor) which is a script language for generating a dynamic web page.

  “Time information (media time)” is information indicating a time at which an object appears in the moving image data M. For example, in “time information”, a time at which an object appears as an elapsed time from the start of reproduction of the moving image data M is set in advance. In FIG. 4, as an example, it is shown that the object [PERSON1] appears within 10 seconds to 15 seconds from the start of the moving image data M (the same applies to other objects).

The “region information (moving image coordinates)” is information indicating a region in the reproduction screen of an object that appears in the moving image data M. That is, this “region information” indicates an effective range as an object when the user selects an object on the screen.
This “area information” is an area in the playback screen of an object that appears within the time specified by “time information”. In FIG. 4, as an example, the object [PERSON1] has two diagonal coordinates. This indicates that the object appears in the area specified by (500, 200)-(1000, 1200) (the same applies to other objects).

  This “region information” can be, for example, a rectangular region including the object as shown in FIG. FIG. 5 represents “region information (moving image coordinates)” of the objects [PERSON1] and [BAG1] by broken lines. As shown in FIG. 5, “region information” indicates coordinates that specify a rectangular region including an object (in the broken line in the figure), and in the coordinate system (x, y) in the screen, for example, upper left, right Set in advance using the coordinates below. The “region information” does not need to be a region that strictly includes the shape of the object, and may be roughly set as a region from which the object can be selected.

When the same object appears in the same moving image data M at different times, a plurality of “time information” and “region information” may be set for “object identification information”. . For example, as in [PERSON3] in FIG. 4, a plurality of “time information” and “region information” are set for the same object.
In addition, even when the same object appears in the time direction in the moving image data M, if the area changes with time, a plurality of “time information” and “area information” are set. To do.

The link information metadata L can be described in a format such as XML (Extensible Markup Language) or CSV (Comma Separated Values).
When the link information metadata L is described in the XML format, a tag for identifying each object information is defined in advance, and each object information is inserted between the tags.

When the link information metadata L is described in the CSV format, [PERSON3] in FIG. 4 sets the same number of “object identification information” and “link information” as the “time information”, respectively. Align the number of rows of. As a result, the link information metadata L can be expressed by simply delimiting it with a delimiter (such as a comma).
As described above, by defining the link information metadata L, it is possible to specify the region of the object appearing in the moving image data M in the time direction.
Returning to FIG. 2, the description of the configuration of the moving image playback apparatus 1 with a link function will be continued.

  The meta information extraction unit 13 analyzes the link information metadata L and extracts individual meta information (object information). The meta information extraction means 13 analyzes each piece of meta information (“object identification information (object ID)”, “link destination information (URL)”) by analyzing the link information metadata L described in XML or CSV format. , “Time information (media time)”, “region information (moving image coordinates)” (see FIG. 4)).

  For example, when the link information metadata L is data described in the XML format, the meta information extracting unit 13 reads the data between the meta information by reading the data sandwiched between the unique tags predetermined for each meta information. To extract. Further, for example, when the link information metadata L is data described in the CSV format, the meta information extracting means 13 extracts the meta information data arranged in a predetermined order by dividing it with a delimiter symbol. .

The meta information extraction unit 13 acquires link information metadata L corresponding to the video data M from the content acquisition unit 11 when performing playback (streaming playback) while sequentially acquiring the video data M via the network N. And analyze.
Further, when performing reproduction (accumulation reproduction) of the moving image data M stored in the storage unit 12, the meta information extraction unit 13 reads the link information metadata L corresponding to the moving image data M from the storage unit 12 and analyzes it. Do.
Further, the meta information extracting unit 13 outputs the extracted meta information to the link destination information specifying unit 16.

  The moving image reproducing means 14 reproduces the moving image data M. The moving image reproducing means 14 decodes moving image data M which is video / audio content encoded by MPEG or the like, and generates display data for screen display. This moving image reproduction means 14 can be realized by a general media player. Here, the moving image reproduction means 14 outputs the generated display data to the display control means 19.

  Here, when the moving image data M is decoded, the moving image reproducing unit 14 measures the reproduction time (media time) of the moving image and outputs it to the link destination information specifying unit 16. For example, when the moving image data M is MPEG, the moving image reproducing means 14 uses the time information (PTS: Presentation Time Stamp, DTS: Decoding Time Stamp) included in the encoded data as a reference for the current reproduction time (media Time).

  The pointer position input means 15 receives a signal from an externally connected position input device P, and receives position information indicating the position on the display screen and operation information indicating the operation of the position input device P included in the signal. Input interface. The position input device P is not particularly limited as long as it can specify the position on the screen, such as a mouse, a joystick, or a touch panel.

Here, the position information input from the position input device P is information for specifying the position on the screen of the display device D. For example, from the position currently indicated by the mouse cursor or the like on the screen. Relative position or absolute position. For example, when position information is input as a movement amount (relative position) like a mouse, the pointer position input unit 15 converts the position information into coordinates on the screen from the current pointer position and the input relative position. To do. When position information is input as an absolute position on the screen as in a touch panel, the pointer position input unit 15 uses the coordinates of the absolute position as position information as they are.
Further, the operation information input from the position input device P is information indicating the user's operation content with respect to the position input device P. For example, it is information indicating that a mouse button or touch panel is pressed or released.

The pointer position input unit 15 outputs position information and operation information on the screen specified by the position input device P to the link destination information specifying unit 16. The pointer position input means 15 further outputs the coordinates on the screen specified by the position input device P to the pointer position determination means 18 and the pointer display means 191.
In the following description, the position input device P will be described as a mouse.

The link destination information specifying unit 16 passes the meta information extracting unit 13 based on the media time of the moving image data M reproduced by the moving image reproducing unit 14 and the position information and the operation information input from the pointer position input unit 15. The link destination (link destination information) of the related information of the object selected by the user from the meta information of the link information metadata L extracted in this way is specified.
Here, the link destination information specifying unit 16 includes an object specifying unit 160 and a link destination information extracting unit 162.

  The object specifying unit 160 specifies an object selected by the user in the moving image data M. Here, the object specifying unit 160 includes a selection position specifying unit 160a, a reproduction time subtracting unit 160b, and an object searching unit 160c.

  The selection position specifying unit 160a specifies a position (selection position) selected by the user in the playback screen of the moving image data M. Here, the selected position specifying unit 160a specifies the selected position based on the position information and the operation information input from the pointer position input unit 15.

Specifically, the selection position specifying unit 160a receives, from the pointer position input unit 15, information indicating that a position has been selected as operation information (selection instruction information; for example, a mouse button is clicked (pressed and released). At the same time as the operation information, the position information input from the pointer position input means 15 is specified as the selected position.
Further, the selection position specifying unit 160a may specify that the position is selected when the position information input from the pointer position input unit 15 does not change for a predetermined time (for example, 1 to 3 seconds).

For example, when the moving image data M is reproduced as a part of the display screen of the display device D by multi-window display or the like, the selection position specifying unit 160a reproduces the moving image data M from the display control unit 19. The position of the moving image reproduction area of the window screen is acquired, and the coordinates of the position are converted to the coordinates in the moving image reproduction area.
Thereby, the selected position specifying unit 160a can specify the position selected by the user in the playback screen of the moving image data M.
The position information specified in this way is output to the object search means 160c.

  In addition, the selection position specifying unit 160a has a function of specifying the position (first selection position, second selection position) selected by the drag operation performed by the user in the reproduction screen of the moving image data M. Note that the drag operation here refers to an operation of specifying the object at the first selection position by tracing back the reproduction time of the moving image data M by the time corresponding to the distance between the first selection position and the second selection position. To do.

  Specifically, the selection position specifying unit 160a receives information indicating that a position has been selected as operation information from the pointer position input unit 15 (selection start information; for example, information indicating that a mouse button has been pressed). Is input as the first selected position, the position information input from the pointer position input means 15 at the same timing as the operation information. In addition, the selection position specifying unit 160a receives information indicating the end of position selection (selection end information; for example, information indicating that the mouse button has been released) from the pointer position input unit 15 as operation information. In the stage, the position information input from the pointer position input means 15 at the same timing as the operation information is specified as the second selection position.

  When the mouse drag operation is performed as described above, the selection position specifying unit 160a outputs the position in the reproduction screen specified by the first selection position as position information to the object searching unit 160c. In addition, the selection position specifying unit 160a outputs the first selection position and the second selection position to the reproduction time subtraction unit 160b.

  The reproduction time subtracting means 160b subtracts a time predetermined according to the distance between the first selection position and the second selection position specified by the selection position specifying means 160a from the reproduction time (media time) of the current moving image. Thus, the past time (past playback time) is calculated.

This reproduction time subtracting means 160b, for example, when the distance between the first selection position and the second selection position is 1 cm on the screen, the time (subtraction time) going back in the past is 5 seconds in advance. Is established. Since the distance on the screen differs depending on the pixel pitch, the resolution on the screen is set in advance, and the reproduction time subtraction unit 160b calculates the distance from the number of pixels between the first selection position and the second selection position. The time corresponding to the distance is set as the subtraction time.
The reproduction time subtracting means 160b outputs the calculated past reproduction time to the object searching means 160c.

The object search means 160c searches for an object at the selection position specified by the selection position specification means 160a in the reproduction screen of the moving image data M.
The object search unit 160c is configured so that the reproduction time (media time) of the current moving image data M in the meta information of the link information metadata L extracted through the meta information extraction unit 13 is “time information ( Media time) ”(see FIG. 4), and object identification included in the range indicated by“ region information (moving image coordinates) ”(see FIG. 4) of meta information. Search for information (object ID). As a result, the object selected by the user is specified in the moving image data M currently being reproduced.

  Note that the object search unit 160c changes the playback time of the video data M to the past playback time when the playback time subtracting unit 160b notifies the playback time of the playback time (past playback time) by the drag operation. The object is searched for using the selected position as the first selected position specified by the selected position specifying means 160a.

That is, the object search means 160c uses the media time (reproduction time) in each piece of meta information of the link information metadata L extracted via the meta information extraction means 13 when the selection position specifying means 160a detects a drag operation. The past reproduction time calculated by the subtracting means 160b) is included in the time section indicated by “time information (media time)” (see FIG. 4) of the meta information, and is selected by the selected position (selected position specifying means 160a). Search for object identification information (object ID) included in the range indicated by “region information (moving image coordinates)” (see FIG. 4) of the meta information.
The object search unit 160c outputs the object identification information of the identified object to the link destination information extraction unit 162.

  The link destination information extracting unit 162 extracts a link destination to related information related to the object specified by the object specifying unit 160 from each meta information of the link information metadata L. That is, the link destination information extraction unit 162 uses the meta information corresponding to the object (object identification information) specified by the object specifying unit 160 from each piece of meta information of the link information metadata L extracted via the meta information extraction unit 13. Information “link destination information (URL)” (see FIG. 4) is extracted.

The link destination information extraction unit 162 outputs the extracted link destination information to the related information presentation unit 17.
Thereby, the link destination information specifying unit 16 can specify the link destination to the related information linked to the object selected by the user from the meta information.

  The related information presenting means 17 acquires related information from the link destination indicated by the link destination information specified by the link destination information specifying means 16 and presents it on the screen. The related information presenting means 17 acquires related information from the link destination (URL) indicated by the link destination information via the communication means 10 and generates display data for screen display. The related information presentation unit 17 can be realized by a general web browser. Here, the related information presentation unit 17 outputs the generated display data to the display control unit 19.

The related information presenting means 17 may display only the related information in the vicinity of the mouse cursor by a pop-up window, or may newly display the web browser screen (window screen) to present the related information. It is good.
Further, when presenting the related information, the related information presenting means 17 may erase the screen of the related information by, for example, a [Close] button (not shown) on the screen, or may be determined in advance. After presenting time and related information, the screen may be deleted.

  The pointer position determination means 18 determines whether or not the position of the pointer (mouse cursor) exists on the object to which the related information is linked on the reproduction screen of the moving image data M.

  Here, when the pointer enters the area of the object to which the related information is linked, the pointer position determining means 18 changes the pointer shape to a predetermined shape indicating that the related information is linked. The pointer display means 191 is instructed. Further, the pointer position determination means 18 instructs the pointer display means 191 to return to the original pointer shape when the pointer leaves the object area.

  The pointer position determination means 18 uses the meta information extracted by the meta information extraction means 13 so that the current playback time (media time) of the moving image data M is “time information (media time)” (see FIG. 4), and the position of the pointer is included in the range indicated by “region information (moving image coordinates)” (see FIG. 4) of the meta information. It is determined that the related information exists on the linked object.

  The display control means 19 displays screen data on the screen of the display device D. This display control means 19 implement | achieves the graphical user interface between users, for example, can be implement | achieved by a general window system. Here, the display control means 19 includes screen display means 190 and pointer display means 191.

  The screen display unit 190 displays screen data required by each task. The screen display unit 190 generates a plurality of windows on the screen and displays the screen data in each window by dividing each task. Here, each task is an execution unit of processing performed by means accompanied by screen display, and here, moving image reproduction by the moving image reproduction means 14 and related information presentation by the related information presentation means 17 correspond to this. .

The pointer display unit 191 displays a pointer for the user to select a position on the screen. The pointer visually presents the position on the screen to the user by a shape (for example, an arrow shape) indicating a position, such as a mouse cursor.
The pointer display unit 191 moves the position of the pointer according to the coordinates of the pointer input from the pointer position input unit 15.
The pointer display unit 191 changes the shape of the pointer when it is instructed by the pointer position determination unit 18 to change the shape of the pointer on the screen.
As a result, the user can visually recognize whether or not there is an object to which the related information is linked at the position of the pointer by the pointer shape on the screen.

  By configuring the video playback device with a link function 1 in this way, the video playback device with a link function 1 can display information related to an object only when the user selects an object with a link with a pointer (mouse cursor). Present on the screen.

  As a result, the moving image reproducing apparatus with a link function 1 can reproduce the moving image on the entire screen of the display device D when the moving image data M is reproduced, and the target (object) on which the user has shown interest in the moving image. Information related to the object can be presented on the screen at a timing when the user shows interest.

[Operation of video playback device with link function]
Next, with reference to FIG. 3 (refer to FIG. 2 as appropriate), the operation of the moving image player with link function 1 according to the first embodiment of the present invention will be described. Here, the description will be made assuming that the moving image content C to be reproduced is stored in the storage unit 12 in advance. However, the moving image content C may be input and reproduced as streaming data from the moving image providing apparatus 2 (see FIG. 1).

First, the link function stored in the storage unit 12 by the meta information extraction unit 13 when the video function C with link function 1 is instructed to reproduce the video content C by an input unit (not shown). Individual metadata (object information) is extracted from the information metadata L (step S1).
Then, the moving image reproducing apparatus 1 with a link function starts reproduction of the moving image data M stored in the storage unit 12 by the moving image reproducing unit 14, and the screen of the display device D is displayed by the screen display unit 190 of the display control unit 19. A reproduced moving image is displayed above (step S2).

  At this time, the moving image reproducing apparatus with a link function 1 sequentially inputs signals of the position input device P (mouse or the like) operated by the user by the pointer position input means 15 and analyzes the position information and the operation information. In addition, the moving image playback apparatus 1 with a link function detects that the pointer has entered the area of the object to which the related information is linked by the pointer position determination means 18 while the pointer is moving, and the pointer enters the area. The pointer shape is changed to a predetermined shape indicating that the related information is linked.

  Then, the link function-equipped moving image playback device 1 uses the pointer position input means 15 to select a pointer position on the screen by the user from the position input device P (mouse button click [single click: press and release]), etc. ) To detect that the pointer position has been selected (step S3). Here, when the pointer position is selected (Yes in step S3), the moving image reproducing apparatus with a link function 1 specifies the position information input from the pointer position input means 15 as the selected position by the selection position specifying means 160a. To do.

Then, the moving image reproducing apparatus with a link function 1 determines whether or not an object exists at the selection position specified by the selection position specifying unit 160a in the reproduction screen of the moving image data M currently being reproduced by the object searching unit 160c. Is searched (step S4).
That is, the object search means 160c responds in the meta information (link information metadata L) extracted in step S1 from the current playback time (media time) of the moving image data M and the selected current pointer position. It is searched whether there is an object linked to related information at the corresponding media time and the corresponding pointer position.

  In step S3, when the pointer position input unit 15 detects from the position input device P that the user has performed a drag operation on the screen, the moving image playback device 1 with a link function uses the playback time subtraction unit 160b. Then, a time (past reproduction time) retroactive by the time corresponding to the distance of the pointer by the drag operation is calculated, and in step S4, an object is searched from the first selection position specified by the drag operation and the past reproduction time.

  Then, when there is an object linked to the related information (Yes in step S5), the moving image reproducing apparatus with a link function 1 uses the link destination information extraction unit 162 to link information corresponding to the object searched in step S4 ( URL) is output to the related information presenting means 17. Then, the link function-equipped video player 1 acquires the related information specified by the link destination information (URL) by the related information presentation unit 17 via the communication unit 10, and the screen display unit 190 of the display control unit 19. Thus, the related information is presented on the screen of the display device D (step S6).

  When the video playback by the video playback means 14 has ended (Yes in step S7), the video playback device with link function 1 ends the operation and continues to play back the video (No in step S7). Returning to S3, the operation is continued.

  Further, when the pointer position is not selected in step S3 (No in step S3), or when there is no object linked to the related information in step S5 (No in step S5), the moving image reproducing apparatus with a link function 1 Will proceed to step S7.

[Screen example of video playback device with link function]
Next, referring to FIG. 6 and FIG. 7 (refer to FIG. 2 as appropriate), a screen example of the moving image player with link function 1 according to the first embodiment of the present invention will be briefly described.

(Example of selecting objects by clicking)
First, an example of a screen for selecting an object will be described with reference to FIG.
As shown in FIG. 6A, in the moving image reproducing device 1 with a link function, the pointer P1 is determined by the pointer position determining unit 18 while the moving image reproducing unit 14 is reproducing the moving image data M on the display screen G. Has entered the area A of the object linked to the related information. When the pointer P1 enters the area A, the moving image playback apparatus 1 with the link function links the shape of the pointer P1 (here, an arrow) to the relevant information by the pointer display unit 191. To a predetermined shape (in this case, an arrow with a document). Thereby, the moving image reproducing apparatus with a link function 1 can visualize and present that the related information is linked to the object pointed to by the user.

  Then, the link function-equipped video player 1 selects the object selected by the link destination information specifying unit 16 when the user selects the position indicated by the pointer P1 (clicks (presses and releases) the mouse button)). The related information link destination is extracted (specified) from the meta information, and the related information presentation unit 17 displays the related information screen W on the display screen G as shown in FIG.

  As a result, as shown in FIG. 6A, the moving image playback apparatus 1 with a link function can play back the moving image on the entire display screen G of the display device D when the moving image data M is played back. As shown in FIG. 6B, information related to the object can be presented on the screen G at the timing when the user shows interest (selected by the user) with respect to the object that showed interest in (1). .

(Past object selection example by dragging)
Next, an example of a screen for selecting an object retroactively by a drag operation will be described with reference to FIG.
As shown in FIG. 7A, an object O1 (region A) linked to related information exists at a certain point (media time) when the moving image data M is reproduced on the display screen G. As shown in (b), it is assumed that the object O1 disappears from the display screen G with the reproduction.
On the screen of FIG. 7B, the user starts the drag operation by specifying the first selection position near the position where the object existed by the pointer P1, and as shown in FIG. 7C, The second selection position is specified by the end of the operation.

  The link function-equipped video reproduction device 1 uses the link destination information specifying unit 16 to trace back the object that has existed at the first selected position back to the time according to the distance Di between the first selected position and the second selected position. The link destination of the related information of O1 is extracted (specified) from the meta information, and the related information presentation unit 17 displays the related information screen W on the display screen G as shown in FIG. As a result, the moving image playback apparatus 1 with a link function can return to the past by the drag operation even if the object that the user showed interest in disappears from the screen G during the playback of the moving image data M. Can be presented on the screen G.

Second Embodiment
[Configuration of video playback device with link function]
Next, with reference to FIG. 8 (refer to FIG. 1 as appropriate), the configuration of the moving image reproducing apparatus with link function 1B according to the second embodiment of the present invention will be described.

This video playback device with link function 1B further has a function for the user to select a plurality of objects and present related information related to the plurality of objects, with respect to the video playback device with link function 1 (see FIG. 2). It is added.
Here, the moving image playback device with link function 1B includes a communication unit 10, a content acquisition unit 11, a storage unit 12B, a meta information extraction unit 13, a video playback unit 14, a pointer position input unit 15, a link destination. Information specifying means 16B, related information presenting means 17, pointer position determining means 18, and display control means 19 are provided.

  Since the configuration other than the storage unit 12B and the link destination information specifying unit 16B is the same as that of the moving image playback device 1 with the link function described with reference to FIG.

The storage unit 12B stores moving image content C (moving image data M, link information metadata L _B ), and is a general storage device such as a hard disk or a magneto-optical disk. The moving image content C stored in the storage unit 12B may be provided by the moving image providing apparatus 2 described with reference to FIG.
Here, the video content C stored in the storage unit 12B, the contents of the link information metadata L _B is different from the link information metadata L described link function attached video reproducing apparatus 1 (see FIG. 2).

The link information metadata L _B, the arrangement of the objects appearing in the video data M (person, thing, etc.) (position, area) or meta-information about individual objects describing the links to related information of the object ( (Individual link information) and meta information (group link information) describing a link destination to related information for each of a plurality of objects.

Referring now to FIG. 10, specifically describes the contents of the link information metadata L _B. As shown in FIG. 10, the link information metadata L _B, constructed out individual link information (a) and the group link information (b).

The individual link information shown in FIG. 10 (a) is the same as the link information metadata L explained in FIG. 4 used in the moving image reproducing apparatus with a link function 1 (see FIG. 2). Omitted.
In the group link information shown in FIG. 10B, two or more individual objects defined in FIG. 10A are combined to form a group, and a link destination to related information for each group is described. Is.

  Here, the group link information includes “group identification information (group ID)”, “group object identification information (object ID)”, and “group link destination information (URL)” as group object information.

  “Group identification information (group ID)” is a unique identifier for identifying a plurality of objects appearing (appearing) in the moving image data M as a group. This identifier is, for example, a character string such as alphanumeric characters. In this “group identification information”, a unique identifier is assigned and set in advance as a group for a plurality of objects to a person or thing appearing in the moving image data M. FIG. 10B shows an example in which two persons (PERSON1 and PERSON2) appearing in the moving image data M are described as one identifier [PERSON-RELATIONSHIP1] (for other group identification information). The same).

  The “in-group object identification information (object ID)” is a unique identifier for identifying an object that appears (appears) in the moving image data M. This “in-group object identification information” in FIG. 10B is obtained by connecting two or more “object identification information” of the individual link information in FIG. FIG. 10B shows an example in which two person identifiers [PERSON1] and [PERSON2] are defined as a group identified by [PERSON-RELATIONSHIP1] (another group). The same applies to).

“Group link destination information (URL)” (second link destination information) is information indicating a link destination to related information related to the group specified by “group identification information”. The contents of the “group link destination information” are the same information as the “link destination information” of the individual link information in FIG.
The link information metadata _{L B} can be described in XML, a CSV like format.
Thus, by leaving established link information metadata L _B, it is possible to identify the direction of the area of an object appearing in the video data M times, it is possible to identify a plurality of objects as a group.
Returning to FIG. 8, the description of the configuration of the link function-equipped video player 1B will be continued.

The link destination information specifying unit 16B passes through the meta information extracting unit 13 based on the media time of the moving image data M reproduced by the moving image reproducing unit 14 and the position information and operation information input from the pointer position input unit 15. from the meta information extracted link information metadata L _B Te, and extracts the link destination of the related information of the object selected by the user (link destination information).

  Here, the link destination information specifying unit 16B includes an object specifying unit 160, a group object specifying unit 161, and a link destination information extracting unit 162B. The object specifying unit 160 has the same configuration as that of the moving image reproducing apparatus with a link function 1 described in FIG.

  The group object specifying means 161 is for specifying a plurality of objects selected by the user in the moving image data M currently being reproduced. The group object specifying unit 161 specifies a plurality of objects by dragging a pointer (mouse cursor). Here, the group object specifying unit 161 includes a first selected position specifying unit 161a, a second selected position specifying unit 161b, and a group object searching unit 161c.

  The drag operation is also detected by the object specifying unit 160. Here, the group object specifying unit 161 receives information indicating the start of position selection from the pointer position input unit 15 (selection start information; for example, mouse button ) And information indicating the end of position selection (selection end information; for example, information indicating that the mouse button has been released) are preferentially acquired.

  The first selection position specifying unit 161 a is for specifying the first position (first selection position) selected by the user in the playback screen of the moving image data M. Here, the first selection position specifying unit 161 a specifies the first selection position based on the position information and the operation information input from the pointer position input unit 15.

Specifically, the first selection position specifying unit 161a receives, from the pointer position input unit 15, information indicating the start of position selection (selection start information; for example, information indicating that a mouse button has been pressed). ), The position information input from the pointer position input means 15 is specified as the first selected position at the same timing as the operation information.
The first selected position specifying means 161a outputs the first selected position and the media time (first playback time) when the position is selected to the group object searching means 161c.

  The second selection position specifying unit 161b specifies the second position (second selection position) selected by the user in the playback screen of the moving image data M. The second selection position specifying unit 161b also specifies the second selection position based on the position information and the operation information input from the pointer position input unit 15.

Specifically, the second selection position specifying unit 161b receives from the pointer position input unit 15 information indicating the end of position selection (selection end information; for example, information indicating that the mouse button has been released) as operation information. ), The position information input from the pointer position input means 15 is specified as the second selection position at the same timing as the operation information.
The second selected position specifying means 161b outputs the second selected position and the media time (second playback time) at which the position is selected to the group object searching means 161c.

  As described above, the user can select the screen by detecting the drag operation by starting the selection (pressing the mouse button) in the first selection position specifying unit 161a and ending the selection (release the mouse button) in the second selection position specifying unit 161b. The two positions selected above (first selection position, second selection position) and time (first reproduction time, second reproduction time) are specified.

  For example, when the moving image data M is reproduced as a part of the display screen of the display device D by multi-window display or the like, the first selection position specifying unit 161a and the second selection position specifying unit 161b are display control units. 19, the position of the moving image reproduction area of the window screen reproducing the moving image data M is acquired, and the coordinates of the position are converted into the coordinates in the moving image reproduction area.

  The group object search means 161c includes the first selection position and the first reproduction time specified by the first selection position specification means 161a, the second selection position and the second reproduction time specified by the second selection position specification means 161b, Based on the above, an object at a plurality of positions selected by the user is searched.

The group object search means 161c, in each meta information extracted link information metadata L _B via the meta-information extraction means 13, the first play time (medium time) is "time information of the meta information (media time) ”(See FIG. 10A) and the first selected position is included in the range indicated by“ region information (moving image coordinates) ”(see FIG. 10A) of the meta information. Search the object identification information (object ID).

The group object search means 161c, in each meta information of the link information metadata L _B extracted through the meta-information extraction means 13, "time information (media time of the second reproduction time (medium time) is meta information ) ”(See FIG. 10A) and the second selected position is within the range indicated by“ region information (moving image coordinates) ”(see FIG. 10A) of the meta information. Search for included object identification information (object ID). As a result, two objects selected by the user are specified in the moving image data M currently being reproduced.
The group object searching unit 161c outputs the object identification information of the identified object to the link destination information extracting unit 162B.

If the object cannot be specified, that is, if the user does not perform the drag operation by directly selecting the object, the group object search unit 161c sends the first selection position and the second selection to the reproduction time subtraction unit 160b. The position is output.
Then, the past playback time is calculated by the playback time subtracting means 160b, the playback time of the moving image data M is set as the past playback time by the object searching means 160c, and the selected position is specified by the first selected position specifying means 161a. An object is searched for as a selection position.

  Here, the group object specifying unit 161 detects the drag operation with priority over the object specifying unit 160, but the present invention is not limited to this. For example, a state where a specific key (for example, a “control” key) is pressed on a keyboard or the like not shown is detected by a key determination unit (not shown), and only when the key is pressed. The group object specifying unit 161 may detect the drag operation. In other cases, the object specifying unit 160 may detect the drag operation.

  The link destination information extracting unit 162B is related to the object specified by the object specifying unit 160 or the group object specifying unit 161 in the meta information of the individual link information (see FIG. 10A) extracted by the meta information extracting unit 13. The link destination to related information is specified.

That is, the link destination information extraction unit 162B, when the object identification information from the object specifying means 160 is input, the meta information the meta information extraction unit 13 links information metadata L _B extracted through (individual link information) Then, “link destination information (URL)” (see FIG. 10A) corresponding to the object (object identification information) specified by the object specifying means 160 is specified.

The link destination information extraction unit 162B may group objects when a plurality of object identification information from the identification means 161 is input, the meta-information (a group of link information metadata L _B extracted through the meta-information extraction means 13 From “link information”, “link destination information (URL)” (see FIG. 10B) corresponding to a plurality of objects (object identification information) specified by the group object specifying means 161 is specified.

  Here, the group object search means 161c is a group of two objects, the object at the position specified by the first selected position specifying means 161a and the object at the position specified by the second selected position specifying means 161b. However, the present invention is not limited to this.

  For example, the group object searching unit 161c includes the first reproduction time specified by the first selected position specifying unit 161a and the second selected position specifying unit 161b as the time section indicated by the “time information (media time)” of the meta information. The range indicated by the “region information (moving image coordinates)” (see FIG. 10A) of the meta information that overlaps the time interval with the second playback time specified in (1) is the first selected position specifying means 161a. It is good also as searching for the object which overlaps with the rectangular area specified by the 1st selection position specified by 2nd, and the 2nd selection position specified by the 2nd selection position specification means 161b. As a result, the object existing within the drag time is selected in the rectangular area on the screen specified by the drag operation by the user. In this case, even three or more objects can be selected.

It should be noted that whether or not three or more objects can be selected as described above, or only two objects specified by the first selection position specifying unit 161a and the second selection position specifying unit 161b can be selected. It doesn't have to be either.
For example, the operation may be switched to any operation depending on whether or not a specific key (for example, a “shift” key) is pressed on a keyboard or the like (not shown).

Here, the group object specifying unit 161 specifies a plurality of objects as one group by the drag operation of the pointer (mouse cursor). However, it is not always necessary to specify by the drag operation.
For example, the group object specifying unit 161 selects one object with one click operation in a state where a specific key (for example, “shift” key) is pressed on a keyboard or the like (not shown). When the object is selected by the double click operation, the objects selected so far may be specified as a group.

  As described above, by configuring the video playback device with link function 1B, the video playback device with link function 1B has one or more objects only when the user selects an object with a link with a pointer (mouse cursor). Information related to can be presented on the screen.

[Operation of video playback device with link function]
Next, with reference to FIG. 9 (refer to FIG. 8 as appropriate), the operation of the moving image player with link function 1B according to the second embodiment of the present invention will be described. Here, the operation of selecting a plurality of objects and presenting related information will be described. However, the operation of selecting one object is the same as the operation described in FIG.

First, in the moving image playback device with link function 1B, when the user instructs playback of the moving image content C via an input unit (not shown), the link stored in the storage unit 12 by the meta information extraction unit 13 is provided. from information metadata _{L B,} it extracts the individual meta information (object information) (step S10).

Then, the moving image reproducing device with link function 1B starts reproducing the moving image data M stored in the storage unit 12 by the moving image reproducing unit 14, and the screen display unit 190 of the display control unit 19 performs the screen display of the display device D. The moving image data M is displayed on the top (step S11).
At this time, the moving image reproducing apparatus with link function 1B sequentially inputs a signal of the position input device P (mouse or the like) operated by the user by the pointer position input means 15, and analyzes the position information and the operation information. In the moving image playback apparatus with link function 1B, the pointer position determination means 18 detects that the pointer has entered the area of the object to which the related information is linked while the pointer is moving, and the pointer enters the area. The pointer shape is changed to a predetermined shape indicating that the related information is linked.

  Then, at the stage (Yes in step S12) that the user has started the selection on the screen (drag operation start; mouse button pressed, etc.) from the position input device P, the video playback device with link function 1B The position information input from the pointer position input means 15 is specified as the first selection position by the first selection position specifying means 161a, and the media time (first playback time) at which the position is selected is specified (step S13). ).

  Furthermore, at the stage (Yes in step S14) that the user has received from the position input device P a signal indicating that the user has finished the selection on the screen (end of the drag operation; release of the mouse button, etc.), the video playback device with link function 1B The position information input from the pointer position input means 15 is specified as the second selection position by the second selection position specifying means 161b, and the media time (second playback time) at which the position is selected is specified (step S15). ).

  Then, the link function-equipped video reproduction device 1B uses the group object search means 161c to specify the first selection position and the first reproduction time specified in step S13, and the second selection position and the second reproduction time specified in step S15. Based on the above, the meta information extracted in step S10 is searched for objects at a plurality of positions selected by the user (step S16).

  That is, the group object searching means 161c includes the first reproduction time in the time section indicated by “time information (media time)” (see FIG. 10A) of the meta information in the meta information extracted in step S10. In addition, an object (object identification information) included in a range where the first selection position is indicated by “region information (moving image coordinates)” (see FIG. 10A) of the meta information is searched.

  Further, the group object search means 161c includes, in the meta information extracted in step S10, the second playback time included in the time section indicated by “time information (media time)” (see FIG. 10A) of the meta information. In addition, an object (object identification information) included in a range where the second selection position is indicated by “region information (moving image coordinates)” of meta information (see FIG. 10A) is searched.

  When the plurality of objects (group objects) searched in step S16 are linked to related information (Yes in step S17), the moving image playback device with link function 1B performs step S16 by the link destination information extraction unit 162B. The link destination information (URL) corresponding to the plurality of objects (group objects) searched for in (1) is output to the related information presentation means 17. Then, the link function-equipped video reproduction device 1B acquires the related information specified by the link destination information (URL) by the related information presenting means 17 via the communication means 10 and the screen display means 190 of the display control means 19. Thus, the related information is presented on the screen of the display device D (step S18).

  Then, the video playback device with link function 1B ends the operation when the video playback by the video playback means 14 is finished (Yes in step S19), and continues the video playback (No in step S19). Returning to S12, the operation is continued.

If the pointer position is not selected in steps S12 and S14 (No in steps S12 and S14), or if there is no group object linked to related information in step S17 (No in step S17), the link function The attached video player 1B proceeds to step S19.
Here, in step S16, two objects specified respectively by the first selection position and the first reproduction time and the second selection position and the second reproduction time are searched. A plurality of objects existing in an area specified by the first selection position and the second selection position may be searched in the time interval between the time and the second reproduction time.

[Screen example of video playback device with link function]
Next, referring to FIG. 11 (refer to FIG. 8 as appropriate), a screen example of the moving image player with link function 1B according to the second embodiment of the present invention will be briefly described.

  As shown in FIG. 11A, in the moving image reproducing apparatus with link function 1B, the moving image reproducing unit 14 reproduces the moving image data M on the display screen G, and the pointer P1 is the first one. In a state where the object exists in the area A1 of the linked object O1, the drag operation is started by pressing the mouse button or the like, the pointer P1 is moved to the area A2 of the second linked object O2, and the drag operation is performed by releasing the mouse button or the like. Is finished.

  Then, the link function-equipped video reproduction device 1B uses the link destination information specifying unit 16B to extract (specify) the link destinations of the related information of the group from the meta information with the linked objects O1 and O2 as one group, and the related information. As shown in FIG. 11B, the information presenting means 17 displays a screen W of related information related to the group (here, objects O1, O2) on the display screen G.

  As a result, as shown in FIG. 11A, the moving image reproducing apparatus with link function 1B can reproduce a moving image on the entire display screen G of the display device D when the moving image data M is reproduced. As shown in FIG. 11B, information related to the plurality of objects is presented on the screen G at the timing when the user showed interest (selected by the user) with respect to the plurality of objects that showed interest in can do.

  As described above, the moving image player with link function 1 according to the first embodiment and the moving image player with link function 1B according to the second embodiment have been described, but the present invention is not limited to these configurations.

Here, the moving image reproducing apparatuses 1 and 1B with the link function have been described as an example in which a mouse or the like used by displaying a pointer pointed to by the user on the screen is used as the position input apparatus P.
However, when the position input device P is a touch panel or the like, it is not always necessary to display a pointer indicating the position on the screen.
That is, when a touch panel is used as the position input device P, the link function-equipped moving image reproduction device 1 (see FIG. 2) and the link function-equipped moving image reproduction device 1B (see FIG. 8) respectively have pointer position determination means 18 and pointer display. The unit 191 may be omitted from the configuration, and the moving image reproducing device with link function 1C illustrated in FIG. 12 and the moving image reproducing device with link function 1D illustrated in FIG. 13 may be configured. In addition, since the structure of the moving image reproducing apparatuses 1C and 1D with a link function is the same structure as a part of the moving image reproducing apparatuses 1 and 1B with a linked function already demonstrated, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  As a result, the link function-equipped video player 1C (see FIG. 12) and the link function-equipped video player 1D (see FIG. 13) can be configured as a small terminal that is operated by a touch panel on a screen such as a portable terminal. become.

  It should be noted that the moving image playback apparatus with link function 1 (FIG. 2), 1B (FIG. 8), 1C (FIG. 12), 1D (FIG. 13) can be configured by a general CPU, RAM, ROM, etc. Can be operated by a program (moving image reproduction program with a link function) that functions as each of the means described above.

S Movie distribution system 1 Movie playback device with link function 10 Communication unit 11 Content acquisition unit 12 Storage unit 13 Meta information extraction unit 14 Movie playback unit 15 Pointer position input unit 16 Link destination information specifying unit 160 Object specifying unit 160a Selection position specifying unit 160b Playback time subtracting means 160c Object searching means 161 Group object specifying means 161a First selected position specifying means 161b Second selected position specifying means 161c Group object searching means 162 Link destination information extracting means 17 Related information presenting means 18 Pointer position determining means 19 Display control means 190 Screen display means 191 Pointer display means

Claims (6)

In association with object identification information for identifying an object in the moving image data, time information indicating a time interval in which the object appears in the moving image data, and the object in the reproduction screen of the moving image data in the time interval Based on link information metadata including area information indicating the area of the object and link destination information indicating a link destination of the related information of the object as meta information, the video data is reproduced via the position input device when the video data is reproduced. A video playback device with a link function that presents related information of an object by selecting the object,
Video playback means for playing back the video data;
Selection position specification that specifies the position as a selection position when position information indicating a position on the screen and selection instruction information indicating that the position is selected are input as input signals via the position input device Means,
In each piece of meta information of the link information metadata, an object in which the playback time of the moving image data is included in the time interval indicated by the time information and the selected position is included in the range indicated by the area information. An object search means for searching;
Link destination information extraction means for extracting link destination information corresponding to the object searched by the object search means from the link information metadata;
Related information presenting means for acquiring and presenting the related information from the link destination indicated by the link destination information extracted by the link destination information extracting means;
A moving image reproducing apparatus with a link function. When selection start information indicating the start of selection is input as the input signal to the selection position specifying means, the position in the reproduction screen based on the position information is specified as the first selection position. When the selection end information indicating the end of selection is input together with the position information, a function of specifying the position in the reproduction screen based on the position information as the second selection position is added,
Reproduction time subtracting means for calculating a past reproduction time by subtracting a predetermined time from the reproduction time according to a distance between the first selection position and the second selection position;
When the second selection position is specified, the object search means searches for an object by setting the reproduction time as the past reproduction time and using the selection position as the first selection position. The moving image reproducing apparatus with a link function according to claim 1. Pointer display means for displaying a pointer indicating a position on the screen, and for moving the position of the pointer based on position information included in an input signal input from the position input device;
By determining whether or not the playback time of the moving image data is included in the time interval indicated by the time information and the position of the pointer is included in the range indicated by the area information, the position of the pointer is determined. Further comprising pointer position determination means for determining whether or not the related information exists on a linked object,
When the pointer position determination unit determines that the pointer position exists on the object to which the related information is linked, the pointer display unit displays the shape of the pointer and the related information is linked to the object. The moving image reproducing apparatus with a link function according to claim 1, wherein the pointer is changed to a predetermined shape of a pointer indicating that the function is performed. In the link information metadata, in-group object identification information including two object identification information in association with group identification information for identifying a group of two objects, and a link destination of related information of the group Second link destination information shown as meta information,
When selection start information indicating the start of selection is input together with the position information as the input signal, a position in the reproduction screen based on the position information is specified as a first selection position, and reproduction of the moving image data is performed First selection position specifying means for specifying the time as the first reproduction time;
At the stage when selection end information indicating the end of selection is input together with the position information as the input signal, a position in the reproduction screen based on the position information is specified as a second selection position, and reproduction of the moving image data is performed Second selection position specifying means for specifying the time as the second reproduction time;
In each piece of meta information of the link information metadata, the first reproduction time is included in a time section indicated by the time information, and the first selection position is included in a range indicated by the area information. 1st object identification information and the 2nd object identification which the said 2nd reproduction time is contained in the time interval shown by the said time information, and the said 2nd selection position is contained in the range shown by the said area | region information And a group object search means for searching for a group including information,
When the group is searched, the link destination information extraction unit extracts the second link destination information corresponding to the group from the link information metadata instead of the link destination information. The moving image reproducing apparatus with a link function according to claim 1. In the link information metadata, in-group object identification information including a plurality of object identification information and a link destination of the related information of the group are associated with group identification information for identifying a group of a plurality of objects. Second link destination information shown as meta information,
When selection start information indicating the start of selection is input together with the position information as the input signal, a position in the reproduction screen based on the position information is specified as a first selection position, and reproduction of the moving image data is performed First selection position specifying means for specifying the time as the first reproduction time;
At the stage when selection end information indicating the end of selection is input together with the position information as the input signal, a position in the reproduction screen based on the position information is specified as a second selection position, and reproduction of the moving image data is performed Second selection position specifying means for specifying the time as the second reproduction time;
In each meta information of the link information metadata, a time interval indicated by the time information overlaps with a time interval between the first reproduction time and the second reproduction time, and a range indicated by the region information is A group object search means for searching a plurality of object identification information overlapping with a rectangular area specified by the first selection position and the second selection position as a group;
When the group is searched, the link destination information extraction unit extracts the second link destination information corresponding to the group from the link information metadata instead of the link destination information. The moving image reproducing apparatus with a link function according to claim 1. In association with object identification information for identifying an object in the moving image data, time information indicating a time interval in which the object appears in the moving image data, and the object in the reproduction screen of the moving image data in the time interval Based on link information metadata including area information indicating the area of the object and link destination information indicating a link destination of the related information of the object as meta information, the video data is reproduced via the position input device when the video data is reproduced. When an object is selected, the computer is displayed in order to present related information of the object.
Moving image reproducing means for reproducing the moving image data;
Selection position specification that specifies the position as a selection position when position information indicating a position on the screen and selection instruction information indicating that the position is selected are input as input signals via the position input device means,
In each piece of meta information of the link information metadata, an object in which the playback time of the moving image data is included in the time interval indicated by the time information and the selected position is included in the range indicated by the area information. Object searching means for searching;
Link destination information extraction means for extracting link destination information corresponding to the object searched by the object search means from the link information metadata;
Related information presenting means for acquiring and presenting the related information from the link destination indicated by the link destination information extracted by the link destination information extracting means;
A video playback program with a link function, characterized in that

Images