JP2008283409A - Metadata related information generating device, metadata related information generating method, and metadata related information generating program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate metadata based upon a viewer's viewpoint for a video-recorded program content, and to reduce the actual damage by arbitrary metadata. <P>SOLUTION: The metadata related information generating device includes: a comment input image position extracting means 153 of extracting a comment input image position along a time zone including the time when an image that a viewer viewed when creasing a comment is displayed based upon comment generation time included in the metadata including the comment on a program that the viewer generated while viewing the program, the generation time of the comment, and program characteristic information wherein a time range of a motion image is related to the comment to generate an editing unit; a comment permission image position determining means 154 of determining the editing unit including the comment input image position as a comment permission image position; a display permission information generating means 155 of generating metadata related information for displaying the motion image of the program corresponding to the determined editing unit and the comment in the same timing; and a metadata related information transmitting means 156. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a metadata related information generating device, a metadata related information generating method, and a metadata related information generating program for generating metadata related information for associating program content of a broadcast program and its metadata.

  In recent years, on the network, viewers who watch program content such as broadcast programs write comments such as comments and opinions on the program content on a bulletin board on the network, and the viewers communicate with each other via the bulletin board. There is a great deal of effort going on. In many cases, comments (text data) such as impressions and opinions are independent of program content moving images and audio (video data, audio data). There is also a method for associating comments such as comments and opinions with moving images and sounds of program content. As an example, a service is known in which a viewer can view a moving image uploaded to a server and a comment on the moving image (see Non-Patent Document 1).

  A moving image that can be viewed with such a service is, for example, an individual who has recorded program content such as a broadcast program, edits (converts) the recorded moving image, uploads it to a service server, and comments Is associated with Therefore, for example, if the uploaded moving image is based on a broadcast program, those rights will be infringed unless appropriate permission regarding the copyright of the program or the portrait right of the program performer is obtained. turn into. In addition, there is a problem that a comment (so-called “unusual metadata”) that is intentionally altered by a third party for a purpose unintended by the creator of the moving image is attached to the video. Further, even if a moving image that is not a broadcast program is uploaded, if the content of the comment is different from the fact, self-contained metadata is a problem. In addition, when a third party intentionally collects and edits only the video that shows a specific object from the original video, and creates a personal comment that is displayed with the edited video In addition, since the created comment is arbitrarily used together with the video, the comment and the video are referred to as self-contained metadata. Broadcasters, etc. are engaged in work to monitor whether malicious comments such as arbitrary metadata are displayed together with moving images, and to apply for service providers to delete these comments and moving images. The burden on such operations is increasing.

On the other hand, a viewer who views program content such as a broadcast program desires to make metadata attached to the program content more attractive. Therefore, not only broadcasters such as broadcast stations as in the current situation but also viewers of the program content attach metadata to the program content such as broadcast programs, so that attractive metadata desired by the viewer can be obtained. It is possible to create. On the other hand, each broadcast station is not limited to a broadcaster as a creator of metadata attached to program content of a broadcast program, and it is desirable that an environment in which a third party can create metadata is desirable. Is expressed. In other words, a viewer who views the program content of a broadcast program is allowed to attach a comment on the program content as metadata under certain conditions. Here, the certain condition means that, for example, it is assumed that an access control technology that does not arbitrarily cut a moving image of recorded program content is used. It is known (see Patent Document 1). The technique disclosed in Patent Document 1 is transmitted in order to prevent a person who has received program content with metadata (an index within a program corresponding to each scene headline) from using the program content illegally. This is a technique designed to effectively operate the control signal multiplexed on the program content by the receiver even if the receiver is illegally modified or manufactured.
[Search April 9, 2007], Internet <URL: http://www.youtube.com>, (youtube is a registered trademark) JP 2003-152698 A (paragraphs 0080 to 0084, FIGS. 3 and 4)

  However, although the technique disclosed in Patent Document 1 satisfies certain conditions that can reduce the actual harm of unintentional metadata by preventing the recorded moving image of the program content from being arbitrarily cut, That is, it is assumed that metadata is attached on the broadcasting station side. Therefore, there is a problem that metadata based on the viewer's viewpoint cannot be created.

  The present invention has been made in view of the above problems, and generates metadata based on the viewer's viewpoint for recorded program content and reduces the actual harm of arbitrary metadata. The purpose is to provide technology that can be used.

  The present invention has been developed to achieve the above object. First, the metadata-related information generating device described in claim 1 is a program content having a predetermined program length of a viewer. And a comment on the program content included in the metadata distributed from the metadata distribution device and connected to a metadata distribution device that distributes the metadata of the program content including the comment created while viewing A metadata-related information generating device that generates metadata-related information for associating with program content, wherein metadata receiving means, comment input image position extracting means, comment permission image position determination means, display permission information generation means, And metadata related information transmitting means.

  According to this configuration, the metadata-related information generating device uses the metadata receiving unit to add the comment content data indicating the content of the comment, the comment generation time in the program scale, and the comment content data. Metadata including program specific information associated with a predetermined time range as one editing unit is received from the metadata distribution apparatus as metadata of the program content. Here, the comment generation time is, for example, the time when the viewer performs an operation of transmitting a comment. Then, the metadata related information generating device uses the comment input image position extracting unit to view an image that was viewed when the viewer created the comment based on the comment generation time included in the received metadata. The comment input image position is extracted along the time zone including the time when is displayed.

  Then, the metadata related information generating device selects an editing unit including a time zone extracted as the comment input image position based on the program specific information included in the received metadata by the comment permission image position determining means. It is determined as a comment permission image position. As a result, the determined comment-permitted image position does not indicate only the time at which the image that was viewed when the viewer created the comment is displayed, but has a time width in edit units. Then, the metadata related information generating device uses the display permission information generating means to make the moving image of the program content corresponding to the determined editing unit and the comment included in the metadata of the program content at the same timing. Information that is permitted to be displayed is generated as the metadata related information, and the metadata related information is transmitted to the metadata distribution device by the metadata related information transmitting means. Therefore, when a malicious comment is created for a scene that is pinpointed in the program content, it is a comment for any scene by displaying the comment with a time width of an editing unit and displaying it with a moving image. Has the effect of blurring.

  The metadata-related information generation method according to claim 2, wherein the metadata for distributing the program content metadata including a comment created while the viewer views the program content having a moving image having a predetermined program scale is provided. A metadata related information generation method for generating metadata related information by a metadata related information generating device for generating metadata related information for associating a comment on the program content included in metadata distributed from a distribution device with the program content Thus, a metadata receiving step, a comment input image position extraction step, a comment permission image position determination step, a display permission information generation step, and a metadata related information transmission step are included.

  According to such a procedure, the metadata related information generating device, in the metadata receiving step, the comment content data indicating the content of the comment, the comment generation time in the program scale, and the moving image in the comment content data. And metadata including program-specific information associated with a predetermined time range as one editing unit is received as metadata of the program content from the metadata distribution apparatus. Then, the metadata related information generating device was viewed when the viewer created the comment based on the comment generation time included in the received metadata in the comment input image position extracting step. The comment input image position is extracted along the time zone including the time when the image is displayed. The metadata-related information generating device includes an editing unit including a time zone extracted as the comment input image position based on the program specific information included in the received metadata in the comment permission image position determination step. Is determined as the comment-permitted image position. Then, the metadata related information generating apparatus, in the display permission information generating step, has the same timing as the moving image of the program content corresponding to the determined editing unit and the comment included in the metadata of the program content. And generating the metadata-related information as the metadata-related information, and transmitting the metadata-related information to the metadata distribution device in the metadata-related information transmission step.

  The metadata-related information generation program according to claim 3 is a metadata for distributing metadata of the program content including a comment created while a viewer views a program content having a moving image of a predetermined program scale. In order to generate metadata related information for associating a comment on the program content included in the metadata distributed from the distribution device with the program content, the computer includes a metadata receiving unit, a comment input image position extracting unit, a comment permission It is assumed to function as an image position determination unit, a display permission information generation unit, and a metadata related information transmission unit.

  According to such a configuration, the metadata-related information generation program causes the metadata receiving means to add comment content data indicating the content of the comment, comment generation time in the program scale, and the video content to the comment content data. Metadata including program specific information associated with a predetermined time range as one editing unit is received from the metadata distribution apparatus as metadata of the program content. The metadata-related information generation program uses the comment input image position extraction unit to view the image that the viewer was viewing when the comment was created based on the comment generation time included in the received metadata. Is extracted as the comment input image position along the time zone including the time when is displayed. The metadata-related information generation program generates an editing unit including a time zone extracted as the comment input image position based on the program specific information included in the received metadata by the comment permission image position determination unit. It is determined as a comment permission image position. Then, the metadata related information generation program causes the display permission information generation means to generate the moving image of the program content corresponding to the determined editing unit and the comment included in the metadata of the program content at the same timing. Information that is permitted to be displayed is generated as the metadata related information, and the metadata related information is transmitted to the metadata distribution device by the metadata related information transmitting means.

  According to the present invention, the metadata related information generating device generates metadata related information for associating a comment on a program content included in the metadata with the program content. For this reason, the comment associated with the moving image of the program content by the metadata related information becomes metadata based on the viewer's viewpoint with respect to the program content. In addition, metadata-related information allows comments created for program content to be displayed with a moving image with a time width in units of editing, so the displayed comment is for any scene of the moving image. It is blurred. As a result, it is possible to reduce the actual damage caused by arbitrary metadata.

  The best mode (hereinafter referred to as “embodiment”) for carrying out the metadata related information generating apparatus of the present invention will be described in detail below with reference to the drawings.

[Outline of metadata related information generation device]
FIG. 1 is a configuration diagram schematically showing a communication system including a metadata related information generating apparatus according to an embodiment of the present invention. The communication system 1 includes a user terminal 10, a blog server 20, a program content distribution server 30, a content providing device 40, and a metadata related information generating device 50.

<User terminal>
The user terminal 10 is operated by a viewer, and is configured to receive program content such as a broadcast program distributed via a network N such as the Internet and present the received program content to the viewer. Has been. This program content (hereinafter also simply referred to as a program) has a moving image of a predetermined program scale. Hereinafter, the moving image displayed on the user terminal 10 will be described separately for a real-time viewing time when the broadcast program is broadcast (synchronous) and a recording / playback viewing time after the broadcast program ends (asynchronous). The user terminal 10 includes, for example, a general personal computer (PC), a television receiver or a portable terminal that can be connected to a network. The user terminal 10 stores the received program content in the storage device 11. The storage device 11 may be configured by a memory, a hard disk, or the like built in the user terminal 10 or may be configured by an external storage device such as a hard disk recorder connected to the user terminal 10 via a home network or the like. Good. As an example, the communication system 1 includes two user terminals 10a and 10b. Moreover, when not distinguishing in particular, it describes with the user terminal 10. The number of user terminals 10 is not limited to this.

  Further, the user terminal 10 is configured such that a viewer can create a comment on the program while viewing the program content. For example, when the user terminal 10 is composed of a PC, these functions can be realized by installing in advance software for viewing program content, displaying comments, and creating comments. In this case, the user terminal 10 includes a user terminal display screen 200 as shown in FIG. FIG. 2 is a diagram schematically showing an example of a display screen of the user terminal shown in FIG. The user terminal display screen 200 has a content display area 201, a received comment display area 202, an input comment display area 203, and an operation button display area 204 in one screen.

  The content display area 201 is an area for displaying program content, and the received comment display area 202 is an area for displaying comments. The input comment display area 203 is an area for displaying a comment text (comment content data) input by a viewer operating the user terminal 10. The operation button display area 204 is an area for displaying various operation buttons for editing and transmitting the comment text input by the viewer.

In the present embodiment, program content and comments are displayed separately on the user terminal display screen 200, but the display method is not limited to this. For example, when the viewer views the program content in real time during the distribution time, the comment title received from the viewer during the distribution time and the viewer who created the comment are displayed in the received comment display area 202 for each comment. The viewer ID (viewer identification information) to be identified and the comment generation time indicating the time information at which the viewer created a comment in the program scale are displayed in one line, and the content of the comment is displayed in the content display area 201. The comment content data indicating may be displayed superimposed on the program content.
Further, in the received comment display area 202, an area in which a combination of a comment title, comment generation time, and viewer ID is displayed, and an area in which comment content data is displayed may be displayed separately. .

Returning to FIG. 1, the outline of the communication system will be continued.
<Blog server>
The blog server (metadata distribution apparatus) 20 is managed by an Internet service provider (ISP) that conducts a business of providing a place for communication between viewers using comments on program content on a network. The blog server 20 receives comments from the user terminal 10 via the network N, and accumulates the received comments in the storage device 21 for each program content. The blog server 20 transmits the accumulated comments to the user terminal 10 in response to a request from the user terminal 10, and also includes program content metadata (hereinafter referred to as program metadata) including comments received during program content distribution. To the user terminals 10a and 10b.

  In this embodiment, the ISP performs a business for providing a place for communication between viewers, and also performs a business for distributing program content provided from the broadcasting station to the viewers on consignment of the broadcasting station. The blog server 20 is connected to the program content distribution server 30 via, for example, an ISP internal LAN (Local Area Network).

<Program content distribution server>
The program content distribution server 30 stores the program content acquired in advance from the content providing device 40 of the broadcasting station in the storage device 31. The program content distribution server 30 distributes the program content stored in the storage device 31 to each user terminal 10a, 10b via the network N. The storage devices 21 and 31 are configured by a general hard disk or the like.

<Content providing device>
The content providing device 40 is managed by a broadcasting station, and transmits the program content stored in the storage device 41 to the program content distribution server 30 via the network N. The storage device 41 is composed of a general hard disk or the like. Further, the content providing device 40 encrypts the program content by a known method and transmits it to the program content distribution server 30. The program content distribution server 30 decrypts the encrypted program content and then stores it in the storage device 31. accumulate.

<Metadata related information generation device>
The metadata related information generation device 50 is communicably connected to the blog server (metadata distribution device) 20, and associates a comment on the program content included in the program metadata distributed from the blog server 20 with the program content. Data related information is generated. Further, the metadata related information generation device 50 accumulates comments included in the program metadata distributed from the blog server 20 in the storage device 51. The accumulated comments are reflected in the program making at the broadcasting station. The storage device 51 is configured by a general hard disk or the like.

<Overall operation of communication system>
In the communication system 1 configured as described above, first, the user terminal 10 starts software that can display a user terminal display screen 200 as shown in FIG. After completing the user authentication process with the server 20, the user terminal display screen 200 is displayed. Then, the program content distribution server 30 distributes the program content to the user terminal 10 via the network N. For example, a viewer who operates the user terminal 10a creates a comment while viewing the program content in real time during distribution of the program content, and operates an operation button for transmitting the created comment. Then, the user terminal 10a transmits metadata including comments to the blog server 20 via the network N along with the time at that time (S1). The blog server 20 transmits the metadata received from the user terminal 10a to the metadata related information generating device 50 via the network N (S2). The blog server 20 transmits the metadata received from the user terminal 10a to the user terminal 10a via the network N (S2a), and further transmits to the user terminal 10b (S2b). Thereby, the viewer who operates the user terminal 10a can view the comment created by himself / herself while viewing the program content. In addition, a viewer who operates the user terminal 10b can view a comment created by another person as it is during distribution of the program content while viewing the program content. In addition, during the distribution of program content, each viewer can freely create impressions and opinions as comments and convey them to other viewers, or empathize by viewing the comments of other viewers. As a result, the communication system 1 can achieve real-time communication between viewers via the program content.

  Further, following S2, the metadata-related information generation device 50 generates metadata-related information that associates the comment included in the metadata received from the blog server 20 with the program content, and uses the generated metadata-related information. It transmits to the blog server 20 via the network N (S3). Hereinafter, the operations of S2 and S3 will be described in detail in comparison with a trackback of a conventionally known blog (Web log) system.

<Trackback in the blog system (comparative example)>
FIG. 3 is an explanatory diagram of trackback in a conventional blog system. The blog system 2 shown in FIG. 3 includes two blog servers 22 (22a, 22b) connected to one user terminal 10 via a network N. The blog server 22a has a web page Pa owned by a first user (hereinafter referred to as user a), and the blog server 22b has a web page Pb owned by a second user (hereinafter referred to as user b). Is assumed to exist. For example, the user a operates the user terminal 10 and refers to the web page Pb (S11). When the user a describes a comment for the referenced web page Pb in his / her web page Pa, the user a updates the web page Pa and uploads it to the blog server 22a, and information described as a trackback URL in the web page Pb. 301 is notified to the blog server 22a (S12). Then, the blog server 22a performs trackback ping to the blog server 22b based on the trackback URL information 301 (S13). That is, the blog server 22b is notified of the URL, title, and content summary of the web page Pa that is the trackback source. Specifically, the blog server 22a adds information 302 indicating that the web page Pb can be referred to as a trackback destination of the web page Pa to the web page Pa.

  In addition, the blog server 22b adds information 303 indicating the trackback source web page Pa as a page referring to the web page Pb to the web page Pb. Thereby, for example, when the user a operates the user terminal 10 and refers to the web page Pa (S14), the information 302 added to the web page Pa can be viewed. The user a can browse the web page Pb by selecting the information 302. Similarly, when the user b refers to the web page Pb (S15), the information 303 added to the web page Pb can be viewed. By selecting this information 303, the user b can browse a web page of a person who uses his / her web page Pb as a trackback destination. The trackback is not limited to the web page, but may be related to an article, a line or paragraph in the article, and the number of user terminals 10 and the number of blog servers 22 are arbitrary.

<Trackback in communication systems>
FIG. 4 is an explanatory diagram of trackback in the communication system shown in FIG. First, the user terminal 10 transmits metadata including a comment to the blog server 20 via the network N (S21: comment transmission). Here, the metadata to be transmitted includes, as program metadata M, comment content data indicating the content of the comment, comment generation time in the program scale, and a viewer ID (viewer that identifies the viewer who created the comment) Identification information) and target program information. The target program information includes program-specific information indicating a program ID (program identification information) for specifying program content, and program-specific information that associates a predetermined time range of a moving image with comment content data as one editing unit. .

  For example, only one editing unit may exist with the same length as the program scale, or only one editing unit may exist at a time corresponding to a predetermined corner in the program scale. Further, a plurality of editing units having the same length may be present so as to fill the program scale, or a plurality of editing units having different lengths may be present so as to fill the program scale.

The target program information can include information such as a program title (program name), a genre, a broadcast date, a channel copyright right, in addition to a program ID (program specific information) and an editing unit (program specific information).
The comment generation time is, for example, a time when the viewer performs an operation of transmitting a comment. During real-time viewing, the comment generation time is information that associates a predetermined frame of the program content C distributed from the program content distribution server 30 with the comment.

  In the present embodiment, when the viewer records and views, the program metadata created on the user terminal 10 includes a “timeline designated time” indicating the display time range of the moving image designated by the viewer who created the comment. Is further included. However, the time specified by this timeline is limited to be shorter than the editing unit predetermined for the program content C on the broadcast station side. That is, the editing unit includes a specified time by the timeline.

  The blog server 20 transmits the metadata received from the user terminal 10 to the metadata related information generating device 50 via the network N (S22). With this function, the blog server 20 can notify the broadcast station that a comment (metadata) has been given by the viewer to the program content for which the broadcast station is copyrighted. Therefore, this operation is called “trackbackping” as in the conventional blog system 2 (see FIG. 3).

  Subsequent to S22, the metadata related information generating device 50 generates metadata related information, and transmits the generated metadata related information to the blog server 20 (S23). This operation performed by the metadata related information generating apparatus 50 does not exist in the conventional blog system 2 (see FIG. 3). However, since this operation corresponds to correcting the display of “trackback destination” in the conventional blog system 2 (see FIG. 3), it is called “trackback correction notification”. Here, the trackback destination is a web page (trackback destination) referred to in the conventional blog system 2, but in the present embodiment, it means the program itself divided within a predetermined time range. .

  When viewing the recorded program content, the viewer may request to refer to the comments of others posted on the program content. In this case, following S23, the user terminal 10 requests another viewer's comment from the blog server 20 in accordance with the operation of the viewer (S24: comment request). Then, the blog server 20 transmits to the user terminal 10 a comment whose display time is changed by associating the requested comment with the program content based on the metadata related information. The user terminal receives the comment whose display time has been changed (S25). In other words, the metadata-related information is displayed in a display method different from the comment displayed when viewing the program content in real time when the comment of another person referred to when viewing the recorded program content is viewed. To. Thus, a viewer who views the recorded program content can, for example, view other viewers' comments to view the program content from that viewpoint, or to view other recorded viewers of the recorded program content. , You can communicate your own comments. As a result, the communication system 1 can achieve communication between viewers at any time via the program content.

[Configuration of Metadata Related Information Generation Device]
FIG. 5 is a block diagram showing a configuration of the metadata related information generating apparatus shown in FIG.
As shown in FIG. 5, the metadata related information generating apparatus 50 includes an input unit 110, an output unit 120, a communication unit 130, a storage unit 140, and a control unit 150.

  The input unit 110 includes a predetermined input interface and the like, and inputs predetermined information and commands. The input unit 110 inputs various information via an input device K such as a mouse or a keyboard. The output unit 120 includes a predetermined output interface and the like, and outputs predetermined information to a display device D such as a liquid crystal display. The communication unit 130 includes a predetermined communication interface and the like, and transmits / receives predetermined information. The communication unit 130 inputs information received from the blog server 20 via the network N to the control unit 150 and transmits information acquired from the control unit 150 to the blog server 20 via the network N. The storage unit 140 stores, for example, a RAM (Random Access Memory) that is used for arithmetic processing by the control unit 150 and stores information acquired through the input unit 110 and the communication unit 130, a predetermined program, and the like. ROM (Read Only Memory).

  The control means 150 is composed of, for example, a CPU (Central Processing Unit) and, as shown in FIG. 5, a metadata reception means 151, a program specific information extraction means 152, a comment input image position extraction means 153, and a comment permission An image position determining unit 154, a display permission information generating unit 155, and a metadata related information transmitting unit 156 are provided.

  The metadata receiving unit 151 receives the metadata described with reference to FIG. 4 from the blog server 20 by the communication unit 130 as program metadata. That is, the metadata receiving unit 151 receives metadata including target program information, comment content data, a viewer ID, and a comment generation time. Note that the program metadata may include a specified time on the timeline.

  An example of the structure of the program metadata is shown in FIG. The program metadata 600 is roughly divided into basic information 610, information about media 620, information about program production 630, and information 640 indicating in which editing unit the program is divided into scenes and managed. is doing. Here, the editing unit indicates a time range in which the comment content data in the program metadata is associated with the moving image within the program scale. In other words, the editing unit has a start time and an end time designated for a predetermined time zone. In this embodiment, it is assumed that the editing unit is predetermined on the broadcast station side, for example, 2 minutes from the start of the program or 5 minutes from a predetermined time.

The basic information 610 is, for example, a program ID.
The media-related information 620 is information indicating the location (for example, address, device name, company name) where the program is stored.
Information relating to program production 630 is information indicating, for example, a program title, genre, broadcast date, broadcast time, channel, copyright right, and the like. The genre is information such as news, variety, drama, for example. Such information is prepared in advance on the broadcasting station side.

  Information 640 indicating what editing unit is used to divide a program into scenes is broadly divided into information 641 indicating what tool is used for dividing and information 642 indicating an actual scene. . Of these, information 642 indicating the actual scene is provided for each scene, and information 642a indicating the scene with the shot number “200” is information regarding the viewer who wrote the comment (such as the viewer ID) and actual information. Contains information (comment content data) indicating a comment. The same applies to information 642b indicating the scene with the shot number “201”, information 642c indicating the scene with the shot number “202”, and the like.

Returning to FIG. 5, the description of the configuration of the control means 150 will be continued.
The program specific information extracting unit 152 analyzes the metadata received by the metadata receiving unit 151 and extracts program specific information included in the target program information from the metadata. In the present embodiment, from the program specific information, a predetermined time range of a moving image can be associated with comment content data as one editing unit. Note that the program specific information may include caption data.

  The comment input image position extracting unit 153 includes a time at which an image viewed when the viewer creates a comment based on information included in the program metadata received by the metadata receiving unit 151 is displayed. The comment input image position is extracted along the time zone.

  Generally, when a viewer creates a comment while watching a program, the comment generation time is delayed from the display time of the corresponding moving image. Therefore, the comment input image position extraction unit 153 matches the word or phrase included in the comment with the word or phrase included in the caption data when, for example, caption data exists corresponding to the moving image of the program. Is detected, the time at which the image viewed when the viewer creates a comment is estimated. Therefore, the comment input image position extracting unit 153 includes a morpheme analyzing unit (not shown) corresponding to the case where the caption data is included as the program specific information. Here, the morpheme refers to the minimum character string that has no meaning if it is made finer than this, and the morpheme analysis is to analyze the sentence by breaking it down to the morpheme level. The comment input image position extraction unit 153 performs morphological analysis of the caption data by the morpheme analysis unit, and holds the caption data as a pair of a word in the text of the caption data and a part of speech specified in advance. Then, the comment input image position extracting unit 153 uses the retained part of speech as a key, and the comment content including the part of speech matching the key in the program metadata received within a certain time from the time stamp of the caption data. The time estimated that the data refers to the moving image of the program is extracted, and the extracted time is corrected to the time described in the time stamp of the caption data. The comment input image position does not need to correspond exactly to one frame of the moving image.

The comment permission image position determination unit 154 includes the time zone extracted as the comment input image position by the comment input image position extraction unit 153 based on the program specific information included in the metadata received by the metadata reception unit 151. The editing unit is determined as the comment permitted image position.
The display permission information generation unit 155 permits the moving image of the program content corresponding to the editing unit determined by the comment permission image position determination unit 154 and the comment included in the program metadata to be displayed at the same timing. Information to be generated as metadata related information.
The metadata related information transmitting unit 156 transmits the metadata related information generated by the display permission information generating unit 155 to the blog server 20 through the communication unit 130.

[Operation of Metadata Related Information Generation Device]
The operation of the metadata related information generating apparatus 50 shown in FIG. 5 will be described with reference to FIG. 7 (see FIGS. 1 and 5 as appropriate). FIG. 7 is a flowchart showing the operation of the metadata related information generating apparatus shown in FIG. First, the metadata related information generation device 50 receives a trackback notification (step S31). That is, the metadata related information generating apparatus 50 receives program metadata from the blog server 20 by the metadata receiving unit 151. Then, the metadata related information generating device 50 stores the comment included in the received program metadata in the storage device 11 (step S32). Further, the metadata related information generating apparatus 50 extracts program specific information included in the target program information from the received program metadata by the program specific information extracting unit 152 (step S33).

  In the metadata related information generating device 50, the comment input image position extracting unit 153 displays the image that the viewer was viewing when the comment was created based on the comment generation time included in the program metadata. The position of the comment input image is extracted along the time zone including the time (step S34). Then, the metadata-related information generating apparatus 50 determines the editing unit including the time zone extracted as the comment input image position as the comment permission image position based on the program specific information by the comment permission image position determination unit 154 ( Step S35). In the metadata-related information generating apparatus 50, the display permission information generating unit 155 displays the moving image of the program content corresponding to the determined editing unit and the comment included in the program metadata at the same timing. Is generated as metadata related information (step S36). Then, the metadata related information generation device 50 transmits the trackback correction to the blog server 20 via the network N (step S37). That is, the metadata related information generation device 50 transmits the generated metadata related information to the blog server 20 by the metadata related information transmission unit 156.

[Example of user terminal display screen during real-time viewing]
FIG. 8 is a diagram showing the user terminal display screen in time series during real-time viewing. In this example, it is assumed that the program content is a news program and scenes 1 to 3 are editing units of this program. First, as shown in FIG. 8A, in scene 1, an image of one person 810 is displayed in the content display area of the user terminal display screen. Three comments 811, 812, and 813 are displayed in the received comment display area of the user terminal display screen. This means that any viewer (or a plurality of possibilities) wrote the comments 811, 812, 813 while viewing the image of the person 810. Since comments (program metadata) are transmitted to the user terminals 10 from the blog server 20 all at once, each viewer can view the program while chatting. At this time, the comments 811, 812, and 813 shown in the received comment display area include an area for displaying a combination of a comment title, a comment generation time, and a viewer ID, and an area for displaying comment content data. Of course, may be displayed separately.

  Next, as shown in FIG. 8B, in scene 2, images of two persons 810 and 820 are displayed in the content display area of the user terminal display screen. Also, no comment is displayed in the received comment display area of the user terminal display screen. This means that no viewer wrote any comment when the images of the two persons 810 and 820 are displayed.

  Next, as shown in FIG. 8C, in the scene 3, as in the scene 1, an image of one person 810 is displayed in the content display area of the user terminal display screen. Three new comments 814, 815, and 816 are displayed in the received comment display area of the user terminal display screen. This means that any viewer (or a plurality of possibilities) wrote the comments 814, 815, and 816 while viewing the image of the person 810.

  During such real-time viewing, viewers do not have time to create comments slowly, so the displayed comments are, for example, words or phrases that omit the subject or predicate or express favor for the performer. There is a tendency to. Therefore, for example, a viewer who is interested only in the person 810 may write a comment only when the image of the person 810 is displayed, as shown in FIGS.

[Example of user terminal display screen during recording viewing]
FIG. 9 is a diagram showing the display screen of the user terminal during recording / playback viewing in time series. This example is based on the same program content and editing unit as described with reference to FIG. The example of the user terminal display screen shown in FIG. 9 is that the user terminal display screen shown in FIG. 8 shows that all comments included in the editing unit are displayed in common in all scenes included in the editing unit. This is different from the example. That is, when viewing the program content recorded by the viewer, comments received from other viewers continue to be displayed for an editing unit indicating a predetermined time range. According to this, the viewer can understand that the comments 811 to 816 are related to the scenes 1 to 3 of the news program, but if the subject or predicate is omitted in the comments 811 to 816, , It is difficult to specify which of the moving images of scenes 1 to 3 is each of the comments 811 to 816. In other words, when a malicious comment is created for a scene that is pinpointed in the program content, it is a comment for which scene by displaying the comment together with a moving image with an editing unit time width. Has the effect of blurring.

  In general, program content having moving images has a stronger impact on people than other media. When a comment (text) is displayed together with a pinpoint moving image, a viewer who views the moving image is greatly affected by the simultaneously displayed comment. For example, if the content of a comment is completely different from the content conveyed in the program content, the viewer cannot correctly recognize the content that the program content creator intends to convey and receives an impression biased toward the content of the comment. It becomes easy. However, when the metadata related information generated by the metadata related information generating apparatus 50 of the present embodiment is used, comments are associated with each editing unit as shown in FIG. For example, the impression that the viewer receives in the video that is viewed and the content of the comment are the same in the range from the beginning to the middle of the editing unit, for example, and are different in the range from the middle to the end of the editing unit. In some cases, the viewer can understand that the comment was created maliciously. This makes it difficult to make malicious comments. Therefore, even if a malicious comment is displayed, the damage caused by information operation that gives a bad impression to the viewer by ignoring the context before and after is reduced.

  At the time of such recording / playback viewing, the viewer has time to make comments slowly, so the comment displayed may be accompanied by a specific reason, for example, when writing a sentence expressing favor for the performer. You can add related topics. Therefore, since program metadata reflecting the viewer's sensibility can be created, there is a high possibility that information attractive to the viewer is added as compared to metadata created by a broadcaster. Further, for example, when recording / playback viewing, the user's own comment created during real-time viewing can be updated.

  According to the present embodiment, the metadata related information generating device 50 generates metadata related information that associates comments included in program metadata with program content. For this reason, the comment associated with the moving image of the program content by the metadata related information becomes metadata based on the viewer's viewpoint with respect to the program content. In addition, metadata-related information allows comments created for program content to be displayed with a moving image with a time width in units of editing, so the displayed comment is for any scene of the moving image. It is blurred. As a result, it is possible to reduce the actual damage caused by arbitrary metadata.

  Further, the metadata related information generating apparatus 50 determines an editing unit longer than the time on the designated timeline as metadata related information. Therefore, even when a viewer creates a comment while viewing the recorded program content, the comment is associated with metadata-related information, so that the program content is based on the viewer's viewpoint. As well as being metadata, it is blurred which scene of the moving image it is for. As a result, it is possible to reduce the actual damage caused by arbitrary metadata.

  Although the present embodiment has been described above, the present invention is not limited to this, and can be implemented in various ways without changing the gist thereof. For example, the metadata related information generating apparatus 50 can be realized by operating a general computer by a program (metadata related information generating program) that functions as the control unit 150 described above. This program can be distributed via a communication line, or can be written on a recording medium such as a CD-ROM for distribution. A computer in which this program is installed can achieve the same effect as the metadata-related information generating device 50 when the CPU expands the program stored in the ROM or the like in the RAM.

  In the present embodiment, the editing unit has been described in association with predetermined time information. However, the editing unit may be associated with time information determined each time according to a predetermined rule included in the metadata. In this case, for example, when the program content includes a live video such as a baseball game, the metadata-related information generating device, in accordance with a predetermined rule, from the input live video, a player at a specific defensive position (for example, It is further provided with a configuration for extracting a cut point of a video based on a predetermined feature amount indicating an operation of a pitcher or catcher, and an editing unit can be set each time based on the extracted cut point. According to this, it is possible to reduce the workload of manually setting the editing unit in the metadata in advance. A known technique can be used as a technique for extracting a cut point of a video from a live video such as a baseball game by a predetermined feature amount.

  Further, in the present embodiment, it has been described that it is divided into real-time viewing indicating the broadcast time (synchronous) of the broadcast program and recording / playback viewing indicating the end of the broadcast program (asynchronous). This does not only indicate recording / playback viewing of a program recorded in the storage device, but also includes a case of viewing a program by server-type broadcasting or streaming broadcasting.

  In this embodiment, the display permission information generating unit 155 is provided to display the received comments in correspondence with the editing unit at the same timing as the moving image of the program content. There may be further provided means for generating information for prohibiting as metadata related information. In this case, the metadata-related information generating apparatus 50 sets the information specifying the program content for which the attachment of text or images is prohibited in advance as program-specific information at the broadcast station, so that the metadata-related information generating device 50 can set the editing unit and comment Since processing such as extraction of the input image position can be omitted, the processing load can be reduced. In addition, for example, information such as “prohibit writing comments and paintings superimposed on the content display area” may be set in advance on the broadcast station side. In this case, since it is possible to forcibly eliminate the display of malicious arbitrary metadata that is superimposed on the moving image of the program content, the metadata related information generation device 50 simplifies the processing and edits each program for each program. It is possible to automatically set to a predetermined editing unit without changing the setting.

Moreover, the above-described user terminal display screen is an example, and the present invention is not limited to this.
The user terminal 10 is configured to be able to set which of the received comment (metadata) is to be displayed, for example, a comment title, comment generation time, viewer ID, or comment content data. For example, during recording / playback viewing, only the comment selected by the viewer may be displayed in the received comment display area of the user terminal display screen. The user terminal 10 may be provided with, for example, a comment display mode and a non-display mode. In this case, the viewer can concentrate on viewing only the program content by selecting the non-display mode.
Further, in the present embodiment, the case where a person appears in the program content is illustrated, but when a person does not appear in the program content, for example, in the case of a program such as an animation, there is a problem such as copyright. There is an effect.

It is a block diagram which shows typically the communication system containing the metadata relevant-information production | generation apparatus which concerns on embodiment of this invention. It is a figure which shows typically an example of the display screen of the user terminal shown in FIG. It is explanatory drawing of the track back in the conventional blog system. It is explanatory drawing of the track back in the communication system shown in FIG. It is a block diagram which shows the structure of the metadata relevant-information production | generation apparatus shown in FIG. It is a figure which shows an example of the structure of program metadata. It is a flowchart which shows operation | movement of the metadata relevant-information production | generation apparatus shown in FIG. It is a figure which shows the display screen of a user terminal at the time series at the time of real-time viewing. It is a figure which shows the display screen of the user terminal at the time of video recording reproduction | regeneration viewing viewing in time series.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Communication system 10 (10a, 10b) User terminal 11 Storage apparatus 20 Blog server 30 Program content delivery server 40 Content provision apparatus 50 Metadata related information generation apparatus 110 Input means 120 Output means 130 Communication means 140 Storage means 150 Control means 151 Meta Data receiving means 152 Program specific information extracting means 153 Comment input image position extracting means 154 Comment permission image position determining means 155 Display permission information generating means 156 Metadata related information transmitting means K Input device D Output device N Network

Claims (3)

Communicatively connected to and distributed from the metadata distribution apparatus that distributes the metadata of the program content including comments created by the viewer watching the program content having a moving image of a predetermined program scale. A metadata-related information generating device for generating metadata-related information for associating a comment on the program content included in the metadata and the program content,
Meta including comment content data indicating the content of the comment, comment generation time in the program scale, and program specific information that associates the comment content data with a predetermined time range of the moving image as one editing unit. Metadata receiving means for receiving data from the metadata distribution apparatus as metadata of the program content;
Based on a comment generation time included in the received metadata, a comment input image position is determined along a time zone including a time when an image viewed when the viewer creates the comment is displayed. Comment input image position extracting means for extracting;
Comment-permitted image position determining means for determining, as a comment-permitted image position, an editing unit including a time zone extracted as the comment input image position based on program-specific information included in the received metadata;
Information that permits the moving image of the program content corresponding to the determined editing unit and the comment included in the metadata of the program content to be displayed at the same timing is generated as the metadata related information. Display permission information generating means;
A metadata related information generation device comprising: metadata related information transmission means for transmitting the metadata related information to the metadata distribution device. Comments on the program content included in the metadata distributed from the metadata distribution device that distributes the metadata of the program content including comments created by the viewer watching the program content having moving images of a predetermined program scale A metadata related information generating method for generating metadata related information by a metadata related information generating device for generating metadata related information for associating the program content with the program content,
A comment receiving data indicating the contents of the comment by the metadata receiving means, a comment generating time in the program scale, and a program that associates a predetermined time range of the moving image with the comment content data as one editing unit. A metadata reception step of receiving metadata including unique information from the metadata distribution apparatus as metadata of the program content;
Based on the comment generation time included in the received metadata by the comment input image position extraction means, in a time zone including the time when the image viewed when the viewer creates the comment is displayed. A comment input image position extracting step for extracting a comment input image position along
A comment-permitted image that determines, as a comment-permitted image position, an editing unit that includes a time zone extracted as the comment input image position based on program-specific information included in the received metadata by a comment-permitted image position determining unit A positioning step;
Information that permits the display permission information generating means to display the moving image of the program content corresponding to the determined editing unit and the comment included in the metadata of the program content at the same timing. A display permission information generation step to generate as metadata related information;
A metadata related information generating method comprising: a metadata related information transmitting step of transmitting the metadata related information to the metadata distribution device by a metadata related information transmitting means. Comments on the program content included in the metadata distributed from the metadata distribution device that distributes the metadata of the program content including comments created by the viewer watching the program content having moving images of a predetermined program scale In order to generate metadata-related information that associates the program content with the computer,
Meta including comment content data indicating the content of the comment, comment generation time in the program scale, and program specific information that associates the comment content data with a predetermined time range of the moving image as one editing unit. Metadata receiving means for receiving data from the metadata distribution device as metadata of the program content;
Based on a comment generation time included in the received metadata, as a comment input image position along a time zone including a time when an image viewed when the viewer creates the comment is displayed. Comment input image position extracting means to extract,
Comment-permitted image position determining means for determining, as a comment-permitted image position, an edit unit including a time zone extracted as the comment input image position based on program-specific information included in the received metadata;
Information that permits the moving image of the program content corresponding to the determined editing unit and the comment included in the metadata of the program content to be displayed at the same timing is generated as the metadata related information. Display permission information generating means,
Metadata-related information transmitting means for transmitting the metadata-related information to the metadata distribution device;
A metadata-related information generation program characterized by functioning as

Images