JP5919325B2 - Comment display device, comment distribution device, comment display system, comment display method, and program - Google Patents

Description

  The present invention relates to a comment display device, a comment distribution device, a comment display system, a comment display method, and a program that display a comment superimposed on moving image data.

  Currently, a video distribution service via the Internet is provided. In general, in such a video distribution service, a user designates video data stored in a video distribution server or non-storage type live broadcast video data using a content list on a web page, and the like. The designated moving image data can be directly distributed to a user terminal by a method such as download or streaming, and can be viewed.

  In addition to simply distributing video data, for example, by receiving comments posted on video data that other viewers are viewing, and distributing the comments together with the video data, There is also a video distribution service that can increase the enjoyment and simulate the interaction between video viewers.

  In video distribution services that allow viewers to post comments, in general, when a viewer posts a comment at a specific playback time in the video data being played, other viewers who view the same video data In the terminal device, a comment is displayed according to the reproduction time when the posting is made. According to such a function, the viewer can share consciousness and impression with other viewers in accordance with the progress of the moving image data (contents content). In addition, a large number of comments (so-called barrage) posted at a specific playback time of moving image data allows the viewer to get a sense of being excited with a plurality of viewers. This can further enhance the interest of viewing moving images.

In addition, there is a system that displays a comment posted by a user with respect to content of moving image data together with the moving image data.
For example, in a bulletin board related to a television program or the like having a different broadcast time in each region, even if the time for browsing the bulletin board is different, the writing to one scene of the television program is stored in association with the net time from the start of broadcasting. There is a system that displays previously written contents in accordance with a scene of a television program (see, for example, Patent Document 1). According to this system, the user can browse and enjoy the comment while watching the content without feeling the time lag of the broadcast time.

JP 2002-290949 A

  However, for example, in the case of moving image data that has just been uploaded to the moving image distribution server, the number of comments posted by viewers is small. Then, even if the viewer views the moving image data, the viewer cannot get excited because there are few posted comments, and cannot enjoy the fun of the comment posting function. That is, in the conventional distribution system, even when the video data has the same content, viewers can be obtained when viewing video data with a small number of posted comments and when viewing video data with rich posted comments. In some cases, a difference occurs in the degree of interest. In addition, if the number of comments posted for a given video data is small, viewers who have been watching the video data will not be tempted to stop watching or post new comments. There was also a problem that the number of comments was more difficult to rise due to circumstances such as.

  The present invention has been made in view of the above problems, and even a video with a small number of comments can be enjoyed by enlarging a viewer who views the video, a comment distribution device, and a comment It is an object to provide a display system, a comment display method, and a program.

According to a first aspect, a comment generating unit that newly generates a comment for moving image data based on a comment posted by a viewer for the moving image data or other moving image data different from the moving image data; and the moving image data A comment display control unit that displays a comment posted by a viewer and a comment generated by the comment generation unit on a terminal device that reproduces the moving image data, and the comment generation unit includes: Among comments posted by viewers on other video data, at least one of the same comments, similar comments, and co-occurring comments as comments posted by viewers on the video data One is a comment display device that newly generates a comment for the moving image data .

  In addition, the second aspect includes a related video extraction unit that extracts other video data having at least a part of the metadata common to the video data, and the comment generation unit includes a comment on the video data as the related data It is a comment display apparatus as described in the 1st aspect produced | generated from the comment posted by the viewer with respect to the said other moving image data which the moving image extraction part extracted.

  In addition, according to a third aspect, the metadata is one or a plurality of video tags, and the related video extractor includes other video data in which the number of video tags in common with the video data is a predetermined number or more. It is the comment display apparatus as described in the 2nd aspect which extracts.

  In addition, according to the fourth aspect, during the reproduction of the moving image data or the other moving image data, the reproduction of the moving image data is performed based on the representative value of the reproduction time in which the comment posted by the viewer is displayed. A playback time specifying unit that specifies a playback time in which a comment generated by the comment generating unit is displayed, and the comment display control unit specifies the comment generated by the comment generating unit and the playback time specifying unit The comment display device according to any one of the first to third aspects, wherein the comment reproduction time is associated with each other and distributed to the terminal device that reproduces the moving image data.

Moreover, a 5th aspect is a comment display system provided with the moving image data distribution apparatus which distributes moving image data, and the comment display apparatus as described in any one of the 1st-4th aspect.

Further, the sixth aspect includes a comment generation unit that newly generates a comment on the video data based on a comment posted by the viewer on the video data or other video data different from the video data, A comment distribution unit that distributes a comment posted by a viewer to the video data and a comment generated by the comment generation unit to a terminal device that reproduces the video data, and the comment generation unit includes: Among the comments posted by viewers on the other video data, at least any of the same comments, similar comments, and co-occurring comments as comments posted by the viewer on the video data This is a comment distribution device that newly generates one as a comment for the moving image data .

Further, the seventh aspect is a comment generating step for newly generating a comment on the moving image data based on a comment posted by a viewer on the moving image data or other moving image data different from the moving image data, and comments posted from viewers on the moving data, and the generated comment, have a, a comment display step of displaying on the terminal device for reproducing the moving image data, in the comment generating step, the other Among the comments posted by the viewer on the video data, at least one of the same comments, similar comments, and co-occurring comments as the comments posted by the viewer on the video data This is a comment display method for newly generating a comment on the moving image data .

Further, according to an eighth aspect, the computer generates a comment for the moving image data based on a comment posted by the viewer on the moving image data or other moving image data different from the moving image data, A comment posted by a viewer for the moving image data and a comment generated by the comment generating unit are made to function as a comment display unit that displays on a terminal device that reproduces the moving image data; Of the comments posted by the viewer on the other video data, at least the same comments, similar comments and co-occurring comments as the comments posted by the viewer on the video data This is a program for newly generating any one as a comment for the moving image data .

  According to the comment display device, the comment distribution device, the comment display system, the comment display method, and the program described above, even a moving image with a small number of comments can be generated and enjoyed by viewers who view the moving image.

It is a schematic block diagram which shows the structure of the comment display system which concerns on 1st Embodiment. It is a schematic block diagram which shows the structure of the comment delivery server which concerns on 1st Embodiment. It is a schematic block diagram which shows the structure of the terminal device which concerns on 1st Embodiment. It is a flowchart which shows the production | generation method of the pseudo comment by the terminal device which concerns on 1st Embodiment. It is a figure explaining the effect by the terminal device concerning a 1st embodiment. It is a schematic block diagram which shows the structure of the terminal device which concerns on 2nd Embodiment. It is a flowchart which shows the production | generation method of the pseudo comment by the terminal device which concerns on 2nd Embodiment. It is a figure explaining the effect by the terminal device concerning a 2nd embodiment. It is a schematic block diagram which shows the structure of the terminal device which concerns on 3rd Embodiment. It is a figure explaining the processing content of the terminal device which concerns on 3rd Embodiment. It is a figure explaining the effect by the terminal device concerning a 3rd embodiment. It is a schematic block diagram which shows the structure of the computer which concerns on at least 1 embodiment.

<First Embodiment>
Hereinafter, the comment display system according to the first embodiment will be described in detail.
The comment display system described below recognizes that a viewer who views a video data through a terminal device recognizes a number of pseudo comments (described later) displayed during playback of the video data. It is a system that provides a “comment raising mode” that can be enjoyed as a production.
FIG. 1 is a schematic block diagram illustrating a configuration of a comment display system 1 according to the first embodiment.

  The comment display system 1 includes a web server 100, a moving image distribution server 200 (moving image data distribution device), a comment distribution server 300, and a plurality of terminal devices 500 (comment display devices). The moving image distribution server 200, the comment distribution server 300, and the plurality of terminal devices 500 are connected via a network N, respectively.

  The web server 100 provides a web page for providing moving image data to a user of the terminal device 500 (viewer of moving image data). The web server 100 stores metadata of each moving image data. In the present embodiment, the metadata of moving image data is a character string (moving image tag) indicating the classification of the moving image data. The web page provided by the web server 100 includes a URL (Uniform Resource Locater) for acquiring moving image data, a URL for acquiring a comment for the moving image data, a URL for acquiring a comment input candidate, Contains metadata for video data.

  The moving image distribution server 200 stores a plurality of moving image data. The moving image distribution server 200 distributes moving image data to the requesting terminal device 500 in response to a distribution request from the terminal device 500. This distribution is performed by streaming distribution, for example.

The comment distribution server 300 receives, from the terminal device 500, comments posted by the viewer on the moving image data distributed by the moving image distribution server 200 and reproduced by the terminal device 500. Hereinafter, a comment actually posted from the viewer to the moving image data is referred to as a “regular comment”.
The comment distribution server 300 receives the received regular comment, the video data ID, the time when the comment was posted, the playback time for displaying the comment, the user ID of the viewer who posted the comment, and the comment display method Store it in association with. The comment distribution server 300 sends a regular comment (regular comment posted in the past from an unspecified number of viewers) stored in association with the ID of the video data to each terminal device 500 that reproduces the video data. To deliver.

The terminal device 500 displays a web page provided from the web server 100. Thereby, the terminal device 500 receives the moving image data (main moving image data) designated by the current viewer (one of the viewers who currently view the moving image data) from the moving image distribution server 200 and reproduces it. Further, the terminal device 500 is a comment distributed from the comment distribution server 300 in a superimposed manner on the main video data being reproduced, and a viewer (unspecified different from the current viewer) for the main video data. Receive and display regular comments posted in the past by many viewers). The terminal device 500 is realized by an information processing device such as a television, a PC, a mobile terminal, or a game machine.
In addition, the terminal device 500 according to the present embodiment makes a comment on the moving image data (hereinafter referred to as “main moving image data”) that is actually reproduced by the designation of the user of the terminal device 500 to the moving image data. And a new generation function based on regular comments posted by other viewers. Hereinafter, apart from comments regularly posted by the viewer, a comment that the terminal device 500 itself automatically generates for the moving image data is referred to as a “pseudo comment”. Then, as will be described later, the terminal device 500 according to the present embodiment displays a pseudo comment automatically generated by the terminal device 500 itself on the moving image data so as to be superimposed on the moving image data being reproduced.

FIG. 2A is a schematic block diagram illustrating the configuration of the comment delivery server 300 according to the first embodiment.
The comment distribution server 300 includes a communication unit 301, a regular comment recording unit 302, and a comment storage unit 303.

The communication unit 301 communicates with the web server 100, the moving image distribution server 200, and the terminal device 500 via the network N.
Specifically, the communication unit 301 receives, from the terminal device 500, a regular comment posted by the viewer for the moving image data distributed to the terminal device 500 by the moving image distribution server 200.
In addition, the communication unit 301 refers to the comment storage unit 303 and distributes regular comments posted in the past by other viewers to the video data being played back on the terminal device 500 toward the terminal device 500. To do. The distributed regular comment is displayed on the terminal device 500 together with the moving image data being reproduced.

  The regular comment recording unit 302 posts the regular comment received from the terminal device 500 (the comment posted by the viewer with respect to the video data), the ID of the video data being reproduced by the terminal device 500, and the comment. The comment is stored in the comment storage unit 303 in association with the displayed time, the reproduction time for displaying the comment, the user ID of the viewer who posted the comment, and the comment display method. Here, the display method is information indicating, for example, the size, color, display position, and the like of characters for displaying comments.

  The comment storage unit 303 is a storage area in which the regular comment posted by the viewer on the video data by the regular comment recording unit 302 is stored in association with the ID of the video data. A regular comment posted for certain moving image data is recorded as a comment dictionary associated with the ID of the moving image data.

FIG. 2B is a schematic block diagram illustrating a configuration of the terminal device according to the first embodiment.
As illustrated in FIG. 2B, the terminal device 500 includes a communication unit 501, a comment generation unit 505, a reproduction time specification unit 506 , a comment display control unit 507, and a display unit 508 .

The communication unit 501 communicates with the web server 100, the moving image distribution server 200, and the comment distribution server 300 via the network N.
Specifically, the communication unit 501 receives from the video distribution server 200 video data specified by a user of the terminal device 500 through a web page provided by the web server 100. In addition, the communication unit 501 receives, from the comment distribution server 300, regular comments posted in the past by other viewers on the moving image data being reproduced.
Further, the communication unit 501 transmits a regular comment posted by the user of the terminal device 500 (viewer of the moving image data) to the moving image data being reproduced to the comment distribution server 300. The regular comments are stored and accumulated in the comment storage unit 303 of the comment distribution server 300 in association with the ID of the moving image data.

The comment generation unit 505 newly generates a pseudo comment for the main video data being reproduced based on regular comments posted in the past by an unspecified number of viewers on the main video data. Specifically, the comment generation unit 505 according to the present embodiment receives a regular comment posted by a viewer on the moving image data being played back on the terminal device 500 from the comment distribution server 300, and the regular comment A similar one is identified, and a group composed of the similar regular comments is generated. Then, for each group of similar comments, a regular comment is duplicated and newly generated as a pseudo comment.
The comment generating unit 505 further includes a similar comment specifying unit 505a, and realizes the above function based on this processing.

  Based on the representative value of the playback time at which the regular comment posted by the viewer on the video data is displayed during playback of the video data in the terminal device 500, the playback time specifying unit 506 During playback, the playback time for displaying the pseudo comment generated for the video data is specified. Here, the “reproduction time” is a value indicating an elapsed time based on the reproduction start time of the moving image data.

  The comment display control unit 507 is associated with the ID of the video data among the regular comments stored in the comment storage unit 303 via the communication unit 501 during the playback of the video data that the terminal device 500 plays. The regular comment and its reproduction time are received, and the regular comment is displayed on the display unit 508. Also, the comment display control unit 507 causes the display unit 508 to reproduce the pseudo comment generated by the comment generation unit 505 based on the reproduction time specified by the reproduction time specifying unit 506.

  The display unit 508 is, for example, a liquid crystal display or an organic EL display.

  By having the above configuration, the terminal device 500 according to the present embodiment generates a pseudo comment for the moving image data (the main moving image data) reproduced by the terminal device 500, and generates the generated comment together with the regular comment for the moving image data. The pseudo comment is superimposed and displayed on the video data.

  The pseudo comment generation by the terminal device 500 is executed at the start of viewing of the moving image data. Here, an operation of generating a pseudo comment for moving image data (main moving image data) having the terminal device 500 will be described.

FIG. 3 is a flowchart illustrating a method for generating a pseudo comment by the terminal device 500 according to the first embodiment.
Hereinafter, a processing flow in which the terminal device 500 generates a pseudo comment for the moving image data based on the regular comment posted for the moving image data will be described with reference to the flowchart illustrated in FIG. 3.

  First, at the stage before the start of the processing flow shown in FIG. 3, the regular comment recording unit 302 of the comment distribution server 300 receives regular comments posted by a large number of viewers who view each video data, It is recorded in the comment storage unit 303 in association with the data ID and the like. Therefore, at the start of the processing flow shown in FIG. 3, the comment storage unit 303 stores a regular comment (comment dictionary associated with the ID of the video data) for each of a plurality of video data stored in the video distribution server 200. ) Is recorded.

First, a user of the terminal device 500 (viewer of the moving image data) operates a not-shown operation unit (mouse, keyboard, touch panel, etc.) to view moving image data (main moving image data) to be viewed on a web page. ) Is specified. As a result, the moving image data corresponding to the designation is distributed from the moving image distribution server 200 and is played back by the terminal device 500.
At this time, the comment generation unit 505 of the terminal device 500 receives the comment dictionary associated with the ID of the main video data designated by the user from the comment distribution server 300 via the communication unit 501, and the main video Regular comments posted in the past from a plurality of viewers on the data and their playback times are acquired (step S101).

Next, the similar comment specifying unit 505a of the comment generating unit 505 generates a parameter capable of calculating the similarity between the acquired regular comments (step S102). For example, the similar comment specifying unit 505a can divide each regular comment in units of a predetermined number of characters (for example, 2 characters) (N-Gram), and calculate a similarity indicating a character string of the predetermined number of characters and the number of appearances thereof. Generate as a parameter.
To explain with a more specific example, the similar comment specifying unit 505a uses a character string “No” once, a character string “Hi” once, and a character string as a vector for the regular comment “Noah ah wwwwww”. A vector indicating that “oh” appears three times, the character string “ah” appears once, and the character string “ww” appears five times is generated. Thereby, for example, the similarity between regular comments is calculated by calculating the cosine similarity between vectors. When calculating the similarity between vectors, it is possible to calculate the similarity more appropriately by weighting the number of occurrences of each character string so as to monotonously decrease with respect to the total appearance frequency of the character string. (For example, TF / IDF method). Specifically, since the character string “ww” and the character string “Oh” are frequent, the weight is relatively small with respect to other character strings. When calculating the degree of similarity using such weighting, the degree of similarity between the character strings “suee wwwwwwwwwww” and “Yamero wwwwwwwwwww” is lower than when no weighting is performed. On the other hand, when calculating the degree of similarity using such weighting, the degree of similarity between the character strings “Yamero wwwwwwwwww” and “Yamero w” is higher than when weighting is not performed.

  Next, the similar comment specifying unit 505a generates a group (similar comment group) including a plurality of similar normal comments from the normal comments for the moving image data acquired in step S101 (step S103). For example, the similar comment specifying unit 505a extracts a combination of regular comments in which the cosine similarity of a vector is equal to or higher than a predetermined threshold (for example, 0.9) as a combination of similar regular comments, and from a plurality of similar regular comments A similar comment group is generated. At this time, the similar comment specifying unit 505a determines that the reproduction times of two similar regular comments are separated from each other by a predetermined time (for example, 4 seconds), and other similar regular comments exist between the two regular comments. If not, the two regular comments are treated as belonging to another group. As a result, the similar comment specifying unit 505a makes regular comments (for example, the first and second lyrics) appearing in separate groups, which are regular comments made of the same character string and appearing at different times. It can be handled. Moreover, the similar comment specific | specification part 505a provides unique ID for every similar comment group.

Next, the comment generation unit 505 extracts any of the generated regular comments belonging to the similar comment group as a pseudo comment (step S104). For example, the comment generation unit 505 may extract a plurality of regular comments belonging to one similar comment group, which has the highest average cosine similarity, or a plurality of regular comments belonging to one similar comment group. Randomly extracted from regular comments.
The comment generation unit 505 may extract one of the regular comments belonging to one similar comment group as two or more new pseudo comments. Further, the comment generation unit 505 may extract each of a plurality of different regular comments belonging to one similar comment group as one or two or more new pseudo comments.

Next, the playback time specifying unit 506 sets the regular comments belonging to one similar comment group to representative values (specifically, for example, an average value and a variance value) of playback times displayed during playback of the moving image data. Based on this, the reproduction time of the pseudo comment extracted in step S104 is specified (step S105).
When a plurality of pseudo comments are extracted in step S104, the playback time specifying unit 506 specifies the playback time for each of the plurality of pseudo comments. In this case, the playback time specifying unit 506 may specify a plurality of different playback times so that the playback time for each pseudo comment varies to some extent. For example, the reproduction time specifying unit 506 displays the average value and variance of reproduction times for regular comments belonging to a certain similar comment group, and the average value and variance of reproduction times for a plurality of pseudo comments extracted from the similar comment group. A plurality of different playback times are specified so as to vary under conditions where the values match.
In this way, the normal comment display frequency distribution with respect to the playback time of the video data and the pseudo comment display frequency distribution similar to the normal comment match, so the comments that do not feel uncomfortable with the progress of the video data Can be generated automatically. For example, when similar regular comments are concentrated and posted in a narrow playback time zone, a plurality of pseudo comments similar to the regular comments are displayed so as to be concentrated in the same playback time zone. In addition, when regular comments that are distributed over a wide playback time zone of video data are distributed and posted, a plurality of pseudo comments similar to the regular comments are displayed in a wide playback time zone in the same way as the regular comments. It appears to be distributed across.

Then, the comment display control unit 507 displays the pseudo comment generated by the comment generation unit 505 on the display unit 508 based on the playback time of the pseudo comment specified by the playback time specifying unit 506 (step S106).
Thereby, the comment display control unit 507 displays the pseudo comment generated by the comment generation unit 505 for the main moving image data together with the regular comment posted by the viewer for the main moving image data on the display unit 508. It can be displayed superimposed on video data.

FIG. 4 is a diagram for explaining the effect of the terminal device 500 according to the first embodiment.
FIG. 4A shows a state in which the moving image data is being reproduced when not based on the function of the terminal device 500. In the moving image data shown in FIG. 4 (a), only regular comments posted by viewers are displayed superimposed on the moving image data. However, since this moving image data has just been posted, the number of posts is small, and the number of comments displayed during playback is small.
On the other hand, FIG. 4B shows a state in which the moving image data is being reproduced when a comment is automatically generated by the function of the terminal device 500. In the moving image data shown in FIG. 4B, in addition to the regular comment displayed in FIG. 4A, an automatically generated pseudo comment is displayed. This is newly generated by the comment generation unit 505 based on a regular comment posted on the moving image data. As a result, many comments are displayed even though the video data has just been posted, so that the current viewer can enjoy the fun of the comment display function of the video data and the viewer. Can be motivated to post new comments.

  As described above, according to the comment display system according to the first embodiment, even if a video has a small number of comments, the comments are appropriately added and displayed, so that viewers who watch the video can be excited and entertained. it can.

At the time of starting the above-described function for generating and displaying a pseudo comment during reproduction of moving image data (comment raising mode), the comment display control unit 507 uses a color frame (or It may be displayed with a code or the like according to this, which can be identified as a pseudo comment). By doing in this way, the user of the terminal device 500 (viewer of the moving image data) enjoys watching the moving image data while discriminating between the regular comments that are properly posted and the pseudo comments that are not regular comments. be able to.
Further, the terminal device 500 can select whether to activate a function (comment raising mode) for generating and displaying a pseudo comment during reproduction of moving image data based on the operation of the user. May be provided.

<Second Embodiment>
Next, the comment display system 1 according to the second embodiment will be described in detail.
The terminal device 500 according to the first embodiment generates a pseudo comment based on only a regular comment for the main video data that has already been posted for the video data (main video data) to be increased. On the other hand, the terminal device 500 according to the present embodiment generates a pseudo comment based on a regular comment posted for other moving image data different from the main moving image data.
In addition, the schematic block diagram of the comment display system 1 which concerns on 2nd Embodiment is equivalent to 1st Embodiment (FIG. 1).

FIG. 5 is a schematic block diagram showing the configuration of the terminal device 500 according to the second embodiment.
As illustrated in FIG. 5, the terminal device 500 according to the present embodiment further includes a related moving image extraction unit 504.
The related moving image extraction unit 504 includes other moving image data (hereinafter referred to as “related moving image data”) related to moving image data (main moving image data) reproduced by the terminal device 500 from the moving image data recorded in the moving image distribution server 200. To be extracted).

  In addition, the comment generation unit 505 according to the present embodiment newly generates a pseudo comment for the moving image data based on a regular comment posted by the viewer on the related moving image data of the moving image. Specifically, the comment generation unit 505 selects a comment that is the same as or similar to the comment posted by the viewer for the video data among the comments posted by the viewer for the related video data. It is newly generated as a pseudo comment for the data. Note that the comment generation unit 505 realizes the above function by the processing of the similar comment specifying unit 505a according to the present embodiment.

  In addition, the playback time specifying unit 506 according to the present embodiment, based on the representative value of the playback time at which the regular comment posted by the viewer is displayed for each during playback of the related video data, During playback, the playback time for displaying the pseudo comment generated for the video data is specified.

  By having the above configuration, the terminal device 500 according to the present embodiment makes a pseudo comment for the main video data reproduced by the terminal device 500 for other video data (related video data) different from the main video data. Generate based on regular comments already posted. More specifically, the terminal device 500 according to the present embodiment extracts and generates a normal comment posted to the related video data that is similar to the normal comment posted to the video data. .

FIG. 6 is a flowchart illustrating a pseudo comment generation method by the terminal device 500 according to the second embodiment.
Hereinafter, a processing flow in which the terminal device 500 generates a pseudo comment for the moving image data based on a regular comment posted for the related moving image data will be described with reference to the flowchart illustrated in FIG. 6. 6, at the start of the processing flow shown in FIG. 6, as in the case of the first embodiment (FIG. 3), the comment storage unit 303 of the comment distribution server 300 stores a plurality of data stored in the video distribution server 200. It is assumed that a regular comment for each of the moving image data is recorded.

First, the related video extraction unit 504 acquires a video tag associated with the video data selected by the user of the terminal device 500 (viewer of the video data) from the web server 100 via the communication unit 501 ( Step S201).
Next, the related moving image extraction unit 504 extracts moving image data having a predetermined number (for example, two) or more of moving image tags common to the moving image data as related moving image data, and acquires the ID of the moving image data ( Step S202).
Here, the moving image tag is metadata indicating the characteristics of the moving image. Therefore, it is presumed that moving image data having a plurality of moving image tags has a strong relationship. In this embodiment, in order to appropriately extract a comment while preventing an increase in calculation amount, the related moving image extraction unit 504 extracts 10 moving image data as related moving image data. When there are 10 or more candidates of related moving image data, the related moving image extraction unit 504 extracts the top 10 moving image data having the highest popularity as related moving image data. Popular video data includes, for example, video data with a large number of playbacks, video data with a large number of favorite registrations, video data with a large number of comments, and the like.

Next, the comment generation unit 505 refers to the 10 comment dictionaries associated with the IDs of the 10 related moving image data via the communication unit 501, and the viewer receives the related moving image data from the viewer. The posted regular comment and its reproduction time are acquired (step S203).
Next, the similar comment specifying unit 505a of the comment generation unit 505 generates a parameter that can calculate the similarity between the normal comments for all the normal comments for the ten related moving image data acquired in step S203 (step S203). S204). Note that this processing by the comment generation unit 505 may be equivalent to that of the first embodiment.
Next, the similar comment specifying unit 505a generates a similar comment group including a plurality of similar normal comments from the normal comments for each of the 10 related moving image data acquired in step S203 (step S205).

Next, the comment generation unit 505 refers to a similar comment group that includes a regular comment posted to the video data among the generated similar comment groups, and among the regular comments belonging to the similar comment group. Is extracted as a pseudo comment (step S206). Note that the process in which the comment generation unit 505 generates a pseudo comment may be equivalent to that in the first embodiment.
In addition, the comment generation unit 505 according to the present embodiment may preferentially extract a regular comment posted only to related video data, not the main video data, from regular comments belonging to one similar comment group. . Here, when a comment exactly the same as a regular comment posted in the moving image data is automatically generated and displayed in plural, it may be assumed that an unnatural impression is given to the current viewer in some cases. However, by preferentially extracting regular comments posted only on related video data, the comment generation unit 505 generates a comment that is similar but not identical to the regular comments posted on this video data. A more natural impression can be given to the current viewer.

Next, the reproduction time specifying unit 506 extracts each of the regular comments belonging to one similar comment group based on the average value and the variance value of the reproduction times displayed during the reproduction of each related video data in step S206. The reproduction time of the pseudo comment is specified (step S207). Note that this processing by the reproduction time specifying unit 506 may be equivalent to that of the first embodiment.
Then, the comment display control unit 507 displays the pseudo comment generated by the comment generation unit 505 on the display unit 508 based on the playback time of the pseudo comment specified by the playback time specifying unit 506 (step S208).

FIG. 7 is a diagram for explaining the effect of the terminal device 500 according to the second embodiment.
FIG. 7A shows a state in which the moving image data is being reproduced when not based on the function of the terminal device 500. Since the moving image data has just been posted, the number of comments displayed during playback is small as shown in FIG.
On the other hand, FIG. 7B shows a state in which the moving image data is being reproduced when a comment is automatically generated by the function of the terminal device 500. In the moving image data shown in FIG. 7B, automatically generated pseudo comments A and B are displayed in addition to the regular comments displayed in FIG. This is newly generated by the comment generation unit 505 based on regular comments posted for the main video data and related video data related to the main video data. First, a pseudo comment A made up of the same character string as the regular comment posted for the main video data is newly displayed in the main video data. Further, pseudo comment B that is similar to but not the same as the regular comment posted to the moving image data is also newly displayed in the moving image data (see FIG. 7B). Thereby, a comment similar to a comment posted to the moving image data (comment posted to related moving image data) that is not posted to the moving image data itself is newly displayed. Therefore, even if there are few comments posted on the moving image data, variations of pseudo comments are increased, and a natural impression can be given to the current viewer.

  As described above, according to the comment display system according to the second embodiment, even if a video has a small number of comments, the comment can be displayed more appropriately, so that the current viewer who views the video is excited. Can be entertained.

Note that the terminal device 500 according to the second embodiment generates a comment similar to the new comment based on the regular comment posted to the video data. However, the comment display system 1 according to another embodiment is not limited to this aspect.
For example, the terminal device 500 according to the modification of the present embodiment may automatically generate an appropriate comment regardless of whether or not a regular comment has been posted on the moving image data.

  Specifically, the similar comment specifying unit 505a according to the present modification first generates a similar comment group for a plurality (for example, 10) of related moving image data of the moving image data in step S205 (FIG. 6). (Equivalent to the second embodiment). And the comment production | generation part 505 specifies the similar comment group in which the regular comment which comprises the similar comment group is contributed over all the related moving image data among the produced | generated similar comment groups.

A regular comment belonging to such a similar comment group is highly likely to be a comment posted strongly depending only on the reproduction time, regardless of the content of the moving image data. Specifically, comments such as “Upotsu” where posts concentrate immediately after the start of video playback, or comments such as “8888” (meaning applause) where posts concentrate immediately before the end of the video. Etc. In addition, between a plurality of moving image data in which the same music is reproduced, the same or similar comments based on the lyrics of the music can be concentrated in the same reproduction time zone.
That is, in all of the 10 related video data, regular comments having a common display frequency distribution with respect to the playback time of each related video data will be posted according to a similar display frequency distribution in the future even if they are not yet posted to this video data. There is a high possibility of being.

  Therefore, the comment generation unit 505 according to this modification extracts one or more of the regular comments belonging to the specified similar comment group as a pseudo comment. By doing in this way, the terminal device 500 has not posted to the video data itself being played back, but has a high possibility of posting in the specific playback time zone (the above “upotsu ”,“ 88888 ”, etc.) are newly displayed. Therefore, even if no comments are posted on this video data, pseudo comments are displayed appropriately, so it may appear to the current viewer as if many comments have been posted. it can.

<Third Embodiment>
Next, the comment display system 1 according to the third embodiment will be described in detail.
The terminal device 500 according to the second embodiment described above extracts a comment similar to a regular comment posted on the moving image data from a regular comment posted on another different moving image data. A comment was generated. On the other hand, the terminal device 500 according to the present embodiment is not limited to a comment similar to a regular comment posted to the video data, but from the regular comment posted to other different video data. Extract regular comments that co-occur with regular comments posted for.
In addition, the schematic block diagram of the comment display system 1 which concerns on 3rd Embodiment is equivalent to 1st Embodiment (FIG. 1).

FIG. 8 is a schematic block diagram illustrating a configuration of a terminal device 500 according to the third embodiment.
As shown in FIG. 8, the comment generating unit 505 of the terminal device 500 according to the present embodiment further includes a co-occurrence comment specifying unit 505b in addition to the second embodiment.
The co-occurrence comment specifying unit 505b specifies a comment that co-occurs from a regular comment posted on the moving image data from a regular comment posted on the related moving image data of the moving image data.

  By having the above configuration, the terminal device 500 according to the present embodiment makes a pseudo comment for the main video data reproduced by the terminal device 500 for other video data (related video data) different from the main video data. Generate based on regular comments already posted. More specifically, the terminal device 500 according to the present embodiment is “co-occurred” among regular comments posted to related video data that are similar to regular comments posted to the video data. Extract and generate comments.

FIG. 9 is a diagram for explaining processing contents of the terminal device 500 according to the third embodiment.
Note that the processing flow by the terminal device 500 according to the present embodiment is equivalent to that of the second embodiment (FIG. 6), and therefore the processing flow of the terminal device 500 will be described with reference to FIGS. .

  First, in step S205 (FIG. 6), the similar comment specifying unit 505a is posted to each of a plurality of related video data (related video data α1, α2,...) Extracted in step S202. A similar comment group is generated for each regular comment. At this time, specifically, as shown in FIG. 9, the similar comment specifying unit 505a generates a plurality of similar comment groups including only regular comments posted to the related moving image data α1 (upper part of FIG. 9). . Similarly, the similar comment specifying unit 505a generates a similar comment group including only regular comments posted for the related video data α1, for each of the other related video data α2, α3,. FIG. 9 bottom). In FIG. 9, only related moving image data α1 and α2 are shown.

Next, in step S206 (FIG. 6), the co-occurrence comment specifying unit 505b generates each similar comment group generated for each of the related moving image data α1, α2,... Generated in step S205 (see FIG. 9). On the other hand, the following procedure is performed to identify a set of comments that co-occur with each other.
First, the co-occurrence comment specifying unit 505b selects any two different similar comment groups (for example, the similar comment group X1) from among a plurality of similar comment groups configured of regular comments posted for certain related video data α1. , X2) (see FIG. 9).
Next, it is determined whether or not both of the two similar comment groups X1 and X2 are included in the similar comment group composed of regular comments posted for the other related video data α2. According to the example shown in FIG. 9, common similar comment groups X1 and X2 are generated among regular comments posted for the related moving image data α2.
Similarly, the co-occurrence comment specifying unit 505b determines whether or not the same similar comment groups X1 and X2 are included for each of the other moving image data α3, α4,... (Not shown). When the number of related video data α1, α2,... That includes both similar comment groups X1, X2 is equal to or greater than a predetermined number (for example, 5), The regular comment belonging to the similar comment group X1 and the regular comment belonging to the similar comment group X2 are determined to be comments that co-occur with each other, and processing for associating the two similar comment groups X1 and X2 with each other is performed.

  Next, in step S206, the comment generation unit 505 refers to a similar comment group that includes a regular comment posted to the moving image data, and has another relationship that co-occurs with the similar comment group. Any regular comment belonging to the similar comment group is extracted as a pseudo comment.

Here, the reason for specifying a comment that is likely to co-occur will be described.
An example of a comment that is likely to co-occur is a comment such as lyrics of the music or a matching hand (call or shout) when the moving image data is mainly music such as live video or promotion video. For example, in the video data of a certain song, a comment “(” ° Д °) ”<wa ↑ hwa ↑” appears at a certain playback time, and a comment “(” ° Д °) ”at another playback time. V · E "appears. In this case, it can be said that the comment “(” ° Д °) ”<wa ↑ wa ↑” and the comment “(” ° Д °) ”L, O, V, E” co-occur with each other.
In other words, when the comment “(” ° Д °) ”<wa ↑ wa ↑” is included as a comment on the video data including the music, the comment “(” ° Д °) ”L, O, V, E” Regardless of the presence or absence of the comment, it can be understood that it is suitable as a comment displayed automatically.
That is, as described above, the comment generation unit 505 has posted to the video data as a comment that has not yet been posted to the video data but is likely to be posted in the future. Extract regular comments that co-occur from regular comments.

FIG. 10 is a diagram for explaining the effect of the terminal device 500 according to the third embodiment.
FIG. 10A shows a state in which the moving image data is being reproduced when it is not based on the function of the terminal device 500. Since the moving image data has just been posted, the number of comments displayed during playback is small as shown in FIG.
On the other hand, FIG. 10B shows a state in which the moving image data is being reproduced when a comment is automatically generated by the function of the terminal device 500. In the moving image data shown in FIG. 10B, in addition to the regular comments displayed in FIG. 10A, automatically generated pseudo comments A, B, and C are displayed. This is newly generated by the comment generation unit 505 based on regular comments posted for the main video data and related video data related to the main video data. In this moving image data, pseudo comments A and B are displayed as in the second embodiment. Further, in this moving image data, a pseudo comment C that is a comment co-occurring with a regular comment posted on the moving image data is also displayed. For example, in the example shown in FIG. 10B, comments “Meow”, “Nyaa”, etc. that co-occur with a regular comment “Neko” posted in the moving image data are newly displayed.
As a result, a comment that is not posted to the moving image data itself and that is not similar to the comment posted to the moving image data is also newly displayed. Therefore, even if there are few comments posted on the moving image data, the variation of pseudo comments is further increased, and a natural impression can be given to the current viewer.

  As described above, according to the comment display system according to the third embodiment, even if a video has a small number of comments, it is possible to appropriately display an additional comment so that the current viewer who views the video is excited. Can be entertained.

<Other embodiments>
The terminal device 500 according to each of the first to third embodiments (and modifications) described above may further have the following functions.

For example, the terminal device 500 may determine the number of pseudo comments to be automatically generated for the moving image data based on a predetermined setting parameter (comment premium P) that adjusts the number of pseudo comments to be automatically generated. Good. In this case, for example, when two or more new pseudo comments are extracted in step S104 (or step S206), the comment generation unit 505 may generate only a number proportional to the comment premium P. . In this way, the administrator of the comment distribution server 300 can adjust the number of automatically generated comments for each moving image data, for example, by adjusting the comment premium P.
Furthermore, the comment generation unit 505 gradually decreases the comment premium P described above as time passes from the time when the moving image data is uploaded or as the number of regular comments for the moving image data increases. You may control to. By doing in this way, the pseudo comments that are often displayed at the beginning of uploading gradually disappear according to the number of posts by the viewer, so that it can be led to the same state as the original video data.

  Moreover, although this embodiment demonstrated the case where the terminal device 500 specified the moving image data which 2 or more moving image tags have in common as similar moving image data, it is not restricted to this. For example, in another embodiment, the terminal device 500 may specify moving image data having three moving image tags as similar moving image data. In another embodiment, the terminal device 500 may specify similar moving image data using metadata other than the moving image tag. Specifically, the terminal device 500 may specify similar moving image data using moving image description or title as metadata. In another embodiment, the terminal device 500 analyzes moving image data, and extracts other moving image data that uses the same music as the moving image data to be extracted as input candidates or other moving image data that includes similar images. Alternatively, it may be specified as similar video data.

  In the first and second embodiments, the case has been described in which the terminal device 500 extracts a regular comment for the moving image data or related moving image data as a pseudo comment. However, the present invention is not limited to this. For example, in another embodiment, the comment generation unit 505 may extract a part of a regular comment for the moving image data or the like as an input candidate. For example, the letter “w” may be used at the end of other words to express laughing. The large number of letters “w” expresses the degree of laughter. That is, the letter “w” is included in the comment together with other words, and the number of the letters differs for each comment. Therefore, the comment generation unit 505 according to another embodiment may extract such characters and character strings as pseudo comments. Specifically, the comment generation unit 505 may perform morphological analysis on the acquired comment and extract each morpheme acquired by morphological analysis as an input candidate. In this case, the comment generation unit 505 can extract a known word as an input candidate. In another embodiment, the comment generation unit 505 extracts a character string from each comment for each of a plurality of different numbers of characters (N-Gram), and extracts input candidates based on the number of appearances and the number of characters of the character string. Also good. For example, the comment generation unit 505 calculates a parameter that monotonously increases with respect to the number of appearances and the number of characters, and extracts characters or character strings whose parameter values are greater than a predetermined value as input candidates. In this case, the comment generation unit 505 can extract not only known words but also idioms and unknown words as input candidates.

  Further, in each of the above-described embodiments, the comment generation unit 505 has been described with respect to the case where the comment similarity is calculated by N-Gram analysis, but the present invention is not limited thereto. For example, in another embodiment, the comment generation unit 505 may calculate the similarity using a vector generated based on a morpheme extracted by morpheme analysis. In another embodiment, the comment generation unit 505 may calculate the similarity based on the Levenshtein distance between comments.

  In each of the above-described embodiments, the terminal device 500 may further include a display method specifying unit that specifies the display method of the comment generated by the comment generating unit 505. The display method specifying unit specifies a display method for the pseudo comment extracted by the comment generation unit 505. Specifically, the display method specifying unit may change for each pseudo comment so that the character size, character color, display position, etc. of the extracted pseudo comment vary moderately.

Further, in each of the above-described embodiments, the terminal device 500 includes the comment generation unit 505, the reproduction time specification unit 506, and the comment display control unit 507, and internally simulates while referring to regular comments accumulated in the comment distribution server 300. This has been described as a mode for generating a comment. However, the comment generation unit 505, the reproduction time specifying unit 506, and the comment display control unit 507 are not limited to the mode provided in the terminal device 500. For example, the comment distribution server 300 (comment distribution apparatus) itself may have the functions of the comment generation unit 505, the reproduction time specifying unit 506, and the comment display control unit 507.
In this case, the comment generation unit 505 generates a pseudo comment while linking to the ID of the moving image data, based on the regular comment for each moving image data accumulated in the comment storage unit 303 of the comment distribution server 300.
Also, in this case, the comment display control unit 507 displays the regular comment posted by the viewer for certain video data and the pseudo comment generated by the comment generation unit 505 for the video data. It functions as a comment distribution unit that distributes to the terminal device 500 that reproduces the message.
Further, in the comment display system 1, the comment distribution server 300 includes at least one of the comment generation unit 505, the reproduction time specifying unit 506, and the comment display control unit 507, and the terminal device 500 includes the comment generation unit 505, the reproduction time. You may implement | achieve with the aspect which comprises at least any one of the specific | specification part 506 and the comment display control part 507.

FIG. 11 is a schematic block diagram illustrating a configuration of a computer 900 according to at least one embodiment.
The computer 900 includes a CPU 901, a main storage device 902, an auxiliary storage device 903, and an interface 904.
The terminal device 500 described above is mounted on the computer 900. The operation of each processing unit described above is stored in the auxiliary storage device 903 in the form of a program. The CPU 901 reads a program from the auxiliary storage device 903, develops it in the main storage device 902, and executes the above processing according to the program. In addition, the CPU 901 ensures a storage area corresponding to the above-described storage unit in the main storage device 902 according to the program.

  In at least one embodiment, the auxiliary storage device 903 is an example of a tangible medium that is not temporary. Other examples of the tangible medium that is not temporary include a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, and a semiconductor memory connected via the interface 904. When this program is distributed to the computer 900 via the network N, the computer 900 that has received the distribution may develop the program in the main storage device 902 and execute the above processing.

  The program may be for realizing a part of the functions described above. Further, the program may be a so-called difference file (difference program) that realizes the above-described function in combination with another program already stored in the auxiliary storage device 903.

  As mentioned above, although some embodiment of this invention was described, these embodiment is shown as an example and is not intending limiting the range of invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the invention described in the claims and equivalents thereof, as long as they are included in the scope and gist of the invention.

DESCRIPTION OF SYMBOLS 1 ... Comment display system 100 ... Web server 200 ... Movie distribution server (video distribution device) 300 ... Comment distribution server (comment distribution device) 301 ... Communication unit 302 ... Post comment recording unit 303 ... Comment storage unit 500 ... Terminal device (comment) 501 ... Communication unit 504 ... Related video extraction unit 505 ... Comment generation unit 505a ... Similar comment identification unit 505b ... Co-occurrence comment identification unit 506 ... Reproduction time identification unit 507 ... Comment display control unit 508 ... Display unit 900 ... Computer 901 ... CPU 902 ... Main memory 903 ... Auxiliary memory 904 ... Interface N ... Network

Claims (8)

A comment generator for newly generating a comment on the video data based on the video data or a comment posted by the viewer for other video data different from the video data;
A comment display control unit that causes a comment posted by a viewer to the video data and a comment generated by the comment generation unit to be displayed on a terminal device that reproduces the video data;
Equipped with a,
The comment generation unit includes at least a comment posted by the viewer for the other video data, a comment that is the same as the comment posted by the viewer for the video data, a similar comment, and a co-occurrence A comment display device that newly generates any one of the comments to be made as a comment for the moving image data . A related video extractor for extracting other video data in which at least a part of the video data and metadata is common;
The comment display device according to claim 1, wherein the comment generation unit generates a comment for the moving image data from a comment posted by a viewer for the other moving image data extracted by the related moving image extraction unit. The metadata is one or more video tags,
The comment display device according to claim 2, wherein the related moving image extraction unit extracts other moving image data in which the number of moving image tags shared with the moving image data is a predetermined number or more. Generated by the comment generator during playback of the video data based on a representative value of playback time during which the comment posted by the viewer is displayed during playback of the video data or the other video data It has a playback time specifying part that specifies the playback time when comments are displayed,
The comment display control unit associates the comment generated by the comment generation unit with the playback time of the comment specified by the playback time specifying unit, and distributes it to the terminal device that plays back the moving image data. The comment display device according to claim 3. A video data distribution device for distributing video data;
The comment display device according to any one of claims 1 to 4 ,
A comment display system. A comment generator for newly generating a comment on the video data based on the video data or a comment posted by the viewer for other video data different from the video data;
A comment delivery unit that delivers a comment posted by a viewer to the video data and a comment generated by the comment generation unit to a terminal device that reproduces the video data;
Equipped with a,
The comment generation unit includes at least a comment posted by the viewer for the other video data, a comment that is the same as the comment posted by the viewer for the video data, a similar comment, and a co-occurrence A comment delivery device that newly generates any one of the comments to be made as a comment on the moving image data . A comment generation step for newly generating a comment on the video data based on the comment posted by the viewer on the video data or other video data different from the video data;
A comment display step of displaying a comment posted by a viewer on the moving image data and the generated comment on a terminal device that reproduces the moving image data;
I have a,
Among the comments posted by the viewer for the other video data in the comment generation step, at least the same comments as those posted by the viewer for the video data, similar comments, and co-occurrence The comment display method which newly produces | generates any one of the comments to perform as a comment with respect to the said moving image data . Computer
Comment generating means for newly generating a comment on the moving image data based on a comment posted by the viewer on the moving image data or other moving image data different from the moving image data;
Comment display means for displaying a comment posted by a viewer on the video data and a comment generated by the comment generation means on a terminal device that reproduces the video data;
To function as,
The comment generating means includes at least a comment posted by the viewer with respect to the other video data, a comment that is the same as a comment posted by the viewer with respect to the video data, a similar comment, and a co-occurrence A program for newly generating any one of the comments to be made as a comment on the moving image data .

Images