JP2014212490A - Terminal device, comment distribution system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow users viewing a distributed image to share excitement among them.SOLUTION: A terminal device connected with a moving image distribution server for distributing moving image data comprises: an output unit 360 for displaying a moving image; an input unit 370 for receiving an inputted comment; a communication unit 310 for transmitting the inputted comment to a comment distribution device; a comment extraction unit 340 for extracting a specific keyword included in the comment received from the comment distribution device; and a decoration unit 350a which, when the output unit 360 displays the moving unit, decorates the moving image in a mode associated with the specific keyword.

Description

  The present invention relates to a terminal device, a comment distribution system, and a program for reproducing a moving image and displaying a comment related to the moving image.

  2. Description of the Related Art Conventionally, there is a system that displays a comment made by a user on a moving image such as a broadcasted TV program together with the moving image. For example, in the technique of Patent Document 1, a viewer writes a comment on a scene of a television program using a terminal device on a bulletin board related to a television program or the like. Thereby, the viewing experience of the same television program can be shared among users and various comments can be made. Any comment can be freely made by any user.

JP 2002-290949 A

  However, in the conventional technology described above, the comment comment by the user is displayed together with the moving image only as simple text (character string). Therefore, the impression received by the user who views the moving image is flat with respect to the comment, and there is a limit to the presence and expressiveness of the comment. For example, since an interesting scene was included in the video to be viewed, even if some users were impressed or excited, it was difficult to convey the impression to other users. Therefore, with the conventional technology, it has been difficult to share impressions and excitement among many users.

  The present invention has been made in view of such circumstances, and its purpose is to easily share impressions among users by modifying a moving image with an image or sound according to the emotion of the user who made the comment. To provide a terminal device, a comment distribution system, and a program.

  One aspect of the present invention is a terminal device connected to a moving image distribution device that distributes moving image data, a display unit that displays a moving image, an input unit that receives input of the comment, and an input comment In a mode associated with the specific keyword when a moving image is displayed on the display unit, a communication unit that transmits to the comment distribution device, an extraction unit that extracts a specific keyword included in the comment received from the comment distribution device A decoration unit for decorating the moving image.

  In the aspect of the invention, the decoration unit changes the decoration aspect of the moving image based on an instruction from a user different from the user who inputs the comment.

  In the aspect of the invention, the decoration unit erases the decoration of the moving image based on an instruction from a user different from the user who inputs the comment.

  One aspect of the present invention is a comment distribution system including a video distribution device that distributes video data, a comment distribution device that distributes comments on a video, and a terminal device, and a display unit that displays a video, An input unit that receives an input of a comment, a communication unit that transmits the input comment to the comment distribution device, an extraction unit that extracts a specific keyword included in the comment received from the comment distribution device, and a moving image on the display unit Is displayed, the decoration unit decorates the moving image in a manner associated with the specific keyword.

One aspect of the present invention is a computer as a terminal device connected to a moving image distribution device that distributes moving image data, a display unit that displays a moving image, an input unit that receives input of the comment,
A communication unit that transmits an input comment to an external comment distribution device, an extraction unit that extracts a specific keyword included in a comment received from the comment distribution device, and the moving image displayed on the display unit It is a program for making it function as a decoration part which decorates the said moving image in the aspect linked | related with the keyword.

  According to the present invention, it is possible to easily share impressions between users by modifying a moving image with an image or sound in accordance with the emotion of the user who made a comment.

It is a schematic block diagram which shows the structure of the comment delivery system 1 which concerns on one Embodiment of this invention. It is a schematic block diagram showing the structure of a comment delivery server. It is a figure which shows an example of the data memorize | stored in a comment information storage part. It is a schematic block diagram showing the structure of a terminal device. It is a figure which shows an example of the screen displayed on an output part. It is a flowchart showing operation | movement of a terminal device. It is a table which illustrates the aspect which modifies a specific keyword and a moving image. It is a figure which shows the mode of the concrete moving image modification in the screen of an output part. It is the figure which showed the example which changes the mode of animation modification over time.

  Hereinafter, a comment distribution system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic block diagram showing a configuration of a comment delivery system 1 according to an embodiment of the present invention. In the comment distribution system 1, the moving image distribution server 10, the comment distribution server 20, and a plurality of terminal devices 30 are connected via a network 40.

  In FIG. 1, the moving image distribution server 10 distributes moving image data to the requesting terminal device 30 in response to a distribution request from the terminal device 30. Distribution by the moving image distribution server 10 is performed by streaming distribution, for example. The moving image distribution server 10 distributes the moving image transmitted from one terminal device 30 to another terminal device 30. The comment distribution server 20 receives a comment on the moving image distributed by the moving image distribution server 10 from the terminal device 30 and distributes the comment to each terminal device 30 viewing the moving image. The terminal device 30 is connected to the video distribution server 10 and the comment distribution server 20 via the network 40, receives and displays the video distributed from the video distribution server 10, and the comment distributed from the comment distribution server 20. Is received and displayed at the same time as the video. The terminal device 30 is a terminal device having a function capable of communicating with various servers and the like via the network 40. For example, a computer (PC), a mobile terminal (a mobile phone, a smartphone, an information terminal device, etc.), a game machine, a television device, or the like can be applied to the terminal device 30.

  FIG. 2 is a block diagram illustrating a configuration of the comment distribution server 20. In FIG. 2, the comment information storage unit 21 associates the content of the comment with the comment grant time and stores it as comment information. The comment giving time is a moving picture playback time based on the playback start time of the moving picture (the beginning of the moving picture) when the comment is given.

  FIG. 3 is an example of data stored in the comment information storage unit 21. The comment information storage unit 21 stores a plurality of pieces of comment information in which comments for moving images distributed from the moving image distribution server 10 are grouped for each thread. Each comment information includes information of a moving image ID for identifying a moving image and a thread ID for identifying a thread. The comment information storage unit 21 can store comment information including a plurality of comment data. The comment data is information for identifying the comment information posting real time (real time information) indicating the actual time when the comment is given (speaking) and the user who gave the comment, in addition to the comment giving time and the comment content. This is data associated with a comment display method that is information for specifying how to display a user name and a comment on a moving image. When the comment distribution server 20 is playing a video with a certain video ID and receives comment data from the terminal device 30 viewing a comment of a thread with a certain thread ID, the received comment data is comment data. Are additionally stored in the comment information corresponding to the moving image ID and thread ID included in. Here, since the thread ID is stored in association with the moving image ID, a plurality of different threads can be provided even for the same moving image.

The comment information distribution unit 22 reads the comment information stored in the comment information storage unit 21 and distributes the comment information having the same moving image ID and thread ID of the moving image being reproduced to the terminal device 30 being reproduced. . The comment information update management unit 23 adds and stores the comment data received from the terminal device 30 via the communication unit 24 in the comment information storage unit 21 according to the corresponding moving image ID and thread ID.
The communication unit 24 communicates with the terminal device 30. The communication unit 24 outputs the comment information transmitted from the terminal device 30 to the comment information update management unit 23 and adds it to the comment information storage unit 21 for storage. The communication unit 24 outputs a comment information distribution instruction to the comment information distribution unit 22.

  FIG. 4 is a schematic block diagram illustrating the configuration of the terminal device 30. The terminal device 30 includes a communication unit 310, a comment storage unit 320, a text image generation unit 330, a comment extraction unit 340, an output control unit 350, an output unit 360, and an input unit 370. The communication unit 310 communicates with the video distribution server 10 and the comment distribution server 20 via the network 40. The communication unit 310 includes a comment receiving unit 311, a moving image data receiving unit 312, and a comment transmitting unit 313. The comment receiving unit 311 receives comment information transmitted from the comment distribution server 20 in accordance with distribution of moving image data distributed from the moving image distribution server 10. In other words, the comment receiving unit 311 receives comment information including a comment input for a moving image to be reproduced from the comment distribution server 20. The moving image data receiving unit 312 receives moving image data distributed from the moving image distribution server 10. The comment transmission unit 313 transmits the comment input from the input unit 370 to the comment distribution server 20. The comment storage unit 320 stores the comment information received by the comment receiving unit 311. The text image generation unit 330 refers to the comment information stored in the comment storage unit 320 and generates a comment text image. The comment extraction unit 340 refers to the comment information stored in the comment storage unit 320 and extracts a specific keyword from the comment content.

  The output control unit 350 transmits a moving image distribution request designated by the user of the terminal device 30 to the moving image distribution server 10, receives and reproduces the moving image data distributed from the moving image distribution server 10, and outputs it to the output unit 360. To do. In addition, the output control unit 350 reads the text image of the comment corresponding to the video playback time of the video to be played out of the text images generated by the text image generation unit 330, and the video data distributed from the video distribution server 10 Are superimposed and combined and displayed on the output unit 360. The output control unit 350 includes a decoration unit 350a. When the output control unit 350 causes the output unit 360 to display a moving image, the decoration unit 350a modifies the moving image to be displayed on the output unit 360 according to an aspect associated with the specific keyword extracted by the comment extraction unit 340.

  The output unit 360 is an audio output device such as a liquid crystal display device, a CRT (Cathode Ray Tube), or a speaker, and outputs various information using them. The output unit 360 displays the moving image data distributed from the moving image distribution server 10 on the screen together with sound according to the instruction of the output control unit 350. The input unit 370 is an input device such as a keyboard or a mouse.

  FIG. 5 is a diagram illustrating an example of a screen displayed on the output unit 360. In the playback area 410 in the screen, the moving image distributed from the moving image distribution server 10 and the comment distributed by the comment distribution server 20 are superimposed and displayed. The comment distributed from the comment distribution server 20 is scrolled and displayed so as to flow from the right to the left on the moving image, as indicated by reference numeral 411. As a result, the user of the terminal device 30 can share a comment input according to the content of the moving image with other users of the terminal device 30 while viewing the moving image, thereby achieving communication.

  A comment is input to the input form 412 from the user via the input unit 370. When the write button 413 is clicked, the comment by the text input in the input form 412, comment addition time, moving image identification information, user identification information, and the like are transmitted to the comment distribution server 20. The user inputs comments on the input form 412 such as impressions of viewing the moving images distributed from the moving image distribution server 10.

  The comment list display area 414 is an area in which comments input from a plurality of users are displayed. The comments listed in this way are periodically received by the communication unit 310 of the terminal device 30 from the comment distribution server 20 and stored in the comment storage unit 320 of the terminal device 30. In the comment list display area 414, a number (symbol 414a) indicating the utterance order given to the comment, a user name (symbol 414b) that inputted the comment, a comment granting time (symbol 414c) in which the comment was written, and a comment A part of the comment (symbol 414d) is displayed in the order of posted real-time information.

Next, the operation of the terminal device 30 will be described with reference to the drawings. FIG. 6 is a flowchart for explaining the operation of the terminal device 30.
First, in the terminal device 30, when a video to be played is input for selection on the menu screen, and further a video playback instruction is input (YES in step S501), the video ID of the specified video is distributed as a video. The video information is transmitted to the server 10 to receive the video data, and the video ID, the user ID, and the comment information distribution request are transmitted to the comment distribution server 20, and the comment information corresponding to the video ID is transmitted. Is stored in the comment storage unit 320 (step S502). Next, the output control unit 350 of the terminal device 30 starts reproduction of the moving image distributed from the moving image distribution server 10 (step S503), and then displays the comment distributed from the comment distribution server 20 (step S504). ). Next, the comment extraction unit 340 of the terminal device 30 determines whether or not the read comment information includes a specific keyword (step S505). If the specific keyword is included, the specific keyword is extracted from the comment information. Extract (step S506). Next, the decoration unit 350a of the terminal device 30 modifies the moving image based on the extracted specific keyword (step S507). Next, the terminal device 30 receives an input of a new comment (step S508). Next, the terminal device 30 determines whether or not the playback of the moving image has ended (step S509). If the playback of the moving image has ended, the terminal device 30 ends the process, but does not end the playback of the moving image. Then, the process returns to step S504 and the subsequent processes are repeated.

  FIG. 7 is a table illustrating a specific keyword extracted by the comment extraction unit 340 and a mode in which the decoration unit 350a modifies the moving image based on the specific keyword. FIG. 7 illustrates eight types of specific comments and moving image modification modes corresponding to the specific comments. In this example, if the specific keyword “like” is included in the comment information, the decoration unit 350a of the terminal device 30 modifies the moving image to reflect the feeling of pleasure of the user who made the comment. . Specifically, a display image of “grass” is added to the video and decorated so that the users of other terminal devices 30 who share the video and comments can enjoy the excitement of watching the video and share the video and comments. To do. Then, if the specific keyword “Like” appears further in the comment information, the decoration unit 350a of the terminal device 30 increases the display image of “grass” that decorates the moving image. As a result, if “Like” is said in many comments, the moving image is filled with many “grass” images. The user of each terminal device 30 can feel the joy and excitement of the user of the other terminal device 30 and himself / herself by viewing a video covered with a large number of “grass” images. It becomes easy for users to share emotions.

  On the other hand, in FIG. 7, if the comment information includes a specific keyword such as “interesting” or “best”, the moving image is modified to reflect the feeling of pleasure of the user who made the comment. Specifically, the atmosphere of video viewing is enlivened, and the user of each terminal device 30 sharing the video and comments is decorated with a display image of “star” added to the video so that joy and excitement can be shared. . As in the case of the “grass” image described above, the user of each terminal device 30 confirms the number of “star” images on the moving image, and shows how many users support the moving image. It becomes possible to know.

  The moving image modification is not limited to modification by an image, and may be modification by sound. In the example of FIG. 7, if the comment information includes a specific keyword such as “laugh” or “w”, a voice output of laughter is added to the video. In this case, in addition to the original sound output included in the moving image, the sound output of the laughing voice is added, so that the user of the terminal device 30 is laughing while the user of the other terminal device 30 is watching the moving image. It becomes easy to grasp the state sensuously. Also, the more keywords such as “laugh” and “w” are included in the comment information, the more laughter is added to the output sound of the video. Therefore, as the content of the video rises, “laughs” and “w” are added to the comment information. Increase the volume of the output voice.

  In addition, moving image modification is not limited to the addition of images and sound to moving images. In the example of FIG. 7, when the comment information includes the specific keyword “No”, the display image of “grass” already added to the moving image is reduced. With this configuration, even if emotions and evaluations for a specific video are different among users, the total number of “grass” display images reflects the emotions and evaluations of all users in real time. Similarly, in the example of FIG. 7, if the comment keyword includes a specific keyword “not boring”, the display image of “grass” added to the moving image is reduced.

  The moving image modification can be realized not only by adding and deleting images, but also by changing the color tone of the moving image. In the example of FIG. 7, when the specific keyword “worst” is included in the comment information, the image color of the moving image is changed from color to black and white. If the color tone of the moving image is greatly changed in this way, the user of the terminal device 30 can grasp at a glance how the comment information includes a specific keyword such as “worst”.

FIG. 8 is a diagram illustrating a specific moving image modification state on the screen of the output unit 360. FIGS. 8A to 8C show the reproduction area 410 in the screen shown in FIG. FIG. 8A shows a screen with no moving image decoration. FIG. 8B is a screen in a state where the specific keyword “like” is included in the comment information and the display image of “grass” is added to the moving image. FIG. 8C shows a screen in which the comment information includes the specific keywords “interesting” and “best” three times in total, and three display images of “star” are added to the moving image.
The animation modification may be performed statically as shown in FIGS. 8B to 8C, but may be changed over time. FIG. 9 is a diagram showing an example in which the state of moving image modification is changed over time. FIG. 9A shows an example of a screen in which a large number of “grass” display images are added to a moving image corresponding to a specific keyword “like”, and shows a high level of user support for the moving image. . When a predetermined time has elapsed with this screen displayed, an image in a state where “flowers” bloom as shown in FIG. 9B may be used. In this way, if the state of the moving image modification is changed over time, it becomes easy to give the modification mode a story.

In this way, the user of the terminal device 30 can execute moving image modification using an image or sound effect based on a comment as an interactive expression method for moving images. As a result, it is possible to transmit emotional expressions and situation determinations that are difficult to obtain user's sympathy only with the text display of the comments by more sensory expressions. In addition, the user's voice can be reflected in real time when viewing the image.
It should be noted that if there is some correspondence between the specific keyword extracted from the comment information and the decoration mode for decorating the moving image, there may not be a direct meaning relationship. Moreover, it is good also as a thing which is easy to recall the decoration aspect which decorates a moving image from the specific keyword contained in comment information.

  The decoration mode of the moving image performed by the decoration unit 350 a may be different depending on each terminal device 30. For example, for a specific keyword included in a comment, a “grass” image may be displayed on one terminal device 30, while an image of “wind blowing” may be displayed on another terminal device 30. In other words, the contents of the table illustrated in FIG. 7 may vary depending on the individual terminal device 30.

  In the comment information, information about what words are extracted as the specific keyword and information on the decoration mode of the moving image performed by the specific keyword may be notified to each user of the terminal device 30 in advance. You don't have to let me know. In the former case, the user can intentionally input a specific keyword, whereas in the latter case, the specific keyword input unintentionally by the user is extracted and the moving image is decorated.

It is also preferable that the decoration unit 350a changes the decoration mode of the moving image based on an instruction from a user different from the user who input the comment. For example, when the video distribution server 10 generates and distributes a video at the same time, the administrator of the video distribution server 10 or the performer of the video can check the video decoration mode on the terminal device 30 as needed. It is also preferable to be able to indicate a change in aspect. For example, the performer of a moving image changes the mode of the moving image decorated by his / her action in the moving image. Specifically, the performer acts to touch the displayed “grass” image with a large number of “grass” display images added to the video, and in that state collects the “grass” images. Move to the corner of the screen. Corresponding to this movement, if the “grass” images added on the video are collectively moved to the corner of the screen, the performer instructed to change the decoration mode of the video only by the movement of his / her body. It will be. Such a change in the decoration mode may be instructed by the administrator of the moving image distribution server 10 using various input devices. If the decoration mode of the moving image is changed based on a user instruction different from the user who input the comment, bidirectional communication can be realized between both users.
The decoration unit 350a may delete the decoration of the moving image based on an instruction from a user different from the user who input the comment. For example, when the video distribution server 10 generates and distributes a video at the same time, if the performer of the video says “I can't see it” in the video, this statement becomes an instruction and the decoration displayed on the video It is also possible to delete the “grass” image.

  The name of the user who made the speech may be displayed in the vicinity of the image modified with the moving image so that it can be seen which image has been added corresponding to the speech of which user. For example, when a “grass” image is displayed corresponding to the specific keyword “like”, the user name of the user who made the comment is displayed directly below the “grass” image together with an image simulating a name tag. May be. In addition, it may replace with a user name and may display the photograph image of the user who said the comment.

  Further, the specific keyword may be the content of content desired to be added to the moving image. For example, if you want to add a spoon image to a video shot of the omelet rice, if the user says a comment that includes the phrase “spoon”, the specific keyword “spoon” included in the comment will be extracted. Correspondingly, a decoration for adding a spoon image is performed on the moving image of the omelet rice. Examples of content include moving images, still images, photos, illustrations, animations, music, sound effects, programs, and the like.

  In this specification, the terminal device 30 includes a communication unit 310, a comment storage unit 320, a text image generation unit 330, a comment extraction unit 340, an output control unit 350, a decoration unit 350a, an output unit 360, and an input unit as a single device. However, in the comment delivery system of the present invention, each of the functional units may be implemented over a plurality of devices. When implemented over a plurality of devices, each device cooperates to provide a comment distribution system implemented as a single information processing device. For example, in the above configuration, the comment extraction unit 340 and the decoration unit 350a may be provided in the video distribution server 10 instead of the terminal device 30.

  In the embodiment described above, the program for realizing the function of the comment distribution server 20 in FIG. 2 or the program for realizing the function of the terminal device 30 in FIG. 4 is recorded on a computer-readable recording medium. Then, the program recorded on the recording medium may be read into the computer system and executed to execute comment distribution and comment display control. Further, a program for realizing the function of the terminal device 30 in FIG. 4 may be applied as a plug-in to an existing terminal device. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW (World Wide Web) system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Further, the “computer-readable recording medium” includes a medium that holds a program for a certain period of time, such as a volatile memory inside a computer system serving as a server or a client. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... Movie delivery server, 20 ... Comment delivery server, 30 ... Terminal device, 40 ... Network, 310 ... Communication part, 311 ... Comment reception part, 312 ... Movie data reception part, 313 ... Comment transmission part, 320 ... Comment storage part , 330 ... text image generation unit, 340 ... comment extraction unit, 350 ... output control unit, 350 a ... decoration unit, 360 output unit, 370 input unit

Claims (5)

A terminal device connected to a video distribution device that distributes video data,
A display for displaying the video,
An input unit for receiving input of the comment;
A communication unit for transmitting the input comment to the comment distribution device;
An extraction unit for extracting a specific keyword included in the comment received from the comment distribution device;
A terminal device comprising: a decoration unit that decorates the moving image in a manner associated with the specific keyword when the moving image is displayed on the display unit.   The terminal device according to claim 1, wherein the decoration unit changes a decoration mode of the moving image based on an instruction from a user different from the user who inputs the comment.   The terminal device according to claim 1, wherein the decoration unit erases the decoration of the moving image based on an instruction from a user different from the user who inputs the comment. A comment delivery system comprising: a video delivery device that delivers video data; a comment delivery device that delivers comments on the video; and a terminal device,
A display for displaying the video,
An input unit for receiving input of the comment;
A communication unit for transmitting the input comment to the comment delivery device;
An extraction unit for extracting a specific keyword included in the comment received from the comment distribution device;
A comment distribution system comprising: a decoration unit that decorates the moving image in a manner associated with the specific keyword when the moving image is displayed on the display unit. A computer as a terminal device connected to a video distribution device that distributes video data,
A display for displaying the video,
An input unit for receiving input of the comment;
A communication unit for transmitting the input comment to the comment distribution device;
An extraction unit for extracting a specific keyword included in the comment received from the comment distribution device;
The program for functioning as a decoration part which decorates the said moving image in the aspect linked | related with the said specific keyword, when a moving image is displayed on the said display part.

Images