JP2017016535A - Comment input display system and method, and program for comment input display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a comment input display system that, when inputting a comment while viewing media contents, can display the comment on a display screen without delaying from an input operation, and can simultaneously generate comment data attached with a timestamp.SOLUTION: A comment display control part 23 is constituted that, every time when data of a single display character is input from an input device, a single display character is displayed on a display screen 15 regarding one or more display characters constituting a new comment. A comment data generation part 27 is constituted to add a timestamp individually to data of a single display character to generate comment data attached with a timestamp.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a comment input display system and method for inputting a comment to media content, and a comment input display program.

  In Japanese Patent No. 4734401 (Patent Document 1), out of input comment information, a comment associated with a comment giving time (time stamp) corresponding to a video playback time of a video to be played back is read from the comment information. Proposals have been made for comment distribution systems that display read comment contents together with moving images. The comment grant time is the moving image playback time at the time when comment content is input.

  Japanese Patent Laid-Open No. 2014-30153 (Patent Document 2) discloses that when a user views a content such as a moving image and starts inputting a comment, the input start time is stored so that the user can really comment. An invention has been disclosed in which a comment is added to a playback position of content to be input.

Japanese Patent No. 4734401 JP 2014-30153 A

  However, in the invention described in Patent Document 1, the comment grant time is the video playback time when the comment content is input and the confirm button is pressed. It is necessary to input a short comment quickly, and there is a problem that timing may be missed if a comment is rewritten or a longer comment is entered.

  On the other hand, in the invention described in Patent Document 2, when a user views media content such as a moving image and starts inputting a comment, the input start time is stored, so that the user creates a long comment. Even if the input is mistaken and the comment is retyped, the comment can be given to the reproduction position that the user wants to input. Since the comment is assigned to the playback position that the user wants to input, the user does not need to perform operations such as rewinding the content to the playback position that the user wants to input after creating the comment.

  However, in the inventions described in Patent Documents 1 and 2, the comment cannot be displayed on the display screen unless the entire comment is input and the input is confirmed. Therefore, a user who views media content or a user who inputs a comment while playing a video cannot share the input process.

  In addition to live performances and singing voices, the real live space is cheered by the audience. Cheering can produce a lot of effects and a higher level of satisfaction for the audience. There are two main functions of cheering. One is to speak a word. Traditionally, cheering has a strong meaning of cheering by speaking to performers, but it is also performed in environments where voices do not reach the other party, such as virtual idols and live viewing. In addition to calling out to the other party, the audience can increase the sense of immersion in the live performance by speaking to the rhythm of the music, getting a sense of participating in the performance by synchronizing with the audience, and performing self-expression. It is thought that this is because The second function of cheering is the sharing of cheering among the audience. In a real live space, other audiences may cheer to respond to the cheering of one audience, or multiple people cheer at the same time. This has the effect of enhancing the sense of unity and excitement of the entire venue by sharing and cheering among the audience.

  However, cheering cannot be shared in the video viewing environment on the Internet, and the above-described effects cannot be obtained. On the other hand, in the video sharing site, it is possible to recognize the existence of another user by sharing a comment. For example, in the Nico Nico Douga (trademark) in which the invention disclosed in Patent Document 1 is implemented, the time synchronization comment is superimposed on the screen, and the presence and sense of unity of other users can be felt in a pseudo manner. . However, the existing system could not reproduce the two functions of cheering. First, in a comment system such as Nico Nico Douga, since a time is given and shared when a confirmation key is pressed after a comment is input, it is displayed with a delay when input for a moving movie. Therefore, it was impossible to input and share comments as if speaking a word while watching a video, and it was difficult to obtain an immersive feeling and a sense of participation. Although the comment can be shared by synchronizing with the video playback time, it is difficult to share the utterance timing that matches the rhythm like cheering in the superimposed display method that flows from the right and left on the screen. From the above, it is difficult for existing comment sharing systems to cheer like a real live space while watching music videos such as live video.

  An object of the present invention is to display a comment on a display screen without delaying an input operation when a comment is being input while viewing media content, and at the same time, creating comment data with a time stamp. An object of the present invention is to provide a comment input display system and method, and a program for a comment input display system.

  The present invention includes a media content server that distributes media content, a comment data server that stores comment data together with a time stamp corresponding to the time in the media content, an input device, and a display device. Connected to the media content server and the comment data server, and implemented in a communication terminal device used in a comment distribution system including a plurality of communication terminal devices that execute media content and display comments on the display screen of the display device. Target comment input display system. In this specification, “time stamp corresponding to the time in the media content” is time information indicating the time when the comment is input using the time given to the media content. In the comment input / display system according to the present invention, if there is comment data stored in the comment data server corresponding to the media content when the media content is being executed, it is based on the comment data at the time specified by the time stamp. A comment display control unit that displays a comment on the display screen, and further displays on the display screen a new comment for the media content input by the user from the input device, and adds a time stamp to the comment data of the new comment. A comment data creation unit that creates comment data with a stamp, and a comment data transmission unit that transmits comment data with a time stamp to a comment data server. The comment display control unit is configured to display one display character on the display screen each time one display character data is input from the input device with respect to one or more display characters constituting the new comment. The comment data creating unit is configured to create time-stamped comment data by individually attaching a time stamp to the data of one display character.

  In the present specification, “media content” may be either live content or recorded content, which includes music video, music only, sports video, car and horse race video, theater video, Various contents such as speeches are included. In addition, the definition of “one display character” in the present specification is, for example, when a Japanese comment “Kita” is input from the input device by a Roman character hiragana conversion input, the first “k” is “one display character”. "Ki" that is displayed when "ki" is input is "one display character".

  According to the present invention, each time one display character data is input from the input device, it is possible to create a comment data with a time stamp by individually attaching a time stamp to one display character data. Comments can be displayed on the display screen without delaying the time of the media content during execution of the media content (including live broadcasting and playback of recorded content). Therefore, if the present invention is used, it becomes possible to cheer with comments as in an actual live space while viewing a music video such as a live video.

  The comment display control unit preferably has a function of displaying the display of a new comment in a manner that can be distinguished from the display of other comments. With such a function, the user's input comments can be confirmed immediately, so that the user's awareness of participation can be increased.

  The comment display control unit displays a single comment that is gradually enlarged when displaying a new comment consisting of a plurality of display characters on the display screen, and a plurality of display characters when the input of a new comment is completed. Is further provided with a display character enlargement / reduction unit that gradually reduces When one display character is gradually enlarged and the comment is gradually reduced, it is possible to make the user recognize that the comment is being input and that the input has been completed together with the execution of the content.

  In addition, the comment data creation unit has a function of determining that one comment has been input when the elapsed time interval from the last input character input from the input device is equal to or greater than a predetermined time interval. It is preferable. In this way, it is possible to determine the end of one comment without separately operating the completion of one comment input.

  Furthermore, the comment data creation unit preferably has a function of giving a user identifier that can be identified as a comment input by the user to comment data with a time stamp of a new comment. In this case, when a comment identifier is assigned to the comment data, the comment display control unit has a function of displaying a comment to be displayed based on the comment data in a display mode that can be distinguished from a comment input by another person. It is preferable. In this way, it is possible to identify at the time of input that the comment has been input by the user. Although the display mode is arbitrary, specifically, the comment display control unit surrounds the comment input by the user with a frame, and the color of the display characters constituting the comment is a specific color specified by the user. It can be displayed in a display mode for displaying or a display mode for blinking or swinging display characters constituting a comment.

  When the media content is media content including a moving image in which a plurality of moving objects are captured, the comment display control unit, when the user specifies one or more moving objects from the plurality of moving objects in advance, the comment specified by the new comment It is preferable to further include a function of displaying a new comment on the display screen in a display mode that can be recognized as a comment on the moving object. In this case, the comment data creation unit further has a function of adding a moving object identifier that can be identified as a comment for one or more moving objects specified by the user to comment data with a time stamp of a new comment. preferable. By providing such a function, for example, it is possible to make it clear that the comment is for a moving object (performer, actor, animal, etc., race car) that the user wants to give or support a comment. This can make the user feel strongly. Although the display mode at this time is also arbitrary, for example, a display mode that is known to be a comment for one or more moving objects may be a display mode in which the background color around the comment is a color or pattern designated by the user in advance. it can. In this way, it is possible to immediately recognize to which moving body the comment is made visually.

  When the system further includes a moving object position detection unit that detects the position of the moving object in the moving image, the comment display control unit is adjacent to or superimposed on the moving object image in the moving image detected by the moving object position detection unit. It preferably has a function of displaying a comment. In this way, since the comment moves as the moving object moves, it is easy to confirm the position of the moving object in the image, and the user's interest can be further enhanced.

  If the moving body is a human, it is preferable that the moving body position detection unit detects the position of the human based on the characteristics of the human face. In recent recognition techniques, it is easy to detect a specific human position based on the characteristics of a human face, and it is not necessary to develop a new recognition technique.

  When the media content includes music, it is preferable to further include a music feature information acquisition unit that acquires music feature information from the music corresponding to the time in the media content. In this case, it is preferable that the comment display control unit has a function of changing the display mode of the comment corresponding to the time based on the music feature information acquired by the music feature information acquisition unit. In this way, since the display mode of the comment changes in conjunction with the music, it is possible to input the comment while feeling a rhythm, and it is possible to further increase the immersive feeling and uplifting feeling.

  The comment display control unit may include a keyword storage unit that associates a predetermined character string that is not included in the character string constituting the hiragana with a predetermined keyword. When a character string not included in the character string constituting the predetermined hiragana is input from the input device, the comment display control unit preferably has a function of displaying a predetermined keyword on the display screen as a comment. . In this way, it becomes possible to input long comments and kanji characters that cannot be normally input in a short time.

  Further, a user ID storage unit for storing a user ID for identifying the user is further provided, and a comment correction / deletion command is generated in which the comment data creation unit generates a command to correct or delete the comment data stored in the comment data server. A part may be further provided. In this case, the comment data creation unit further has a function of assigning the user ID to comment data with a time stamp of a new comment. Then, the comment correction / deletion command generation unit generates a command to correct or delete the comment data only for the comment data to which the same user ID as the user ID input by the user is assigned. In this way, an erroneous comment that the user is interested in can be deleted / corrected, so that the user can easily enter a comment.

  In the case where the communication terminal device further includes a sensor input detection unit that detects an external input such as a vibration impact applied by the user to the input device, the comment display control unit is a new one based on the output of the sensor input detection unit. What is necessary is just to have the function to change the display mode of a comment. In this way, the user can reflect the strength or change of emotion in the comment by vibration impact or the like, and can give the user a sense of unity and a range of expression.

  It is preferable that the comment data creation unit further includes a real time giving unit that individually gives the real time when the media content is being executed to the data of one display character. When the real time is also given, it is possible to adjust the number of comments to be displayed based on the real time, or to display only comments in a specific period.

  Further, a histogram creation unit that creates a histogram of comments based on comment data input from the comment data server may be further provided. In this case, the comment display control unit only needs to further have a function of displaying a histogram related to the comment created by the histogram creation unit on the display screen. For example, this histogram divides the moving image playback time into certain time segments, and displays the number of comments per hour segment and comments input by a plurality of users. In this way, it is possible to detect the same comment input by a plurality of users, and to detect, for example, a section where cheers are likely to rise from the time zone including the time when the number of comments is large.

  A comment input / display method according to the present invention includes a media content server that distributes media content, a comment data server that stores comment data together with a time stamp corresponding to a time in the media content, an input device, and a display device. Communication used in a comment distribution system comprising a plurality of communication terminal devices connected to a media content server and a comment data server via a communication network and executing media content and displaying comments on a display screen of a display device This is a comment input display method used in the terminal device. In the present invention, when the media content is being executed, if there is comment data stored in the comment data server corresponding to the media content, a comment based on the comment data is displayed at the time specified by the time stamp. A new comment for the media content displayed above and input by the user from the input device is displayed on the screen (comment display step). Then, comment data with a time stamp is created by adding a time stamp to the comment data of the new comment (comment data creation step). Then, the comment data with the time stamp is transmitted to the comment data server (comment data transmission step). Particularly in the method of the present invention, in the comment display step, for one or more display characters constituting a new comment, each time one display character data is input from the input device, one display character is displayed on the display screen. To do. In the comment data creation step, comment data with a time stamp is created by individually attaching a time stamp to the data of one display character.

  A comment input / display program according to the present invention includes a media content server that distributes media content, a comment data server that stores comment data together with a time stamp corresponding to a time in the media content, an input device, and a display device. And a comment distribution system that is connected to a media content server and a comment data server via a communication network, and that includes a plurality of communication terminal devices that execute media content and display comments on a display screen of a display device. The information is stored in a computer-readable storage medium in the communication terminal device and executed by the computer. The comment input display program of the present invention, when executing the media content, if there is comment data stored in the comment data server corresponding to the media content, the comment data is displayed at the time specified by the time stamp. Comment display function for displaying a comment on the display screen, and a new comment for the media content input by the user from the input device on the display screen, and adding a time stamp to the comment data of the new comment. A comment data creation function for creating comment data with a stamp and a comment data transmission function for transmitting comment data with a time stamp to the comment data server are realized, and a new comment is configured by the comment display function 1 More than As for the display characters, each time one display character data is input from the input device, one display character is displayed on the display screen, and a time stamp is individually added to one display character data by the comment data creation function. To create comment data with a time stamp.

It is a figure which shows the outline | summary of a delivery system. It is a figure which shows the structure of the comment input display system of embodiment of this invention comprised using the program for comment input display systems used by embodiment of this invention with a communication terminal device. It is a flowchart which shows the main algorithms of an example of the program for comment input display systems for implement | achieving a comment input display system. It is a figure which shows typically an example of the standby state (standby screen) of the interface displayed on a display screen. It is a flowchart which shows the specific algorithm of the comment execution start process in step ST9. It is a figure which shows the state in which the comment display is performed at the time of animation reproduction | regeneration in an interface. It is a flowchart which shows the detailed algorithm of the display comment determination process start step of step ST14 of FIG. It is a flowchart which shows the detailed algorithm of the input process start step of step ST25 of FIG. It is a flowchart which shows the algorithm of input process start step ST15 of FIG. It is a figure which shows the screen of the interface during comment display. It is a flowchart which shows the algorithm of the program used in order to implement | achieve the function which displays a new comment on a display screen in the display mode which turns out that a new comment is a comment with respect to the designated moving body. It is a figure which shows an example of a color list. It is a figure which shows an example of a comment histogram. It is a flowchart which shows an example of the algorithm of the program used in order to implement | achieve a histogram creation part. It is a figure which shows an example of the flowchart of the algorithm in the case of implementing the display of the comment using a recognition technique with a program. It is a figure which shows an example of the flowchart of the algorithm of the program used when performing the display process according to music characteristic information. It is a flowchart which shows an example of the algorithm of the program for implement | achieving the function to change the display mode of a new comment based on the output of a sensor input detection part. It is a flowchart which shows an example of the algorithm of the program used when the comment correction deletion command generation part is implement | achieved by a program.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<Description of main components>
FIG. 1 shows a media content server 5 that distributes media content via a network 3 such as the Internet, and a time corresponding to the time in the media content. An outline of a comment distribution system 9 configured to be connected to a comment data server 7 in which comment data is stored together with a stamp is shown. As the media content server 5, the most famous one is Youtube (registered trademark) [https://www.youtube.com]. In the present embodiment, Youtube (registered trademark) is used as the media content server 5. As a representative example of the comment data server 7, there is a comment data server of Nico Nico Douga (registered trademark) [http://www.nicovideo.jp]. In this embodiment, the Nico Nico Douga is used as the comment data server 7. A dedicated comment data server is prepared separately from the comment data server.

  The communication terminal device 1 is a personal computer. Of course, the communication terminal device 1 may be a portable notification terminal device such as a smartphone. The comment input display system program described in the embodiment of the present invention is executed by connecting the communication terminal device 1 to the comment data server 7. Of course, the communication terminal device 1 may be made available in the communication terminal device 1 by connecting the communication terminal device 1 to another server such as the comment data server 7.

  FIG. 2 is a diagram showing a configuration of the comment input display system 11 configured by using the comment input display system program used in the present embodiment in the communication terminal device 1. The communication terminal device 1 includes a display device 17 including an input device 13 and a display screen 15. The display device 17 has a built-in sound generator including a speaker for outputting music, voice and the like. Although not shown in FIG. 2, the means required for the comment input display system 11 is a communication means, an image data processing device, an acoustic data processing device, etc. that are naturally necessary for the operation of the personal computer. It is implemented using hardware including a processor, RAM and ROM, and various application programs.

  The communication terminal device 1 executes the media content transmitted from the media content server 5, displays an image on the display screen of the display device, and outputs sound from a sound generator (not shown). Here, “execution of media content” includes both live video of live content distributed from the media content server and reproduction of registered commedia content. In this comment input display system 11, a comment display control unit 23 including a display character enlargement / reduction unit 19 and a keyword storage unit 21, a comment correction / deletion command generation unit 24, a real time addition unit 25, and a comment including a time stamp addition unit 26. A data creation unit 27, a comment data transmission unit 29, a sensor input detection unit 31, a moving object position detection unit 33, a music feature information acquisition unit 35, a histogram creation unit 37, and a user ID storage unit 39 are provided. .

  When the comment display creation unit 27 executes the media content transmitted from the media content server 5 and there is comment data stored in the comment data server 7 corresponding to the media content, the comment display creation unit 27 designates the comment content by the time stamp. A comment based on the comment data is displayed on the display screen 15 at the given time, and a new comment for the media content input by the user from the input device 13 is displayed on the display screen 15. In the present embodiment, the comment display control unit 23 displays one display character on the display screen 15 each time one display character data is input from the input device 13 for one or more display characters constituting a new comment. It is configured to display characters.

  The comment data creating unit 27 creates a comment data with a time stamp by adding a time stamp to the comment data of a new comment by the time stamp adding unit 26. The time stamp giving unit 26 generates a time stamp corresponding to the time in the media content input from the media content server 5 and gives it to a new comment. The comment data creation unit 27 of the present embodiment is configured to create comment data with a time stamp by individually attaching a time stamp to data of one display character. When the user inputs a comment from the input device while viewing the image displayed on the display screen 15, a time stamp that matches the time in the media content is individually assigned to the data of one display character. Therefore, when a comment with a time stamp is displayed later, the comment is displayed on the display screen at the time of the media content, and the time of the image matches the time of the comment. In the present embodiment, the real time giving unit 25 of the comment data creating unit 27 has a function of giving information on the time (real time) when a new comment is actually input to the comment data. In this way, it is possible to adjust the number of comments to be displayed based on the actual time and display only comments for a specified period.

  Here, “one display character” means that, for example, when a Japanese comment “Kita” is input from the input device 13 by romaji hiragana conversion input, the first “k” does not become “one display character”. , “Ki” that is displayed when “ki” is input becomes “one display character”. In the present embodiment, the time stamp corresponding to the time in the media content is input at the time of inputting “k”, “t” and “−” in the alphabet input “kita-” of “Kita”. Give. However, when inputting so that “kita-” is displayed as an English comment from the input device 13, each of “k” and “i” becomes “one display character”, and the time stamp giving unit 26 A time stamp is given.

  The comment display control unit 23 of the present embodiment has a function of displaying a new comment display in a form that can be distinguished from other comment displays. The display method for displaying new comments in a manner that can be distinguished from other comments is arbitrary, but with such a function, users can immediately check the comments that they have entered. Can raise awareness. In the present embodiment, when the comment display control unit 23 displays a new comment composed of a plurality of display characters on the display screen, the comment display control unit 23 displays one display character while being gradually enlarged so that a new comment can be input. When completed, a display character enlargement / reduction unit 19 is provided for gradually reducing a plurality of display characters simultaneously. When one display character is gradually enlarged and the comment is gradually reduced, it is possible to allow the user to recognize that the comment is being input and that the input has been completed while giving a sense of reality together with the execution of the content. Further, in the present embodiment, the comment display control unit 23 uses a predetermined character string (for example, “XYZ”) that is not included in the character string constituting the hiragana and a predetermined keyword (for example, “fight, fight, fight”). Etc.) are stored in association with each other. When a predetermined character string (for example, “XYZ”) that is not included in the character string constituting the hiragana is input from the input device 13, the comment display control unit 23 determines a predetermined keyword (“fight, fight, fight”). As a comment on the display screen 15. In this way, a long comment can be input and displayed in a short time.

  In addition, the comment data creation unit 27 of the present embodiment determines that the input of one comment has ended when the elapsed time from the last input character input from the input device 13 is equal to or greater than a predetermined time interval. It has a function to do. For this reason, it is possible to determine the end of one comment without separately performing the input of one comment.

  Furthermore, the comment data creation unit 27 has a function of giving a user identifier (user ID) that can be identified as a comment input by the user to comment data with a time stamp of a new comment. The user identifier (user ID) is stored in the user ID storage unit 39. The comment correction / deletion command generation unit 24 generates a command for correcting or deleting the comment data stored in the comment data server 7. In this case, the comment data creation unit 27 further has a function of assigning the user ID to comment data with a time stamp of a new comment. Then, the comment correction / deletion command generation unit 24 generates a command to correct or delete the comment data only for the comment data to which the same user ID as the user ID input by the user is given. In this way, an erroneous comment that the user is interested in can be deleted / corrected, so that the user can easily enter a comment.

  In this case, the comment display control unit 23 has a function of displaying a comment to be displayed based on the comment data in a display mode that can be distinguished from a comment input by another person when a user identifier is assigned to the comment data. It is preferable. In this way, it is possible to identify at the time of input that the comment has been input by the user. Specifically, the comment display control unit 23 displays a display mode that surrounds a comment input by the user with a frame, a display mode that displays the color of display characters constituting the comment in a specific color specified by the user, or a comment Can also be displayed in a display mode that blinks or swings.

  The comment data transmission unit 29 transmits comment data with a time stamp to the comment data server 7. The received comment data server 7 stores the new comment data with the time stamp and the real time in the comment data of the corresponding media content. The timing of saving may be any one after one display character is input, after one comment is completed, or after execution of one media content is completed.

  In this embodiment, whenever one display character data is input from the input device 13, it is possible to create a comment data with a time stamp by attaching a time stamp to one display character data individually. Comments can be displayed on the display screen without delaying the time of the media content during execution of the media content (including live broadcasting and playback of recorded content). Therefore, it is possible to cheer with comments like a real live space while watching a music video like a live video.

  Note that the sensor input detection unit 31, the moving object position detection unit 33, the music feature information acquisition unit 35, and the histogram creation unit 37 shown in FIG. 2 are used for performing the additional function of the present embodiment. An explanation of the algorithm of the comment input display system program for realizing the comment input display system 11 of the present embodiment to be described and an example of an interface to be used will be given together with an additional function using these elements. .

<Program algorithm>
FIG. 3 shows a main algorithm of an example of a comment input display system program for realizing the comment input display system 11. In the following description of FIG. 3, each algorithm will be described by taking a moving image as an example of media content. FIG. 4 is a diagram schematically showing an example of the standby state (standby screen) of the interface displayed on the display screen 15. This algorithm and interface make it possible to experience and experience a real live space in a moving image viewing environment. Therefore, in this specific example, a live pseudo-experience interface that can input and share cheering in a comment is realized. Two functions of cheering “speech of words” and “sharing of cheering” can be expressed by three functions: (1) input, (2) expression, and (3) sharing. That is, if the program described below is used, the following becomes possible.

  (1) The input comment is automatically converted into display data, and immediately enlarged and displayed on the display screen 15 by the display function. The input is automatically confirmed based on the elapsed time from the last input of the comment character. The display function reduces the display screen 15 so that the comment can be shared by the comment data server. As a result, it is possible to solve the problem that the input of the comment is displayed with a delay with respect to the moving image, and it is possible to input the comment with the same feeling as the utterance of the word.

  (2) A display method is provided in which a comment is superimposed at a random position on the screen by scaling up or down in units of display characters. In the current implementation, the height of the video player is divided by the maximum character size determined by the window size, multiple lines are created, and the vertical position is determined by randomly selecting lines. The horizontal position is randomly determined within the range of the video player's width. As a result, the time when the comment is input can be determined by a short time segment.

  (3) The comment data server shares the comment input time by giving a time stamp for synchronizing the comment with the time in the media content in units of one display character. The time in the media content is recorded in character units as the comment time (time stamp). As a result, comments stored in the comment data server of other users can be displayed in synchronization with the playback time when the media content is played back.

  First, it is assumed that the communication terminal device 1 is installed with a comment input display program. In step ST1, the playback page of the video sharing site is accessed. At this time, the URL key is obtained as a unique key for uniquely identifying the moving image by percent-encoding the URL. Then, in step ST2, it is determined whether or not it is a playback page of the video sharing site. If Yes, the process proceeds to step ST3, and if No, the process ends. In step ST3, the comment data server 7 is checked for the presence or absence of a comment based on the URL. If there is a comment assigned to the video in the comment data server 7 (in the case of Yes), in step ST4 and ST5, the comment of the corresponding video is acquired from the comment data server 7 based on the URL key, Next, proceeding to step ST6, the standby screen shown in FIG. 4 is constructed. If there is no comment (in the case of No), the process proceeds to step ST6 to construct a standby screen. Thereafter, the standby state is maintained in step ST7. The interface shown in FIG. 4 displays an execution button for instructing execution and the number of comments. In step ST8, it is determined whether or not there has been an execution start instruction depending on whether or not the execution button has been pressed. If the execute button is pressed, the comment input execution process is started (step ST9). If the execution button is not pressed, the standby state is maintained in step ST7.

  FIG. 5 is a flowchart showing a specific algorithm of the comment execution start process in step ST9. When the execute button is pressed, a system execution screen is constructed on the display screen 15 in step ST11. In step ST12, the presence / absence of a moving image reproduction instruction is determined. If there is a moving image reproduction instruction, reproduction of a moving image (media content) is started in step ST13. FIG. 6 shows a state in which comment display is being executed at the time of moving image playback in the interface. When the reproduction of the moving image is started, display comment determination processing is started in step ST14, and input processing is started simultaneously in step ST15. Thereafter, the process up to the determination of whether or not there is an “execution end instruction” based on whether or not the execution end button, that is, the “leave” button in FIG. 6 has been pressed, is repeated.

  FIG. 6 shows an interface for browsing and inputting comments while watching music videos (media contents). This interface was implemented assuming an environment in which a music video is viewed by a video sharing site Youtube (registered trademark) as an extended function of the browser Google Chrome (registered trademark). As described above, the system is executed when the playback page of the moving image on Youtube is accessed with the extended function first introduced. Then, the sharing unit is inquired about the presence or absence of a comment. When the execution button shown in FIG. 4 is pressed, the screen changes to an execution state, and an execution screen having a comment drawing area, a comment input field, and an execution end button “leave” is constructed (FIG. 6). The comment drawing area is created throughout the browser window except for the search area, and the acquired comment is superimposed on the screen. In addition, when the user inputs text in the comment input field (the field described as cheering), the text data of the comment is passed to the comment data creation unit 27. Then, the user can return to the original standby screen by pressing the execution end button (leaving) in the upper right.

  FIG. 7 is a flowchart showing a detailed algorithm of the display comment determination process start step in step ST14 of FIG. 5, and FIG. 8 is a flowchart showing a detailed algorithm of the input process start step of step ST25 in FIG. The display comment determination process in FIG. 7 is a process for determining display of a comment depending on whether or not there is a comment in the comment data server 7. In step ST21, the current video playback time (time in the media content) is acquired. In step ST22, it is determined whether there is a comment to be displayed on the comment data server 7. If there is, the process proceeds to step ST23, and the input time (time stamp) of the first character of the comment is acquired. In step ST24, it is determined whether or not there is a comment whose input time (time stamp) corresponds to the playback time (time in the media content). If it is determined in step ST24 that there is a comment (YES), enlargement / reduction display processing of the character of the comment is started in step ST25. If it is determined in step ST24 that there is no corresponding comment (in the case of NO), the process returns to step ST21.

  The enlargement / reduction display processing step of step ST25 is as shown in FIG. In the enlargement / reduction display process of step ST25, first, in step ST25A, the initialization process n = 1 is performed, and then the drawing position of the comment is determined. The drawing position of the comment may be random or determined according to a certain rule, but it is preferable to determine the drawing position so that the comments do not overlap as much as possible. Then, all character sizes constituting the comment to be displayed are set to the minimum size. Next, in step ST25B, the current video playback time (time in the media content) and the input time (time stamp) of the nth character are acquired. Then, in step ST25C, it is determined whether or not the input time (time stamp) of the nth character constituting the comment is the moving image playback time (time in the media content). In the case of Yes, n is added to n + 1 at step ST25D, and the characters up to the (n-1) th character are displayed at the respective character sizes at step ST25E. In step ST25F, the size of each character up to the (n-1) th character is enlarged to the maximum size. In step ST25G, it is determined whether or not the last character of the characters constituting the comment has reached the maximum size. If No, the process returns to step ST25B. If Yes, the process proceeds to step ST25H to perform the reduced display process. Start. In step ST25H, all displayed characters are reduced simultaneously. Then, in step ST25I, it is determined whether or not the character has become the minimum size. If Yes, the process ends. If No, the process returns to step ST25H.

  An example of enlarged display of comment characters is as shown in the comment displays CD1 and CD2 shown in FIG. In the display CD1 and CD2, the size is larger as the first character (left end) of the comment is larger, and the size is smaller as the character is rearward (right end). This display state indicates a state where display of one comment has not been completed yet. An example of the comment character display end state is as shown in the comment display CD3 shown in FIG. In the display CD3, since all the characters of the comment are the same size, it indicates that it is not a new character. In the reduced display of characters, all the characters start to be reduced simultaneously from this state, and the display ends when the minimum size is reached. The display form of a new comment in this embodiment is an example, and it is needless to say that the present invention is not limited to the display form of this embodiment.

  FIG. 9 is a flowchart showing the algorithm of the input processing start step ST15 of FIG. First, in step ST31, initialization of a timer for measuring the time from when one key is input until the next one key is input, initialization of an input buffer ("Wow!" At the lower right of FIG. 10), and comment After initialization, the input acceptance state is entered at step ST32. Thereafter, it is determined whether or not the timer has reached a threshold value or more (step ST33). This threshold value is a threshold value used as a criterion for determining whether or not the input of a comment has been completed. If the count value of the timer is not equal to or greater than the threshold value (in the case of No), the process proceeds to step ST34 to determine whether or not a “key” is input from the input device. If there is a “key” input, the timer is reset in step S35, and the time stamp is stored in step ST36. In this embodiment, the time in the media content (moving image playback time) and the real time are acquired. Next, the keys are displayed in the input buffer (the column in which “Wow!” Characters are input) at the lower right of the screen of FIG. 10, and the keys are recorded in the internal memory. Next, in step ST38, it is determined whether or not the input confirmation key has been pressed. In this embodiment, a space key (only when inputting Japanese) is used as an input confirmation key. If the user inputs the space key while inputting the comment, the determination becomes YES and the process proceeds to step ST43. If the space key is not pressed, the determination is NO and the process proceeds to step ST39. In step ST39, it is determined whether the input key can be converted by the dictionary (only Japanese input). If the determination is YES, the process proceeds to step ST40 and the type stamp of the first key of the converted character (one display character) is recorded. In step ST41, the converted character (one display character) is added to the end of the comment. Thereafter, the enlarged display process is started (step ST42). This enlarged display character processing is the same as steps ST25A to ST25G in FIG. When the enlarged display process ends, the process returns to step ST32. In the display CD4 of FIG. 10, the characters “Wow!” Of the new comment are enlarged and displayed in order from the first character.

  If the decision result in step ST39 is NO, the process returns to step ST32. If the count value of the timer becomes greater than or equal to the threshold value in step ST33 and if the input confirmation key is pressed in step ST38, the process proceeds to step ST43, where it is determined whether there is a character after conversion. In the case of YES, the character as the comment recorded in the input buffer is confirmed, then the comment and the time stamp for each character are transmitted to the comment data server 7 in step ST45, and the display character “Wow! The reduced display process of “” is started. The reduced display process in step ST46 is the same as steps ST25H to ST25I in FIG. In the present embodiment, the comment data creation unit 27 of FIG. 2 is configured by the algorithm of FIG.

  In the example shown in FIG. 10, a rectangular frame is displayed around the display CD4 of the comment “Wow!”. In the present embodiment, the comment display control unit 23 employs such a display mode, thereby having a function of displaying a new comment display in a mode that can be distinguished from the display of other comments. With such a function, the user's input comments can be confirmed immediately, so that the user's awareness of participation can be increased. This function is added to the start step of the enlarged display process in step ST42 of FIG.

  In the present embodiment, the comment data creating unit 27 further has a function of adding a user identifier that can be identified as a comment input by the user to comment data with a time stamp of a new comment. The user identifier is stored in the user ID storage unit 39. In this case, when a comment identifier is assigned to the comment data, the comment display control unit 23 has a function of displaying a comment to be displayed based on the comment data in a display mode that can be distinguished from a comment input by another person. It is preferable. Although the display mode at this time is arbitrary, for example, the comment display control unit 23 displays the background color of the display characters constituting the comment input by the user in a specific color designated by the user (see FIG. 10). Display CD5), or display characters constituting a comment are displayed in a blinking or swinging display mode.

  In the present embodiment, when the media content is a media content including a moving image including a plurality of moving objects, the comment display control unit 23 specifies that one or more moving objects are designated in advance from the plurality of moving objects. The new comment is further provided with a function of displaying the new comment on the display screen in a display mode that indicates that the new comment is a comment for one or more moving objects specified. In this case, the comment data creation unit 27 further has a function of assigning a moving object identifier that can be identified as a comment for one or more moving objects specified by the user to comment data with a time stamp of a new comment. An example of a program algorithm for realizing this function is as shown in FIG. In this example, the step ST51 is started by pressing the “member name” button displayed at the lower right of the interface of FIG. In step ST51, a color list in which a subject name (name of a moving object) and a color corresponding to the name are created in advance is acquired. FIG. 12 shows an example of the color list. In this color list, names of a plurality of subjects (a plurality of moving objects) appearing in a specific media content and a combination of colors (color 1 to color X) set in advance or by the user for each subject are recorded. Yes. If the number of colors to be combined increases, it becomes difficult to identify. Therefore, even if the color combination is such that the color of the comment character itself is color 1 and the background color of the character is color 2, the user can identify a sufficiently specified moving object. It is possible to do. In step ST52, selection of a target person (moving object) by the user or a target person name set in advance by the user is acquired. For example, by selecting the name (A, B,...) In the name column of the target person in the color list, the selection of the target person or the name of the target person is acquired. In step ST53, the comment display control unit 23 acquires the color of the selected target person from the color list, reflects the color 1 acquired as the comment character color in step ST54, and further represents an element (character The color 2), which is the background color of the character inside the circle around the circle, is displayed together with the comment. When such a function is provided, for example, when there is a specific color combination for identifying a moving object (performer, actor, animal, etc., a race car) that the user wants to give a comment or supports, the target moving object Since a comment having the same color as the color for identifying a comment is a comment for the moving object, the user can strongly feel that the comment is a cheer for the specific moving object. In this way, it is possible to immediately recognize to which moving body the comment is made visually.

<Additional functions>
As shown in FIG. 2, the present embodiment includes a histogram creation unit 37. The histogram creation unit 37 creates a comment histogram based on the comment data input from the comment data server 7. FIG. 13 shows an example of a comment histogram. FIG. 14 shows an example of an algorithm of a program used for realizing the histogram creation unit 37. In step ST61, the URL of the page opened in the interface is acquired. In step ST62, it is determined whether or not the page is a reproduction page of the moving image sharing site. If it is a reproduction page of a moving image sharing site, the presence or absence of a comment is confirmed in the comment data server 7 based on the URL in step ST63. In step ST64, it is determined whether or not there is a comment attached to the moving image. If there is no comment (in the case of NO), the process proceeds to step 31, and the input process is started to input a new comment. Is done. If there is a comment (in the case of YES, the process proceeds to step ST65, where comment data is acquired from the comment data server 7. Next, in step ST66, a histogram creation process is started. A comment is counted for each section in which the moving image playback axis is divided by time segment, and a comment having a high comment appearance rate is extracted by counting duplicate comments for each section. In this manner, a bar display having a different height according to the number of comments in the section is displayed as a histogram in the histogram display area below the video playback screen, and when a certain section is selected in step ST68, the number of comments and frequent occurrences in that section are displayed. Words are displayed over the histogram display area, as shown in FIG. In the balloon display, “30 comments; frequent words: amazing, highest.” The comment display control unit 23 further has a function of displaying the histogram created by the histogram creation unit 37 on the display screen. In this way, in addition to knowing the comment input status of other users, it is possible to detect, for example, a section where cheers are likely to rise from the time zone including the time when the number of comments is large.

  In the present embodiment, as shown in FIG. 2, a moving body position detection unit 33 that detects the position of the moving body in the moving image is provided. If the moving body is a human, it is preferable that the moving body position detector 33 detects the position of the human based on the characteristics of the human face. In recent recognition techniques, it is easy to detect a specific human position based on the characteristics of a human face, and it is not necessary to develop a new recognition technique. FIG. 15 shows an example of a flowchart of an algorithm in the case where a comment is displayed using this recognition technique by a program. In this example, in step ST71, a person and their position information are recorded for each moving image (media content) in a database (not shown) prepared separately from the comment database. In step ST72, a process of acquiring the position of the person's face during the moving image reproduction is executed. This process is achieved by using a known recognition technique. In step ST73, the designated person name is acquired. This designation may be made, for example, from a color list target person who presses a member name button in FIG. Next, in step ST74, if the person specified at the time of inputting the comment appears on the moving picture screen, the display position of the comment is determined near the person. The display CD6 in FIG. 10 shows an example in which a comment is displayed at the display position determined in this way. In the example of FIG. 10, the comments are displayed so as to overlap in the vicinity of the human body so that the human face can be seen. In such a display, it is preferable to determine the maximum size of the display character of the comment according to the size of the person. In this way, since the comment moves as the moving object moves, it is easy to confirm the position of the moving object in the image, and the user's interest can be further enhanced. In the present embodiment, the comment display control unit 23 has a function of displaying a comment adjacent to or overlapping the moving object image in the moving image detected by the moving object position detection unit 33.

  In this embodiment, as shown in FIG. 2, a music feature information acquisition unit 35 is further provided. When the media content includes music, the music feature information acquisition unit 35 acquires the music feature information from the music corresponding to the time in the media content. The comment display control unit 23 has a function of changing the display mode of the comment corresponding to the time based on the music feature information acquired by the music feature information acquisition unit 35. FIG. 16 shows an example of a flowchart of an algorithm of a program used when display processing according to music feature information is performed. In this example, in step ST81, the music feature information of the music of the moving image (media content) is acquired from another database (not shown) acquired and stored in advance by a known technique. Next, in step ST82, the current video playback time (time in the media content) is acquired. In step ST83, a visual visual effect is displayed based on the music feature information of the music corresponding to the reproduction time. As a visual visual effect, there is a mode in which the display mode of comments changes in conjunction with the beat of music. For example, the display character of the comment may be vibrated according to the beat, and the display character may be expanded / contracted in a short cycle. In this way, it is possible to input comments while feeling a sense of rhythm, and it is possible to further increase the sense of immersion and uplift.

  In the present embodiment, as shown in FIG. 2, the communication terminal device 1 further includes a sensor input detection unit 31. The sensor input detection unit 31 detects an external input such as a vibration impact applied by the user to the input device. The comment display control unit 23 has a function of changing the display mode of a new comment based on the output of the sensor input detection unit 31. FIG. 17 shows an example of a program algorithm for realizing this function. In step ST91, the key input included in the input device 13 is detected. In step ST92, the key input strength is acquired from the sensor input detection unit 31. The sensor input detection unit 31 in this case can be realized by attaching an acceleration sensor on the input device 13. The amplitude of the acceleration detection signal in the Z-axis direction of the acceleration sensor is proportional to the strength of keystroke. In step ST93, display effect information such as a character size is set based on the strength of the keystroke. For example, the display character of the comment may be vibrated according to the strength of the keystroke, or the display character may be expanded and contracted in a short cycle. If it does in this way, it will become possible to detect a change of a user's emotion by vibration impact etc., and can give a user a sense of unity and the width of expression.

  In the present embodiment, as shown in FIG. 2, the comment data creation unit 27 includes a comment correction / deletion command generation unit 24. The comment correction / deletion command generation unit 24 generates a command for correcting or deleting the comment data stored in the comment data server 7. In addition, the comment data creation unit 27 has a function of assigning the user ID acquired from the user ID storage unit 39 to comment data with a time stamp of a new comment. The comment correction / deletion command generation unit 24 is configured to generate a command to correct or delete the comment data only for the comment data to which the same user ID as the user ID input by the user is assigned. FIG. 18 shows an example of a flowchart of a program algorithm used when the comment correction / deletion command generation unit 24 is realized by a program. In this example, a user ID is acquired in step ST101, and in step ST102, a comment that matches the user ID is acquired from the comments assigned to the current moving image (media content) from the comment data server 7. In step ST103, a comment correction / deletion command for editing / deleting a comment acquired to match the user ID is created. Then, a comment correction / deletion command is transmitted to the comment data server 7 to execute a comment update process. In this way, an erroneous comment that the user is interested in can be deleted, so that the user can easily enter a comment.

  In addition, the comment data creation unit 27 shown in FIG. 2 further includes a real time giving unit 25 that individually gives the real time when the media content is being executed to character data of one display character. When the real time is also given to the comment data, it is possible to adjust the number of comments to be displayed based on the real time, or to display only comments for a specified period.

  According to the present invention, each time one display character data is input from the input device, it is possible to create a comment data with a time stamp by individually attaching a time stamp to one display character data. Comments can be displayed on the display screen without delaying the time of the media content during execution of the media content.

DESCRIPTION OF SYMBOLS 1 Communication terminal device 3 Network 5 Media content server 7 Comment data server 9 Comment delivery system 11 Comment input display system 13 Input device 15 Display screen 17 Display device 19 Display character expansion / contraction part 21 Keyword storage part 23 Comment display control part 24 Comment correction Deletion command generation unit 25 Real time grant unit 26 Time stamp grant unit 27 Comment data creation unit 29 Comment data transmission unit 31 Sensor input detection unit 33 Moving object position detection unit 35 Music feature information acquisition unit 37 Histogram creation unit 39 User ID storage unit

Claims (19)

A media content server for delivering media content;
A comment data server in which comment data is stored together with a time stamp corresponding to the time in the media content;
A plurality of communication terminal devices, each having an input device and a display device, connected to the media content server and the comment data server via a communication network to execute the media content and display a comment on the display screen of the display device A comment input display system used in the communication terminal device used in the comment distribution system consisting of:
When executing the media content, if there is the comment data stored in the comment data server corresponding to the media content, the comment based on the comment data is added at the time specified by the time stamp. A comment display control unit for displaying on the display screen a new comment for the media content displayed on the display screen and further input by the user from the input device;
A comment data creation unit that creates comment data with a time stamp by attaching the time stamp to the comment data of the new comment;
A comment data transmission unit that transmits the comment data with the time stamp to the comment data server,
The comment display control unit displays the one display character on the display screen each time one piece of display character data is input from the input device for one or more display characters constituting the new comment. Configured to
The comment input / display system, wherein the comment data creation unit is configured to create the time-stamped comment data by individually attaching the time stamp to the one display character data.   The comment input control system according to claim 1, wherein the comment display control unit displays the display of the new comment in a manner that can be distinguished from the display of other comments.   When the comment display control unit displays the new comment composed of a plurality of display characters on the display screen, the comment display control unit displays the one display character while gradually expanding, and when the input of the new comment is completed The comment input / display system according to claim 2, further comprising a display character enlargement / reduction unit that gradually reduces the plurality of display characters simultaneously.   The comment data creation unit has a function of determining that one comment has been input when an elapsed time interval from a character last input from the input device is equal to or greater than a predetermined time interval. The comment input display system according to 1. The comment data creation unit has a function of giving a user identifier that can be identified as a comment input by the user to the comment data with a time stamp of the new comment,
The comment display control unit has a function of displaying the comment displayed based on the comment data in a display mode that can be distinguished from a comment input by another person when the user identifier is given to the comment data. The comment input display system according to claim 1.   The comment display control unit is a display mode in which the comment input by the user is surrounded by a frame, a display mode in which the color of the display character constituting the comment is displayed in a specific color designated by the user, or The comment input / display system according to claim 5, wherein the display characters constituting the comment are displayed in a display mode that blinks or swings.   The comment input / display system according to claim 1, wherein the media content is live media content. The media content is media content including a video in which a plurality of moving objects are shown,
The comment display control unit is configured to display the new comment in a display mode in which when the user designates one or more moving objects in advance from the plurality of moving objects, the new comment is a comment for the one or more moving objects specified. And a function for displaying the comment on the display screen,
The comment data creation unit further has a function of adding a moving object identifier that can be identified as a comment for the one or more moving objects specified by the user to the comment data with time stamp of the new comment. Item 2. The comment input display system according to Item 1.   The comment input / display system according to claim 8, wherein a display mode that is known to be a comment for the one or more moving objects is a display mode in which a background color around the comment is set to a color or pattern designated in advance by the user. A moving object position detecting unit for detecting the position of the moving object in the moving image;
The comment according to claim 8 or 9, wherein the comment display control unit has a function of displaying the comment adjacent to or overlapping the image of the moving object in the moving image detected by the moving object position detecting unit. Input display system.   The comment input / display system according to claim 10, wherein the moving object is a human, and the moving object position detection unit detects the position of the human based on characteristics of the human face. The media content includes music;
A music feature information acquisition unit that acquires music feature information corresponding to the time in the media content from the music;
The comment input display according to claim 1, wherein the comment display control unit has a function of changing a display mode of the comment corresponding to the time based on the music feature information acquired by the music feature information acquisition unit. system.   The comment display control unit includes a keyword storage unit that associates a predetermined character string that is not included in a character string that forms a hiragana character with a predetermined keyword, and the character string that forms the hiragana character from the input device The comment input / display system according to claim 1, which has a function of displaying the predetermined keyword as a comment on the display screen when a predetermined character string is input. A user ID storage unit for storing a user ID for identifying the user;
The comment data creation unit further includes a comment correction deletion command generation unit that generates a command to correct or delete the comment data stored in the comment data server,
The comment data creation unit further has a function of assigning the user ID to the comment data with the time stamp of the new comment,
The comment correction / deletion command generation unit generates a command to correct or delete the comment data only for the comment data to which the same user ID as the user ID input by the user is given. Comment input display system described in. The communication terminal device further includes a sensor input detection unit that detects an external input such as a vibration impact applied by the user to the input device,
The comment input display system according to claim 1, wherein the comment display control unit has a function of changing a display mode of the new comment based on an output of the sensor input detection unit.   2. The comment input display according to claim 1, wherein the comment data creation unit further includes a real time adding unit that individually adds a real time when the media content is being executed to the data of the one display character. system. A histogram creation unit for creating a comment histogram based on the comment data input from the comment data server;
The comment input / display system according to claim 1, wherein the comment display control unit further has a function of displaying the histogram created by the histogram creation unit on the display screen. A media content server for delivering media content;
A comment data server in which comment data is stored together with a time stamp corresponding to the time in the media content;
A plurality of communication terminal devices, each having an input device and a display device, connected to the media content server and the comment data server via a communication network to execute the media content and display a comment on the display screen of the display device A comment input display method used in the communication terminal device used in the comment distribution system comprising:
When executing the media content, if there is the comment data stored in the comment data server corresponding to the media content, the comment based on the comment data is added at the time specified by the time stamp. A comment display step of displaying on the display screen a new comment for the media content displayed on the display screen and input by the user from the input device;
Comment data creating step for creating comment data with a time stamp by adding the time stamp to the comment data of the new comment;
A comment data transmission step of transmitting the comment data with the time stamp to the comment data server,
In the comment display step, for each of one or more display characters constituting the new comment, the display character is displayed on the display screen each time data of one display character is input from the input device. ,
In the comment data creating step, comment data with a time stamp is created by individually attaching the time stamp to the data of the one display character. A media content server for delivering media content;
A comment data server in which comment data is stored together with a time stamp corresponding to the time in the media content;
A plurality of communication terminal devices, each having an input device and a display device, connected to the media content server and the comment data server via a communication network to execute the media content and display a comment on the display screen of the display device A comment input display program stored in a computer-readable storage medium in the communication terminal device used in the comment distribution system and executed by the computer,
When executing the media content, if there is the comment data stored in the comment data server corresponding to the media content, the comment based on the comment data is added at the time specified by the time stamp. A comment display function for displaying on the display screen a new comment for the media content displayed on the display screen and further input by the user from the input device;
Comment data creation function for creating comment data with a time stamp by adding the time stamp to the comment data of the new comment;
A comment data transmission function for transmitting the comment data with the time stamp to the comment data server,
The comment display function displays the one display character on the display screen each time one of the display character data is input from the input device for one or more display characters constituting the new comment. ,
A comment input / display program for creating the comment data with the time stamp by individually attaching the time stamp to the data of the one display character by the comment data creation function.