JP2015115892A - Comment generating apparatus and control method of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To avoid interruption of viewing a video content and originate a comment corresponding to the video content without delay.SOLUTION: A comment generating apparatus comprises: a content receiver (11) for successively receiving a video content; and a response comment candidate generator (14) for generating one after another a response comment candidate relating to a video from the received video content and outputting the response comment candidate. A response comment candidate selected by a user from among the response comment candidates is transmitted to a communication network (7) as a comment of the user.

Description

  The present invention relates to a comment creating apparatus for displaying text information and the like and a control method therefor.

  With the spread of the Internet, various approaches for so-called broadcasting and communication fusion in television are being sought. In recent years, various communication service sites have been provided that allow users to view the content while sharing and exchanging comments (for example, evaluations or impressions) with respect to the content of the video content with other viewers. Yes. For example, a chat where a plurality of users exchange opinions, a blog where individual users record their impressions, or a social networking service (SNS) such as Twitter (registered trademark) where individual users post “tweets”. An example is given.

  With regard to blog articles, for example, Patent Document 1 discloses a system that at least partially automates content generation of web page entries that record the interaction of entities with a multi-user environment. The system described in Patent Document 1 is a blog that includes an automatic screenshot and an automatically generated descriptive copy of an event that occurred in a video game such as MMORPG (a large scale multiplayer online role playing game). Articles can be posted automatically.

  On the other hand, there is a system that displays a comment made by a user who views video content to the video content together with the video content. In this case, it is possible to view the moving image content while exchanging opinions and impressions in real time among a plurality of users who view the same moving image content.

  However, in order to speak (input) a comment on the moving image content, after the user views the moving image content, the user uses a remote control or a keyboard of an information terminal and a personal computer to enter a comment to be rewritten into a character string. Need to enter and send as. If the remote control or the keyboard cannot be operated quickly, comments are input and the display timing is delayed, and communication such as exchange of opinions cannot be performed smoothly. In the first place, such a comment input method hinders viewing of moving image content. That is, when inputting a comment on the moving image content while viewing the moving image content, it is necessary to move the line of sight from the moving image content to the keyboard at hand. For example, the following patent document 2 discloses a technique for supporting such a character string input operation.

  In Patent Document 2, a video output unit that displays video on a display, a camera that acquires a face video capturing a user's face existing in front of the display while the video is displayed, and an analysis of the acquired face video. Thus, a character input device is disclosed that includes an analysis unit that generates character information corresponding to the movement of the user's mouth, and a tweet processing unit that associates the generated character information with video information. Since the character input device described in Patent Literature 2 generates character information corresponding to the movement of the mouth of the user who is viewing the video on the display, the user does not need to input a character string. Therefore, the character information associated with the video information can be easily used as the user's impression of the video.

  On the other hand, Patent Document 3 generates comment options that can be selected by the viewer based on the raw comments generated by the viewer from the results of collecting and analyzing comments from the viewer sent to the broadcast program, An option generation / presentation device to be presented is disclosed. The option generation / presentation device described in Patent Literature 3 can generate an option for a live program comment generated by a viewer without the involvement of a service provider such as a program producer or an Internet provider. Then, the viewer only has to select one that is close to or matches his / her opinion and impression from the presented options.

WO 2008/094946 (published August 7, 2008) JP 2011-164681 A (released on August 25, 2011) JP 2011-151741 A (released on August 4, 2011)

  However, the conventional techniques such as Patent Documents 1 and 2 have a problem that a user who views the content requires a user action when inputting a comment corresponding to the content. Here, specifically, the user action means that an event occurs in a game in Patent Document 1, and in Patent Document 2, the user moves his / her mouth while watching the content in a state where a movie is shot. It is.

  When inputting by such a method, there is a problem that character information such as a comment cannot be generated and a comment cannot be input if there is no user action.

  Moreover, in the conventional comment input method, since it is necessary to operate the terminal or keyboard at hand in order to input a comment, viewing of a broadcast program must be suspended temporarily. Also, if the input operation is not performed quickly, timely comment input cannot be performed. That is, if the user is not familiar with the operation for input, the input completion timing may be delayed from the video.

  Further, in the conventional technique such as Patent Document 3, since viewer comments are collected and analyzed and comment options are generated, there is an advantage that options that do not depend on the intention of the production side can be selected. Since the existence of related comments is essential, it is difficult in practice to generate appropriate options in real time. In addition, since the same options are presented to a large number of users in a method, comment options customized for each user and options that can be used for conversation sentences between specific users are generated. It is not possible.

  SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and its purpose is to create a comment that can send a comment according to the content of the video content without delay without interrupting the viewing of the video content. It is to provide an apparatus and a control method thereof.

  In order to solve the above-described problem, a comment creating apparatus according to an aspect of the present invention is a comment creating apparatus that creates and transmits a comment related to a certain video, and sequentially receives video content including the video. Of the comment candidates generated by the receiving means, the comment candidates generating means for generating and outputting comment candidates relating to the video one after another from the video content received by the content receiving means, and the comment candidates output by the comment candidate generating means, Comment sending means for sending the selected comment candidate to the external network as the user's comment on the video is provided.

  According to one aspect of the present invention, it is possible to realize a comment creation device, a comment creation device control method, and the like that can send a comment according to the content of the video content without delay without interrupting the viewing of the video content. The effect of doing.

It is a block diagram which shows an example of the principal part structure of the information display apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows the outline | summary of the system containing the information display apparatus of FIG. It is a block diagram which shows an example of the principal part structure of the response comment candidate preparation part of the information display apparatus of FIG. It is a figure which shows the structural example of the dictionary memory | storage part of the response comment candidate preparation part of FIG. 2 is an arrangement example of a video display area for displaying video content and a comment display area for displaying comments in the display unit of the information display device in FIG. 1. It is the example of a screen transition explaining an example of the display content of the comment display area shown to Fig.5 (a), and its operation method. It is a block diagram which shows an example of the principal part structure of the information display apparatus which concerns on Embodiment 2 of this invention. It is a figure which shows an example of the display content of the comment display area in the display part of the information display apparatus shown in FIG. It is the example of a screen transition explaining an example of the display content of the comment display area in the display part of the information display apparatus shown in FIG. 7, and its operation method. It is a flowchart which shows an example of the process which the said information display apparatus performs. An example of the process of creating the response comment candidate shown in S5 of FIG. 10 will be described. It is a flowchart. It is the figure which showed the response | compatibility with the example of the subtitle text input into a conversation bot, and the response comment candidate which the conversation bot produced with respect to the subtitle text.

Embodiment 1
(Example of system configuration)
Hereinafter, embodiments of the present invention will be described in detail. In the following description, the information display device 1 including the content creation device according to the present invention will be described as an example.

  The video content may be any content as long as it can be viewed by a plurality of viewers. That is, it may be a broadcast program distributed from a broadcast station, or may be video content that can be received via the communication network (external network) 7, such as a video file provided from a website on various networks.

  First, a communication system 100 including the information display device 1 will be described with reference to FIG. FIG. 2 is a diagram showing an outline of the communication system 100 including the information display device 1.

  The communication system 100 includes a plurality of information display devices 1, a content server 3, a comment server 5, a communication network 7, and a broadcasting station 9. In FIG. 2, three information display devices 1 a to 1 c are shown as the information display device 1 as an example in which the number of users who use the information display device 1 and the number of the information display devices 1 are plural. However, this is only an example and is not limited to this number.

  The information display device 1 sequentially receives and reproduces broadcast programs distributed from the broadcast station 9. Further, the information display device 1 can access the content server 3 via the communication network 7 such as the Internet and request transmission of desired video content stored in the content server 3. The information display device 1 that sequentially receives the video content from the content server 3 can also reproduce the video content. In other words, the information display device 1 can receive and reproduce both video content distributed from the broadcasting station 9 and video content distributed via the communication network 7 such as video files and streaming videos. is there. The video content that can be reproduced by the information display apparatus 1 includes content data such as video data, caption data, audio data (audio data), metadata described in association with video and audio, and frame images in the video data. Text data such as captions and telops included in the image data is also included.

  In addition, the information display apparatus 1 reproduces video content such as a broadcast program, a video file, and a streaming video, generates a response comment candidate including an impression, an opinion, a tweet, and the like with respect to the video content, and the video content and the response comment candidate Is displayed on the display unit (display means, display device) 17.

  Furthermore, the information display device 1 has a function of transmitting a response comment selected by the user, and the user selects and transmits a response comment (post comment) that he / she likes from among the displayed response comment candidates ( Outgoing). The response comment selected by the user may be transmitted to a predetermined comment server 5 that provides a dedicated service to a predetermined viewer (such as the user's family, friend, or acquaintance) who views the video content. Then, it may be posted together with the user's account information to a server (not shown) such as an external social networking service (SNS) such as Twitter (registered trademark). Further, the response comment may be transmitted to the information display device 1 where a predetermined viewer set in advance is viewing the video (for example, from the information display device 1a to the information display device 1b or 1c). Good. As described above, in the communication system 100, it is also possible to share or exchange comments regarding the video content and to have a conversation between a plurality of viewers who view the video using the information display device 1. In addition, it is also possible to realize such a conversation using the information display device 1, and this usage mode is hereinafter referred to as “conversation mode”, and on the other hand, when the user alone is viewing video content Will be referred to as a “tweet mode”. The “tweet mode” and the “conversation mode” can be freely switched by the user, and the user can view the video content in a desired usage form.

  As described above, the user of the information display device 1 likes the response comment candidates that are presented in accordance with the flow of the video content being reproduced without actually inputting the response comment using a keyboard or the like. A response comment (impression, opinion, tweet, etc.) for the video content can be transmitted to the communication network 7 simply by selecting one.

  Therefore, compared with the case where the user inputs a response comment, it takes less time, and as a result, the period during which the video cannot be viewed for creating the response comment can be shortened, and the response comment can be transmitted without delay. be able to. In the present embodiment, the created response comment candidate is displayed on the information display device 1, but may be output to a display device such as a mobile terminal that is different from the information display device 1.

  In addition, when the video content is a broadcast program distributed from the broadcast station 9 or the content server 3, a response comment can be sent to the broadcast program broadcast in real time without delay, so a timely response Comments can be sent.

(Block diagram of information display device 1)
Next, a configuration example of the information display device 1 will be described with reference to FIG. FIG. 1 is a block diagram showing an example of a main configuration of an information display device 1 according to Embodiment 1 of the present invention.

  The information display device 1 includes a comment creation device 10, a display unit 17, and an operation input unit 18. The comment creating apparatus 10 includes a content receiving unit (content receiving unit) 11, a content processing unit 12, a content information extracting unit 13, a response comment candidate creating unit (comment candidate creating unit) 14, a response comment candidate adjusting unit 15, and a display. A control unit 16, a communication unit (comment transmission means) 19, and a storage unit 20 are provided.

  Further, the storage unit 20 includes a dictionary 21, a response history cache 22, user information 23, terminal setting information 24, and viewing history 25.

  In FIG. 1, some configurations are not shown for simplicity of explanation because they are not directly related to the features of the present invention. For example, the information display device 1 may include a tuner for switching the broadcast station 9, a speaker, a receiving unit that receives an instruction signal from a remote controller (remote controller), a timer, a calendar, and the like.

  The content receiving unit 11 receives video content including video such as a broadcast program distributed from the broadcasting station 9 by broadcast waves and a moving image file acquired or received via the communication network 7.

  The content processing unit 12 performs demultiplexing and decoding for reproducing the received video content. The content data of the video content processed by the content processing unit 12 is output to the content information extraction unit 13. Note that the content data of the video content includes caption data, audio data, telop data, and the like.

  The content information extraction unit 13 analyzes content data of video content and extracts text format data (text data) from the content data. For example, if the content data is audio data (voice data), the text data is extracted by converting the voice into text data by voice recognition such as sound wave analysis. If the content data is data such as a telop included in the frame image, the image data is converted into text format data by image recognition from the frame image, and the text data is extracted. On the other hand, if it is subtitle data, since it is already a text format, it is not necessary to perform the above analysis. The content information extraction unit 13 may extract the text data using at least one of caption data, audio data, and telop data, which are content data of video content.

  In addition, it includes a plurality of audio data such as video content including multi-viewpoint (or multi-angle) image data photographed from different directions using a plurality of cameras or content of audio multiplex broadcasting. In the case of video content, the video and audio to be played back are selected by the user who plays and views the content. When video content including a plurality of selectable data is received and reproduced as described above, the video displayed on the display unit 17 and the audio output in accordance with the video are input by the selection by the user. Are identified. In such a case, it is desirable that text data is extracted by selecting appropriate video data or audio data based on information for selecting display (output). Therefore, the data displayed in the setting (default setting) until the selection by the user is input is output to the response comment candidate creating unit 14 regardless of the display / non-display setting. Here, the data output to the response comment candidate creation unit 14 regardless of the display / non-display setting includes, for example, caption data. Only when an instruction to select other data is input by the user, the data to be output to the response comment candidate creation unit 14 is changed to the selected data. As a result, a more natural response comment candidate is created, and even when the user changes the data displayed during viewing, the response comment candidate can be created and displayed following the operation. .

  The response comment candidate creation unit 14 sequentially creates text-format response comment candidates using the text-format data output from the content information extraction unit 13. In this case, as compared with the case where the response comment candidate is video or audio, it does not include extra information other than information related to the response comment, such as background or background sound information, so that the user can easily refer to the response comment candidate. become. As a result, it is possible to quickly select the response comment by the user, and it is possible to further shorten the period during which the video cannot be visually recognized for creating the response comment. The number of response comment candidates to be created is not particularly limited, and may be one or plural.

  Since the text format data output from the content information extraction unit 13 is extracted from the content data of the video content, the response comment candidate created by the response comment candidate creation unit 14 corresponds to the video included in the video content. doing. Then, response comment candidates are sequentially created in accordance with the video flow. The response comment candidate creation unit 14 can be realized using an algorithm such as artificial intelligence or artificial brainlessness, for example. Note that a more detailed configuration of the response comment candidate creation unit 14 that sequentially creates response comment candidates in text format using the text format data output from the content information extraction unit 13 will be described in detail later.

  The response comment candidate adjustment unit 15 changes the expression of the response comment candidate created by the response comment candidate creation unit 14 based on the user information 23 stored in the storage unit 20. The user information 23 is user attribute information such as the user's gender and age. The response comment candidate adjustment unit 15 changes the expression of the response comment candidate to an expression with less discomfort with respect to the user attribute. For example, the ending is changed depending on whether the user's gender is male or female, or the ending, wording, or vocabulary is changed depending on whether the user's age group is elderly or young. Accordingly, it is possible to create response comment candidates of expressions and wordings that are more appropriate to the attributes of each user and have no sense of incongruity. Therefore, the user can use response comment candidates that are more natural and friendly as conversations with other viewers who are viewing the same video content as the video content that they are viewing.

  Further, the response comment candidate adjustment unit 15 may change the expression of the response comment candidate created by the response comment candidate creation unit 14 based on the terminal setting information 24 stored in the storage unit 20. The terminal setting information 24 is, for example, a location (or current position) where the information display device 1 is installed and the current time. Further, information such as the size and arrangement of the display area used for displaying response comment candidates may be stored in the terminal setting information 24 as terminal setting information. In addition, it is not limited to what was illustrated here, You may make it change the expression of a response comment candidate based on various information regarding a user. Thereby, the expression of the response comment candidate can be changed to a more individual and attractive one.

  The display unit 17 is a flat panel display such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or an organic EL (Organic LED). . The display unit 17 displays video included in the received video content, response comment candidates that are data in text format, and the like.

  The display control unit 16 receives the content data of the video content output from the content processing unit 12, and controls the display unit 17 to reproduce the video. Further, the display control unit 16 controls the display unit 17 to display a part or all of the response comment candidates acquired from the response comment candidate adjustment unit 15 together with the video. The display unit 17 controlled to display response comment candidates by the display control unit 16 will be specifically described later using a screen transition example.

  If there are too many response comment candidates to be displayed at the same time on the display unit 17, when displayed on the display unit 17, the characters to be displayed become smaller or the display time of one response comment candidate becomes shorter. Since it becomes difficult for the user to visually recognize each response comment candidate, it is desirable to set an upper limit on the number of response comment candidates to be displayed as appropriate. Therefore, the display control unit 16 may adjust the number of response comment candidates to be displayed based on information regarding the display area stored in the terminal setting information 24. For example, depending on the size of the display area used for displaying the response comment candidates on the display unit 17 and the size of the characters of the response comment candidates to be displayed, up to three response comment candidates are displayed, or up to five. It can be displayed.

  Further, when it is desirable not to display long response comment candidates so that a large number of response comment candidates can be efficiently displayed in the display area (see FIG. 6 or the like) where response comment candidates are displayed on the display unit 17. Is also possible. Accordingly, the display control unit 16 sets an upper limit (for example, 30 characters) for the number of characters of the output response comment candidate, and when a response comment candidate having more characters than the upper limit is received, the response comment candidate is displayed. It may not be possible.

  In addition, you may comprise so that the response comment candidate adjustment part 15 may perform the process which adjusts the number of response comment candidates and the number of characters which are simultaneously displayed on the display part 17 instead of the display control part 16. FIG. If the display control unit 16 is configured to perform the adjustment, even if the display unit 17 is replaced or the display area is changed, the response comment candidates are appropriately displayed in accordance with the display area for displaying the response comment candidates. It is possible to control as appropriate. Therefore, when the display unit 17 is exchanged, changes to the configuration of the information display device 1 can be minimized. On the other hand, if the response comment candidate adjustment unit 15 is configured to perform the adjustment, the display control unit 16 can be realized with a simpler configuration. Furthermore, when the number of response comment candidates created by the response comment candidate creation unit 14 is insufficient, the response comment candidate adjustment unit 15 appropriately instructs the response comment candidate creation unit 14 to add response comment candidates. There is also an advantage of being able to.

  The operation input unit 18 functions as a user interface (UI) that accepts inputs such as user operations and selection instructions. Hereinafter, the information display device 1 in which a touch panel is superimposed on the display unit 17 and part or all of the display unit 17 functions as the operation input unit 18 will be described as an example.

  The user of the information display device 1 touches a position on the display screen of the display unit 17 on which the selection button, each response comment candidate, and the like are displayed with a fingertip or the like, thereby displaying a desired menu indicated on the selection button. It is possible to select or select a favorite comment among response comment candidates. When information indicating a position where the user performs a touch operation is output from the touch panel superimposed on the display unit 17 to the display control unit 16, a response comment candidate displayed at the position of the touch operation is specified. . When the comment selected by the user is specified by the display control unit 16, the display control unit 16 outputs the comment to the communication unit 19. In addition, the display control unit 16 may perform display changes such as adding a balloon used in a comic or the like outside the comment.

  By using the display unit 17 as the operation input unit 18 in this way, the user can confirm or select a selection button or a response comment candidate displayed on the display unit 17 while viewing the video. it can. However, the present invention is not limited to this, and for example, a selection operation or the like may be input using a remote controller at hand, or a communication interface such as a portable terminal from an information display device different from the information display device 1 may be used. You may enable it to input indirectly via.

  The communication unit 19 transmits and receives text format data (such as comments) via an external communication network 7 such as the Internet. On the other hand, the text data received by the communication unit 19 is output to the display control unit 16.

  As described above, the information display device 1 converts the audio data included in the video content into text data, and extracts the main text (word, person name, place name, etc.) included in the text data. Alternatively, texts such as telops and captions included in image data and texts included in subtitle data are extracted. The extracted text is input to the response comment candidate creation unit 14 using a conversation bot (artificial brainless) algorithm or the response comment candidate creation unit 14 using an artificial intelligence algorithm, for example. The response comment candidate creation unit 14 creates a simple document (short text) as a response comment candidate based on the input text. Then, the information display device 1 displays the created response comment candidates in accordance with the flow of the video content being reproduced and presents them to the user one after another. The user can select a favorite comment from the response comment candidates displayed on the display unit 17. The selected comment is transmitted to the outside (for example, the comment server 5 of the communication system 100 in FIG. 2) via the communication network 7.

(Block diagram of response comment candidate creation unit 14)
Next, the response comment candidate creation unit 14 will be described with reference to FIG. FIG. 3 is a block diagram illustrating an example of a main configuration of the response comment candidate creation unit 14 of the information display device of FIG.

  As described above, the response comment candidate creation unit 14 sequentially creates text-format comment candidates for the video included in the video content. Then, from the audio data and the telop data, which are non-text data, among the content data of the video content, these are analyzed to extract text data, and response comment candidates are created from the extracted text data.

  In the example illustrated in FIG. 3, a case where a conversation bot (artificial brainless) is used as the response comment candidate creation unit 14 will be described. As a conversation bot that can be used for the response comment candidate creation unit 14, existing techniques and programs can be used.

  By the way, a conversation bot (Chatterbot or Chatbot) is also called an artificial brainless name, and is a program that simulates an intelligent conversation performed by a human using text or voice. It is possible to mechanically create a response sentence (text) that is plausible as a response sentence to a word (text) uttered by the input conversation partner, that is, as if a person is having a conversation.

  The typical processing flow of the conversation bot used as the response comment candidate creation unit 14 is as follows (1) and (2).

  (1) A text document input is decomposed into a word group (part of speech group) by morphological analysis, and a related word group is searched from these words using various dictionary data.

  (2) Using the search result (word group), create a sentence using an algorithm such as Markov chain, and after confirming duplication with the latest cached response history, output a preset number of response text candidates To do.

  The response comment candidate creation unit 14 illustrated in FIG. 3 includes a morphological analysis unit 141, a search processing unit 142, a document configuration unit 143, and a duplication confirmation unit 144.

  When the text data output from the content information extraction unit 13 is input as input text, the morpheme analysis unit 141 decomposes the input text into word groups (part of speech groups) and extracts word groups.

  The search processing unit 142 refers to various dictionaries stored in the dictionary 21 of the storage unit 20 based on the word group extracted by the morphological analysis unit 141, and is highly related to each word in the word group Search for a group.

  The document construction unit 143 composes a document using a word group that is a result of the search by the search processing unit 142, creates a sentence using an algorithm such as a Markov chain, and outputs the text document.

  The duplication confirmation unit 144 confirms whether the text document output from the document configuration unit 143 is duplicated with the most recent text document stored in the response history cache 22 of the storage unit 20. In case of duplication, the text document is not output. If it does not overlap, it is output as a response comment candidate. The number of comments output as response comment candidates is not particularly limited, but if there are too many response comment candidates to be displayed, the flow of the video being played may not match the response comment candidate display. Therefore, it is desirable to set an upper limit on the number of response comment candidates to be output.

  As described above, by using an artificial brainless algorithm as the response comment candidate creation unit 14, it is possible to create a response comment candidate suitable for a conversation or a tweet that is more humanly performed according to the video. By using a word group in the input text extracted by morphological analysis, a response comment candidate can be output through a relatively short processing time such as searching the dictionary 21, document configuration, and duplication confirmation.

  There are approximately three types of conversation bot algorithms including the above (dictionary type, log type, and Markov sentence generation type), and the response comment candidate creation unit 14 selects any type of conversation bot. May be used.

  The response comment candidate creation unit 14 may create a response comment candidate using an artificial intelligence algorithm. Artificial intelligence generally has a learning function to realize intelligent functions such as inference and judgment, so as the number of times it is used by the user increases, it creates more accurate response comment candidates that are more easily selected by the user. can do.

(Dictionary 21)
As described above, the response comment candidate creation unit 14 automatically generates response comment candidates for the text extracted by the content information extraction unit 13. If the response comment candidate generated using the conversation bot algorithm has a high degree of completeness of the dictionary stored in the dictionary 21 searched by the search processing unit 142, the fitness of the response comment candidate to be output can be high.

  FIG. 4 is a diagram illustrating a configuration example of the dictionary 21 that is referred to when the search processing unit 142 of the response comment candidate creation unit 14 of FIG. 3 performs a search. In the illustrated example, the dictionary 21 includes a greeting dictionary 211, a question dictionary 212, an Aizuchi dictionary 213, a social story dictionary 214, a chat frequent phrase dictionary 215, and the like.

  In this way, response comment candidates that match the application used by the user can be generated with a higher probability. Further, it may include a dialect dictionary (not shown), a ending dictionary (not shown), a youth term dictionary (not shown), and the like. As a result, the response comment candidate adjustment unit 15 changes the expression of the response comment candidate created by the response comment candidate creation unit 14 so that the comment comment widely corresponds to the user's attributes (birthplace, gender, age, etc.). It becomes possible to do.

(Example of arrangement of video display area and comment display area)
The information display device 1 generates response comment candidates for the user who views the video content based on the text extracted from the content information included in the video content, and provides the response comment candidate to the user. Therefore, the display area of the display unit 17 of the information display device 1 can be divided into a video display area 17V for displaying video content such as a moving image and a comment display area 17C. Here, an example in which the display area of the display unit 17 is divided into a video display area 17V and a comment display area 17C will be described with reference to FIG. FIG. 5 is an arrangement example of the video display area 17V for displaying video content and the comment display area 17C for displaying response comment candidates and the like on the display unit 17 of the information display device 1 of FIG.

  FIGS. 5A and 5B show an example in which the comment display area 17C is displayed so as to overlap a part of the video display area 17V. That is, in FIG. 5A, the entire display area of the display unit 17 is used as the video display area 17V, while the comment display area 17C is provided at a part of the display unit 17, for example, at the edge of the display unit 17. An example in which a comment display area 17C is provided is shown. The number of comment display areas 17C is not limited to one, and a plurality of comment display areas 17C may be provided in the video display area 17V as shown in FIG. However, the background of the comment display area 17C may be set to be transparent or semi-transparent, or the area of the comment display area 17C may be suppressed as narrow as possible while maintaining the readability of each response comment candidate to be displayed. desirable. Accordingly, response comment candidates displayed in the comment display area 17C can be presented to the user without hindering viewing of the video content displayed in the video display area 17V behind.

  FIG. 5C shows an example in which the video display area 17V and the comment display area 17C are divided so that the video display area 17V and the comment display area 17C do not overlap, and the video display area 17V is reduced and displayed. In addition, the shape and width of each display area of the video display area 17V and the comment display area 17C are not limited to those illustrated here, and can be arbitrarily set.

  Here, although the example which displays both using the one display part 17 as the video display area 17V and the comment display area 17C was demonstrated, it is not restrict | limited to these. For example, the second display unit 17 dedicated to comment display may be provided separately from the first display unit 17 that performs video display. However, in this case, it is desirable that the second display unit 17 dedicated to comment display is provided at a position where a response comment candidate displayed by the user who views the video displayed on the first display unit 17 is visible. As a result, the user can confirm response comment candidates or perform a selection operation without stopping the viewing while viewing the video content.

(Example of tweet mode display)
Next, when the user alone selects “tweet mode”, which is a usage mode when viewing video content using the information display device 1, the generated response comment candidates are displayed and selected by the user. The flow until acceptance will be described with reference to FIG. FIG. 6 is an example of screen transition for explaining an example of display contents of the comment display area 17C shown in FIG. 5A and an operation method thereof. FIG. 6 shows an example of the comment display area 17C that is effectively used when the information display device 1 is used in the “tweet mode”, and the display position, content, and configuration are limited to this. Not.

  The comment display area 17C performs four types of display: an expression selection button 17Ca, an emotion expression image 17Cb, a response comment display area 17Cc, and a time display 17d.

  The emotion expression image 17Cb displays an illustration such as a human or animal face that can be preset by the user. It can be considered that illustrations such as a human or animal face shown in the emotion expression image 17Cb are displayed as an alternative to the user of the information display device 1. The images and illustrations that can be displayed on the emotion expression image 17Cb may be selected by the user from those prepared in advance, or a desired illustration created by the user may be registered in the storage unit 20. Also good. In addition, the emotion expression image 17Cb selected by each user is registered in, for example, the comment server 5, and a comment is sent from the comment server 5 to each information display device 1 together with illustration information corresponding to the viewer who has transmitted the response comment. You may comprise so that it may transmit. Thereby, the conversation can be displayed more effectively in the conversation mode described later.

  The facial expression selection button 17Ca displays buttons corresponding to emotions that can be expressed using the image displayed in the emotion expression image 17Cb. The user can change the image of the emotion expression image 17Cb by touching a display screen corresponding to the button portion of the expression selection button 17Ca.

  On the facial expression selection button 17Ca in FIG. 6, button-like displays representing six types of emotions or facial expressions are displayed. “YES” and “NO” indicate affirmation (agreement) and denial (rejection), respectively. “Smile”, “Sad ...”, and “Angry” indicate smile, sadness, and anger (怒), respectively. “Wink;” is a wink and is a gesture for greeting or favor.

  In this way, by changing the expression of the emotion expression image 17Cb displayed in the emotion expression image 17Cb, the exact meaning of the response comment selected from the response comment candidates can be expressed more effectively. The response comment to be displayed can be used. Alternatively, the user may operate only the emotion expression of the emotion expression image 17Cb. Thereby, a user's emotion and opinion can be effectively expressed with an intuitive image with respect to the viewer who is watching the comment display area 17C. The facial expression selection button 17Ca and the emotional expression image 17Cb are more effectively used when the information display device 1 is used in the “conversation mode” (see FIG. 9A).

  The response comment display area 17Cc is an area for successively displaying the response comment candidates output from the response comment candidate adjustment unit 15 to the display control unit 16.

  The time display 17d is an area for displaying output information of a clock (not shown) or calendar (not shown) included in the information display device 1, or information related to the date and time received from the communication network.

  FIG. 6A shows the state of the comment display area 17C when, for example, video content in which a puppy appears is started to be viewed. First, the response comment candidate “puppy is cute” output to the display control unit 16 is displayed at the bottom of the response comment display area 17Cc, which is the position for displaying the latest response comment candidate.

  In FIG. 6B, when the response comment candidate “I love dogs” is output second, it is displayed below the response comment candidate “puppy is cute” displayed earlier. This is because the response comment candidate “I love dogs” is the latest response comment candidate, and the position where the latest response comment candidate is displayed is at the bottom of the response comment display area 17Cc. Similarly, in FIG. 6C, the third response comment candidate “Tomorrow is fine” is displayed at the bottom of the response comment display area 17Cc.

  This response comment candidate “Yoroka tomorrow tomorrow @ Osaka” is a response comment candidate that is seemingly irrelevant to the puppy. For example, it is displayed as follows. A word group such as “tomorrow” or “weather” is extracted from the content data of the video content viewed by the user by the morphological analysis unit 141. For these word groups, the search processing unit 142 refers to the dictionary 21 to extract related word groups, and the document composition unit outputs “Is tomorrow sunny? After the confirmation by the duplication confirmation unit 144, this “Will tomorrow clear @?” Is output to the response comment candidate adjustment unit 15. The response comment candidate adjustment unit 15 refers to the user information 23 and the terminal setting information 24 to acquire that the user is resident in Osaka or that the information display device 1 is installed in Osaka. Then, the response comment candidate adjustment unit 15 changes the ending “Is it?” To “Yaroka” which is the Kansai dialect, and inserts “Osaka” after “@”.

  When the fourth response comment candidate is displayed next, the fourth response comment candidate is displayed at the bottom of the response comment display area 17Cc, while the first response comment candidate displayed first is the longest. The display of the th response comment candidate ends.

  FIG. 6D shows a case where the user performs the selection operation of the third response comment candidate “Tomorrow is fine @ Osaka”. A touch sensor is superimposed on the display unit 17 of the information display device 1, and the display unit 17 can function as an operation input unit 18 that detects a contact position of a user's finger or the like with respect to the screen. Therefore, as shown in FIG. 6D, the selection of selecting the response comment candidate by the user's touch operation on the screen corresponding to the position where the response comment candidate “Tomorrow is sunny @ Osaka” is displayed. It becomes operation.

  When the response comment candidate “Tomorrow is fine @ Osaka” is selected in FIG. 6D, information indicating the selection operation is output to the display control unit 16. As shown in FIG. 6D, the display control unit 16 adds and displays a balloon that includes the selected response comment candidate “Tomorrow is sunny”. Thereby, it is possible to effectively display that the comment is issued by the user himself / herself represented by the illustration of the emotion expression image 17Cb.

  In addition, the selected response comment candidate “Tomorrow is sunny @ Osaka” includes the account information of the user and an external social networking service (SNS) such as Twitter (registered trademark) that transmits the comment to the public. May be transmitted to a server (not shown).

  In this way, the information display device 1 extracts text from the content data included in the video content, generates response comment candidates corresponding to the extracted text, and displays them on the display unit 17. Of the displayed response comment candidates, the response comment candidate selected by the user is transmitted as a posted comment. As a result, the user who views the video content can confirm the response comment candidate generated corresponding to the video content, and can select and transmit an appropriate comment. Therefore, it is possible to send a posted comment in accordance with the contents of the video content without delaying the viewing of the video content.

  Note that when the information display device 1 is used in the tweet mode, selecting what the user likes from the displayed response comment candidates is not necessarily a personal tweet. Selection of response comment candidates by a plurality of viewers viewing the same video content using a single information display device 1 can give a different pleasure from viewing video content.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

(Block diagram of information display device 1 used in conversation mode)
In the information display device 1 according to the present embodiment, when the communication unit 19 receives a comment of another user from the communication network 7 in text format data, the response comment candidate creation unit 14 responds to the text format data. It differs from the information display apparatus 1 shown in FIG. 1 in that a candidate is created.

  That is, in this embodiment, the response comment candidate creation unit 14 creates response comment candidates for the text format data received by the communication unit 19 as well as response comment candidates for the video included in the video content received by the content reception unit 11. To do. As a result, the response comment candidates are related to the video and comments of other users. Accordingly, by transmitting the response comment candidate selected by the user to the communication network 7 as the user's comment, it is possible to establish a conversation with the other user regarding the video.

  The communication unit 19 can receive information designating an illustration to be displayed on the display unit 17 or the illustration itself in addition to the text format data. The received information other than the text format is sent to the display control unit 16 together with the text format data. The display control unit 16 controls the display unit 17 so that the information specifying the illustration or the illustration itself is displayed at a predetermined position of the display unit 17 (for example, the illustration display area 17Cf in FIG. 8). On the other hand, the display unit is controlled so that the data in the text format is displayed at a predetermined position (for example, the comment display area 17Cc in FIG. 8) of the display unit 17. The control of the display unit 17 according to the present embodiment will be described in detail later.

  It is desirable to display the received text format data in the vicinity of the response comment candidate. For example, when a user receives a comment that is data in text format from another viewer who is viewing the same video content as the video content that the user is viewing, the received comment is in the vicinity of the comment candidate. Is displayed. Thereby, since the user can visually recognize the comment candidate and the received comment simultaneously, it is possible to easily select an appropriate comment candidate as a response comment. Therefore, it is possible to exchange or share impressions and opinions regarding the video content and enjoy conversations with other viewers without disturbing the viewing of the video content.

(Example of conversation mode display)
Next, when a “conversation mode” that is a usage mode when viewing video content using the information display device 1 is selected among a plurality of viewers including the user, the created response comment candidates are displayed. The flow until the selection by the user is accepted will be described with reference to FIG. FIG. 8 is an example of screen transition for explaining an example of display contents of the comment display area 17C shown in FIG. 5A and an operation method thereof. FIG. 8 shows an example of the comment display area 17C that is effectively used when the information display device 1 is used in the “conversation mode”, and the display position, content, and configuration are limited to this. Not.

  The comment display area 17C displays seven types of displays: an expression selection button 17Ca, an emotion expression image 17Cb, a response comment display area 17Cc, a time display 17d, a mode display area 17Ce, an illustration display area 17Cf, and a viewing status display area 17Cg. Note that the expression selection button 17Ca, the emotion expression image 17Cb, and the time display 17d are the same as those already described, and are not described here to avoid duplication (see FIG. 6).

  In the mode display area 17Ce, information indicating that the “conversation mode” is currently selected is displayed. Here, an example is shown in which a character string “co-view” and an illustration are displayed.

  The illustration display area 17Cf displays information specifying the illustration attached to the text data received by the communication unit 19 via the communication network 7, or the illustration itself. Or you may receive the illustration designation | designated information which designates either among the illustrations previously registered into the memory | storage part of the information display apparatus 1. FIG. Based on the illustration designation information, the display control unit 16 may read an illustration corresponding to the illustration designation information received from the storage unit 20 and display it in the illustration display area 17Cf. This illustration can express an emotion in the same manner as the illustration displayed in the emotion expression image 17Cb described above.

  The viewing status display area 17Cg notifies the current viewing status of the group members other than the user of the predetermined group (chat group) to which the user belongs who is viewing the video content such as the same broadcast program as the user. It is a display to do. For example, the viewing status display area 17Cg includes three information fields <viewer>, <person in conversation>, and <OFF>. The display of the viewing status display area 17Cg will be described later in detail with reference to FIG.

  In FIG. 8A, the response comment display area 17Cc indicates a point in time when the third response comment candidate “Tomorrow is sunny” is displayed at the bottom of the response comment display area 17Cc. At this point, the same video is being viewed. In FIG. 8A, “Mr. P” and “2 other people” who are watching the same broadcast program or video as the user in a state where the conversation mode is selected and the comment server 5 is logged in, have a conversation. Not.

  FIG. 8B shows a state in which a comment (conversation) “Are you fine?” Is received from Mr. P and displayed in the response comment display area 17Cc. In accordance with the display of the received comment, an illustration representing Mr. P is displayed in the illustration display area 17Cf. In this way, the display control unit 16 displays the text format data received from the communication network 7 in the vicinity of the response comment candidate.

  In addition to the response comment candidate for the video currently being viewed by the user, the response comment candidate creation unit 14 uses the text format data from the text format data “Ah, how are you?” Received from the communication network 7. Create response comment candidates for. For example, in FIG. 8C, a response comment candidate of “Well, messy” is created and newly displayed at the bottom of the response comment display area 17Cc.

  A user who likes the response comment candidate “Well, Bitch” performs a touch operation on the portion where the response comment candidate is displayed in FIG. When the response comment candidate “Well, Bitch” is selected in FIG. 8D, information indicating the selection operation is output to the display control unit 16. As shown in FIG. 8E, the display control unit 16 adds and displays a balloon that includes the selected response comment candidate “Well, Bitch”. Thereby, it is possible to effectively display that the comment is issued by the user himself / herself represented by the illustration of the emotion expression image 17Cb.

  In addition, the selected response comment candidate “Well, Bochobichi” provides a dedicated service to a predetermined viewer (such as an acquaintance of a chat group to which the user belongs) who views the video content together with the account information of the user. May be sent to a predetermined comment server 5 (FIG. 2), or sent to a server (not shown) such as an external social networking service (SNS) such as Twitter (registered trademark) that is publicly transmitted. May be.

(Other effects in the display of the comment display area 17C)
FIG. 9 is an example of screen transition for explaining an example of display contents of the comment display area and its operation method in the display unit of the information display device shown in FIG. First, the expression selection button 17Ca and the emotion expression image 17Cb shown in the comment display area 17C of FIGS. 6 and 8 will be described with reference to FIG.

  FIG. 9A shows a case where anger (憤慨) is expressed in the facial expression of the illustration displayed in the emotional expression image 17Cb by selecting and operating “Angry” of the facial expression selection button 17Ca. An example is shown. For example, compared to the case where the response comment candidate “Is it still?” Is issued with a straight face, an illustration that expresses anger (憤慨) is added as shown in FIG. Can respond more effectively.

  Next, the illustration display area 17Cf and the viewing status display area 17Cg shown in the comment display area 17C of FIG. 8 will be described with reference to FIG. FIG. 9B is a diagram illustrating a display transition example of the viewing status display area 17Cg. As shown in FIG. 9, in the viewing status display area 17Cg, three types of information are displayed: a column K for <viewer>, a column L for <person in conversation>, and a column R for <OFF>. Yes. In column K of <Watchers>, an acquaintance M (group member of the chat group to which the user belongs) who is currently watching a broadcast program of the same channel and has selected the conversation mode, and The number N is displayed. For example, in FIG. 9B, in the initial state, “Mr. P” and “3 other people” select the conversation mode and log in to the comment server, but do not have a conversation. is there. Next, when Mr. P participates in the conversation with the user, “Mr. B” and “2 other persons” are displayed on the acquaintance M and the number of people N (FIG. 9, (b) middle). Furthermore, when Mr. B also participates in the conversation with the user, “Mr. Q” and “one other person” are displayed for the acquaintance M and the number of people N, respectively ((c) middle in FIG. 9). In this way, in the <viewer> column K of the viewing status display area 17Cg, information notifying the user of the existence of an acquaintance capable of talking with the user is displayed.

  In the viewing status display area 17Cg, the <Language in conversation> column L displays the number of acquaintances who are currently watching a broadcast program on the same channel and are currently using the conversation mode. The In the <OFF> column R, the number of acquaintances who are not currently viewing is displayed.

(Processing flow from receiving video content to sending comments to the communication network)
Hereinafter, the flow of processing from the reception of video content to the transmission of a comment to a communication network will be described with reference to FIG. FIG. 10 is a flowchart illustrating an example of processing executed by the information display device.

  The information display device 1 receives video content including video (S1: content reception step). Here, the video content may be a broadcast program distributed from a broadcasting station using a broadcast wave, or may be content such as a moving image file provided from any accessible site on the Internet. Video content often includes images, audio, music, character strings, and the like in addition to video.

  Next, when the user views the video content using the information display device 1, it is determined whether “tweet mode” or “conversation mode” is selected and set (S2). When “conversation mode” is selected (YES in S2), the communication unit 19 of the information display device 1 accesses the comment server 5 via the communication network, and within a specific group (such as a chat group to which the user belongs). A comment transmitted from another user (viewer) belonging to is received (S3). The received comment is output from the communication unit 19 to the display control unit 16, and the display control unit 16 displays the comment at a predetermined display position (see FIG. 8B) (S4).

  The content information included in the video content received by the content receiving unit 11 is extracted by the content information extracting unit 13, and the document constituting unit 143 of the response comment candidate creating unit 14 sequentially creates documents that become response comment candidates for the video. (S5: Comment candidate creation step). The flow of creating the response comment candidate will be described in detail later with reference to FIG.

  The duplication confirmation unit 144 of the response comment candidate creation unit 14 confirms whether or not the document (response comment candidate) output from the document configuration unit 143 overlaps with a recently output document (S6). The duplication confirmation unit 144 outputs a non-overlapping document as a response comment candidate to the response comment candidate adjustment unit 15. On the other hand, a document that overlaps a recently output document is deleted by the duplication confirmation unit 144. Thereby, it is possible to prevent the same response comment candidate from being continuously presented to the user.

  The response comment candidates output from the duplication confirmation unit 144 are then used as response comment candidates by referring to the user information 23, terminal setting information 24, and the like stored in the storage unit 20 in the response comment candidate adjustment unit 15. The output response comment candidate expression is converted (S7). Thereby, it can be shown as a response comment candidate with little discomfort to the user.

  The display control unit 16 that receives the response comment candidate output from the response comment candidate adjustment unit 15 displays the response comment candidate at a predetermined position on the display unit 17, that is, a position where the latest response comment candidate is displayed. (S8).

  The user can confirm each displayed response comment candidate and select a favorite response comment candidate. When the selection operation by the user is accepted (YES in S9), the display control unit 16 displays the selected response comment candidate with a balloon used in comics or the like, or displays the characters in bold. (S10).

  Further, the display control unit 16 outputs the selected response comment candidate text to the communication unit 19, and the communication unit 19 transmits the selected response comment candidate text to the comment server 5 via the communication network. (S11: Comment sending step).

The comment server 5 transmits to other users (viewers) belonging to the specific group (S12). Thereby, the comment regarding the said image | video can be exchanged within a specific group.
Even if the response comment candidate to be created is inaccurate or inappropriate, the user can select a response comment candidate that he / she likes, so that the user can make an appropriate comment publicly or publicly. Can be sent.

  Note that viewing the displayed response comment candidate together with the video content may provide an attractive way of enjoying the video content for the user.

  As described above, the information display device 1 is presented one after another without performing a keyboard or voice input (including software) when a user posts a comment while viewing a video or has a conversation with an acquaintance. Therefore, it is possible to input timely without disturbing video viewing and to have conversations.

  In addition, user setting, viewing history, comment selection (content and timing) history, chat history, etc. are accumulated in the storage unit 20 and are referred to when creating response comment candidates, so that response comment candidates can be customized for each user. This makes it possible to present more appropriate response comment candidates.

(Flow for creating response comment candidates)
Here, an example of using a conversation bot when creating a response comment candidate will be described with reference to FIG.

  Text is extracted from the content data of the video content received by the content receiving unit 11. If the content data is subtitle data, the text is already in the text format, so the text is extracted without requiring analysis (S51). The extracted text is displayed as a caption at a predetermined output location (display position) (S52).

  If the content data is image data, the content information extraction unit 13 performs image analysis on the frame image to extract telops included in the frame image as text data (S53).

  If the content data is audio data, the content information extraction unit 13 extracts text data from the audio data by sound wave analysis or the like (S54). Note that a change in silence (silence) or voice color (frequency) for a certain period of time is detected, and these are used as delimiters at the timing of displaying response comment candidates (S55). In the case of text extracted by analyzing voice data, it is preferable to set a delimiter as in S55 in order to adjust a period for generating and displaying response comment candidates related to the text.

  Since the received comments from other users are already in text format, the text is extracted without requiring analysis (S56).

  The extracted text is input to the conversation bot of the response comment candidate creation unit 14 (S57).

  Thus, a wide range of comment candidates can be created using various texts included in the video content.

[Embodiment 3]
The control block (particularly the content processing unit 12, the content information extraction unit 13, the response comment candidate creation unit 14, and the response comment candidate adjustment unit 15) of the information display device 1 is a logic circuit formed in an integrated circuit (IC chip) or the like. (Hardware) or software using a CPU (Central Processing Unit).

  In the latter case, the comment creating apparatus 10 includes a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only Memory) in which the program and various data are recorded so as to be readable by a computer (or CPU). Alternatively, a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) that expands the program, and the like are provided. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

〔Example〕
(Example of input text added to the conversation bot)
For example, subtitle data of a broadcast program often includes the names of performers who appear in the broadcast program. The applicant has found that the response comment candidate output from the conversation bot becomes a more natural conversation by changing the name portion. This will be described with reference to FIG. FIG. 12 is a diagram illustrating a correspondence between an example of subtitle text input to the conversation bot and a response comment candidate created by the conversation bot for the subtitle text.

  When the input is performed while the name is included in the subtitle text, as shown in FIG. 12A, a shifted response comment candidate that is uncomfortable as a conversation is output. This is generally recognized as a phenomenon when the conversation bot cannot understand the input text.

  Therefore, in FIG. 12B, the name of the performer is automatically replaced with the name “Hime” of the conversation bot itself used this time. In this case, a response comment candidate indicating that the name of the replaced person (conversation bot) was strongly reacted was output.

  Finally, in FIG. 12 (c), the name portion is automatically deleted together with the particle "mo" following the name. In this case, the conversation was fairly natural.

  When using a conversation bot to create response comment candidates as in the present application, check whether the name of the input text includes someone's name, and if it can be confirmed, delete the name and subsequent particles from the input text. Then, it is considered that an algorithm of inputting to the conversation bot is preferable. If it cannot be confirmed that the name is included, the input text can be input to the conversation bot as it is.

[Summary]
The comment creating apparatus 10 according to the first aspect of the present invention is a comment creating apparatus that creates and transmits a comment related to a certain video, and content receiving means (content receiving unit 11) that sequentially receives video content including the video. Comment candidate creation means (response comment candidate creation section 14) for creating and outputting comment candidates relating to the video one after another from the video content received by the content receiving means, and the comment output by the comment candidate creation means Comment candidates (communication unit 19) for transmitting comment candidates selected by the user among the candidates to the external network (communication network 7) as comments of the user regarding the video are provided.

  According to the above configuration, video content including a video is received, and comment candidates relating to the video are sequentially created and output from the received video content. Then, the comment candidate selected by the user is transmitted to the external network as the user's comment regarding the video. Accordingly, the user can transmit his / her comment to the external network only by selecting the desired comment candidate by referring to the output comment candidate. Therefore, compared with the case where the user creates his / her own comment, it takes less time, and as a result, the period during which the video cannot be viewed for creating the comment can be shortened, and the comment can be transmitted without delay. Can do.

  Note that the created comment candidates may be output to a display device that displays the video, or may be output to a display device (for example, a portable terminal) different from the display device. Further, the selection instruction by the user may be acquired directly from the user via the user interface, or may be indirectly acquired from the other display device via the communication interface.

  In the comment creating apparatus according to aspect 2 of the present invention, in the above aspect 1, the comment candidate is text, and the comment candidate creating unit extracts text related to the video from content data included in the video content, It is preferable to create comment candidates related to the video from the extracted text.

  In this case, compared to the case where the comment candidate is video or audio, extra information other than information related to the comment such as background or background sound information is not included, so that the user can easily refer to the comment candidate. As a result, it is possible to quickly select the comment by the user, and it is possible to further shorten the period during which the video cannot be visually recognized for the creation of the comment. In order to extract the text from the content data, for example, the text is extracted from the caption data of the video content, the text is extracted from the audio data of the video content through speech recognition, The text may be extracted from image content telop data through image recognition.

  In the comment creating device according to aspect 3 of the present invention, in the above aspect 1, the comment candidate creating unit preferably creates the comment candidate from the extracted text using an artificial brainless or artificial intelligence algorithm. .

  Artificial brainlessness, also known as a conversation bot, simulates an intelligent conversation performed by humans. By using an artificial brainless algorithm, it is possible to quickly create comment candidates suitable for conversations or tweets that are more humanly performed according to the video content.

  Artificial intelligence, on the other hand, artificially realizes intelligent functions such as inference and judgment. By using the artificial intelligence algorithm, it is possible to automatically create comment candidates that enable more natural and complex conversations. Furthermore, when the artificial intelligence has a learning function, it is possible to create an accurate comment candidate that is easier for the user to select by repeatedly using the artificial intelligence.

  In the embodiment, when the extracted text includes a name, it is preferable to create the comment candidate after deleting a phrase including the name.

  The comment creation device according to aspect 4 of the present invention is the display device (display unit 17) in any one of the above aspects 1 to 3, wherein the comment candidate creation means displays the created comment candidates together with the video. It is preferable to instruct. In this case, since the user can visually recognize the comment candidate while visually recognizing the video, it is easy to select the comment candidate corresponding to the video.

  In the comment creating apparatus according to aspect 5 of the present invention, in any one of the aspects 1 to 4, the video content is preferably a broadcast program distributed from a broadcast station or a server. In this case, since a comment can be transmitted without delay to a broadcast program broadcast in real time, a timely comment can be transmitted.

  In any one of the first to fifth aspects, the comment creating apparatus according to the sixth aspect of the present invention receives the text data indicating the comment of another user from the external network. It is preferable that the comment candidate is created from the video content and the text data. In this case, the comment candidate is related to the video and the comment of the other user. Accordingly, by transmitting the comment candidate selected by the user as the user's comment to the external network, a conversation with the other user regarding the video can be established.

  In the comment creating apparatus according to aspect 7 of the present invention, in the above aspect 6, the comment candidate creating unit preferably instructs the display device to display the created comment candidate and the comment of the other user. In this case, since the user can visually recognize the comment candidate while visually recognizing the comment of the other user, it is easy to select the comment candidate corresponding to the comment of the other user. The comment candidate creating means displays the comment of the other user in the vicinity of the comment candidate when instructing the display device to display the comment candidate and the comment of the other user together with the video. It is preferable to instruct the display device.

  A comment creating apparatus according to an aspect 8 of the present invention further includes a storage unit for storing the attribute information of the user in any one of the aspects 1 to 7, wherein the comment candidate creating unit The output may be output after changing the expression based on the attribute information of the user in the storage unit. Here, examples of user attribute information include a user's sex, age, and the like. In the above case, comment candidates that are suitable for the user in terms of expressions such as wording and wording are output, so that the user does not feel uncomfortable.

  The comment creating apparatus according to aspect 9 of the present invention displays the video content received by the content receiving means and the comment candidates output by the comment candidate creating means in any one of the above aspects 1 to 8. Display means may be provided.

  The comment server 5 according to the tenth aspect of the present invention is a comment server that provides a comment related to a certain video, sets a group of users related to the video, and transmits a comment related to the video to a communication of a certain user of the group. The received comment is received from the device (comment creating device 1) via the external network, and the received comment is transmitted to the communication device of another user of the group via the external network.

  Thereby, a comment regarding a certain video created by a certain user of a certain group can be provided to other users of the group. As a result, comments regarding the video can be exchanged within the group.

  A display device according to an aspect 11 of the present invention is a display device that displays a certain video, sequentially receives video content including the video, sequentially receives comment candidates related to the video, and receives the received video content. The included video is displayed together with the received comment candidate.

  Thereby, the user can easily compare the video and comment candidates related to the video. As a result, an appropriate comment can be selected from the comment candidates.

  A control method for a comment creating apparatus according to aspect 12 of the present invention is the method for controlling a comment creating apparatus according to any one of the above aspects 1 to 8, wherein the comment creating apparatus creates and transmits a comment related to a video. A content receiving step (S1) for sequentially receiving video content including a comment candidate creating step (S5) for generating and outputting comment candidates relating to the video one after another from the video content received in the content receiving step; A comment sending step (S11) for sending the comment candidate selected by the user out of the comment candidates created and output in the comment candidate creating step to the external network as the user's comment regarding the video is included. .

  According to said method, there exists an effect similar to said aspect 1. FIG.

  The comment creating apparatus according to each aspect of the present invention may be realized by a computer. In this case, the comment creating apparatus is realized by the computer by causing the computer to operate as each unit included in the comment creating apparatus. A control program for the comment creating apparatus and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  INDUSTRIAL APPLICABILITY The present invention can be used for a tablet, a communication terminal such as a smartphone, a TV, and the like that can receive a broadcast program distributed from a broadcast station by broadcast waves and a video content such as a moving image from an external network and reproduce it. .

1 Information display device 5 Comment server 7 Communication network (external network)
DESCRIPTION OF SYMBOLS 10 Comment production apparatus 11 Content receiving part (content receiving means)
14 Response comment candidate creation section (comment candidate creation means)
16 Display control unit (display control means)
17 Display unit (display means, display device)
19 Communication Department (Comment sending means)
20 storage unit S1 content reception step S5 comment candidate creation step S11 comment transmission step

Claims (5)

A comment creation device for creating and sending a comment about a video,
Content receiving means for sequentially receiving video content including the video;
Comment candidate creating means for creating and outputting comment candidates relating to the video one after another from the video content received by the content receiving means;
Comment creating means comprising comment sending means for sending a comment candidate selected by the user among the comment candidates output by the comment candidate creating means to the external network as the user's comment regarding the video. apparatus. The comment candidate is text,
The comment creation unit according to claim 1, wherein the comment candidate creating unit extracts text related to the video from content data included in the video content, and creates a comment candidate related to the video from the extracted text. apparatus.   3. The comment creating apparatus according to claim 2, wherein the comment candidate creating means creates the comment candidate from the extracted text using an artificial brainless or artificial intelligence algorithm.   2. The comment candidate creating means creates the comment candidate from the video content and the text data when text data indicating a comment of another user is received from the external network. 4. The comment creating device according to any one of 3 above. A method for controlling a comment creating apparatus for creating and sending a comment about a video,
A content receiving step for sequentially receiving video content including the video;
A comment candidate creating step for creating and outputting comment candidates for the video one after another from the video content received in the content receiving step;
A comment transmission step of transmitting a comment candidate selected by a user among the comment candidates generated and output in the comment candidate generation step as a comment of the user regarding the video to an external network, To control the comment creating apparatus.

Images